Jul 24 14:32:13.887717 ip-10-0-131-12 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 24 14:32:13.887726 ip-10-0-131-12 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 24 14:32:13.887733 ip-10-0-131-12 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 24 14:32:13.888044 ip-10-0-131-12 systemd[1]: Failed to start Kubernetes Kubelet. Jul 24 14:32:24.092575 ip-10-0-131-12 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 24 14:32:24.092596 ip-10-0-131-12 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot fdf56d1bdc254c998e640c341ff918d0 -- Jul 24 14:34:19.357705 ip-10-0-131-12 systemd[1]: Starting Kubernetes Kubelet... Jul 24 14:34:19.785265 ip-10-0-131-12 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 14:34:19.785265 ip-10-0-131-12 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 24 14:34:19.785265 ip-10-0-131-12 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 14:34:19.785265 ip-10-0-131-12 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 24 14:34:19.785265 ip-10-0-131-12 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 14:34:19.785265 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.730528 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 24 14:34:19.785265 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735284 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 14:34:19.785265 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735295 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 14:34:19.785265 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735298 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 14:34:19.785265 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735302 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 14:34:19.785265 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735306 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 14:34:19.785265 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735309 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 14:34:19.785265 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735312 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 14:34:19.785265 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735315 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 14:34:19.786506 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735319 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 14:34:19.786506 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735322 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 14:34:19.786506 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735325 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 14:34:19.786506 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735328 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 14:34:19.786506 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735331 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 14:34:19.786506 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735333 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 14:34:19.786506 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735336 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 14:34:19.786506 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735339 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 14:34:19.786506 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735342 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 14:34:19.786506 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735344 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 14:34:19.786506 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735349 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 14:34:19.786506 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735352 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 14:34:19.786506 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735361 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 14:34:19.786506 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735366 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 24 14:34:19.786506 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735369 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 14:34:19.786506 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735372 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 14:34:19.786506 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735375 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 14:34:19.786506 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735377 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 14:34:19.786506 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735381 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 14:34:19.787620 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735384 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 14:34:19.787620 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735386 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 14:34:19.787620 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735389 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 14:34:19.787620 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735391 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 14:34:19.787620 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735395 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 14:34:19.787620 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735397 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 14:34:19.787620 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735400 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 14:34:19.787620 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735402 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 14:34:19.787620 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735405 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 14:34:19.787620 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735407 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 14:34:19.787620 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735410 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 14:34:19.787620 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735412 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 14:34:19.787620 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735415 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 14:34:19.787620 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735417 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 14:34:19.787620 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735420 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 14:34:19.787620 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735423 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 14:34:19.787620 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735425 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 14:34:19.787620 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735427 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 14:34:19.787620 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735430 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 14:34:19.787620 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735432 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 14:34:19.788521 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735435 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 14:34:19.788521 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735438 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 14:34:19.788521 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735442 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 14:34:19.788521 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735445 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 14:34:19.788521 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735448 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 14:34:19.788521 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735451 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 14:34:19.788521 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735454 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 14:34:19.788521 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735458 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 14:34:19.788521 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735461 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 14:34:19.788521 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735464 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 14:34:19.788521 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735466 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 14:34:19.788521 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735469 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 14:34:19.788521 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735472 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 14:34:19.788521 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735475 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 14:34:19.788521 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735477 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 14:34:19.788521 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735479 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 14:34:19.788521 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735482 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 14:34:19.788521 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735485 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 14:34:19.788521 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735487 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 14:34:19.789750 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735490 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 14:34:19.789750 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735493 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 14:34:19.789750 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735495 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 14:34:19.789750 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735498 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 14:34:19.789750 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735500 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 14:34:19.789750 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735503 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 14:34:19.789750 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735505 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 14:34:19.789750 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735508 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 14:34:19.789750 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735510 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 14:34:19.789750 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735513 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 14:34:19.789750 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735516 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 14:34:19.789750 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735518 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 14:34:19.789750 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735522 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 14:34:19.789750 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735524 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 14:34:19.789750 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735527 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 14:34:19.789750 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735529 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 14:34:19.789750 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735532 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 14:34:19.789750 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735535 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 14:34:19.789750 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735537 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 14:34:19.789750 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735540 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 14:34:19.790484 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735542 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 14:34:19.790484 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735545 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 14:34:19.790484 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735547 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 14:34:19.790484 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735549 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 14:34:19.790484 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735552 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 14:34:19.790484 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735554 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 14:34:19.790484 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735557 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 14:34:19.790484 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735559 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 14:34:19.790484 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735562 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 14:34:19.790484 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735564 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 14:34:19.790484 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735567 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 14:34:19.790484 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735570 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 14:34:19.790484 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.735572 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 14:34:19.790484 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736243 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 14:34:19.790484 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736249 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 14:34:19.790484 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736252 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 14:34:19.790484 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736254 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 14:34:19.790484 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736258 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 14:34:19.790484 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736261 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 14:34:19.790484 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736264 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 14:34:19.790484 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736266 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 14:34:19.791165 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736269 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 14:34:19.791165 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736271 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 14:34:19.791165 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736274 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 14:34:19.791165 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736277 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 14:34:19.791165 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736279 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 14:34:19.791165 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736282 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 14:34:19.791165 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736286 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 14:34:19.791165 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736289 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 14:34:19.791165 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736293 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 14:34:19.791165 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736295 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 14:34:19.791165 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736298 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 14:34:19.791165 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736300 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 14:34:19.791165 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736303 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 14:34:19.791165 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736306 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 14:34:19.791165 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736309 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 14:34:19.791165 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736311 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 14:34:19.791165 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736314 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 14:34:19.791165 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736317 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 14:34:19.791165 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736319 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 14:34:19.791165 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736322 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 14:34:19.791838 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736324 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 14:34:19.791838 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736327 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 14:34:19.791838 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736329 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 14:34:19.791838 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736331 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 14:34:19.791838 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736334 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 14:34:19.791838 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736337 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 14:34:19.791838 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736339 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 14:34:19.791838 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736342 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 14:34:19.791838 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736344 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 14:34:19.791838 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736349 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 14:34:19.791838 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736353 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 14:34:19.791838 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736356 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 14:34:19.791838 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736359 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 14:34:19.791838 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736361 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 14:34:19.791838 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736364 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 14:34:19.791838 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736367 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 14:34:19.791838 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736369 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 14:34:19.791838 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736372 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 14:34:19.791838 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736374 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 14:34:19.792497 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736377 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 14:34:19.792497 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736379 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 14:34:19.792497 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736382 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 14:34:19.792497 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736384 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 14:34:19.792497 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736388 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 14:34:19.792497 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736390 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 14:34:19.792497 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736393 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 14:34:19.792497 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736396 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 14:34:19.792497 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736398 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 14:34:19.792497 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736401 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 14:34:19.792497 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736403 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 14:34:19.792497 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736406 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 14:34:19.792497 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736408 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 14:34:19.792497 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736411 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 14:34:19.792497 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736413 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 14:34:19.792497 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736416 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 14:34:19.792497 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736419 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 14:34:19.792497 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736421 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 14:34:19.792497 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736424 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 14:34:19.793181 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736426 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 14:34:19.793181 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736429 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 14:34:19.793181 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736431 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 14:34:19.793181 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736434 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 14:34:19.793181 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736437 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 14:34:19.793181 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736440 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 14:34:19.793181 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736442 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 14:34:19.793181 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736445 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 14:34:19.793181 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736447 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 14:34:19.793181 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736450 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 14:34:19.793181 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736452 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 14:34:19.793181 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736455 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 14:34:19.793181 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736457 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 14:34:19.793181 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736460 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 14:34:19.793181 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736463 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 14:34:19.793181 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736465 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 14:34:19.793181 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736468 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 14:34:19.793181 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736470 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 14:34:19.793181 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736477 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 14:34:19.793181 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736482 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 14:34:19.793849 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736486 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 14:34:19.793849 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736489 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 14:34:19.793849 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736492 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 14:34:19.793849 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736494 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 14:34:19.793849 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736497 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 14:34:19.793849 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736499 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 14:34:19.793849 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736502 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 14:34:19.793849 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736505 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 14:34:19.793849 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736507 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 24 14:34:19.793849 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736509 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 14:34:19.793849 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736513 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 14:34:19.793849 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736517 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 14:34:19.793849 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736520 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 14:34:19.793849 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736867 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 14:34:19.793849 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736872 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 14:34:19.793849 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736874 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 14:34:19.793849 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736877 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 14:34:19.793849 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736880 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 14:34:19.793849 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736883 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 14:34:19.795009 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736885 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 14:34:19.795009 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736890 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 14:34:19.795009 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736893 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 14:34:19.795009 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736896 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 14:34:19.795009 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736899 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 14:34:19.795009 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736902 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 14:34:19.795009 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736905 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 14:34:19.795009 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736908 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 14:34:19.795009 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736911 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 14:34:19.795009 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736914 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 14:34:19.795009 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736917 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 14:34:19.795009 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736920 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 14:34:19.795009 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736923 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 14:34:19.795009 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736925 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 14:34:19.795009 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736928 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 14:34:19.795009 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736931 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 14:34:19.795009 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736933 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 14:34:19.795009 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736936 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 14:34:19.795009 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736938 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 14:34:19.795009 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736941 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 14:34:19.795631 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736947 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 14:34:19.795631 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736950 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 14:34:19.795631 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736952 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 14:34:19.795631 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736955 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 14:34:19.795631 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736958 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 14:34:19.795631 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736961 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 14:34:19.795631 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736963 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 14:34:19.795631 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736966 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 14:34:19.795631 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736968 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 14:34:19.795631 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736971 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 14:34:19.795631 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736974 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 14:34:19.795631 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736978 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 14:34:19.795631 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736980 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 14:34:19.795631 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736983 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 14:34:19.795631 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736985 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 14:34:19.795631 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736988 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 14:34:19.795631 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736990 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 14:34:19.795631 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736993 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 14:34:19.795631 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736996 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 14:34:19.795631 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.736998 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 14:34:19.796417 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737001 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 14:34:19.796417 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737003 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 14:34:19.796417 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737006 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 14:34:19.796417 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737009 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 14:34:19.796417 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737011 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 14:34:19.796417 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737014 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 14:34:19.796417 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737016 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 14:34:19.796417 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737019 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 14:34:19.796417 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737021 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 14:34:19.796417 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737024 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 14:34:19.796417 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737026 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 14:34:19.796417 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737029 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 14:34:19.796417 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737032 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 14:34:19.796417 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737035 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 14:34:19.796417 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737037 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 14:34:19.796417 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737040 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 14:34:19.796417 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737043 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 14:34:19.796417 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737045 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 14:34:19.796417 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737048 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 14:34:19.796417 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737050 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 24 14:34:19.797032 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737053 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 14:34:19.797032 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737055 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 14:34:19.797032 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737058 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 14:34:19.797032 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737060 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 14:34:19.797032 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737063 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 14:34:19.797032 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737065 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 14:34:19.797032 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737068 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 14:34:19.797032 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737071 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 14:34:19.797032 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737074 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 14:34:19.797032 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737077 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 14:34:19.797032 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737080 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 14:34:19.797032 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737082 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 14:34:19.797032 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737085 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 14:34:19.797032 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737087 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 14:34:19.797032 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737090 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 14:34:19.797032 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737092 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 14:34:19.797032 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737097 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 14:34:19.797032 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737099 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 14:34:19.797032 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737102 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 14:34:19.797032 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737104 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 14:34:19.798488 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737108 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 14:34:19.798488 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737112 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 14:34:19.798488 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737115 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 14:34:19.798488 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737118 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 14:34:19.798488 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737122 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 14:34:19.798488 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737125 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 14:34:19.798488 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737128 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 14:34:19.798488 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737131 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 14:34:19.798488 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737133 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 14:34:19.798488 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737136 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 14:34:19.798488 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737138 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 14:34:19.798488 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737141 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 14:34:19.798488 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737143 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 14:34:19.798488 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737241 2581 flags.go:64] FLAG: --address="0.0.0.0" Jul 24 14:34:19.798488 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737249 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 24 14:34:19.798488 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737255 2581 flags.go:64] FLAG: --anonymous-auth="true" Jul 24 14:34:19.798488 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737260 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 24 14:34:19.798488 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737263 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 24 14:34:19.798488 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737267 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 24 14:34:19.798488 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737270 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 24 14:34:19.799195 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737274 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 24 14:34:19.799195 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737277 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 24 14:34:19.799195 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737280 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 24 14:34:19.799195 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737284 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 24 14:34:19.799195 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737287 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 24 14:34:19.799195 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737290 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 24 14:34:19.799195 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737292 2581 flags.go:64] FLAG: --cgroup-root="" Jul 24 14:34:19.799195 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737295 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 24 14:34:19.799195 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737304 2581 flags.go:64] FLAG: --client-ca-file="" Jul 24 14:34:19.799195 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737307 2581 flags.go:64] FLAG: --cloud-provider="external" Jul 24 14:34:19.799195 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737310 2581 flags.go:64] FLAG: --cluster-dns="[]" Jul 24 14:34:19.799195 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737314 2581 flags.go:64] FLAG: --cluster-domain="" Jul 24 14:34:19.799195 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737317 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 24 14:34:19.799195 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737320 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 24 14:34:19.799195 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737323 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 24 14:34:19.799195 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737327 2581 flags.go:64] FLAG: --container-log-max-files="5" Jul 24 14:34:19.799195 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737332 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 24 14:34:19.799195 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737335 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 24 14:34:19.799195 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737338 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 24 14:34:19.799195 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737341 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 24 14:34:19.799195 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737344 2581 flags.go:64] FLAG: --contention-profiling="false" Jul 24 14:34:19.799195 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737347 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 24 14:34:19.799195 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737350 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 24 14:34:19.799195 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737353 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 24 14:34:19.800117 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737356 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 24 14:34:19.800117 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737360 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 24 14:34:19.800117 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737363 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 24 14:34:19.800117 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737366 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 24 14:34:19.800117 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737368 2581 flags.go:64] FLAG: --enable-load-reader="false" Jul 24 14:34:19.800117 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737371 2581 flags.go:64] FLAG: --enable-server="true" Jul 24 14:34:19.800117 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737374 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 24 14:34:19.800117 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737379 2581 flags.go:64] FLAG: --event-burst="100" Jul 24 14:34:19.800117 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737382 2581 flags.go:64] FLAG: --event-qps="50" Jul 24 14:34:19.800117 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737385 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 24 14:34:19.800117 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737390 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 24 14:34:19.800117 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737394 2581 flags.go:64] FLAG: --eviction-hard="" Jul 24 14:34:19.800117 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737400 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 24 14:34:19.800117 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737404 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 24 14:34:19.800117 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737409 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 24 14:34:19.800117 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737414 2581 flags.go:64] FLAG: --eviction-soft="" Jul 24 14:34:19.800117 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737419 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 24 14:34:19.800117 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737423 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 24 14:34:19.800117 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737425 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 24 14:34:19.800117 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737428 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jul 24 14:34:19.800117 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737431 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 24 14:34:19.800117 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737434 2581 flags.go:64] FLAG: --fail-swap-on="true" Jul 24 14:34:19.800117 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737437 2581 flags.go:64] FLAG: --feature-gates="" Jul 24 14:34:19.800117 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737440 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jul 24 14:34:19.800117 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737445 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 24 14:34:19.801265 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737448 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 24 14:34:19.801265 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737451 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 24 14:34:19.801265 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737454 2581 flags.go:64] FLAG: --healthz-port="10248" Jul 24 14:34:19.801265 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737457 2581 flags.go:64] FLAG: --help="false" Jul 24 14:34:19.801265 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737459 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-131-12.ec2.internal" Jul 24 14:34:19.801265 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737463 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 24 14:34:19.801265 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737466 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jul 24 14:34:19.801265 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737469 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 24 14:34:19.801265 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737472 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 24 14:34:19.801265 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737475 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 24 14:34:19.801265 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737478 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 24 14:34:19.801265 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737481 2581 flags.go:64] FLAG: --image-service-endpoint="" Jul 24 14:34:19.801265 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737483 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 24 14:34:19.801265 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737486 2581 flags.go:64] FLAG: --kube-api-burst="100" Jul 24 14:34:19.801265 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737489 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 24 14:34:19.801265 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737492 2581 flags.go:64] FLAG: --kube-api-qps="50" Jul 24 14:34:19.801265 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737495 2581 flags.go:64] FLAG: --kube-reserved="" Jul 24 14:34:19.801265 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737498 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 24 14:34:19.801265 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737500 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 24 14:34:19.801265 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737503 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jul 24 14:34:19.801265 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737506 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 24 14:34:19.801265 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737509 2581 flags.go:64] FLAG: --lock-file="" Jul 24 14:34:19.801265 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737512 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 24 14:34:19.801265 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737515 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 24 14:34:19.802151 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737518 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 24 14:34:19.802151 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737524 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jul 24 14:34:19.802151 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737527 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 24 14:34:19.802151 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737529 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jul 24 14:34:19.802151 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737532 2581 flags.go:64] FLAG: --logging-format="text" Jul 24 14:34:19.802151 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737535 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 24 14:34:19.802151 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737538 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 24 14:34:19.802151 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737542 2581 flags.go:64] FLAG: --manifest-url="" Jul 24 14:34:19.802151 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737545 2581 flags.go:64] FLAG: --manifest-url-header="" Jul 24 14:34:19.802151 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737549 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 24 14:34:19.802151 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737552 2581 flags.go:64] FLAG: --max-open-files="1000000" Jul 24 14:34:19.802151 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737556 2581 flags.go:64] FLAG: --max-pods="110" Jul 24 14:34:19.802151 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737559 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 24 14:34:19.802151 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737562 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 24 14:34:19.802151 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737566 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jul 24 14:34:19.802151 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737568 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 24 14:34:19.802151 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737571 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 24 14:34:19.802151 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737574 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 24 14:34:19.802151 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737577 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 24 14:34:19.802151 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737584 2581 flags.go:64] FLAG: --node-status-max-images="50" Jul 24 14:34:19.802151 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737587 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 24 14:34:19.802151 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737590 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jul 24 14:34:19.802151 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737593 2581 flags.go:64] FLAG: --pod-cidr="" Jul 24 14:34:19.804678 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737596 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 24 14:34:19.804678 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737602 2581 flags.go:64] FLAG: --pod-manifest-path="" Jul 24 14:34:19.804678 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737605 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jul 24 14:34:19.804678 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737608 2581 flags.go:64] FLAG: --pods-per-core="0" Jul 24 14:34:19.804678 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737611 2581 flags.go:64] FLAG: --port="10250" Jul 24 14:34:19.804678 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737615 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 24 14:34:19.804678 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737618 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-023946aea3a1694ac" Jul 24 14:34:19.804678 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737621 2581 flags.go:64] FLAG: --qos-reserved="" Jul 24 14:34:19.804678 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737625 2581 flags.go:64] FLAG: --read-only-port="10255" Jul 24 14:34:19.804678 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737628 2581 flags.go:64] FLAG: --register-node="true" Jul 24 14:34:19.804678 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737631 2581 flags.go:64] FLAG: --register-with-taints="" Jul 24 14:34:19.804678 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737636 2581 flags.go:64] FLAG: --registry-burst="10" Jul 24 14:34:19.804678 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737639 2581 flags.go:64] FLAG: --registry-qps="5" Jul 24 14:34:19.804678 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737642 2581 flags.go:64] FLAG: --reserved-cpus="" Jul 24 14:34:19.804678 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737645 2581 flags.go:64] FLAG: --reserved-memory="" Jul 24 14:34:19.804678 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737648 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 24 14:34:19.804678 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737652 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 24 14:34:19.804678 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737656 2581 flags.go:64] FLAG: --rotate-certificates="false" Jul 24 14:34:19.804678 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737659 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 24 14:34:19.804678 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737662 2581 flags.go:64] FLAG: --runonce="false" Jul 24 14:34:19.804678 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737665 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 24 14:34:19.804678 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737668 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 24 14:34:19.804678 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737672 2581 flags.go:64] FLAG: --seccomp-default="false" Jul 24 14:34:19.804678 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737675 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 24 14:34:19.804678 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737678 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 24 14:34:19.805585 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737681 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 24 14:34:19.805585 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737684 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 24 14:34:19.805585 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737687 2581 flags.go:64] FLAG: --storage-driver-password="root" Jul 24 14:34:19.805585 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737691 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jul 24 14:34:19.805585 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737694 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jul 24 14:34:19.805585 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737697 2581 flags.go:64] FLAG: --storage-driver-user="root" Jul 24 14:34:19.805585 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737699 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 24 14:34:19.805585 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737703 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 24 14:34:19.805585 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737706 2581 flags.go:64] FLAG: --system-cgroups="" Jul 24 14:34:19.805585 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737709 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 24 14:34:19.805585 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737715 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 24 14:34:19.805585 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737718 2581 flags.go:64] FLAG: --tls-cert-file="" Jul 24 14:34:19.805585 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737721 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 24 14:34:19.805585 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737725 2581 flags.go:64] FLAG: --tls-min-version="" Jul 24 14:34:19.805585 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737728 2581 flags.go:64] FLAG: --tls-private-key-file="" Jul 24 14:34:19.805585 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737731 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jul 24 14:34:19.805585 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737734 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 24 14:34:19.805585 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737737 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jul 24 14:34:19.805585 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737740 2581 flags.go:64] FLAG: --v="2" Jul 24 14:34:19.805585 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737745 2581 flags.go:64] FLAG: --version="false" Jul 24 14:34:19.805585 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737749 2581 flags.go:64] FLAG: --vmodule="" Jul 24 14:34:19.805585 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737753 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 24 14:34:19.805585 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.737757 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 24 14:34:19.805585 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737887 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 14:34:19.805585 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737892 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 14:34:19.806501 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737896 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 14:34:19.806501 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737899 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 14:34:19.806501 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737903 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 14:34:19.806501 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737906 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 14:34:19.806501 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737909 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 14:34:19.806501 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737912 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 14:34:19.806501 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737915 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 14:34:19.806501 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737918 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 14:34:19.806501 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737920 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 14:34:19.806501 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737924 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 14:34:19.806501 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737928 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 14:34:19.806501 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737930 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 14:34:19.806501 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737933 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 14:34:19.806501 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737936 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 14:34:19.806501 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737939 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 14:34:19.806501 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737941 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 14:34:19.806501 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737944 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 14:34:19.806501 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737947 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 14:34:19.806501 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737950 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 14:34:19.806501 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737953 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 14:34:19.807640 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737955 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 14:34:19.807640 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737958 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 14:34:19.807640 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737961 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 14:34:19.807640 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737963 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 14:34:19.807640 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737966 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 14:34:19.807640 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737969 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 14:34:19.807640 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737973 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 14:34:19.807640 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737976 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 14:34:19.807640 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737979 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 14:34:19.807640 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737982 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 14:34:19.807640 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737985 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 14:34:19.807640 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737989 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 14:34:19.807640 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737992 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 14:34:19.807640 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737994 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 14:34:19.807640 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.737997 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 14:34:19.807640 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738000 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 14:34:19.807640 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738003 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 14:34:19.807640 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738006 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 14:34:19.807640 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738008 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 14:34:19.807640 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738011 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 14:34:19.808756 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738014 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 14:34:19.808756 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738017 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 14:34:19.808756 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738020 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 14:34:19.808756 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738023 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 14:34:19.808756 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738025 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 14:34:19.808756 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738028 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 14:34:19.808756 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738031 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 14:34:19.808756 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738033 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 14:34:19.808756 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738036 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 14:34:19.808756 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738039 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 14:34:19.808756 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738042 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 14:34:19.808756 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738044 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 24 14:34:19.808756 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738047 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 14:34:19.808756 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738050 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 14:34:19.808756 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738053 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 14:34:19.808756 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738056 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 14:34:19.808756 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738059 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 14:34:19.808756 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738061 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 14:34:19.808756 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738065 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 14:34:19.808756 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738068 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 14:34:19.809668 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738072 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 14:34:19.809668 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738074 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 14:34:19.809668 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738077 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 14:34:19.809668 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738081 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 14:34:19.809668 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738084 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 14:34:19.809668 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738087 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 14:34:19.809668 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738090 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 14:34:19.809668 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738092 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 14:34:19.809668 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738095 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 14:34:19.809668 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738098 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 14:34:19.809668 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738101 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 14:34:19.809668 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738104 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 14:34:19.809668 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738107 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 14:34:19.809668 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738109 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 14:34:19.809668 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738114 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 14:34:19.809668 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738117 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 14:34:19.809668 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738121 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 14:34:19.809668 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738124 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 14:34:19.809668 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738126 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 14:34:19.810373 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738130 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 14:34:19.810373 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738132 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 14:34:19.810373 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738135 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 14:34:19.810373 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738139 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 14:34:19.810373 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738141 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 14:34:19.810373 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738144 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 14:34:19.810373 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738147 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 14:34:19.810373 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738149 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 14:34:19.810373 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738152 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 14:34:19.810373 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738155 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 14:34:19.810373 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738157 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 14:34:19.810373 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738161 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 14:34:19.810373 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738165 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 14:34:19.810373 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738169 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 14:34:19.810373 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738173 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 14:34:19.810373 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738176 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 14:34:19.810373 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738180 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 14:34:19.810373 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.738184 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 14:34:19.811004 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.738189 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 14:34:19.811004 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.746488 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 24 14:34:19.811004 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.746503 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 24 14:34:19.811004 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.747358 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 24 14:34:19.811004 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.747371 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 24 14:34:19.811004 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747431 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 14:34:19.811004 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747436 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 14:34:19.811004 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747440 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 14:34:19.811004 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747444 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 14:34:19.811004 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747447 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 14:34:19.811004 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747451 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 14:34:19.811004 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747454 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 14:34:19.811004 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747457 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 14:34:19.811004 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747460 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 14:34:19.889275 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747462 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 14:34:19.889275 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747465 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 14:34:19.889275 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747468 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 14:34:19.889275 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747471 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 14:34:19.889275 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747474 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 14:34:19.889275 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747476 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 14:34:19.889275 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747480 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 14:34:19.889275 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747489 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 14:34:19.889275 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747492 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 14:34:19.889275 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747495 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 14:34:19.889275 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747498 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 14:34:19.889275 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747503 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 14:34:19.889275 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747506 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 14:34:19.889275 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747509 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 14:34:19.889275 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747512 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 14:34:19.889275 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747515 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 14:34:19.889275 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747517 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 14:34:19.889275 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747522 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 14:34:19.889275 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747525 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 14:34:19.889275 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747528 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 14:34:19.815533 ip-10-0-131-12 systemd[1]: Started Kubernetes Kubelet. Jul 24 14:34:19.890143 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747531 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 14:34:19.890143 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747533 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 14:34:19.890143 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747536 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 14:34:19.890143 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747539 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 14:34:19.890143 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747542 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 14:34:19.890143 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747544 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 14:34:19.890143 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747549 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 14:34:19.890143 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747553 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 14:34:19.890143 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747556 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 14:34:19.890143 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747559 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 14:34:19.890143 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747562 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 14:34:19.890143 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747564 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 14:34:19.890143 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747567 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 14:34:19.890143 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747570 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 14:34:19.890143 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747573 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 14:34:19.890143 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747575 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 14:34:19.890143 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747578 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 14:34:19.890143 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747581 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 14:34:19.890143 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747584 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 14:34:19.890143 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747586 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 14:34:19.891003 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747589 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 14:34:19.891003 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747592 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 14:34:19.891003 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747596 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 14:34:19.891003 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747601 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 14:34:19.891003 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747604 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 14:34:19.891003 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747607 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 14:34:19.891003 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747610 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 14:34:19.891003 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747613 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 14:34:19.891003 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747616 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 14:34:19.891003 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747620 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 14:34:19.891003 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747622 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 14:34:19.891003 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747625 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 14:34:19.891003 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747628 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 14:34:19.891003 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747631 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 14:34:19.891003 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747634 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 14:34:19.891003 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747637 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 14:34:19.891003 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747639 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 14:34:19.891003 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747643 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 14:34:19.891003 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747645 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 14:34:19.891693 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747648 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 14:34:19.891693 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747651 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 14:34:19.891693 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747653 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 14:34:19.891693 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747656 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 24 14:34:19.891693 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747660 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 14:34:19.891693 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747663 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 14:34:19.891693 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747666 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 14:34:19.891693 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747669 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 14:34:19.891693 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747672 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 14:34:19.891693 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747675 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 14:34:19.891693 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747677 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 14:34:19.891693 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747681 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 14:34:19.891693 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747684 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 14:34:19.891693 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747687 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 14:34:19.891693 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747689 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 14:34:19.891693 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747692 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 14:34:19.891693 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747698 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 14:34:19.891693 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747701 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 14:34:19.891693 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747704 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 14:34:19.892390 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747707 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 14:34:19.892390 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747710 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 14:34:19.892390 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747713 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 14:34:19.892390 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747718 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 14:34:19.892390 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747721 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 14:34:19.892390 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747724 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 14:34:19.892390 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747726 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 14:34:19.892390 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747729 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 14:34:19.892390 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747732 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 14:34:19.892390 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747735 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 14:34:19.892390 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747738 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 14:34:19.892390 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747740 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 14:34:19.892390 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.747746 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 14:34:19.892390 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747868 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 14:34:19.892390 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747873 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 14:34:19.892941 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747877 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 14:34:19.892941 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747880 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 14:34:19.892941 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747883 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 14:34:19.892941 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747886 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 14:34:19.892941 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747890 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 14:34:19.892941 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747892 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 14:34:19.892941 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747895 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 24 14:34:19.892941 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747898 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 14:34:19.892941 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747901 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 14:34:19.892941 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747903 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 14:34:19.892941 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747907 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 14:34:19.892941 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747909 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 14:34:19.892941 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747912 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 14:34:19.892941 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747916 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 14:34:19.892941 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747922 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 14:34:19.892941 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747925 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 14:34:19.892941 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747928 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 14:34:19.892941 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747930 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 14:34:19.892941 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747933 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 14:34:19.892941 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747936 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 14:34:19.893740 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747940 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 14:34:19.893740 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747945 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 14:34:19.893740 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747949 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 14:34:19.893740 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747952 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 14:34:19.893740 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747955 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 14:34:19.893740 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747957 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 14:34:19.893740 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747960 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 14:34:19.893740 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747963 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 14:34:19.893740 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747966 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 14:34:19.893740 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747969 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 14:34:19.893740 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747971 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 14:34:19.893740 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747974 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 14:34:19.893740 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747977 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 14:34:19.893740 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747980 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 14:34:19.893740 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747983 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 14:34:19.893740 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747985 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 14:34:19.893740 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747988 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 14:34:19.893740 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747990 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 14:34:19.893740 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747993 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 14:34:19.893740 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747996 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 14:34:19.894447 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.747998 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 14:34:19.894447 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748001 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 14:34:19.894447 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748004 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 14:34:19.894447 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748007 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 14:34:19.894447 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748009 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 14:34:19.894447 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748012 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 14:34:19.894447 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748016 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 14:34:19.894447 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748019 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 14:34:19.894447 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748021 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 14:34:19.894447 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748024 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 14:34:19.894447 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748027 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 14:34:19.894447 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748029 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 14:34:19.894447 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748032 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 14:34:19.894447 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748038 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 14:34:19.894447 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748041 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 14:34:19.894447 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748044 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 14:34:19.894447 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748047 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 14:34:19.894447 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748049 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 14:34:19.894447 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748052 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 14:34:19.894447 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748055 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 14:34:19.895061 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748059 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 14:34:19.895061 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748062 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 14:34:19.895061 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748066 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 14:34:19.895061 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748069 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 14:34:19.895061 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748071 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 14:34:19.895061 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748074 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 14:34:19.895061 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748077 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 14:34:19.895061 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748079 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 14:34:19.895061 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748082 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 14:34:19.895061 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748085 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 14:34:19.895061 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748088 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 14:34:19.895061 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748091 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 14:34:19.895061 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748093 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 14:34:19.895061 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748096 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 14:34:19.895061 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748099 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 14:34:19.895061 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748101 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 14:34:19.895061 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748105 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 14:34:19.895061 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748108 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 14:34:19.895061 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748112 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 14:34:19.895716 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748115 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 14:34:19.895716 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748118 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 14:34:19.895716 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748120 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 14:34:19.895716 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748123 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 14:34:19.895716 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748126 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 14:34:19.895716 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748128 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 14:34:19.895716 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748133 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 14:34:19.895716 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748136 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 14:34:19.895716 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748139 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 14:34:19.895716 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748141 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 14:34:19.895716 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748144 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 14:34:19.895716 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748147 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 14:34:19.895716 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748150 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 14:34:19.895716 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748153 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 14:34:19.895716 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748156 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 14:34:19.895716 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748159 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 14:34:19.895716 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748162 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 14:34:19.895716 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:19.748164 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 14:34:19.896361 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.748170 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 14:34:19.896361 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.748280 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jul 24 14:34:19.896361 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.751769 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 24 14:34:19.896361 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.753417 2581 server.go:1019] "Starting client certificate rotation" Jul 24 14:34:19.896361 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.753535 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 14:34:19.896361 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.753584 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 14:34:19.896361 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.756313 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 14:34:19.896361 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.757708 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 14:34:19.896361 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.770568 2581 log.go:25] "Validated CRI v1 runtime API" Jul 24 14:34:19.896361 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.772996 2581 log.go:25] "Validated CRI v1 image API" Jul 24 14:34:19.896361 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.773838 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 24 14:34:19.896361 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.777468 2581 fs.go:135] Filesystem UUIDs: map[16e75810-2d9f-40d0-834e-2f4dc824977f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 adb1f8c8-f8cc-4a4a-a1d9-408804c234cb:/dev/nvme0n1p4] Jul 24 14:34:19.896811 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.777509 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 24 14:34:19.897012 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.791066 2581 manager.go:216] Machine: {Timestamp:2026-07-24 14:34:19.790306551 +0000 UTC m=+0.327562499 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3092761 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27e0e9be0e3a3799159f247f6e732b SystemUUID:ec27e0e9-be0e-3a37-9915-9f247f6e732b BootID:fdf56d1b-dc25-4c99-8e64-0c341ff918d0 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:12:f8:d5:7b:d1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:12:f8:d5:7b:d1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:61:da:d0:71:6e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 24 14:34:19.897012 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.791200 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 24 14:34:19.897012 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.791300 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 24 14:34:19.897012 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.795046 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 14:34:19.897012 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.797995 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 24 14:34:19.897012 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.798027 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-12.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 24 14:34:19.897012 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.798989 2581 topology_manager.go:138] "Creating topology manager with none policy" Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.799003 2581 container_manager_linux.go:309] "Creating device plugin manager" Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.799014 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.799028 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.799871 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.803134 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.803297 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.803332 2581 kubelet.go:486] "Attempting to sync node with API server" Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.803345 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.803364 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.803384 2581 kubelet.go:398] "Adding apiserver pod source" Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.803403 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.803797 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.803818 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.807224 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.809139 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.809169 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.810697 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.810716 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.810727 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.810738 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.810749 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.810755 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.810766 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.810773 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.810780 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.810785 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.810803 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.810811 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.811458 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.811466 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.814401 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-12.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.814767 2581 server.go:1268] "Started kubelet" Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:19.815074 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-12.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.815122 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:19.815074 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.816104 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.816181 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.816862 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m28tw" Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.818100 2581 server.go:310] "Adding debug handlers to kubelet server" Jul 24 14:34:19.897337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.819385 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 24 14:34:19.898526 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:19.820198 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 24 14:34:19.898526 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:19.819321 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-12.ec2.internal.18c5406bf98aceba default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-12.ec2.internal,UID:ip-10-0-131-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-12.ec2.internal,},FirstTimestamp:2026-07-24 14:34:19.814571706 +0000 UTC m=+0.351828088,LastTimestamp:2026-07-24 14:34:19.814571706 +0000 UTC m=+0.351828088,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-12.ec2.internal,}" Jul 24 14:34:19.898526 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.824550 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m28tw" Jul 24 14:34:19.898526 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.825796 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 24 14:34:19.898526 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.827351 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 24 14:34:19.898526 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:19.827375 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-12.ec2.internal\" not found" Jul 24 14:34:19.898526 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.827993 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 24 14:34:19.898526 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.828008 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 24 14:34:19.898526 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.828018 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 24 14:34:19.898526 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.828109 2581 reconstruct.go:97] "Volume reconstruction finished" Jul 24 14:34:19.898526 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.828117 2581 reconciler.go:29] "Reconciler: start to sync state" Jul 24 14:34:19.898526 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.828249 2581 factory.go:55] Registering systemd factory Jul 24 14:34:19.898526 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.828264 2581 factory.go:223] Registration of the systemd container factory successfully Jul 24 14:34:19.898526 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.828535 2581 factory.go:153] Registering CRI-O factory Jul 24 14:34:19.898526 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.828547 2581 factory.go:223] Registration of the crio container factory successfully Jul 24 14:34:19.898526 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.828597 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 24 14:34:19.898526 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.828632 2581 factory.go:103] Registering Raw factory Jul 24 14:34:19.898526 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.828643 2581 manager.go:1196] Started watching for new ooms in manager Jul 24 14:34:19.898526 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.829341 2581 manager.go:349] Starting recovery of all containers Jul 24 14:34:19.898526 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:19.829536 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 24 14:34:19.898526 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:19.829614 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-12.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 24 14:34:19.898526 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.851015 2581 manager.go:354] Recovery completed Jul 24 14:34:19.898526 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.856624 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 14:34:19.898526 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.858396 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasSufficientMemory" Jul 24 14:34:19.898526 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.858424 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 14:34:19.898526 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.858438 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasSufficientPID" Jul 24 14:34:19.898526 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.859028 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 24 14:34:19.898526 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.859039 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 14:34:19.898526 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.859041 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 24 14:34:19.898526 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.859083 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 24 14:34:19.898526 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.861843 2581 policy_none.go:49] "None policy: Start" Jul 24 14:34:19.898526 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.861857 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 24 14:34:19.898526 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.861868 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 24 14:34:19.898526 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.864034 2581 policy_none.go:47] "Start" Jul 24 14:34:19.899521 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.875976 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasSufficientMemory" Jul 24 14:34:19.899521 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.876001 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 14:34:19.899521 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.876029 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasSufficientPID" Jul 24 14:34:20.056223 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.909818 2581 manager.go:337] "Starting Device Plugin manager" Jul 24 14:34:20.056223 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:19.909876 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 24 14:34:20.056223 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.909887 2581 server.go:87] "Starting device plugin registration server" Jul 24 14:34:20.056223 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.910087 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 24 14:34:20.056223 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.910097 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 24 14:34:20.056223 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.910204 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 24 14:34:20.056223 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.910296 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 24 14:34:20.056223 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:19.910308 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 24 14:34:20.056223 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:19.910836 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 24 14:34:20.056223 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:19.910898 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-12.ec2.internal\" not found" Jul 24 14:34:20.056223 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.016892 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 14:34:20.056223 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.017796 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasSufficientMemory" Jul 24 14:34:20.056223 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.017820 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 14:34:20.056223 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.017833 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasSufficientPID" Jul 24 14:34:20.056223 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.017867 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-12.ec2.internal" Jul 24 14:34:20.056223 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.024016 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-12.ec2.internal" Jul 24 14:34:20.056223 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:20.024033 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-12.ec2.internal\": node \"ip-10-0-131-12.ec2.internal\" not found" Jul 24 14:34:20.056223 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:20.040866 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-12.ec2.internal\" not found" Jul 24 14:34:20.204846 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.104807 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 24 14:34:20.204846 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.106030 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 24 14:34:20.204846 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.106063 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 24 14:34:20.204846 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.106082 2581 kubelet.go:2448] "Starting kubelet main sync loop" Jul 24 14:34:20.204846 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:20.106139 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 24 14:34:20.204846 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.108516 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 14:34:20.204846 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:20.141408 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-12.ec2.internal\" not found" Jul 24 14:34:20.331500 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.210841 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-12.ec2.internal"] Jul 24 14:34:20.331500 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.210923 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 14:34:20.331500 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.212383 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasSufficientMemory" Jul 24 14:34:20.331500 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.212406 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 14:34:20.331500 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.212423 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasSufficientPID" Jul 24 14:34:20.331500 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.214648 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 14:34:20.331500 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.214829 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal" Jul 24 14:34:20.331500 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.214896 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 14:34:20.331500 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.215316 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasSufficientMemory" Jul 24 14:34:20.331500 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.215317 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasSufficientMemory" Jul 24 14:34:20.331500 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.215341 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 14:34:20.331500 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.215370 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 14:34:20.331500 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.215376 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasSufficientPID" Jul 24 14:34:20.331500 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.215383 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasSufficientPID" Jul 24 14:34:20.331500 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.217574 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-12.ec2.internal" Jul 24 14:34:20.331500 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.217605 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 14:34:20.331500 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.220441 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasSufficientMemory" Jul 24 14:34:20.331500 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.220463 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 14:34:20.331500 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.220476 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeHasSufficientPID" Jul 24 14:34:20.331500 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.237340 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bcce044147adca679fede2754bc49a60-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal\" (UID: \"bcce044147adca679fede2754bc49a60\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal" Jul 24 14:34:20.331500 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.237368 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcce044147adca679fede2754bc49a60-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal\" (UID: \"bcce044147adca679fede2754bc49a60\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal" Jul 24 14:34:20.331500 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.237390 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c18d0a8ddba5724c2819ddd49f257f64-config\") pod \"kube-apiserver-proxy-ip-10-0-131-12.ec2.internal\" (UID: \"c18d0a8ddba5724c2819ddd49f257f64\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-12.ec2.internal" Jul 24 14:34:20.331500 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:20.242552 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-12.ec2.internal\" not found" Jul 24 14:34:20.331500 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:20.257935 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-12.ec2.internal\" not found" node="ip-10-0-131-12.ec2.internal" Jul 24 14:34:20.331500 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:20.263662 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-12.ec2.internal\" not found" node="ip-10-0-131-12.ec2.internal" Jul 24 14:34:20.337887 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.337525 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bcce044147adca679fede2754bc49a60-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal\" (UID: \"bcce044147adca679fede2754bc49a60\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal" Jul 24 14:34:20.337887 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.337558 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcce044147adca679fede2754bc49a60-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal\" (UID: \"bcce044147adca679fede2754bc49a60\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal" Jul 24 14:34:20.337887 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.337589 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c18d0a8ddba5724c2819ddd49f257f64-config\") pod \"kube-apiserver-proxy-ip-10-0-131-12.ec2.internal\" (UID: \"c18d0a8ddba5724c2819ddd49f257f64\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-12.ec2.internal" Jul 24 14:34:20.337887 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.337625 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c18d0a8ddba5724c2819ddd49f257f64-config\") pod \"kube-apiserver-proxy-ip-10-0-131-12.ec2.internal\" (UID: \"c18d0a8ddba5724c2819ddd49f257f64\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-12.ec2.internal" Jul 24 14:34:20.337887 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.337630 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bcce044147adca679fede2754bc49a60-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal\" (UID: \"bcce044147adca679fede2754bc49a60\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal" Jul 24 14:34:20.337887 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.337634 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcce044147adca679fede2754bc49a60-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal\" (UID: \"bcce044147adca679fede2754bc49a60\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal" Jul 24 14:34:20.468342 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:20.342975 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-12.ec2.internal\" not found" Jul 24 14:34:20.468342 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:20.443984 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-12.ec2.internal\" not found" Jul 24 14:34:20.548853 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:20.544776 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-12.ec2.internal\" not found" Jul 24 14:34:20.676805 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.561035 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal" Jul 24 14:34:20.676805 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.567142 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-12.ec2.internal" Jul 24 14:34:20.676805 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:20.645659 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-12.ec2.internal\" not found" Jul 24 14:34:20.825638 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:20.746792 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-12.ec2.internal\" not found" Jul 24 14:34:20.825638 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.752300 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 24 14:34:20.825638 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.752448 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 14:34:20.830062 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.830034 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 14:29:20 +0000 UTC" deadline="2028-02-25 14:42:20.627359368 +0000 UTC" Jul 24 14:34:20.830124 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.830063 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13944h7m59.797300819s" Jul 24 14:34:20.847684 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:20.847659 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-12.ec2.internal\" not found" Jul 24 14:34:20.948103 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:20.948037 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-12.ec2.internal\" not found" Jul 24 14:34:20.982832 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:20.982808 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 14:34:21.027689 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.027660 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal" Jul 24 14:34:21.041135 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.041113 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 14:34:21.042987 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.042974 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-12.ec2.internal" Jul 24 14:34:21.052155 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.052140 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 14:34:21.198218 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.198150 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 14:34:21.294772 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:21.294734 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcce044147adca679fede2754bc49a60.slice/crio-5165cbed5243c27fd103546d8626bd13b10e937cfb6f36c9f18c5d2ead7f4fd0 WatchSource:0}: Error finding container 5165cbed5243c27fd103546d8626bd13b10e937cfb6f36c9f18c5d2ead7f4fd0: Status 404 returned error can't find the container with id 5165cbed5243c27fd103546d8626bd13b10e937cfb6f36c9f18c5d2ead7f4fd0 Jul 24 14:34:21.296917 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:21.296890 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc18d0a8ddba5724c2819ddd49f257f64.slice/crio-ae7394e47e497fd6a638e036cc51b4eed6bbba33acd03cc5a4ca40f9b9249db0 WatchSource:0}: Error finding container ae7394e47e497fd6a638e036cc51b4eed6bbba33acd03cc5a4ca40f9b9249db0: Status 404 returned error can't find the container with id ae7394e47e497fd6a638e036cc51b4eed6bbba33acd03cc5a4ca40f9b9249db0 Jul 24 14:34:21.299475 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.299458 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 14:34:21.372128 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.372104 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 14:34:21.806949 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.806922 2581 apiserver.go:52] "Watching apiserver" Jul 24 14:34:21.816785 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.816598 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 24 14:34:21.817568 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.817160 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-mr85c","openshift-multus/network-metrics-daemon-wjgg5","kube-system/konnectivity-agent-ww5lq","kube-system/kube-apiserver-proxy-ip-10-0-131-12.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x4lb","openshift-network-diagnostics/network-check-target-hcq7x","openshift-network-operator/iptables-alerter-vk9p4","openshift-ovn-kubernetes/ovnkube-node-4cffq","kube-system/global-pull-secret-syncer-cwz72","openshift-cluster-node-tuning-operator/tuned-z724g","openshift-dns/node-resolver-shsqx","openshift-image-registry/node-ca-rrxgj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal","openshift-multus/multus-additional-cni-plugins-6wsm6"] Jul 24 14:34:21.819839 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.819811 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.822565 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.822545 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vk9p4" Jul 24 14:34:21.824026 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.823299 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 24 14:34:21.824026 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.823556 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 24 14:34:21.824026 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.823879 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-t7zn6\"" Jul 24 14:34:21.826212 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.824682 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rrxgj" Jul 24 14:34:21.826212 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.825607 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6h779\"" Jul 24 14:34:21.826212 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.825901 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 24 14:34:21.826212 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.826047 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 24 14:34:21.826212 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.826120 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 24 14:34:21.827224 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.827094 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.828687 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.827841 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 24 14:34:21.828687 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.827883 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 24 14:34:21.828687 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.828014 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6hlzv\"" Jul 24 14:34:21.828687 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.828245 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 24 14:34:21.828687 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.828254 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 24 14:34:21.830023 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.829696 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcq7x" Jul 24 14:34:21.830023 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:21.829768 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcq7x" podUID="a448a0f9-4482-497d-8a40-06c479df078f" Jul 24 14:34:21.831904 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.831881 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:34:21.831998 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:21.831978 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwz72" podUID="7bf205e6-d5a4-4e93-a3c8-e3ea35355044" Jul 24 14:34:21.836440 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.836412 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 24 14:34:21.836547 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.836477 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 24 14:34:21.836869 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.836843 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x4lb" Jul 24 14:34:21.837099 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.837079 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-n9cjb\"" Jul 24 14:34:21.837169 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.837113 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 24 14:34:21.837169 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.837137 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 24 14:34:21.838213 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.837988 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjgg5" Jul 24 14:34:21.838213 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:21.838073 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjgg5" podUID="5d6fca35-b619-48ce-9227-1f10e1b2fda1" Jul 24 14:34:21.840728 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.840643 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 24 14:34:21.840829 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.840741 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 24 14:34:21.840829 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.840642 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zhgg5\"" Jul 24 14:34:21.840829 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.840780 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-shsqx" Jul 24 14:34:21.841003 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.840652 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 24 14:34:21.844585 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.843938 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ww5lq" Jul 24 14:34:21.845361 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.845035 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-r4r4m\"" Jul 24 14:34:21.845982 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.845504 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 24 14:34:21.845982 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.845716 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 14:34:21.847610 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.847591 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 24 14:34:21.848084 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.847773 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 24 14:34:21.848283 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.848263 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ef210e03-663f-4876-90d1-136f2546a174-run\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.848398 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.848300 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw72l\" (UniqueName: \"kubernetes.io/projected/0459058c-9c25-4674-9521-fdc41c238ab7-kube-api-access-jw72l\") pod \"iptables-alerter-vk9p4\" (UID: \"0459058c-9c25-4674-9521-fdc41c238ab7\") " pod="openshift-network-operator/iptables-alerter-vk9p4" Jul 24 14:34:21.848398 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.848326 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-cni-binary-copy\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.848398 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.848351 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-host-run-multus-certs\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.848398 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.848375 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ef210e03-663f-4876-90d1-136f2546a174-etc-sysctl-conf\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.848612 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.848398 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef210e03-663f-4876-90d1-136f2546a174-var-lib-kubelet\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.848612 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.848420 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-multus-cni-dir\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.848612 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.848443 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-host-run-netns\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.848612 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.848469 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-host-var-lib-kubelet\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.848612 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.848494 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-etc-kubernetes\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.848612 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.848516 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef210e03-663f-4876-90d1-136f2546a174-lib-modules\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.848612 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.848541 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ef210e03-663f-4876-90d1-136f2546a174-etc-modprobe-d\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.848612 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.848563 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/76abe981-1c84-4f65-82ff-a837b3e20722-host\") pod \"node-ca-rrxgj\" (UID: \"76abe981-1c84-4f65-82ff-a837b3e20722\") " pod="openshift-image-registry/node-ca-rrxgj" Jul 24 14:34:21.848612 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.848598 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-host-var-lib-cni-multus\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.849186 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.848622 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef210e03-663f-4876-90d1-136f2546a174-sys\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.849186 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.848647 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef210e03-663f-4876-90d1-136f2546a174-tmp\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.849186 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.848674 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0459058c-9c25-4674-9521-fdc41c238ab7-iptables-alerter-script\") pod \"iptables-alerter-vk9p4\" (UID: \"0459058c-9c25-4674-9521-fdc41c238ab7\") " pod="openshift-network-operator/iptables-alerter-vk9p4" Jul 24 14:34:21.849186 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.848702 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/76abe981-1c84-4f65-82ff-a837b3e20722-serviceca\") pod \"node-ca-rrxgj\" (UID: \"76abe981-1c84-4f65-82ff-a837b3e20722\") " pod="openshift-image-registry/node-ca-rrxgj" Jul 24 14:34:21.849186 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.848725 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-os-release\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.849186 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.848752 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-multus-socket-dir-parent\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.849186 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.848777 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-hostroot\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.849186 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.848802 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph8vp\" (UniqueName: \"kubernetes.io/projected/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-kube-api-access-ph8vp\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.849186 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.848837 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4gnc\" (UniqueName: \"kubernetes.io/projected/a448a0f9-4482-497d-8a40-06c479df078f-kube-api-access-k4gnc\") pod \"network-check-target-hcq7x\" (UID: \"a448a0f9-4482-497d-8a40-06c479df078f\") " pod="openshift-network-diagnostics/network-check-target-hcq7x" Jul 24 14:34:21.849186 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.848871 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef210e03-663f-4876-90d1-136f2546a174-etc-kubernetes\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.849186 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.848898 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ef210e03-663f-4876-90d1-136f2546a174-etc-systemd\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.849186 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.848922 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-cnibin\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.849186 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.847907 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-js87p\"" Jul 24 14:34:21.849945 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.849198 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-host-var-lib-cni-bin\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.849945 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.849244 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ef210e03-663f-4876-90d1-136f2546a174-etc-sysctl-d\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.849945 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.849268 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ef210e03-663f-4876-90d1-136f2546a174-etc-tuned\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.849945 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.849299 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-multus-conf-dir\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.849945 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.849322 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-multus-daemon-config\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.849945 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.847989 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 24 14:34:21.849945 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.849359 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ef210e03-663f-4876-90d1-136f2546a174-etc-sysconfig\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.849945 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.849418 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef210e03-663f-4876-90d1-136f2546a174-host\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.849945 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.849448 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-465nf\" (UniqueName: \"kubernetes.io/projected/ef210e03-663f-4876-90d1-136f2546a174-kube-api-access-465nf\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.849945 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.849488 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0459058c-9c25-4674-9521-fdc41c238ab7-host-slash\") pod \"iptables-alerter-vk9p4\" (UID: \"0459058c-9c25-4674-9521-fdc41c238ab7\") " pod="openshift-network-operator/iptables-alerter-vk9p4" Jul 24 14:34:21.849945 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.849535 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksh79\" (UniqueName: \"kubernetes.io/projected/76abe981-1c84-4f65-82ff-a837b3e20722-kube-api-access-ksh79\") pod \"node-ca-rrxgj\" (UID: \"76abe981-1c84-4f65-82ff-a837b3e20722\") " pod="openshift-image-registry/node-ca-rrxgj" Jul 24 14:34:21.849945 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.849570 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-system-cni-dir\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.849945 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.849613 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-host-run-k8s-cni-cncf-io\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.849945 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.849623 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:21.851891 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.851868 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6wsm6" Jul 24 14:34:21.852461 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.852434 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 24 14:34:21.852599 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.852576 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 24 14:34:21.853290 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.853078 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fr55d\"" Jul 24 14:34:21.853290 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.853143 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 24 14:34:21.853290 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.853249 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 24 14:34:21.853723 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.853707 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 24 14:34:21.854704 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.854545 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 24 14:34:21.854704 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.854546 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 24 14:34:21.857721 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.856748 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 24 14:34:21.857721 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.856843 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-czmlz\"" Jul 24 14:34:21.864618 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.864414 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-c4vc2" Jul 24 14:34:21.876024 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.874852 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-c4vc2" Jul 24 14:34:21.929601 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.929574 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 24 14:34:21.951840 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.949797 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ef210e03-663f-4876-90d1-136f2546a174-etc-sysconfig\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.951840 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.949837 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-var-lib-openvswitch\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:21.951840 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.949867 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-ovnkube-config\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:21.951840 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.949927 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bjpf\" (UniqueName: \"kubernetes.io/projected/5d6fca35-b619-48ce-9227-1f10e1b2fda1-kube-api-access-5bjpf\") pod \"network-metrics-daemon-wjgg5\" (UID: \"5d6fca35-b619-48ce-9227-1f10e1b2fda1\") " pod="openshift-multus/network-metrics-daemon-wjgg5" Jul 24 14:34:21.951840 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.949976 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ec152e93-0223-4419-b21a-d325b39654cd-cnibin\") pod \"multus-additional-cni-plugins-6wsm6\" (UID: \"ec152e93-0223-4419-b21a-d325b39654cd\") " pod="openshift-multus/multus-additional-cni-plugins-6wsm6" Jul 24 14:34:21.951840 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.950002 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ec152e93-0223-4419-b21a-d325b39654cd-os-release\") pod \"multus-additional-cni-plugins-6wsm6\" (UID: \"ec152e93-0223-4419-b21a-d325b39654cd\") " pod="openshift-multus/multus-additional-cni-plugins-6wsm6" Jul 24 14:34:21.951840 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.950110 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-system-cni-dir\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.951840 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.950035 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-system-cni-dir\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.951840 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.950216 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-host-run-k8s-cni-cncf-io\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.951840 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.950244 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-systemd-units\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:21.951840 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.950271 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-run-systemd\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:21.951840 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.950280 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ef210e03-663f-4876-90d1-136f2546a174-etc-sysconfig\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.951840 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.950326 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-run-ovn\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:21.951840 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.950362 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ec152e93-0223-4419-b21a-d325b39654cd-cni-binary-copy\") pod \"multus-additional-cni-plugins-6wsm6\" (UID: \"ec152e93-0223-4419-b21a-d325b39654cd\") " pod="openshift-multus/multus-additional-cni-plugins-6wsm6" Jul 24 14:34:21.952730 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.950389 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-host-run-k8s-cni-cncf-io\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.952730 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.950410 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-host-run-multus-certs\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.952730 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.950438 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ef210e03-663f-4876-90d1-136f2546a174-etc-sysctl-conf\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.952730 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.950477 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef210e03-663f-4876-90d1-136f2546a174-var-lib-kubelet\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.952730 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.950509 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-multus-cni-dir\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.952730 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.950557 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-etc-kubernetes\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.952730 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.950584 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-host-slash\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:21.952730 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.950589 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-host-run-multus-certs\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.952730 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.950613 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7bf205e6-d5a4-4e93-a3c8-e3ea35355044-dbus\") pod \"global-pull-secret-syncer-cwz72\" (UID: \"7bf205e6-d5a4-4e93-a3c8-e3ea35355044\") " pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:34:21.952730 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.950557 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ef210e03-663f-4876-90d1-136f2546a174-etc-sysctl-conf\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.952730 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.950675 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d6fca35-b619-48ce-9227-1f10e1b2fda1-metrics-certs\") pod \"network-metrics-daemon-wjgg5\" (UID: \"5d6fca35-b619-48ce-9227-1f10e1b2fda1\") " pod="openshift-multus/network-metrics-daemon-wjgg5" Jul 24 14:34:21.952730 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.950704 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ef210e03-663f-4876-90d1-136f2546a174-etc-modprobe-d\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.952730 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.950728 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-run-openvswitch\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:21.952730 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.950755 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-log-socket\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:21.952730 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.950759 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-multus-cni-dir\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.953587 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.950782 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rn8h\" (UniqueName: \"kubernetes.io/projected/ec152e93-0223-4419-b21a-d325b39654cd-kube-api-access-6rn8h\") pod \"multus-additional-cni-plugins-6wsm6\" (UID: \"ec152e93-0223-4419-b21a-d325b39654cd\") " pod="openshift-multus/multus-additional-cni-plugins-6wsm6" Jul 24 14:34:21.953587 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.950813 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef210e03-663f-4876-90d1-136f2546a174-sys\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.953587 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.950821 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef210e03-663f-4876-90d1-136f2546a174-var-lib-kubelet\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.953587 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.950881 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0459058c-9c25-4674-9521-fdc41c238ab7-iptables-alerter-script\") pod \"iptables-alerter-vk9p4\" (UID: \"0459058c-9c25-4674-9521-fdc41c238ab7\") " pod="openshift-network-operator/iptables-alerter-vk9p4" Jul 24 14:34:21.953587 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.950899 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef210e03-663f-4876-90d1-136f2546a174-sys\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.953587 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.950908 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-hostroot\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.953587 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.950943 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph8vp\" (UniqueName: \"kubernetes.io/projected/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-kube-api-access-ph8vp\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.953587 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.950953 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-etc-kubernetes\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.953587 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.950972 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/df66942e-5c07-46e0-93fe-04ad53865c89-hosts-file\") pod \"node-resolver-shsqx\" (UID: \"df66942e-5c07-46e0-93fe-04ad53865c89\") " pod="openshift-dns/node-resolver-shsqx" Jul 24 14:34:21.953587 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.951041 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ec152e93-0223-4419-b21a-d325b39654cd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6wsm6\" (UID: \"ec152e93-0223-4419-b21a-d325b39654cd\") " pod="openshift-multus/multus-additional-cni-plugins-6wsm6" Jul 24 14:34:21.953587 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.951045 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ef210e03-663f-4876-90d1-136f2546a174-etc-modprobe-d\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.953587 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.951076 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0e2d96fe-c8d4-43c3-b840-aa9c83cf6900-device-dir\") pod \"aws-ebs-csi-driver-node-9x4lb\" (UID: \"0e2d96fe-c8d4-43c3-b840-aa9c83cf6900\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x4lb" Jul 24 14:34:21.953587 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.951105 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4gnc\" (UniqueName: \"kubernetes.io/projected/a448a0f9-4482-497d-8a40-06c479df078f-kube-api-access-k4gnc\") pod \"network-check-target-hcq7x\" (UID: \"a448a0f9-4482-497d-8a40-06c479df078f\") " pod="openshift-network-diagnostics/network-check-target-hcq7x" Jul 24 14:34:21.953587 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.951130 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ef210e03-663f-4876-90d1-136f2546a174-etc-systemd\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.954310 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.951158 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-host-var-lib-cni-bin\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.954310 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.951182 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-etc-openvswitch\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:21.954310 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.951215 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7bf205e6-d5a4-4e93-a3c8-e3ea35355044-original-pull-secret\") pod \"global-pull-secret-syncer-cwz72\" (UID: \"7bf205e6-d5a4-4e93-a3c8-e3ea35355044\") " pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:34:21.954310 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.951306 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ef210e03-663f-4876-90d1-136f2546a174-etc-sysctl-d\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.954310 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.951332 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ef210e03-663f-4876-90d1-136f2546a174-etc-tuned\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.954310 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.951356 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-multus-conf-dir\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.954310 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.951383 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-multus-daemon-config\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.954310 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.951411 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-host-run-ovn-kubernetes\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:21.954310 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.951440 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-host-cni-bin\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:21.954310 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.951461 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-hostroot\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.954310 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.951468 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0e2d96fe-c8d4-43c3-b840-aa9c83cf6900-registration-dir\") pod \"aws-ebs-csi-driver-node-9x4lb\" (UID: \"0e2d96fe-c8d4-43c3-b840-aa9c83cf6900\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x4lb" Jul 24 14:34:21.954310 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.951548 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ef210e03-663f-4876-90d1-136f2546a174-etc-systemd\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.954310 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.951639 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ef210e03-663f-4876-90d1-136f2546a174-etc-sysctl-d\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.954310 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.951777 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 24 14:34:21.954310 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.951922 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-host-var-lib-cni-bin\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.955076 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.951997 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-multus-conf-dir\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.955076 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.952577 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-multus-daemon-config\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.955076 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.952652 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef210e03-663f-4876-90d1-136f2546a174-host\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.955076 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.952683 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-465nf\" (UniqueName: \"kubernetes.io/projected/ef210e03-663f-4876-90d1-136f2546a174-kube-api-access-465nf\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.955076 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.952764 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0459058c-9c25-4674-9521-fdc41c238ab7-host-slash\") pod \"iptables-alerter-vk9p4\" (UID: \"0459058c-9c25-4674-9521-fdc41c238ab7\") " pod="openshift-network-operator/iptables-alerter-vk9p4" Jul 24 14:34:21.955076 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.952809 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksh79\" (UniqueName: \"kubernetes.io/projected/76abe981-1c84-4f65-82ff-a837b3e20722-kube-api-access-ksh79\") pod \"node-ca-rrxgj\" (UID: \"76abe981-1c84-4f65-82ff-a837b3e20722\") " pod="openshift-image-registry/node-ca-rrxgj" Jul 24 14:34:21.955076 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.952810 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef210e03-663f-4876-90d1-136f2546a174-host\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.955076 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.953016 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dbll\" (UniqueName: \"kubernetes.io/projected/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-kube-api-access-4dbll\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:21.955076 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.953121 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-host-run-netns\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:21.955076 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.953133 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0459058c-9c25-4674-9521-fdc41c238ab7-host-slash\") pod \"iptables-alerter-vk9p4\" (UID: \"0459058c-9c25-4674-9521-fdc41c238ab7\") " pod="openshift-network-operator/iptables-alerter-vk9p4" Jul 24 14:34:21.955076 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.953153 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-node-log\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:21.955076 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.953178 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-ovnkube-script-lib\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:21.955076 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.953183 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0459058c-9c25-4674-9521-fdc41c238ab7-iptables-alerter-script\") pod \"iptables-alerter-vk9p4\" (UID: \"0459058c-9c25-4674-9521-fdc41c238ab7\") " pod="openshift-network-operator/iptables-alerter-vk9p4" Jul 24 14:34:21.955076 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.953221 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ef210e03-663f-4876-90d1-136f2546a174-run\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.955930 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.953270 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw72l\" (UniqueName: \"kubernetes.io/projected/0459058c-9c25-4674-9521-fdc41c238ab7-kube-api-access-jw72l\") pod \"iptables-alerter-vk9p4\" (UID: \"0459058c-9c25-4674-9521-fdc41c238ab7\") " pod="openshift-network-operator/iptables-alerter-vk9p4" Jul 24 14:34:21.955930 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.953293 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ef210e03-663f-4876-90d1-136f2546a174-run\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.955930 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.953341 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-cni-binary-copy\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.955930 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.953473 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-host-kubelet\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:21.955930 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.953610 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ec152e93-0223-4419-b21a-d325b39654cd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6wsm6\" (UID: \"ec152e93-0223-4419-b21a-d325b39654cd\") " pod="openshift-multus/multus-additional-cni-plugins-6wsm6" Jul 24 14:34:21.955930 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.953663 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0e2d96fe-c8d4-43c3-b840-aa9c83cf6900-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9x4lb\" (UID: \"0e2d96fe-c8d4-43c3-b840-aa9c83cf6900\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x4lb" Jul 24 14:34:21.955930 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.953735 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-host-run-netns\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.955930 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.953788 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-host-var-lib-kubelet\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.955930 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.953793 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-host-run-netns\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.955930 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.953820 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/94643644-01c1-41e6-b869-ca7f08f2010f-agent-certs\") pod \"konnectivity-agent-ww5lq\" (UID: \"94643644-01c1-41e6-b869-ca7f08f2010f\") " pod="kube-system/konnectivity-agent-ww5lq" Jul 24 14:34:21.955930 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.953848 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-host-cni-netd\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:21.955930 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.953873 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-ovn-node-metrics-cert\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:21.955930 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.953901 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-host-var-lib-kubelet\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.955930 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.953913 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7bf205e6-d5a4-4e93-a3c8-e3ea35355044-kubelet-config\") pod \"global-pull-secret-syncer-cwz72\" (UID: \"7bf205e6-d5a4-4e93-a3c8-e3ea35355044\") " pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:34:21.956665 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.953940 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ec152e93-0223-4419-b21a-d325b39654cd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6wsm6\" (UID: \"ec152e93-0223-4419-b21a-d325b39654cd\") " pod="openshift-multus/multus-additional-cni-plugins-6wsm6" Jul 24 14:34:21.956665 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.953969 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef210e03-663f-4876-90d1-136f2546a174-lib-modules\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.956665 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.953986 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-cni-binary-copy\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.956665 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.953995 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/76abe981-1c84-4f65-82ff-a837b3e20722-host\") pod \"node-ca-rrxgj\" (UID: \"76abe981-1c84-4f65-82ff-a837b3e20722\") " pod="openshift-image-registry/node-ca-rrxgj" Jul 24 14:34:21.956665 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.954021 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-host-var-lib-cni-multus\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.956665 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.954048 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/76abe981-1c84-4f65-82ff-a837b3e20722-host\") pod \"node-ca-rrxgj\" (UID: \"76abe981-1c84-4f65-82ff-a837b3e20722\") " pod="openshift-image-registry/node-ca-rrxgj" Jul 24 14:34:21.956665 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.954072 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df66942e-5c07-46e0-93fe-04ad53865c89-tmp-dir\") pod \"node-resolver-shsqx\" (UID: \"df66942e-5c07-46e0-93fe-04ad53865c89\") " pod="openshift-dns/node-resolver-shsqx" Jul 24 14:34:21.956665 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.954092 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-host-var-lib-cni-multus\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.956665 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.954101 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef210e03-663f-4876-90d1-136f2546a174-lib-modules\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.956665 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.954135 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-env-overrides\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:21.956665 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.954167 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef210e03-663f-4876-90d1-136f2546a174-tmp\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.956665 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.954200 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/76abe981-1c84-4f65-82ff-a837b3e20722-serviceca\") pod \"node-ca-rrxgj\" (UID: \"76abe981-1c84-4f65-82ff-a837b3e20722\") " pod="openshift-image-registry/node-ca-rrxgj" Jul 24 14:34:21.956665 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.954231 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-os-release\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.956665 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.954280 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-multus-socket-dir-parent\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.956665 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.954307 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ec152e93-0223-4419-b21a-d325b39654cd-system-cni-dir\") pod \"multus-additional-cni-plugins-6wsm6\" (UID: \"ec152e93-0223-4419-b21a-d325b39654cd\") " pod="openshift-multus/multus-additional-cni-plugins-6wsm6" Jul 24 14:34:21.957431 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.954331 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0e2d96fe-c8d4-43c3-b840-aa9c83cf6900-socket-dir\") pod \"aws-ebs-csi-driver-node-9x4lb\" (UID: \"0e2d96fe-c8d4-43c3-b840-aa9c83cf6900\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x4lb" Jul 24 14:34:21.957431 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.954361 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0e2d96fe-c8d4-43c3-b840-aa9c83cf6900-etc-selinux\") pod \"aws-ebs-csi-driver-node-9x4lb\" (UID: \"0e2d96fe-c8d4-43c3-b840-aa9c83cf6900\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x4lb" Jul 24 14:34:21.957431 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.954415 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef210e03-663f-4876-90d1-136f2546a174-etc-kubernetes\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.957431 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.954443 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-cnibin\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.957431 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.954509 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:21.957431 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.954517 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-os-release\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.957431 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.954538 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0e2d96fe-c8d4-43c3-b840-aa9c83cf6900-sys-fs\") pod \"aws-ebs-csi-driver-node-9x4lb\" (UID: \"0e2d96fe-c8d4-43c3-b840-aa9c83cf6900\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x4lb" Jul 24 14:34:21.957431 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.954566 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbst2\" (UniqueName: \"kubernetes.io/projected/0e2d96fe-c8d4-43c3-b840-aa9c83cf6900-kube-api-access-rbst2\") pod \"aws-ebs-csi-driver-node-9x4lb\" (UID: \"0e2d96fe-c8d4-43c3-b840-aa9c83cf6900\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x4lb" Jul 24 14:34:21.957431 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.954585 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-multus-socket-dir-parent\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.957431 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.954591 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g77h5\" (UniqueName: \"kubernetes.io/projected/df66942e-5c07-46e0-93fe-04ad53865c89-kube-api-access-g77h5\") pod \"node-resolver-shsqx\" (UID: \"df66942e-5c07-46e0-93fe-04ad53865c89\") " pod="openshift-dns/node-resolver-shsqx" Jul 24 14:34:21.957431 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.954617 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/94643644-01c1-41e6-b869-ca7f08f2010f-konnectivity-ca\") pod \"konnectivity-agent-ww5lq\" (UID: \"94643644-01c1-41e6-b869-ca7f08f2010f\") " pod="kube-system/konnectivity-agent-ww5lq" Jul 24 14:34:21.957431 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.954645 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-cnibin\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.957431 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.954656 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/76abe981-1c84-4f65-82ff-a837b3e20722-serviceca\") pod \"node-ca-rrxgj\" (UID: \"76abe981-1c84-4f65-82ff-a837b3e20722\") " pod="openshift-image-registry/node-ca-rrxgj" Jul 24 14:34:21.957431 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.954735 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef210e03-663f-4876-90d1-136f2546a174-etc-kubernetes\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.958691 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.958473 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ef210e03-663f-4876-90d1-136f2546a174-etc-tuned\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.958895 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.958874 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef210e03-663f-4876-90d1-136f2546a174-tmp\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.965457 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.965430 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph8vp\" (UniqueName: \"kubernetes.io/projected/4f6eeddb-4e0e-4d5b-8112-16aeb42d258b-kube-api-access-ph8vp\") pod \"multus-mr85c\" (UID: \"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b\") " pod="openshift-multus/multus-mr85c" Jul 24 14:34:21.966421 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:21.966401 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 14:34:21.966523 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:21.966428 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 14:34:21.966523 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:21.966443 2581 projected.go:196] Error preparing data for projected volume kube-api-access-k4gnc for pod openshift-network-diagnostics/network-check-target-hcq7x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:21.966523 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:21.966503 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a448a0f9-4482-497d-8a40-06c479df078f-kube-api-access-k4gnc podName:a448a0f9-4482-497d-8a40-06c479df078f nodeName:}" failed. No retries permitted until 2026-07-24 14:34:22.466482109 +0000 UTC m=+3.003738057 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-k4gnc" (UniqueName: "kubernetes.io/projected/a448a0f9-4482-497d-8a40-06c479df078f-kube-api-access-k4gnc") pod "network-check-target-hcq7x" (UID: "a448a0f9-4482-497d-8a40-06c479df078f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:21.968141 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.968091 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-465nf\" (UniqueName: \"kubernetes.io/projected/ef210e03-663f-4876-90d1-136f2546a174-kube-api-access-465nf\") pod \"tuned-z724g\" (UID: \"ef210e03-663f-4876-90d1-136f2546a174\") " pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:21.968757 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.968711 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw72l\" (UniqueName: \"kubernetes.io/projected/0459058c-9c25-4674-9521-fdc41c238ab7-kube-api-access-jw72l\") pod \"iptables-alerter-vk9p4\" (UID: \"0459058c-9c25-4674-9521-fdc41c238ab7\") " pod="openshift-network-operator/iptables-alerter-vk9p4" Jul 24 14:34:21.971450 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:21.971429 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksh79\" (UniqueName: \"kubernetes.io/projected/76abe981-1c84-4f65-82ff-a837b3e20722-kube-api-access-ksh79\") pod \"node-ca-rrxgj\" (UID: \"76abe981-1c84-4f65-82ff-a837b3e20722\") " pod="openshift-image-registry/node-ca-rrxgj" Jul 24 14:34:22.055911 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.055330 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-host-run-ovn-kubernetes\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.055911 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.055375 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-host-cni-bin\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.055911 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.055400 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0e2d96fe-c8d4-43c3-b840-aa9c83cf6900-registration-dir\") pod \"aws-ebs-csi-driver-node-9x4lb\" (UID: \"0e2d96fe-c8d4-43c3-b840-aa9c83cf6900\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x4lb" Jul 24 14:34:22.055911 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.055427 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dbll\" (UniqueName: \"kubernetes.io/projected/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-kube-api-access-4dbll\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.055911 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.055452 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-host-run-netns\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.055911 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.055475 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-node-log\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.055911 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.055499 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-ovnkube-script-lib\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.055911 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.055528 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-host-kubelet\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.055911 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.055552 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ec152e93-0223-4419-b21a-d325b39654cd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6wsm6\" (UID: \"ec152e93-0223-4419-b21a-d325b39654cd\") " pod="openshift-multus/multus-additional-cni-plugins-6wsm6" Jul 24 14:34:22.055911 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.055580 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0e2d96fe-c8d4-43c3-b840-aa9c83cf6900-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9x4lb\" (UID: \"0e2d96fe-c8d4-43c3-b840-aa9c83cf6900\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x4lb" Jul 24 14:34:22.055911 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.055606 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/94643644-01c1-41e6-b869-ca7f08f2010f-agent-certs\") pod \"konnectivity-agent-ww5lq\" (UID: \"94643644-01c1-41e6-b869-ca7f08f2010f\") " pod="kube-system/konnectivity-agent-ww5lq" Jul 24 14:34:22.055911 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.055630 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-host-cni-netd\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.055911 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.055662 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-ovn-node-metrics-cert\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.055911 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.055686 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7bf205e6-d5a4-4e93-a3c8-e3ea35355044-kubelet-config\") pod \"global-pull-secret-syncer-cwz72\" (UID: \"7bf205e6-d5a4-4e93-a3c8-e3ea35355044\") " pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:34:22.056804 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.055712 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ec152e93-0223-4419-b21a-d325b39654cd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6wsm6\" (UID: \"ec152e93-0223-4419-b21a-d325b39654cd\") " pod="openshift-multus/multus-additional-cni-plugins-6wsm6" Jul 24 14:34:22.056804 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.055741 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df66942e-5c07-46e0-93fe-04ad53865c89-tmp-dir\") pod \"node-resolver-shsqx\" (UID: \"df66942e-5c07-46e0-93fe-04ad53865c89\") " pod="openshift-dns/node-resolver-shsqx" Jul 24 14:34:22.056804 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.055766 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-env-overrides\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.056804 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.055807 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ec152e93-0223-4419-b21a-d325b39654cd-system-cni-dir\") pod \"multus-additional-cni-plugins-6wsm6\" (UID: \"ec152e93-0223-4419-b21a-d325b39654cd\") " pod="openshift-multus/multus-additional-cni-plugins-6wsm6" Jul 24 14:34:22.056804 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.055831 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0e2d96fe-c8d4-43c3-b840-aa9c83cf6900-socket-dir\") pod \"aws-ebs-csi-driver-node-9x4lb\" (UID: \"0e2d96fe-c8d4-43c3-b840-aa9c83cf6900\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x4lb" Jul 24 14:34:22.056804 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.055858 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0e2d96fe-c8d4-43c3-b840-aa9c83cf6900-etc-selinux\") pod \"aws-ebs-csi-driver-node-9x4lb\" (UID: \"0e2d96fe-c8d4-43c3-b840-aa9c83cf6900\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x4lb" Jul 24 14:34:22.056804 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.055869 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-host-run-ovn-kubernetes\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.056804 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.055887 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.056804 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.055912 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0e2d96fe-c8d4-43c3-b840-aa9c83cf6900-sys-fs\") pod \"aws-ebs-csi-driver-node-9x4lb\" (UID: \"0e2d96fe-c8d4-43c3-b840-aa9c83cf6900\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x4lb" Jul 24 14:34:22.056804 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.055935 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbst2\" (UniqueName: \"kubernetes.io/projected/0e2d96fe-c8d4-43c3-b840-aa9c83cf6900-kube-api-access-rbst2\") pod \"aws-ebs-csi-driver-node-9x4lb\" (UID: \"0e2d96fe-c8d4-43c3-b840-aa9c83cf6900\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x4lb" Jul 24 14:34:22.056804 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.055951 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0e2d96fe-c8d4-43c3-b840-aa9c83cf6900-registration-dir\") pod \"aws-ebs-csi-driver-node-9x4lb\" (UID: \"0e2d96fe-c8d4-43c3-b840-aa9c83cf6900\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x4lb" Jul 24 14:34:22.056804 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.055958 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g77h5\" (UniqueName: \"kubernetes.io/projected/df66942e-5c07-46e0-93fe-04ad53865c89-kube-api-access-g77h5\") pod \"node-resolver-shsqx\" (UID: \"df66942e-5c07-46e0-93fe-04ad53865c89\") " pod="openshift-dns/node-resolver-shsqx" Jul 24 14:34:22.056804 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.055980 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/94643644-01c1-41e6-b869-ca7f08f2010f-konnectivity-ca\") pod \"konnectivity-agent-ww5lq\" (UID: \"94643644-01c1-41e6-b869-ca7f08f2010f\") " pod="kube-system/konnectivity-agent-ww5lq" Jul 24 14:34:22.056804 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.056024 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-var-lib-openvswitch\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.057618 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.056050 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-ovnkube-config\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.057618 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.056091 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bjpf\" (UniqueName: \"kubernetes.io/projected/5d6fca35-b619-48ce-9227-1f10e1b2fda1-kube-api-access-5bjpf\") pod \"network-metrics-daemon-wjgg5\" (UID: \"5d6fca35-b619-48ce-9227-1f10e1b2fda1\") " pod="openshift-multus/network-metrics-daemon-wjgg5" Jul 24 14:34:22.057618 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.056117 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ec152e93-0223-4419-b21a-d325b39654cd-cnibin\") pod \"multus-additional-cni-plugins-6wsm6\" (UID: \"ec152e93-0223-4419-b21a-d325b39654cd\") " pod="openshift-multus/multus-additional-cni-plugins-6wsm6" Jul 24 14:34:22.057618 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.056144 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ec152e93-0223-4419-b21a-d325b39654cd-os-release\") pod \"multus-additional-cni-plugins-6wsm6\" (UID: \"ec152e93-0223-4419-b21a-d325b39654cd\") " pod="openshift-multus/multus-additional-cni-plugins-6wsm6" Jul 24 14:34:22.057618 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.056174 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-systemd-units\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.057618 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.055827 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-host-kubelet\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.057618 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.056236 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-host-run-netns\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.057618 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.056285 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-node-log\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.057618 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.056295 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-run-systemd\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.057618 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.056352 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0e2d96fe-c8d4-43c3-b840-aa9c83cf6900-etc-selinux\") pod \"aws-ebs-csi-driver-node-9x4lb\" (UID: \"0e2d96fe-c8d4-43c3-b840-aa9c83cf6900\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x4lb" Jul 24 14:34:22.057618 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.056401 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7bf205e6-d5a4-4e93-a3c8-e3ea35355044-kubelet-config\") pod \"global-pull-secret-syncer-cwz72\" (UID: \"7bf205e6-d5a4-4e93-a3c8-e3ea35355044\") " pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:34:22.057618 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.056411 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.057618 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.056444 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-host-cni-bin\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.057618 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.056513 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0e2d96fe-c8d4-43c3-b840-aa9c83cf6900-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9x4lb\" (UID: \"0e2d96fe-c8d4-43c3-b840-aa9c83cf6900\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x4lb" Jul 24 14:34:22.058192 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.056527 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0e2d96fe-c8d4-43c3-b840-aa9c83cf6900-sys-fs\") pod \"aws-ebs-csi-driver-node-9x4lb\" (UID: \"0e2d96fe-c8d4-43c3-b840-aa9c83cf6900\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x4lb" Jul 24 14:34:22.058192 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.056582 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-var-lib-openvswitch\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.058192 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.057023 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-ovnkube-script-lib\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.058192 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.057099 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ec152e93-0223-4419-b21a-d325b39654cd-cnibin\") pod \"multus-additional-cni-plugins-6wsm6\" (UID: \"ec152e93-0223-4419-b21a-d325b39654cd\") " pod="openshift-multus/multus-additional-cni-plugins-6wsm6" Jul 24 14:34:22.058192 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.057224 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ec152e93-0223-4419-b21a-d325b39654cd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6wsm6\" (UID: \"ec152e93-0223-4419-b21a-d325b39654cd\") " pod="openshift-multus/multus-additional-cni-plugins-6wsm6" Jul 24 14:34:22.058192 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.057331 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ec152e93-0223-4419-b21a-d325b39654cd-os-release\") pod \"multus-additional-cni-plugins-6wsm6\" (UID: \"ec152e93-0223-4419-b21a-d325b39654cd\") " pod="openshift-multus/multus-additional-cni-plugins-6wsm6" Jul 24 14:34:22.058192 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.057383 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-systemd-units\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.058192 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.057497 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/94643644-01c1-41e6-b869-ca7f08f2010f-konnectivity-ca\") pod \"konnectivity-agent-ww5lq\" (UID: \"94643644-01c1-41e6-b869-ca7f08f2010f\") " pod="kube-system/konnectivity-agent-ww5lq" Jul 24 14:34:22.058192 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.057570 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ec152e93-0223-4419-b21a-d325b39654cd-system-cni-dir\") pod \"multus-additional-cni-plugins-6wsm6\" (UID: \"ec152e93-0223-4419-b21a-d325b39654cd\") " pod="openshift-multus/multus-additional-cni-plugins-6wsm6" Jul 24 14:34:22.058192 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.057610 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-ovnkube-config\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.058192 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.057697 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-host-cni-netd\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.058192 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.057730 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0e2d96fe-c8d4-43c3-b840-aa9c83cf6900-socket-dir\") pod \"aws-ebs-csi-driver-node-9x4lb\" (UID: \"0e2d96fe-c8d4-43c3-b840-aa9c83cf6900\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x4lb" Jul 24 14:34:22.058192 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.057745 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df66942e-5c07-46e0-93fe-04ad53865c89-tmp-dir\") pod \"node-resolver-shsqx\" (UID: \"df66942e-5c07-46e0-93fe-04ad53865c89\") " pod="openshift-dns/node-resolver-shsqx" Jul 24 14:34:22.058192 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.056200 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-run-systemd\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.058910 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.057794 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-run-ovn\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.058910 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.057827 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ec152e93-0223-4419-b21a-d325b39654cd-cni-binary-copy\") pod \"multus-additional-cni-plugins-6wsm6\" (UID: \"ec152e93-0223-4419-b21a-d325b39654cd\") " pod="openshift-multus/multus-additional-cni-plugins-6wsm6" Jul 24 14:34:22.058910 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.057921 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-run-ovn\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.058910 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.057953 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-env-overrides\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.058910 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.058069 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-host-slash\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.058910 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.058099 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7bf205e6-d5a4-4e93-a3c8-e3ea35355044-dbus\") pod \"global-pull-secret-syncer-cwz72\" (UID: \"7bf205e6-d5a4-4e93-a3c8-e3ea35355044\") " pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:34:22.058910 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.058126 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d6fca35-b619-48ce-9227-1f10e1b2fda1-metrics-certs\") pod \"network-metrics-daemon-wjgg5\" (UID: \"5d6fca35-b619-48ce-9227-1f10e1b2fda1\") " pod="openshift-multus/network-metrics-daemon-wjgg5" Jul 24 14:34:22.058910 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.058132 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-host-slash\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.058910 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.058158 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ec152e93-0223-4419-b21a-d325b39654cd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6wsm6\" (UID: \"ec152e93-0223-4419-b21a-d325b39654cd\") " pod="openshift-multus/multus-additional-cni-plugins-6wsm6" Jul 24 14:34:22.058910 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.058205 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7bf205e6-d5a4-4e93-a3c8-e3ea35355044-dbus\") pod \"global-pull-secret-syncer-cwz72\" (UID: \"7bf205e6-d5a4-4e93-a3c8-e3ea35355044\") " pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:34:22.058910 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.058231 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-run-openvswitch\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.058910 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.058263 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-log-socket\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.058910 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.058273 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-run-openvswitch\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.058910 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:22.058235 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:22.058910 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.058292 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rn8h\" (UniqueName: \"kubernetes.io/projected/ec152e93-0223-4419-b21a-d325b39654cd-kube-api-access-6rn8h\") pod \"multus-additional-cni-plugins-6wsm6\" (UID: \"ec152e93-0223-4419-b21a-d325b39654cd\") " pod="openshift-multus/multus-additional-cni-plugins-6wsm6" Jul 24 14:34:22.059735 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.058336 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/df66942e-5c07-46e0-93fe-04ad53865c89-hosts-file\") pod \"node-resolver-shsqx\" (UID: \"df66942e-5c07-46e0-93fe-04ad53865c89\") " pod="openshift-dns/node-resolver-shsqx" Jul 24 14:34:22.059735 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:22.058359 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d6fca35-b619-48ce-9227-1f10e1b2fda1-metrics-certs podName:5d6fca35-b619-48ce-9227-1f10e1b2fda1 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:22.558337483 +0000 UTC m=+3.095593434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d6fca35-b619-48ce-9227-1f10e1b2fda1-metrics-certs") pod "network-metrics-daemon-wjgg5" (UID: "5d6fca35-b619-48ce-9227-1f10e1b2fda1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:22.059735 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.058386 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/df66942e-5c07-46e0-93fe-04ad53865c89-hosts-file\") pod \"node-resolver-shsqx\" (UID: \"df66942e-5c07-46e0-93fe-04ad53865c89\") " pod="openshift-dns/node-resolver-shsqx" Jul 24 14:34:22.059735 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.058392 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ec152e93-0223-4419-b21a-d325b39654cd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6wsm6\" (UID: \"ec152e93-0223-4419-b21a-d325b39654cd\") " pod="openshift-multus/multus-additional-cni-plugins-6wsm6" Jul 24 14:34:22.059735 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.058356 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-log-socket\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.059735 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.058409 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ec152e93-0223-4419-b21a-d325b39654cd-cni-binary-copy\") pod \"multus-additional-cni-plugins-6wsm6\" (UID: \"ec152e93-0223-4419-b21a-d325b39654cd\") " pod="openshift-multus/multus-additional-cni-plugins-6wsm6" Jul 24 14:34:22.059735 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.058430 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0e2d96fe-c8d4-43c3-b840-aa9c83cf6900-device-dir\") pod \"aws-ebs-csi-driver-node-9x4lb\" (UID: \"0e2d96fe-c8d4-43c3-b840-aa9c83cf6900\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x4lb" Jul 24 14:34:22.059735 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.058477 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-etc-openvswitch\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.059735 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.058506 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7bf205e6-d5a4-4e93-a3c8-e3ea35355044-original-pull-secret\") pod \"global-pull-secret-syncer-cwz72\" (UID: \"7bf205e6-d5a4-4e93-a3c8-e3ea35355044\") " pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:34:22.059735 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:22.058601 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:22.059735 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.058611 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0e2d96fe-c8d4-43c3-b840-aa9c83cf6900-device-dir\") pod \"aws-ebs-csi-driver-node-9x4lb\" (UID: \"0e2d96fe-c8d4-43c3-b840-aa9c83cf6900\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x4lb" Jul 24 14:34:22.059735 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:22.058650 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bf205e6-d5a4-4e93-a3c8-e3ea35355044-original-pull-secret podName:7bf205e6-d5a4-4e93-a3c8-e3ea35355044 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:22.558634552 +0000 UTC m=+3.095890489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7bf205e6-d5a4-4e93-a3c8-e3ea35355044-original-pull-secret") pod "global-pull-secret-syncer-cwz72" (UID: "7bf205e6-d5a4-4e93-a3c8-e3ea35355044") : object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:22.059735 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.058665 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-etc-openvswitch\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.060438 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.059153 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ec152e93-0223-4419-b21a-d325b39654cd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6wsm6\" (UID: \"ec152e93-0223-4419-b21a-d325b39654cd\") " pod="openshift-multus/multus-additional-cni-plugins-6wsm6" Jul 24 14:34:22.060438 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.060270 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/94643644-01c1-41e6-b869-ca7f08f2010f-agent-certs\") pod \"konnectivity-agent-ww5lq\" (UID: \"94643644-01c1-41e6-b869-ca7f08f2010f\") " pod="kube-system/konnectivity-agent-ww5lq" Jul 24 14:34:22.061270 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.061211 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-ovn-node-metrics-cert\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.066317 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.066268 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dbll\" (UniqueName: \"kubernetes.io/projected/73267cf4-76dd-4bfa-b6a1-0cffba540a1e-kube-api-access-4dbll\") pod \"ovnkube-node-4cffq\" (UID: \"73267cf4-76dd-4bfa-b6a1-0cffba540a1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.068364 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.068340 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bjpf\" (UniqueName: \"kubernetes.io/projected/5d6fca35-b619-48ce-9227-1f10e1b2fda1-kube-api-access-5bjpf\") pod \"network-metrics-daemon-wjgg5\" (UID: \"5d6fca35-b619-48ce-9227-1f10e1b2fda1\") " pod="openshift-multus/network-metrics-daemon-wjgg5" Jul 24 14:34:22.073151 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.073126 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbst2\" (UniqueName: \"kubernetes.io/projected/0e2d96fe-c8d4-43c3-b840-aa9c83cf6900-kube-api-access-rbst2\") pod \"aws-ebs-csi-driver-node-9x4lb\" (UID: \"0e2d96fe-c8d4-43c3-b840-aa9c83cf6900\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x4lb" Jul 24 14:34:22.077867 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.077841 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rn8h\" (UniqueName: \"kubernetes.io/projected/ec152e93-0223-4419-b21a-d325b39654cd-kube-api-access-6rn8h\") pod \"multus-additional-cni-plugins-6wsm6\" (UID: \"ec152e93-0223-4419-b21a-d325b39654cd\") " pod="openshift-multus/multus-additional-cni-plugins-6wsm6" Jul 24 14:34:22.079427 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.079406 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g77h5\" (UniqueName: \"kubernetes.io/projected/df66942e-5c07-46e0-93fe-04ad53865c89-kube-api-access-g77h5\") pod \"node-resolver-shsqx\" (UID: \"df66942e-5c07-46e0-93fe-04ad53865c89\") " pod="openshift-dns/node-resolver-shsqx" Jul 24 14:34:22.115469 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.115411 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-12.ec2.internal" event={"ID":"c18d0a8ddba5724c2819ddd49f257f64","Type":"ContainerStarted","Data":"ae7394e47e497fd6a638e036cc51b4eed6bbba33acd03cc5a4ca40f9b9249db0"} Jul 24 14:34:22.118083 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.118052 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal" event={"ID":"bcce044147adca679fede2754bc49a60","Type":"ContainerStarted","Data":"5165cbed5243c27fd103546d8626bd13b10e937cfb6f36c9f18c5d2ead7f4fd0"} Jul 24 14:34:22.140503 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.140475 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z724g" Jul 24 14:34:22.150759 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:22.150732 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef210e03_663f_4876_90d1_136f2546a174.slice/crio-7b3ad49b4bc76c8943f8823596c0e470f10894765d1c8f868e14f0f687a7a2a0 WatchSource:0}: Error finding container 7b3ad49b4bc76c8943f8823596c0e470f10894765d1c8f868e14f0f687a7a2a0: Status 404 returned error can't find the container with id 7b3ad49b4bc76c8943f8823596c0e470f10894765d1c8f868e14f0f687a7a2a0 Jul 24 14:34:22.151560 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.151509 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vk9p4" Jul 24 14:34:22.160855 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.160828 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x4lb" Jul 24 14:34:22.162805 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:22.162777 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0459058c_9c25_4674_9521_fdc41c238ab7.slice/crio-d06b1ef2a79c957b8ad75be8f900c46c52a1940a2ec5aa200b736470fdfb0f56 WatchSource:0}: Error finding container d06b1ef2a79c957b8ad75be8f900c46c52a1940a2ec5aa200b736470fdfb0f56: Status 404 returned error can't find the container with id d06b1ef2a79c957b8ad75be8f900c46c52a1940a2ec5aa200b736470fdfb0f56 Jul 24 14:34:22.168226 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.168057 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rrxgj" Jul 24 14:34:22.172007 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:22.171981 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e2d96fe_c8d4_43c3_b840_aa9c83cf6900.slice/crio-68d501cf1090f65a7aec6876204436200d896d805fcfa04cece32e59c3adda7f WatchSource:0}: Error finding container 68d501cf1090f65a7aec6876204436200d896d805fcfa04cece32e59c3adda7f: Status 404 returned error can't find the container with id 68d501cf1090f65a7aec6876204436200d896d805fcfa04cece32e59c3adda7f Jul 24 14:34:22.177763 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.177741 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mr85c" Jul 24 14:34:22.178268 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:22.178248 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76abe981_1c84_4f65_82ff_a837b3e20722.slice/crio-bda38cb332eced115ceffa5dba91eba87d1c71764539c90aecc01098b90f9ff5 WatchSource:0}: Error finding container bda38cb332eced115ceffa5dba91eba87d1c71764539c90aecc01098b90f9ff5: Status 404 returned error can't find the container with id bda38cb332eced115ceffa5dba91eba87d1c71764539c90aecc01098b90f9ff5 Jul 24 14:34:22.185951 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.185927 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-shsqx" Jul 24 14:34:22.188350 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:22.188327 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f6eeddb_4e0e_4d5b_8112_16aeb42d258b.slice/crio-f0e19552d7faed0b6ec524b946982c62ea883ec88040b1f0ba020fe422ef625c WatchSource:0}: Error finding container f0e19552d7faed0b6ec524b946982c62ea883ec88040b1f0ba020fe422ef625c: Status 404 returned error can't find the container with id f0e19552d7faed0b6ec524b946982c62ea883ec88040b1f0ba020fe422ef625c Jul 24 14:34:22.195901 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.195880 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ww5lq" Jul 24 14:34:22.196434 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:22.196414 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf66942e_5c07_46e0_93fe_04ad53865c89.slice/crio-47520d07691967f81dfb1282682a5504231aca13748e0c11baaa7399e340fc59 WatchSource:0}: Error finding container 47520d07691967f81dfb1282682a5504231aca13748e0c11baaa7399e340fc59: Status 404 returned error can't find the container with id 47520d07691967f81dfb1282682a5504231aca13748e0c11baaa7399e340fc59 Jul 24 14:34:22.204695 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.204561 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:22.206740 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:22.206714 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94643644_01c1_41e6_b869_ca7f08f2010f.slice/crio-d9ffc4df41f31c67760e79196d673437ddb08c32602220faf01255f6ac3e1484 WatchSource:0}: Error finding container d9ffc4df41f31c67760e79196d673437ddb08c32602220faf01255f6ac3e1484: Status 404 returned error can't find the container with id d9ffc4df41f31c67760e79196d673437ddb08c32602220faf01255f6ac3e1484 Jul 24 14:34:22.210332 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.210314 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6wsm6" Jul 24 14:34:22.220301 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:22.220278 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73267cf4_76dd_4bfa_b6a1_0cffba540a1e.slice/crio-fcbd5ed0fc1a182ff7924a116a29d596e129a472f3a03dd4f5be0436e105b68e WatchSource:0}: Error finding container fcbd5ed0fc1a182ff7924a116a29d596e129a472f3a03dd4f5be0436e105b68e: Status 404 returned error can't find the container with id fcbd5ed0fc1a182ff7924a116a29d596e129a472f3a03dd4f5be0436e105b68e Jul 24 14:34:22.223842 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:22.223802 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec152e93_0223_4419_b21a_d325b39654cd.slice/crio-451037eccc04380b6e7277dff14337a4332f80873c662134caabad6333a5a86b WatchSource:0}: Error finding container 451037eccc04380b6e7277dff14337a4332f80873c662134caabad6333a5a86b: Status 404 returned error can't find the container with id 451037eccc04380b6e7277dff14337a4332f80873c662134caabad6333a5a86b Jul 24 14:34:22.261396 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.261154 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 14:34:22.563771 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.563733 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d6fca35-b619-48ce-9227-1f10e1b2fda1-metrics-certs\") pod \"network-metrics-daemon-wjgg5\" (UID: \"5d6fca35-b619-48ce-9227-1f10e1b2fda1\") " pod="openshift-multus/network-metrics-daemon-wjgg5" Jul 24 14:34:22.564016 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.563783 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4gnc\" (UniqueName: \"kubernetes.io/projected/a448a0f9-4482-497d-8a40-06c479df078f-kube-api-access-k4gnc\") pod \"network-check-target-hcq7x\" (UID: \"a448a0f9-4482-497d-8a40-06c479df078f\") " pod="openshift-network-diagnostics/network-check-target-hcq7x" Jul 24 14:34:22.564016 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.563814 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7bf205e6-d5a4-4e93-a3c8-e3ea35355044-original-pull-secret\") pod \"global-pull-secret-syncer-cwz72\" (UID: \"7bf205e6-d5a4-4e93-a3c8-e3ea35355044\") " pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:34:22.564016 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:22.563913 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:22.564016 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:22.563959 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 14:34:22.564016 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:22.563976 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bf205e6-d5a4-4e93-a3c8-e3ea35355044-original-pull-secret podName:7bf205e6-d5a4-4e93-a3c8-e3ea35355044 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:23.563957438 +0000 UTC m=+4.101213372 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7bf205e6-d5a4-4e93-a3c8-e3ea35355044-original-pull-secret") pod "global-pull-secret-syncer-cwz72" (UID: "7bf205e6-d5a4-4e93-a3c8-e3ea35355044") : object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:22.564016 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:22.563985 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 14:34:22.564016 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:22.563997 2581 projected.go:196] Error preparing data for projected volume kube-api-access-k4gnc for pod openshift-network-diagnostics/network-check-target-hcq7x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:22.564016 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:22.563913 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:22.564476 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:22.564056 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a448a0f9-4482-497d-8a40-06c479df078f-kube-api-access-k4gnc podName:a448a0f9-4482-497d-8a40-06c479df078f nodeName:}" failed. No retries permitted until 2026-07-24 14:34:23.564039161 +0000 UTC m=+4.101295110 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-k4gnc" (UniqueName: "kubernetes.io/projected/a448a0f9-4482-497d-8a40-06c479df078f-kube-api-access-k4gnc") pod "network-check-target-hcq7x" (UID: "a448a0f9-4482-497d-8a40-06c479df078f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:22.564476 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:22.564077 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d6fca35-b619-48ce-9227-1f10e1b2fda1-metrics-certs podName:5d6fca35-b619-48ce-9227-1f10e1b2fda1 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:23.564068871 +0000 UTC m=+4.101324818 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d6fca35-b619-48ce-9227-1f10e1b2fda1-metrics-certs") pod "network-metrics-daemon-wjgg5" (UID: "5d6fca35-b619-48ce-9227-1f10e1b2fda1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:22.878508 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.878388 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 14:29:22 +0000 UTC" deadline="2028-02-23 09:16:19.532515655 +0000 UTC" Jul 24 14:34:22.878508 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:22.878455 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13890h41m56.654064891s" Jul 24 14:34:23.106452 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:23.106415 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjgg5" Jul 24 14:34:23.106633 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:23.106558 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjgg5" podUID="5d6fca35-b619-48ce-9227-1f10e1b2fda1" Jul 24 14:34:23.106808 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:23.106784 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:34:23.106923 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:23.106901 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwz72" podUID="7bf205e6-d5a4-4e93-a3c8-e3ea35355044" Jul 24 14:34:23.106992 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:23.106968 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcq7x" Jul 24 14:34:23.107084 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:23.107060 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcq7x" podUID="a448a0f9-4482-497d-8a40-06c479df078f" Jul 24 14:34:23.123994 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:23.123960 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6wsm6" event={"ID":"ec152e93-0223-4419-b21a-d325b39654cd","Type":"ContainerStarted","Data":"451037eccc04380b6e7277dff14337a4332f80873c662134caabad6333a5a86b"} Jul 24 14:34:23.126001 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:23.125970 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ww5lq" event={"ID":"94643644-01c1-41e6-b869-ca7f08f2010f","Type":"ContainerStarted","Data":"d9ffc4df41f31c67760e79196d673437ddb08c32602220faf01255f6ac3e1484"} Jul 24 14:34:23.128050 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:23.128022 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-shsqx" event={"ID":"df66942e-5c07-46e0-93fe-04ad53865c89","Type":"ContainerStarted","Data":"47520d07691967f81dfb1282682a5504231aca13748e0c11baaa7399e340fc59"} Jul 24 14:34:23.130041 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:23.129938 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rrxgj" event={"ID":"76abe981-1c84-4f65-82ff-a837b3e20722","Type":"ContainerStarted","Data":"bda38cb332eced115ceffa5dba91eba87d1c71764539c90aecc01098b90f9ff5"} Jul 24 14:34:23.132029 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:23.131937 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x4lb" event={"ID":"0e2d96fe-c8d4-43c3-b840-aa9c83cf6900","Type":"ContainerStarted","Data":"68d501cf1090f65a7aec6876204436200d896d805fcfa04cece32e59c3adda7f"} Jul 24 14:34:23.134228 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:23.134052 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" event={"ID":"73267cf4-76dd-4bfa-b6a1-0cffba540a1e","Type":"ContainerStarted","Data":"fcbd5ed0fc1a182ff7924a116a29d596e129a472f3a03dd4f5be0436e105b68e"} Jul 24 14:34:23.136161 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:23.136003 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mr85c" event={"ID":"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b","Type":"ContainerStarted","Data":"f0e19552d7faed0b6ec524b946982c62ea883ec88040b1f0ba020fe422ef625c"} Jul 24 14:34:23.137520 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:23.137464 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vk9p4" event={"ID":"0459058c-9c25-4674-9521-fdc41c238ab7","Type":"ContainerStarted","Data":"d06b1ef2a79c957b8ad75be8f900c46c52a1940a2ec5aa200b736470fdfb0f56"} Jul 24 14:34:23.139352 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:23.139232 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z724g" event={"ID":"ef210e03-663f-4876-90d1-136f2546a174","Type":"ContainerStarted","Data":"7b3ad49b4bc76c8943f8823596c0e470f10894765d1c8f868e14f0f687a7a2a0"} Jul 24 14:34:23.572823 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:23.572781 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d6fca35-b619-48ce-9227-1f10e1b2fda1-metrics-certs\") pod \"network-metrics-daemon-wjgg5\" (UID: \"5d6fca35-b619-48ce-9227-1f10e1b2fda1\") " pod="openshift-multus/network-metrics-daemon-wjgg5" Jul 24 14:34:23.573029 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:23.572853 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4gnc\" (UniqueName: \"kubernetes.io/projected/a448a0f9-4482-497d-8a40-06c479df078f-kube-api-access-k4gnc\") pod \"network-check-target-hcq7x\" (UID: \"a448a0f9-4482-497d-8a40-06c479df078f\") " pod="openshift-network-diagnostics/network-check-target-hcq7x" Jul 24 14:34:23.573029 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:23.572884 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7bf205e6-d5a4-4e93-a3c8-e3ea35355044-original-pull-secret\") pod \"global-pull-secret-syncer-cwz72\" (UID: \"7bf205e6-d5a4-4e93-a3c8-e3ea35355044\") " pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:34:23.573029 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:23.572920 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:23.573029 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:23.572992 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d6fca35-b619-48ce-9227-1f10e1b2fda1-metrics-certs podName:5d6fca35-b619-48ce-9227-1f10e1b2fda1 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:25.572970001 +0000 UTC m=+6.110225958 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d6fca35-b619-48ce-9227-1f10e1b2fda1-metrics-certs") pod "network-metrics-daemon-wjgg5" (UID: "5d6fca35-b619-48ce-9227-1f10e1b2fda1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:23.573029 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:23.573009 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:23.573351 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:23.573052 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bf205e6-d5a4-4e93-a3c8-e3ea35355044-original-pull-secret podName:7bf205e6-d5a4-4e93-a3c8-e3ea35355044 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:25.573037497 +0000 UTC m=+6.110293429 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7bf205e6-d5a4-4e93-a3c8-e3ea35355044-original-pull-secret") pod "global-pull-secret-syncer-cwz72" (UID: "7bf205e6-d5a4-4e93-a3c8-e3ea35355044") : object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:23.573351 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:23.573057 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 14:34:23.573351 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:23.573087 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 14:34:23.573351 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:23.573103 2581 projected.go:196] Error preparing data for projected volume kube-api-access-k4gnc for pod openshift-network-diagnostics/network-check-target-hcq7x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:23.573351 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:23.573157 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a448a0f9-4482-497d-8a40-06c479df078f-kube-api-access-k4gnc podName:a448a0f9-4482-497d-8a40-06c479df078f nodeName:}" failed. No retries permitted until 2026-07-24 14:34:25.573138612 +0000 UTC m=+6.110394549 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-k4gnc" (UniqueName: "kubernetes.io/projected/a448a0f9-4482-497d-8a40-06c479df078f-kube-api-access-k4gnc") pod "network-check-target-hcq7x" (UID: "a448a0f9-4482-497d-8a40-06c479df078f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:23.879136 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:23.879033 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 14:29:22 +0000 UTC" deadline="2028-01-17 03:11:43.893033911 +0000 UTC" Jul 24 14:34:23.879136 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:23.879076 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12996h37m20.013963081s" Jul 24 14:34:25.106851 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:25.106817 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjgg5" Jul 24 14:34:25.107405 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:25.106963 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjgg5" podUID="5d6fca35-b619-48ce-9227-1f10e1b2fda1" Jul 24 14:34:25.107405 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:25.107366 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcq7x" Jul 24 14:34:25.107525 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:25.107461 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcq7x" podUID="a448a0f9-4482-497d-8a40-06c479df078f" Jul 24 14:34:25.107525 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:25.107517 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:34:25.107636 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:25.107593 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwz72" podUID="7bf205e6-d5a4-4e93-a3c8-e3ea35355044" Jul 24 14:34:25.589106 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:25.589067 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d6fca35-b619-48ce-9227-1f10e1b2fda1-metrics-certs\") pod \"network-metrics-daemon-wjgg5\" (UID: \"5d6fca35-b619-48ce-9227-1f10e1b2fda1\") " pod="openshift-multus/network-metrics-daemon-wjgg5" Jul 24 14:34:25.589325 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:25.589126 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4gnc\" (UniqueName: \"kubernetes.io/projected/a448a0f9-4482-497d-8a40-06c479df078f-kube-api-access-k4gnc\") pod \"network-check-target-hcq7x\" (UID: \"a448a0f9-4482-497d-8a40-06c479df078f\") " pod="openshift-network-diagnostics/network-check-target-hcq7x" Jul 24 14:34:25.589325 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:25.589158 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7bf205e6-d5a4-4e93-a3c8-e3ea35355044-original-pull-secret\") pod \"global-pull-secret-syncer-cwz72\" (UID: \"7bf205e6-d5a4-4e93-a3c8-e3ea35355044\") " pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:34:25.589442 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:25.589326 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:25.589442 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:25.589391 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bf205e6-d5a4-4e93-a3c8-e3ea35355044-original-pull-secret podName:7bf205e6-d5a4-4e93-a3c8-e3ea35355044 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:29.589370693 +0000 UTC m=+10.126626632 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7bf205e6-d5a4-4e93-a3c8-e3ea35355044-original-pull-secret") pod "global-pull-secret-syncer-cwz72" (UID: "7bf205e6-d5a4-4e93-a3c8-e3ea35355044") : object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:25.589822 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:25.589797 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:25.589909 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:25.589862 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d6fca35-b619-48ce-9227-1f10e1b2fda1-metrics-certs podName:5d6fca35-b619-48ce-9227-1f10e1b2fda1 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:29.589843401 +0000 UTC m=+10.127099332 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d6fca35-b619-48ce-9227-1f10e1b2fda1-metrics-certs") pod "network-metrics-daemon-wjgg5" (UID: "5d6fca35-b619-48ce-9227-1f10e1b2fda1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:25.589982 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:25.589951 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 14:34:25.589982 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:25.589969 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 14:34:25.590080 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:25.589984 2581 projected.go:196] Error preparing data for projected volume kube-api-access-k4gnc for pod openshift-network-diagnostics/network-check-target-hcq7x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:25.590080 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:25.590025 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a448a0f9-4482-497d-8a40-06c479df078f-kube-api-access-k4gnc podName:a448a0f9-4482-497d-8a40-06c479df078f nodeName:}" failed. No retries permitted until 2026-07-24 14:34:29.590010172 +0000 UTC m=+10.127266108 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-k4gnc" (UniqueName: "kubernetes.io/projected/a448a0f9-4482-497d-8a40-06c479df078f-kube-api-access-k4gnc") pod "network-check-target-hcq7x" (UID: "a448a0f9-4482-497d-8a40-06c479df078f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:27.107415 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:27.107376 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjgg5" Jul 24 14:34:27.107928 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:27.107422 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:34:27.107928 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:27.107422 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcq7x" Jul 24 14:34:27.107928 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:27.107532 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjgg5" podUID="5d6fca35-b619-48ce-9227-1f10e1b2fda1" Jul 24 14:34:27.107928 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:27.107693 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwz72" podUID="7bf205e6-d5a4-4e93-a3c8-e3ea35355044" Jul 24 14:34:27.107928 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:27.107786 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcq7x" podUID="a448a0f9-4482-497d-8a40-06c479df078f" Jul 24 14:34:29.106444 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:29.106409 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjgg5" Jul 24 14:34:29.106444 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:29.106442 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:34:29.107090 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:29.106426 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcq7x" Jul 24 14:34:29.107090 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:29.106568 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjgg5" podUID="5d6fca35-b619-48ce-9227-1f10e1b2fda1" Jul 24 14:34:29.107090 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:29.106716 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcq7x" podUID="a448a0f9-4482-497d-8a40-06c479df078f" Jul 24 14:34:29.107090 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:29.106827 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwz72" podUID="7bf205e6-d5a4-4e93-a3c8-e3ea35355044" Jul 24 14:34:29.623015 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:29.622602 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d6fca35-b619-48ce-9227-1f10e1b2fda1-metrics-certs\") pod \"network-metrics-daemon-wjgg5\" (UID: \"5d6fca35-b619-48ce-9227-1f10e1b2fda1\") " pod="openshift-multus/network-metrics-daemon-wjgg5" Jul 24 14:34:29.623015 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:29.622665 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4gnc\" (UniqueName: \"kubernetes.io/projected/a448a0f9-4482-497d-8a40-06c479df078f-kube-api-access-k4gnc\") pod \"network-check-target-hcq7x\" (UID: \"a448a0f9-4482-497d-8a40-06c479df078f\") " pod="openshift-network-diagnostics/network-check-target-hcq7x" Jul 24 14:34:29.623015 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:29.622696 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7bf205e6-d5a4-4e93-a3c8-e3ea35355044-original-pull-secret\") pod \"global-pull-secret-syncer-cwz72\" (UID: \"7bf205e6-d5a4-4e93-a3c8-e3ea35355044\") " pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:34:29.623015 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:29.622747 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:29.623015 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:29.622807 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:29.623015 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:29.622815 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d6fca35-b619-48ce-9227-1f10e1b2fda1-metrics-certs podName:5d6fca35-b619-48ce-9227-1f10e1b2fda1 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:37.622795058 +0000 UTC m=+18.160051015 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d6fca35-b619-48ce-9227-1f10e1b2fda1-metrics-certs") pod "network-metrics-daemon-wjgg5" (UID: "5d6fca35-b619-48ce-9227-1f10e1b2fda1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:29.623015 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:29.622842 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bf205e6-d5a4-4e93-a3c8-e3ea35355044-original-pull-secret podName:7bf205e6-d5a4-4e93-a3c8-e3ea35355044 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:37.622831751 +0000 UTC m=+18.160087683 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7bf205e6-d5a4-4e93-a3c8-e3ea35355044-original-pull-secret") pod "global-pull-secret-syncer-cwz72" (UID: "7bf205e6-d5a4-4e93-a3c8-e3ea35355044") : object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:29.623015 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:29.622923 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 14:34:29.623015 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:29.622938 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 14:34:29.623015 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:29.622950 2581 projected.go:196] Error preparing data for projected volume kube-api-access-k4gnc for pod openshift-network-diagnostics/network-check-target-hcq7x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:29.623015 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:29.622982 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a448a0f9-4482-497d-8a40-06c479df078f-kube-api-access-k4gnc podName:a448a0f9-4482-497d-8a40-06c479df078f nodeName:}" failed. No retries permitted until 2026-07-24 14:34:37.622972344 +0000 UTC m=+18.160228279 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-k4gnc" (UniqueName: "kubernetes.io/projected/a448a0f9-4482-497d-8a40-06c479df078f-kube-api-access-k4gnc") pod "network-check-target-hcq7x" (UID: "a448a0f9-4482-497d-8a40-06c479df078f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:31.107301 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:31.107226 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcq7x" Jul 24 14:34:31.107766 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:31.107233 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjgg5" Jul 24 14:34:31.107766 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:31.107366 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:34:31.107766 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:31.107357 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcq7x" podUID="a448a0f9-4482-497d-8a40-06c479df078f" Jul 24 14:34:31.107766 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:31.107444 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjgg5" podUID="5d6fca35-b619-48ce-9227-1f10e1b2fda1" Jul 24 14:34:31.107766 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:31.107514 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwz72" podUID="7bf205e6-d5a4-4e93-a3c8-e3ea35355044" Jul 24 14:34:33.107132 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:33.107102 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcq7x" Jul 24 14:34:33.107132 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:33.107130 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:34:33.107683 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:33.107102 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjgg5" Jul 24 14:34:33.107683 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:33.107314 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcq7x" podUID="a448a0f9-4482-497d-8a40-06c479df078f" Jul 24 14:34:33.107683 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:33.107470 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjgg5" podUID="5d6fca35-b619-48ce-9227-1f10e1b2fda1" Jul 24 14:34:33.107683 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:33.107566 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwz72" podUID="7bf205e6-d5a4-4e93-a3c8-e3ea35355044" Jul 24 14:34:35.106372 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:35.106340 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:34:35.106372 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:35.106359 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcq7x" Jul 24 14:34:35.106803 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:35.106346 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjgg5" Jul 24 14:34:35.106803 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:35.106454 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwz72" podUID="7bf205e6-d5a4-4e93-a3c8-e3ea35355044" Jul 24 14:34:35.106803 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:35.106574 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjgg5" podUID="5d6fca35-b619-48ce-9227-1f10e1b2fda1" Jul 24 14:34:35.106803 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:35.106654 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcq7x" podUID="a448a0f9-4482-497d-8a40-06c479df078f" Jul 24 14:34:37.107133 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:37.107107 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:34:37.107459 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:37.107107 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjgg5" Jul 24 14:34:37.107459 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:37.107213 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwz72" podUID="7bf205e6-d5a4-4e93-a3c8-e3ea35355044" Jul 24 14:34:37.107459 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:37.107273 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjgg5" podUID="5d6fca35-b619-48ce-9227-1f10e1b2fda1" Jul 24 14:34:37.107459 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:37.107107 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcq7x" Jul 24 14:34:37.107459 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:37.107327 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcq7x" podUID="a448a0f9-4482-497d-8a40-06c479df078f" Jul 24 14:34:37.683219 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:37.683186 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d6fca35-b619-48ce-9227-1f10e1b2fda1-metrics-certs\") pod \"network-metrics-daemon-wjgg5\" (UID: \"5d6fca35-b619-48ce-9227-1f10e1b2fda1\") " pod="openshift-multus/network-metrics-daemon-wjgg5" Jul 24 14:34:37.683497 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:37.683228 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4gnc\" (UniqueName: \"kubernetes.io/projected/a448a0f9-4482-497d-8a40-06c479df078f-kube-api-access-k4gnc\") pod \"network-check-target-hcq7x\" (UID: \"a448a0f9-4482-497d-8a40-06c479df078f\") " pod="openshift-network-diagnostics/network-check-target-hcq7x" Jul 24 14:34:37.683497 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:37.683257 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7bf205e6-d5a4-4e93-a3c8-e3ea35355044-original-pull-secret\") pod \"global-pull-secret-syncer-cwz72\" (UID: \"7bf205e6-d5a4-4e93-a3c8-e3ea35355044\") " pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:34:37.683497 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:37.683350 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:37.683497 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:37.683363 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 14:34:37.683497 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:37.683384 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 14:34:37.683497 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:37.683398 2581 projected.go:196] Error preparing data for projected volume kube-api-access-k4gnc for pod openshift-network-diagnostics/network-check-target-hcq7x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:37.683497 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:37.683349 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:37.683497 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:37.683398 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bf205e6-d5a4-4e93-a3c8-e3ea35355044-original-pull-secret podName:7bf205e6-d5a4-4e93-a3c8-e3ea35355044 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:53.68338209 +0000 UTC m=+34.220638021 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7bf205e6-d5a4-4e93-a3c8-e3ea35355044-original-pull-secret") pod "global-pull-secret-syncer-cwz72" (UID: "7bf205e6-d5a4-4e93-a3c8-e3ea35355044") : object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:37.683497 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:37.683492 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a448a0f9-4482-497d-8a40-06c479df078f-kube-api-access-k4gnc podName:a448a0f9-4482-497d-8a40-06c479df078f nodeName:}" failed. No retries permitted until 2026-07-24 14:34:53.683475279 +0000 UTC m=+34.220731210 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-k4gnc" (UniqueName: "kubernetes.io/projected/a448a0f9-4482-497d-8a40-06c479df078f-kube-api-access-k4gnc") pod "network-check-target-hcq7x" (UID: "a448a0f9-4482-497d-8a40-06c479df078f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:37.683497 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:37.683505 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d6fca35-b619-48ce-9227-1f10e1b2fda1-metrics-certs podName:5d6fca35-b619-48ce-9227-1f10e1b2fda1 nodeName:}" failed. No retries permitted until 2026-07-24 14:34:53.68349811 +0000 UTC m=+34.220754040 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d6fca35-b619-48ce-9227-1f10e1b2fda1-metrics-certs") pod "network-metrics-daemon-wjgg5" (UID: "5d6fca35-b619-48ce-9227-1f10e1b2fda1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:39.106259 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:39.106232 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcq7x" Jul 24 14:34:39.106700 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:39.106232 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:34:39.106700 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:39.106328 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcq7x" podUID="a448a0f9-4482-497d-8a40-06c479df078f" Jul 24 14:34:39.106700 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:39.106341 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjgg5" Jul 24 14:34:39.106700 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:39.106436 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwz72" podUID="7bf205e6-d5a4-4e93-a3c8-e3ea35355044" Jul 24 14:34:39.106700 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:39.106522 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjgg5" podUID="5d6fca35-b619-48ce-9227-1f10e1b2fda1" Jul 24 14:34:41.107167 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:41.107017 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:34:41.107461 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:41.107035 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjgg5" Jul 24 14:34:41.107461 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:41.107250 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwz72" podUID="7bf205e6-d5a4-4e93-a3c8-e3ea35355044" Jul 24 14:34:41.107461 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:41.107044 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcq7x" Jul 24 14:34:41.107461 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:41.107319 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjgg5" podUID="5d6fca35-b619-48ce-9227-1f10e1b2fda1" Jul 24 14:34:41.107461 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:41.107399 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcq7x" podUID="a448a0f9-4482-497d-8a40-06c479df078f" Jul 24 14:34:42.189142 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:42.188936 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mr85c" event={"ID":"4f6eeddb-4e0e-4d5b-8112-16aeb42d258b","Type":"ContainerStarted","Data":"48e7f433428b60d97097bd4d48bf5de8d08f2b6accf70bf369641ba6d4548b11"} Jul 24 14:34:42.190591 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:42.190563 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z724g" event={"ID":"ef210e03-663f-4876-90d1-136f2546a174","Type":"ContainerStarted","Data":"f0bde00f47c9950ab5f0ccd920760183caa9d399b95b163d344bbf173783ce39"} Jul 24 14:34:42.191881 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:42.191862 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-12.ec2.internal" event={"ID":"c18d0a8ddba5724c2819ddd49f257f64","Type":"ContainerStarted","Data":"90cd60a2124849159bfeb5475d92564c8b1b46ea486b33964d6c6afebd7950f0"} Jul 24 14:34:42.193460 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:42.193439 2581 generic.go:356] "Generic (PLEG): container finished" podID="ec152e93-0223-4419-b21a-d325b39654cd" containerID="28310bbee72bf0ef579f43340afd57cb4247c6e31cff751734b0c16bb9b27f2e" exitCode=0 Jul 24 14:34:42.193562 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:42.193469 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6wsm6" event={"ID":"ec152e93-0223-4419-b21a-d325b39654cd","Type":"ContainerDied","Data":"28310bbee72bf0ef579f43340afd57cb4247c6e31cff751734b0c16bb9b27f2e"} Jul 24 14:34:42.195056 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:42.195036 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ww5lq" event={"ID":"94643644-01c1-41e6-b869-ca7f08f2010f","Type":"ContainerStarted","Data":"bc4e1b150e141cc2ee23f3743dd68825dfa2d883bfffdc927a4edbfa6482b2d1"} Jul 24 14:34:42.196524 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:42.196502 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-shsqx" event={"ID":"df66942e-5c07-46e0-93fe-04ad53865c89","Type":"ContainerStarted","Data":"96061e2fb1d755b6e585332512dd9c3fe2485b65f1f970823d40a91451446a73"} Jul 24 14:34:42.197903 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:42.197883 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rrxgj" event={"ID":"76abe981-1c84-4f65-82ff-a837b3e20722","Type":"ContainerStarted","Data":"a657097d6cb188aa5bf24ad78c51402763060d1cd5f341cb657ac4a31d787087"} Jul 24 14:34:42.199336 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:42.199316 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x4lb" event={"ID":"0e2d96fe-c8d4-43c3-b840-aa9c83cf6900","Type":"ContainerStarted","Data":"a25c96dea528d82a887a365bf0f3c6f1cebe47dca20088ca72eb115a168984aa"} Jul 24 14:34:42.200688 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:42.200669 2581 generic.go:356] "Generic (PLEG): container finished" podID="bcce044147adca679fede2754bc49a60" containerID="6b6c2b7b815423ada3526dec85e3065d385aed9940801768a0db57f9b3a22a50" exitCode=0 Jul 24 14:34:42.200776 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:42.200743 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal" event={"ID":"bcce044147adca679fede2754bc49a60","Type":"ContainerDied","Data":"6b6c2b7b815423ada3526dec85e3065d385aed9940801768a0db57f9b3a22a50"} Jul 24 14:34:42.203616 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:42.203597 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" event={"ID":"73267cf4-76dd-4bfa-b6a1-0cffba540a1e","Type":"ContainerStarted","Data":"e91b9a5999954711b0301b83f5f9869423ac673da3a05eda7a7ed1071e4b6016"} Jul 24 14:34:42.203700 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:42.203654 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" event={"ID":"73267cf4-76dd-4bfa-b6a1-0cffba540a1e","Type":"ContainerStarted","Data":"a3cfd516a3095fcb08d23295dc2afda9bde008e785f5d701d3d9767c1b09d391"} Jul 24 14:34:42.203700 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:42.203692 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" event={"ID":"73267cf4-76dd-4bfa-b6a1-0cffba540a1e","Type":"ContainerStarted","Data":"32821a4e8af5ab59cc93f89e75e75222b30cb048c9950a00115caaccd578bc7b"} Jul 24 14:34:42.203815 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:42.203725 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" event={"ID":"73267cf4-76dd-4bfa-b6a1-0cffba540a1e","Type":"ContainerStarted","Data":"f5704cb40603f97560dbf6a1d2d6c478cfdf88c801b2d96ae17aea149c3337b9"} Jul 24 14:34:42.203815 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:42.203752 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" event={"ID":"73267cf4-76dd-4bfa-b6a1-0cffba540a1e","Type":"ContainerStarted","Data":"8dcd19bd216e8c87519bf226a23120fa0d183e65206a4d75d0008515ebaae0a8"} Jul 24 14:34:42.203815 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:42.203780 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" event={"ID":"73267cf4-76dd-4bfa-b6a1-0cffba540a1e","Type":"ContainerStarted","Data":"cd70b33a753da54a8c03bf05e6d70c4411588e1a93c3e2a8fedb514944db66c8"} Jul 24 14:34:42.208059 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:42.208025 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mr85c" podStartSLOduration=3.167821125 podStartE2EDuration="22.208013802s" totalImagesPullingTime="19.040192677s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:34:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:34:42.207399603 +0000 UTC m=+22.744655556" watchObservedRunningTime="2026-07-24 14:34:42.208013802 +0000 UTC m=+22.745269754" Jul 24 14:34:42.222784 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:42.222750 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-shsqx" podStartSLOduration=2.402116216 podStartE2EDuration="21.222738054s" totalImagesPullingTime="18.820621838s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:34:42.22238497 +0000 UTC m=+22.759640922" watchObservedRunningTime="2026-07-24 14:34:42.222738054 +0000 UTC m=+22.759994005" Jul 24 14:34:42.240216 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:42.240183 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ww5lq" podStartSLOduration=6.373033361 podStartE2EDuration="21.240148821s" totalImagesPullingTime="14.86711546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:34:42.239520192 +0000 UTC m=+22.776776144" watchObservedRunningTime="2026-07-24 14:34:42.240148821 +0000 UTC m=+22.777425462" Jul 24 14:34:42.272186 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:42.272130 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-12.ec2.internal" podStartSLOduration=21.272118656 podStartE2EDuration="21.272118656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:34:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:34:42.255546587 +0000 UTC m=+22.792802539" watchObservedRunningTime="2026-07-24 14:34:42.272118656 +0000 UTC m=+22.809374609" Jul 24 14:34:42.302030 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:42.302000 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rrxgj" podStartSLOduration=3.462230525 podStartE2EDuration="22.301988837s" totalImagesPullingTime="18.839758312s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:34:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:34:42.272214821 +0000 UTC m=+22.809470772" watchObservedRunningTime="2026-07-24 14:34:42.301988837 +0000 UTC m=+22.839244788" Jul 24 14:34:42.327321 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:42.327138 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-z724g" podStartSLOduration=3.459297406 podStartE2EDuration="22.327128058s" totalImagesPullingTime="18.867830652s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:34:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:34:42.326543411 +0000 UTC m=+22.863799363" watchObservedRunningTime="2026-07-24 14:34:42.327128058 +0000 UTC m=+22.864384038" Jul 24 14:34:43.080904 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:43.080780 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 24 14:34:43.106660 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:43.106632 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:34:43.106767 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:43.106674 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcq7x" Jul 24 14:34:43.106767 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:43.106727 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjgg5" Jul 24 14:34:43.106767 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:43.106737 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwz72" podUID="7bf205e6-d5a4-4e93-a3c8-e3ea35355044" Jul 24 14:34:43.106928 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:43.106812 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcq7x" podUID="a448a0f9-4482-497d-8a40-06c479df078f" Jul 24 14:34:43.106928 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:43.106873 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjgg5" podUID="5d6fca35-b619-48ce-9227-1f10e1b2fda1" Jul 24 14:34:43.207559 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:43.207474 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vk9p4" event={"ID":"0459058c-9c25-4674-9521-fdc41c238ab7","Type":"ContainerStarted","Data":"8a3b4cd3cede0aaf06ef51d1daab090e8b294e0f3a95d641a30443ef3bb25a7e"} Jul 24 14:34:43.209624 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:43.209599 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x4lb" event={"ID":"0e2d96fe-c8d4-43c3-b840-aa9c83cf6900","Type":"ContainerStarted","Data":"3d918a57d73da181d4908bee2ff1644acf8a0efc2d5934f89af3bd9ee8133ff9"} Jul 24 14:34:43.227560 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:43.227497 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vk9p4" podStartSLOduration=4.372831702 podStartE2EDuration="23.227484835s" totalImagesPullingTime="18.854653133s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:34:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:34:43.226904693 +0000 UTC m=+23.764160644" watchObservedRunningTime="2026-07-24 14:34:43.227484835 +0000 UTC m=+23.764740787" Jul 24 14:34:43.930005 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:43.929902 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T14:34:43.080803054Z","UUID":"cc05bf23-23e1-45cc-b175-c2c22b1ef9d2","Handler":null,"Name":"","Endpoint":""} Jul 24 14:34:43.931938 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:43.931917 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 24 14:34:43.932119 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:43.931953 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 24 14:34:44.214111 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:44.214070 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal" event={"ID":"bcce044147adca679fede2754bc49a60","Type":"ContainerStarted","Data":"6c9ecb64ee94305a883efa79844620289fc9c5ec5acb3c46565d140a258e8c8a"} Jul 24 14:34:44.231518 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:44.231475 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-12.ec2.internal" podStartSLOduration=23.23146107 podStartE2EDuration="23.23146107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:34:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:34:44.231427729 +0000 UTC m=+24.768683682" watchObservedRunningTime="2026-07-24 14:34:44.23146107 +0000 UTC m=+24.768717022" Jul 24 14:34:45.107188 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:45.107146 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjgg5" Jul 24 14:34:45.107188 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:45.107180 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcq7x" Jul 24 14:34:45.107442 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:45.107277 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:34:45.107442 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:45.107285 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjgg5" podUID="5d6fca35-b619-48ce-9227-1f10e1b2fda1" Jul 24 14:34:45.107442 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:45.107334 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcq7x" podUID="a448a0f9-4482-497d-8a40-06c479df078f" Jul 24 14:34:45.107442 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:45.107424 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwz72" podUID="7bf205e6-d5a4-4e93-a3c8-e3ea35355044" Jul 24 14:34:45.219167 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:45.219130 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x4lb" event={"ID":"0e2d96fe-c8d4-43c3-b840-aa9c83cf6900","Type":"ContainerStarted","Data":"5640618cf2dc1556637a2fde16b2c64b676276f0ab043fca587287890cbe8033"} Jul 24 14:34:45.222661 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:45.222636 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" event={"ID":"73267cf4-76dd-4bfa-b6a1-0cffba540a1e","Type":"ContainerStarted","Data":"e3edb5e854383f61592cf7c3201b4504fe0b7fd88c30cbf7d35431ab03a02923"} Jul 24 14:34:45.240627 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:45.240588 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9x4lb" podStartSLOduration=2.928241088 podStartE2EDuration="24.240575642s" totalImagesPullingTime="21.312334554s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:34:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:34:45.240237303 +0000 UTC m=+25.777493256" watchObservedRunningTime="2026-07-24 14:34:45.240575642 +0000 UTC m=+25.777831593" Jul 24 14:34:45.499063 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:45.498986 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ww5lq" Jul 24 14:34:45.499656 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:45.499634 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ww5lq" Jul 24 14:34:46.225090 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:46.225043 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ww5lq" Jul 24 14:34:46.225543 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:46.225454 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ww5lq" Jul 24 14:34:47.106592 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:47.106557 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:34:47.106770 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:47.106557 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcq7x" Jul 24 14:34:47.106770 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:47.106672 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwz72" podUID="7bf205e6-d5a4-4e93-a3c8-e3ea35355044" Jul 24 14:34:47.106770 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:47.106559 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjgg5" Jul 24 14:34:47.106770 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:47.106756 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcq7x" podUID="a448a0f9-4482-497d-8a40-06c479df078f" Jul 24 14:34:47.106948 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:47.106851 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjgg5" podUID="5d6fca35-b619-48ce-9227-1f10e1b2fda1" Jul 24 14:34:48.232194 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:48.231997 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" event={"ID":"73267cf4-76dd-4bfa-b6a1-0cffba540a1e","Type":"ContainerStarted","Data":"b044304f7f4865c17c60d88ef067bed35cb3dbf0b153d99ac99a7c82b704fa7f"} Jul 24 14:34:48.233010 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:48.232312 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:48.233010 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:48.232541 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:48.233010 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:48.232636 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:48.237867 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:48.237839 2581 generic.go:356] "Generic (PLEG): container finished" podID="ec152e93-0223-4419-b21a-d325b39654cd" containerID="9ccfb15ec6a66d67d39dace74d188afcbc78936b89314962451f45a2331a4a0d" exitCode=0 Jul 24 14:34:48.238057 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:48.237923 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6wsm6" event={"ID":"ec152e93-0223-4419-b21a-d325b39654cd","Type":"ContainerDied","Data":"9ccfb15ec6a66d67d39dace74d188afcbc78936b89314962451f45a2331a4a0d"} Jul 24 14:34:48.248937 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:48.248920 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:48.249025 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:48.249001 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:34:48.262000 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:48.261963 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" podStartSLOduration=7.919389299 podStartE2EDuration="27.261951961s" totalImagesPullingTime="19.342562662s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:34:48.260290666 +0000 UTC m=+28.797546617" watchObservedRunningTime="2026-07-24 14:34:48.261951961 +0000 UTC m=+28.799207942" Jul 24 14:34:49.107019 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:49.106790 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcq7x" Jul 24 14:34:49.107070 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:49.106791 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjgg5" Jul 24 14:34:49.107104 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:49.106829 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:34:49.107138 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:49.107091 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcq7x" podUID="a448a0f9-4482-497d-8a40-06c479df078f" Jul 24 14:34:49.107200 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:49.107184 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjgg5" podUID="5d6fca35-b619-48ce-9227-1f10e1b2fda1" Jul 24 14:34:49.107270 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:49.107249 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwz72" podUID="7bf205e6-d5a4-4e93-a3c8-e3ea35355044" Jul 24 14:34:49.241800 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:49.241775 2581 generic.go:356] "Generic (PLEG): container finished" podID="ec152e93-0223-4419-b21a-d325b39654cd" containerID="476d0168cfd140545049f62cb5406170cd7b02d362cf3ca910054c0b9318b631" exitCode=0 Jul 24 14:34:49.242129 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:49.241845 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6wsm6" event={"ID":"ec152e93-0223-4419-b21a-d325b39654cd","Type":"ContainerDied","Data":"476d0168cfd140545049f62cb5406170cd7b02d362cf3ca910054c0b9318b631"} Jul 24 14:34:49.539274 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:49.539250 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hcq7x"] Jul 24 14:34:49.539393 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:49.539371 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcq7x" Jul 24 14:34:49.539530 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:49.539501 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcq7x" podUID="a448a0f9-4482-497d-8a40-06c479df078f" Jul 24 14:34:49.539995 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:49.539968 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cwz72"] Jul 24 14:34:49.540275 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:49.540053 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:34:49.540275 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:49.540182 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwz72" podUID="7bf205e6-d5a4-4e93-a3c8-e3ea35355044" Jul 24 14:34:49.540595 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:49.540576 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wjgg5"] Jul 24 14:34:49.540698 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:49.540655 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjgg5" Jul 24 14:34:49.540771 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:49.540747 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjgg5" podUID="5d6fca35-b619-48ce-9227-1f10e1b2fda1" Jul 24 14:34:51.106819 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:51.106795 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjgg5" Jul 24 14:34:51.107230 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:51.106832 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcq7x" Jul 24 14:34:51.107230 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:51.106910 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:34:51.107230 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:51.106930 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjgg5" podUID="5d6fca35-b619-48ce-9227-1f10e1b2fda1" Jul 24 14:34:51.107230 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:51.106976 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwz72" podUID="7bf205e6-d5a4-4e93-a3c8-e3ea35355044" Jul 24 14:34:51.107230 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:51.107036 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcq7x" podUID="a448a0f9-4482-497d-8a40-06c479df078f" Jul 24 14:34:51.248665 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:51.248599 2581 generic.go:356] "Generic (PLEG): container finished" podID="ec152e93-0223-4419-b21a-d325b39654cd" containerID="469aeaa2c1a4f40c70dffcf95da3a4768ced938d46c1734e7d234636cfe5b240" exitCode=0 Jul 24 14:34:51.248665 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:51.248633 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6wsm6" event={"ID":"ec152e93-0223-4419-b21a-d325b39654cd","Type":"ContainerDied","Data":"469aeaa2c1a4f40c70dffcf95da3a4768ced938d46c1734e7d234636cfe5b240"} Jul 24 14:34:53.106852 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:53.106818 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:34:53.106852 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:53.106838 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcq7x" Jul 24 14:34:53.107280 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:53.106853 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjgg5" Jul 24 14:34:53.107280 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:53.106941 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwz72" podUID="7bf205e6-d5a4-4e93-a3c8-e3ea35355044" Jul 24 14:34:53.107280 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:53.107022 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcq7x" podUID="a448a0f9-4482-497d-8a40-06c479df078f" Jul 24 14:34:53.107280 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:53.107097 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjgg5" podUID="5d6fca35-b619-48ce-9227-1f10e1b2fda1" Jul 24 14:34:53.708361 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:53.708336 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d6fca35-b619-48ce-9227-1f10e1b2fda1-metrics-certs\") pod \"network-metrics-daemon-wjgg5\" (UID: \"5d6fca35-b619-48ce-9227-1f10e1b2fda1\") " pod="openshift-multus/network-metrics-daemon-wjgg5" Jul 24 14:34:53.708629 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:53.708370 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4gnc\" (UniqueName: \"kubernetes.io/projected/a448a0f9-4482-497d-8a40-06c479df078f-kube-api-access-k4gnc\") pod \"network-check-target-hcq7x\" (UID: \"a448a0f9-4482-497d-8a40-06c479df078f\") " pod="openshift-network-diagnostics/network-check-target-hcq7x" Jul 24 14:34:53.708629 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:53.708395 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7bf205e6-d5a4-4e93-a3c8-e3ea35355044-original-pull-secret\") pod \"global-pull-secret-syncer-cwz72\" (UID: \"7bf205e6-d5a4-4e93-a3c8-e3ea35355044\") " pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:34:53.708629 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:53.708490 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:53.708629 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:53.708544 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bf205e6-d5a4-4e93-a3c8-e3ea35355044-original-pull-secret podName:7bf205e6-d5a4-4e93-a3c8-e3ea35355044 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:25.708526403 +0000 UTC m=+66.245782348 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7bf205e6-d5a4-4e93-a3c8-e3ea35355044-original-pull-secret") pod "global-pull-secret-syncer-cwz72" (UID: "7bf205e6-d5a4-4e93-a3c8-e3ea35355044") : object "kube-system"/"original-pull-secret" not registered Jul 24 14:34:53.708629 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:53.708549 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 14:34:53.708629 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:53.708490 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:53.708629 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:53.708573 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 14:34:53.708629 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:53.708589 2581 projected.go:196] Error preparing data for projected volume kube-api-access-k4gnc for pod openshift-network-diagnostics/network-check-target-hcq7x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:53.708629 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:53.708626 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d6fca35-b619-48ce-9227-1f10e1b2fda1-metrics-certs podName:5d6fca35-b619-48ce-9227-1f10e1b2fda1 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:25.708608901 +0000 UTC m=+66.245864846 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d6fca35-b619-48ce-9227-1f10e1b2fda1-metrics-certs") pod "network-metrics-daemon-wjgg5" (UID: "5d6fca35-b619-48ce-9227-1f10e1b2fda1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 14:34:53.708987 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:53.708642 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a448a0f9-4482-497d-8a40-06c479df078f-kube-api-access-k4gnc podName:a448a0f9-4482-497d-8a40-06c479df078f nodeName:}" failed. No retries permitted until 2026-07-24 14:35:25.708635565 +0000 UTC m=+66.245891498 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-k4gnc" (UniqueName: "kubernetes.io/projected/a448a0f9-4482-497d-8a40-06c479df078f-kube-api-access-k4gnc") pod "network-check-target-hcq7x" (UID: "a448a0f9-4482-497d-8a40-06c479df078f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 14:34:55.106610 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.106381 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcq7x" Jul 24 14:34:55.107055 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.106409 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:34:55.107055 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:55.106711 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcq7x" podUID="a448a0f9-4482-497d-8a40-06c479df078f" Jul 24 14:34:55.107055 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.106417 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjgg5" Jul 24 14:34:55.107055 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:55.106796 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwz72" podUID="7bf205e6-d5a4-4e93-a3c8-e3ea35355044" Jul 24 14:34:55.107055 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:55.106922 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjgg5" podUID="5d6fca35-b619-48ce-9227-1f10e1b2fda1" Jul 24 14:34:55.208019 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.207948 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-12.ec2.internal" event="NodeReady" Jul 24 14:34:55.208173 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.208075 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 24 14:34:55.256281 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.256248 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lxwhk"] Jul 24 14:34:55.290349 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.290325 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-df8sl"] Jul 24 14:34:55.290485 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.290453 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lxwhk" Jul 24 14:34:55.293117 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.293097 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-26zbb\"" Jul 24 14:34:55.293253 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.293141 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 24 14:34:55.293253 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.293189 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 24 14:34:55.314690 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.314665 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lxwhk"] Jul 24 14:34:55.314786 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.314702 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-df8sl"] Jul 24 14:34:55.314786 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.314766 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-df8sl" Jul 24 14:34:55.317445 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.317419 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n9c9d\"" Jul 24 14:34:55.317542 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.317422 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 24 14:34:55.317542 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.317482 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 24 14:34:55.317891 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.317878 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 24 14:34:55.324530 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.322820 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9rxp\" (UniqueName: \"kubernetes.io/projected/f1af447a-c7f6-4788-b687-514e2f6f732e-kube-api-access-v9rxp\") pod \"dns-default-lxwhk\" (UID: \"f1af447a-c7f6-4788-b687-514e2f6f732e\") " pod="openshift-dns/dns-default-lxwhk" Jul 24 14:34:55.324530 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.322870 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f1af447a-c7f6-4788-b687-514e2f6f732e-config-volume\") pod \"dns-default-lxwhk\" (UID: \"f1af447a-c7f6-4788-b687-514e2f6f732e\") " pod="openshift-dns/dns-default-lxwhk" Jul 24 14:34:55.324530 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.322935 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1af447a-c7f6-4788-b687-514e2f6f732e-metrics-tls\") pod \"dns-default-lxwhk\" (UID: \"f1af447a-c7f6-4788-b687-514e2f6f732e\") " pod="openshift-dns/dns-default-lxwhk" Jul 24 14:34:55.324530 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.323012 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1af447a-c7f6-4788-b687-514e2f6f732e-tmp-dir\") pod \"dns-default-lxwhk\" (UID: \"f1af447a-c7f6-4788-b687-514e2f6f732e\") " pod="openshift-dns/dns-default-lxwhk" Jul 24 14:34:55.423897 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.423876 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f1af447a-c7f6-4788-b687-514e2f6f732e-config-volume\") pod \"dns-default-lxwhk\" (UID: \"f1af447a-c7f6-4788-b687-514e2f6f732e\") " pod="openshift-dns/dns-default-lxwhk" Jul 24 14:34:55.423992 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.423918 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1af447a-c7f6-4788-b687-514e2f6f732e-metrics-tls\") pod \"dns-default-lxwhk\" (UID: \"f1af447a-c7f6-4788-b687-514e2f6f732e\") " pod="openshift-dns/dns-default-lxwhk" Jul 24 14:34:55.423992 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.423954 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1af447a-c7f6-4788-b687-514e2f6f732e-tmp-dir\") pod \"dns-default-lxwhk\" (UID: \"f1af447a-c7f6-4788-b687-514e2f6f732e\") " pod="openshift-dns/dns-default-lxwhk" Jul 24 14:34:55.423992 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.423980 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95c5e482-1abe-49b4-bb3e-154df4ac5486-cert\") pod \"ingress-canary-df8sl\" (UID: \"95c5e482-1abe-49b4-bb3e-154df4ac5486\") " pod="openshift-ingress-canary/ingress-canary-df8sl" Jul 24 14:34:55.424134 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.423999 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9rxp\" (UniqueName: \"kubernetes.io/projected/f1af447a-c7f6-4788-b687-514e2f6f732e-kube-api-access-v9rxp\") pod \"dns-default-lxwhk\" (UID: \"f1af447a-c7f6-4788-b687-514e2f6f732e\") " pod="openshift-dns/dns-default-lxwhk" Jul 24 14:34:55.424134 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.424015 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m82m2\" (UniqueName: \"kubernetes.io/projected/95c5e482-1abe-49b4-bb3e-154df4ac5486-kube-api-access-m82m2\") pod \"ingress-canary-df8sl\" (UID: \"95c5e482-1abe-49b4-bb3e-154df4ac5486\") " pod="openshift-ingress-canary/ingress-canary-df8sl" Jul 24 14:34:55.424134 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:55.424058 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 14:34:55.424303 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:55.424142 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1af447a-c7f6-4788-b687-514e2f6f732e-metrics-tls podName:f1af447a-c7f6-4788-b687-514e2f6f732e nodeName:}" failed. No retries permitted until 2026-07-24 14:34:55.924118311 +0000 UTC m=+36.461374255 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f1af447a-c7f6-4788-b687-514e2f6f732e-metrics-tls") pod "dns-default-lxwhk" (UID: "f1af447a-c7f6-4788-b687-514e2f6f732e") : secret "dns-default-metrics-tls" not found Jul 24 14:34:55.424430 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.424412 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1af447a-c7f6-4788-b687-514e2f6f732e-tmp-dir\") pod \"dns-default-lxwhk\" (UID: \"f1af447a-c7f6-4788-b687-514e2f6f732e\") " pod="openshift-dns/dns-default-lxwhk" Jul 24 14:34:55.424490 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.424473 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f1af447a-c7f6-4788-b687-514e2f6f732e-config-volume\") pod \"dns-default-lxwhk\" (UID: \"f1af447a-c7f6-4788-b687-514e2f6f732e\") " pod="openshift-dns/dns-default-lxwhk" Jul 24 14:34:55.434130 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.434112 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9rxp\" (UniqueName: \"kubernetes.io/projected/f1af447a-c7f6-4788-b687-514e2f6f732e-kube-api-access-v9rxp\") pod \"dns-default-lxwhk\" (UID: \"f1af447a-c7f6-4788-b687-514e2f6f732e\") " pod="openshift-dns/dns-default-lxwhk" Jul 24 14:34:55.524412 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.524369 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95c5e482-1abe-49b4-bb3e-154df4ac5486-cert\") pod \"ingress-canary-df8sl\" (UID: \"95c5e482-1abe-49b4-bb3e-154df4ac5486\") " pod="openshift-ingress-canary/ingress-canary-df8sl" Jul 24 14:34:55.524412 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.524397 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m82m2\" (UniqueName: \"kubernetes.io/projected/95c5e482-1abe-49b4-bb3e-154df4ac5486-kube-api-access-m82m2\") pod \"ingress-canary-df8sl\" (UID: \"95c5e482-1abe-49b4-bb3e-154df4ac5486\") " pod="openshift-ingress-canary/ingress-canary-df8sl" Jul 24 14:34:55.526514 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.526495 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95c5e482-1abe-49b4-bb3e-154df4ac5486-cert\") pod \"ingress-canary-df8sl\" (UID: \"95c5e482-1abe-49b4-bb3e-154df4ac5486\") " pod="openshift-ingress-canary/ingress-canary-df8sl" Jul 24 14:34:55.533618 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.533599 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m82m2\" (UniqueName: \"kubernetes.io/projected/95c5e482-1abe-49b4-bb3e-154df4ac5486-kube-api-access-m82m2\") pod \"ingress-canary-df8sl\" (UID: \"95c5e482-1abe-49b4-bb3e-154df4ac5486\") " pod="openshift-ingress-canary/ingress-canary-df8sl" Jul 24 14:34:55.622700 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.622677 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-df8sl" Jul 24 14:34:55.861568 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.861509 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-df8sl"] Jul 24 14:34:55.864777 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:34:55.864745 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95c5e482_1abe_49b4_bb3e_154df4ac5486.slice/crio-39d1a7e2729ad39a1271756c5f4edcd623ae5b4311a881941f85b79ae23d9312 WatchSource:0}: Error finding container 39d1a7e2729ad39a1271756c5f4edcd623ae5b4311a881941f85b79ae23d9312: Status 404 returned error can't find the container with id 39d1a7e2729ad39a1271756c5f4edcd623ae5b4311a881941f85b79ae23d9312 Jul 24 14:34:55.927554 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:55.927364 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1af447a-c7f6-4788-b687-514e2f6f732e-metrics-tls\") pod \"dns-default-lxwhk\" (UID: \"f1af447a-c7f6-4788-b687-514e2f6f732e\") " pod="openshift-dns/dns-default-lxwhk" Jul 24 14:34:55.927647 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:55.927499 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 14:34:55.927700 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:55.927689 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1af447a-c7f6-4788-b687-514e2f6f732e-metrics-tls podName:f1af447a-c7f6-4788-b687-514e2f6f732e nodeName:}" failed. No retries permitted until 2026-07-24 14:34:56.927668855 +0000 UTC m=+37.464924786 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f1af447a-c7f6-4788-b687-514e2f6f732e-metrics-tls") pod "dns-default-lxwhk" (UID: "f1af447a-c7f6-4788-b687-514e2f6f732e") : secret "dns-default-metrics-tls" not found Jul 24 14:34:56.261826 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:56.261733 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-df8sl" event={"ID":"95c5e482-1abe-49b4-bb3e-154df4ac5486","Type":"ContainerStarted","Data":"39d1a7e2729ad39a1271756c5f4edcd623ae5b4311a881941f85b79ae23d9312"} Jul 24 14:34:56.264616 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:56.264594 2581 generic.go:356] "Generic (PLEG): container finished" podID="ec152e93-0223-4419-b21a-d325b39654cd" containerID="a4e6ff7e50234242e7c56c45305fa0544b425f7f5ebf9181b233763ea1ca7fd0" exitCode=0 Jul 24 14:34:56.264703 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:56.264628 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6wsm6" event={"ID":"ec152e93-0223-4419-b21a-d325b39654cd","Type":"ContainerDied","Data":"a4e6ff7e50234242e7c56c45305fa0544b425f7f5ebf9181b233763ea1ca7fd0"} Jul 24 14:34:56.933719 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:56.933684 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1af447a-c7f6-4788-b687-514e2f6f732e-metrics-tls\") pod \"dns-default-lxwhk\" (UID: \"f1af447a-c7f6-4788-b687-514e2f6f732e\") " pod="openshift-dns/dns-default-lxwhk" Jul 24 14:34:56.933878 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:56.933836 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 14:34:56.933923 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:56.933898 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1af447a-c7f6-4788-b687-514e2f6f732e-metrics-tls podName:f1af447a-c7f6-4788-b687-514e2f6f732e nodeName:}" failed. No retries permitted until 2026-07-24 14:34:58.933881742 +0000 UTC m=+39.471137694 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f1af447a-c7f6-4788-b687-514e2f6f732e-metrics-tls") pod "dns-default-lxwhk" (UID: "f1af447a-c7f6-4788-b687-514e2f6f732e") : secret "dns-default-metrics-tls" not found Jul 24 14:34:57.106785 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:57.106750 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:34:57.106785 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:57.106788 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcq7x" Jul 24 14:34:57.106981 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:57.106789 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjgg5" Jul 24 14:34:57.109773 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:57.109757 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 14:34:57.111062 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:57.111045 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d7cdd\"" Jul 24 14:34:57.111184 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:57.111046 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 14:34:57.111184 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:57.111079 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 14:34:57.111184 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:57.111110 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2pw7m\"" Jul 24 14:34:57.111184 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:57.111125 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 14:34:57.271221 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:57.271135 2581 generic.go:356] "Generic (PLEG): container finished" podID="ec152e93-0223-4419-b21a-d325b39654cd" containerID="9c6d12032ebc73f37465cf3920558bdf9ff622fc0ccc36d101e5e10e4c8638d6" exitCode=0 Jul 24 14:34:57.271221 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:57.271191 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6wsm6" event={"ID":"ec152e93-0223-4419-b21a-d325b39654cd","Type":"ContainerDied","Data":"9c6d12032ebc73f37465cf3920558bdf9ff622fc0ccc36d101e5e10e4c8638d6"} Jul 24 14:34:58.276217 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:58.276181 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6wsm6" event={"ID":"ec152e93-0223-4419-b21a-d325b39654cd","Type":"ContainerStarted","Data":"027e1adc12db3dd394d1a5b1a36ec0e495ea28d2348deaf2cb484d01818b8165"} Jul 24 14:34:58.302910 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:58.302867 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6wsm6" podStartSLOduration=6.833955231 podStartE2EDuration="37.302853106s" totalImagesPullingTime="30.468897875s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:34:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:34:58.301211796 +0000 UTC m=+38.838467748" watchObservedRunningTime="2026-07-24 14:34:58.302853106 +0000 UTC m=+38.840109095" Jul 24 14:34:58.948540 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:58.948505 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1af447a-c7f6-4788-b687-514e2f6f732e-metrics-tls\") pod \"dns-default-lxwhk\" (UID: \"f1af447a-c7f6-4788-b687-514e2f6f732e\") " pod="openshift-dns/dns-default-lxwhk" Jul 24 14:34:58.948698 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:58.948644 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 14:34:58.948744 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:34:58.948703 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1af447a-c7f6-4788-b687-514e2f6f732e-metrics-tls podName:f1af447a-c7f6-4788-b687-514e2f6f732e nodeName:}" failed. No retries permitted until 2026-07-24 14:35:02.948688545 +0000 UTC m=+43.485944476 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f1af447a-c7f6-4788-b687-514e2f6f732e-metrics-tls") pod "dns-default-lxwhk" (UID: "f1af447a-c7f6-4788-b687-514e2f6f732e") : secret "dns-default-metrics-tls" not found Jul 24 14:34:59.279399 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:59.279361 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-df8sl" event={"ID":"95c5e482-1abe-49b4-bb3e-154df4ac5486","Type":"ContainerStarted","Data":"f88383a8fce07e68774603746f3b91d2ba1d7642d62ad39a0d01d45acd0b681f"} Jul 24 14:34:59.298693 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:34:59.298650 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-df8sl" podStartSLOduration=1.745939369 podStartE2EDuration="4.298634427s" totalImagesPullingTime="2.552695058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:34:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:34:59.298281992 +0000 UTC m=+39.835537946" watchObservedRunningTime="2026-07-24 14:34:59.298634427 +0000 UTC m=+39.835890356" Jul 24 14:35:02.975573 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:02.975538 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1af447a-c7f6-4788-b687-514e2f6f732e-metrics-tls\") pod \"dns-default-lxwhk\" (UID: \"f1af447a-c7f6-4788-b687-514e2f6f732e\") " pod="openshift-dns/dns-default-lxwhk" Jul 24 14:35:02.975947 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:02.975679 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 14:35:02.975947 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:02.975740 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1af447a-c7f6-4788-b687-514e2f6f732e-metrics-tls podName:f1af447a-c7f6-4788-b687-514e2f6f732e nodeName:}" failed. No retries permitted until 2026-07-24 14:35:10.975726439 +0000 UTC m=+51.512982369 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f1af447a-c7f6-4788-b687-514e2f6f732e-metrics-tls") pod "dns-default-lxwhk" (UID: "f1af447a-c7f6-4788-b687-514e2f6f732e") : secret "dns-default-metrics-tls" not found Jul 24 14:35:11.024570 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:11.024537 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1af447a-c7f6-4788-b687-514e2f6f732e-metrics-tls\") pod \"dns-default-lxwhk\" (UID: \"f1af447a-c7f6-4788-b687-514e2f6f732e\") " pod="openshift-dns/dns-default-lxwhk" Jul 24 14:35:11.024996 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:11.024672 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 14:35:11.024996 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:11.024735 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1af447a-c7f6-4788-b687-514e2f6f732e-metrics-tls podName:f1af447a-c7f6-4788-b687-514e2f6f732e nodeName:}" failed. No retries permitted until 2026-07-24 14:35:27.024719038 +0000 UTC m=+67.561974982 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f1af447a-c7f6-4788-b687-514e2f6f732e-metrics-tls") pod "dns-default-lxwhk" (UID: "f1af447a-c7f6-4788-b687-514e2f6f732e") : secret "dns-default-metrics-tls" not found Jul 24 14:35:20.255347 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:20.255310 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4cffq" Jul 24 14:35:25.786571 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:25.786533 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d6fca35-b619-48ce-9227-1f10e1b2fda1-metrics-certs\") pod \"network-metrics-daemon-wjgg5\" (UID: \"5d6fca35-b619-48ce-9227-1f10e1b2fda1\") " pod="openshift-multus/network-metrics-daemon-wjgg5" Jul 24 14:35:25.787023 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:25.786581 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4gnc\" (UniqueName: \"kubernetes.io/projected/a448a0f9-4482-497d-8a40-06c479df078f-kube-api-access-k4gnc\") pod \"network-check-target-hcq7x\" (UID: \"a448a0f9-4482-497d-8a40-06c479df078f\") " pod="openshift-network-diagnostics/network-check-target-hcq7x" Jul 24 14:35:25.787023 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:25.786600 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7bf205e6-d5a4-4e93-a3c8-e3ea35355044-original-pull-secret\") pod \"global-pull-secret-syncer-cwz72\" (UID: \"7bf205e6-d5a4-4e93-a3c8-e3ea35355044\") " pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:35:25.789990 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:25.789973 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 14:35:25.790764 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:25.790751 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 14:35:25.790849 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:25.790834 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 14:35:25.797402 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:25.797385 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 24 14:35:25.797479 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:25.797460 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d6fca35-b619-48ce-9227-1f10e1b2fda1-metrics-certs podName:5d6fca35-b619-48ce-9227-1f10e1b2fda1 nodeName:}" failed. No retries permitted until 2026-07-24 14:36:29.797438184 +0000 UTC m=+130.334694133 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d6fca35-b619-48ce-9227-1f10e1b2fda1-metrics-certs") pod "network-metrics-daemon-wjgg5" (UID: "5d6fca35-b619-48ce-9227-1f10e1b2fda1") : secret "metrics-daemon-secret" not found Jul 24 14:35:25.799997 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:25.799984 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 14:35:25.800696 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:25.800676 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7bf205e6-d5a4-4e93-a3c8-e3ea35355044-original-pull-secret\") pod \"global-pull-secret-syncer-cwz72\" (UID: \"7bf205e6-d5a4-4e93-a3c8-e3ea35355044\") " pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:35:25.810279 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:25.810260 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4gnc\" (UniqueName: \"kubernetes.io/projected/a448a0f9-4482-497d-8a40-06c479df078f-kube-api-access-k4gnc\") pod \"network-check-target-hcq7x\" (UID: \"a448a0f9-4482-497d-8a40-06c479df078f\") " pod="openshift-network-diagnostics/network-check-target-hcq7x" Jul 24 14:35:25.916709 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:25.916690 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwz72" Jul 24 14:35:25.924670 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:25.924658 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2pw7m\"" Jul 24 14:35:25.932750 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:25.932735 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcq7x" Jul 24 14:35:26.078946 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:26.078918 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cwz72"] Jul 24 14:35:26.082535 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:35:26.082504 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bf205e6_d5a4_4e93_a3c8_e3ea35355044.slice/crio-3c000a3c0fbf29759d52df02fbc9e4ccbc8fbb2cde0e7eb38ae810d4269d7f8c WatchSource:0}: Error finding container 3c000a3c0fbf29759d52df02fbc9e4ccbc8fbb2cde0e7eb38ae810d4269d7f8c: Status 404 returned error can't find the container with id 3c000a3c0fbf29759d52df02fbc9e4ccbc8fbb2cde0e7eb38ae810d4269d7f8c Jul 24 14:35:26.094260 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:26.094234 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hcq7x"] Jul 24 14:35:26.096943 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:35:26.096921 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda448a0f9_4482_497d_8a40_06c479df078f.slice/crio-ed8987b8c41c4212ea1a8a74b948e39ed3c5352d47b0c12b36bbb95afb1179e2 WatchSource:0}: Error finding container ed8987b8c41c4212ea1a8a74b948e39ed3c5352d47b0c12b36bbb95afb1179e2: Status 404 returned error can't find the container with id ed8987b8c41c4212ea1a8a74b948e39ed3c5352d47b0c12b36bbb95afb1179e2 Jul 24 14:35:26.348918 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:26.348825 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hcq7x" event={"ID":"a448a0f9-4482-497d-8a40-06c479df078f","Type":"ContainerStarted","Data":"ed8987b8c41c4212ea1a8a74b948e39ed3c5352d47b0c12b36bbb95afb1179e2"} Jul 24 14:35:26.349878 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:26.349854 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cwz72" event={"ID":"7bf205e6-d5a4-4e93-a3c8-e3ea35355044","Type":"ContainerStarted","Data":"3c000a3c0fbf29759d52df02fbc9e4ccbc8fbb2cde0e7eb38ae810d4269d7f8c"} Jul 24 14:35:27.094805 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:27.094766 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1af447a-c7f6-4788-b687-514e2f6f732e-metrics-tls\") pod \"dns-default-lxwhk\" (UID: \"f1af447a-c7f6-4788-b687-514e2f6f732e\") " pod="openshift-dns/dns-default-lxwhk" Jul 24 14:35:27.095411 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:27.094905 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 14:35:27.095411 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:27.094988 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1af447a-c7f6-4788-b687-514e2f6f732e-metrics-tls podName:f1af447a-c7f6-4788-b687-514e2f6f732e nodeName:}" failed. No retries permitted until 2026-07-24 14:35:59.094965321 +0000 UTC m=+99.632221259 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f1af447a-c7f6-4788-b687-514e2f6f732e-metrics-tls") pod "dns-default-lxwhk" (UID: "f1af447a-c7f6-4788-b687-514e2f6f732e") : secret "dns-default-metrics-tls" not found Jul 24 14:35:31.364222 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:31.364187 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hcq7x" event={"ID":"a448a0f9-4482-497d-8a40-06c479df078f","Type":"ContainerStarted","Data":"1d63739398b58a3054b510ec8a2ae9928b8fe08f61f297bad3611b12c9c8020a"} Jul 24 14:35:31.364690 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:31.364321 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hcq7x" Jul 24 14:35:31.365659 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:31.365638 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cwz72" event={"ID":"7bf205e6-d5a4-4e93-a3c8-e3ea35355044","Type":"ContainerStarted","Data":"b7f14cfc9c1fa47faa2a12ddc916ccc6866a0e0d01ea154513879e592edb328a"} Jul 24 14:35:31.405830 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:31.405773 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cwz72" podStartSLOduration=66.004324013 podStartE2EDuration="1m10.405761456s" totalImagesPullingTime="4.401437443s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:35:31.405198379 +0000 UTC m=+71.942454331" watchObservedRunningTime="2026-07-24 14:35:31.405761456 +0000 UTC m=+71.943017408" Jul 24 14:35:31.406096 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:31.406077 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hcq7x" podStartSLOduration=66.022713744 podStartE2EDuration="1m10.406070154s" totalImagesPullingTime="4.38335641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:35:31.387249336 +0000 UTC m=+71.924505323" watchObservedRunningTime="2026-07-24 14:35:31.406070154 +0000 UTC m=+71.943326115" Jul 24 14:35:43.007493 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.007370 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-tzpfp"] Jul 24 14:35:43.011434 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.011414 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-tzpfp" Jul 24 14:35:43.017271 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.015072 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-78dd4996b7-bzkqg"] Jul 24 14:35:43.017271 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.015488 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 24 14:35:43.017271 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.015496 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 24 14:35:43.017271 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.016896 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 24 14:35:43.018274 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.018243 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rhdrn\"" Jul 24 14:35:43.018532 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.018512 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 24 14:35:43.019494 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.019294 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-78dd4996b7-bzkqg" Jul 24 14:35:43.022287 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.022251 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 24 14:35:43.022515 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.022426 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-tzpfp"] Jul 24 14:35:43.022515 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.022457 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 24 14:35:43.022714 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.022459 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 24 14:35:43.022714 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.022710 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 24 14:35:43.022839 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.022766 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-m7xtk\"" Jul 24 14:35:43.022885 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.022836 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 24 14:35:43.022972 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.022953 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 24 14:35:43.031343 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.031320 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-78dd4996b7-bzkqg"] Jul 24 14:35:43.096229 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.096209 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef917c53-72f3-4267-a655-84607918a723-service-ca-bundle\") pod \"router-default-78dd4996b7-bzkqg\" (UID: \"ef917c53-72f3-4267-a655-84607918a723\") " pod="openshift-ingress/router-default-78dd4996b7-bzkqg" Jul 24 14:35:43.096328 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.096250 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad44feb0-98db-4e8f-b9f9-b7495d6adf97-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-tzpfp\" (UID: \"ad44feb0-98db-4e8f-b9f9-b7495d6adf97\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-tzpfp" Jul 24 14:35:43.096328 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.096267 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ef917c53-72f3-4267-a655-84607918a723-stats-auth\") pod \"router-default-78dd4996b7-bzkqg\" (UID: \"ef917c53-72f3-4267-a655-84607918a723\") " pod="openshift-ingress/router-default-78dd4996b7-bzkqg" Jul 24 14:35:43.096328 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.096282 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6psg\" (UniqueName: \"kubernetes.io/projected/ef917c53-72f3-4267-a655-84607918a723-kube-api-access-z6psg\") pod \"router-default-78dd4996b7-bzkqg\" (UID: \"ef917c53-72f3-4267-a655-84607918a723\") " pod="openshift-ingress/router-default-78dd4996b7-bzkqg" Jul 24 14:35:43.096450 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.096342 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ef917c53-72f3-4267-a655-84607918a723-default-certificate\") pod \"router-default-78dd4996b7-bzkqg\" (UID: \"ef917c53-72f3-4267-a655-84607918a723\") " pod="openshift-ingress/router-default-78dd4996b7-bzkqg" Jul 24 14:35:43.096450 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.096377 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ad44feb0-98db-4e8f-b9f9-b7495d6adf97-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-tzpfp\" (UID: \"ad44feb0-98db-4e8f-b9f9-b7495d6adf97\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-tzpfp" Jul 24 14:35:43.096450 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.096395 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-545sl\" (UniqueName: \"kubernetes.io/projected/ad44feb0-98db-4e8f-b9f9-b7495d6adf97-kube-api-access-545sl\") pod \"cluster-monitoring-operator-548b489cb8-tzpfp\" (UID: \"ad44feb0-98db-4e8f-b9f9-b7495d6adf97\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-tzpfp" Jul 24 14:35:43.096450 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.096415 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef917c53-72f3-4267-a655-84607918a723-metrics-certs\") pod \"router-default-78dd4996b7-bzkqg\" (UID: \"ef917c53-72f3-4267-a655-84607918a723\") " pod="openshift-ingress/router-default-78dd4996b7-bzkqg" Jul 24 14:35:43.197518 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.197499 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ef917c53-72f3-4267-a655-84607918a723-default-certificate\") pod \"router-default-78dd4996b7-bzkqg\" (UID: \"ef917c53-72f3-4267-a655-84607918a723\") " pod="openshift-ingress/router-default-78dd4996b7-bzkqg" Jul 24 14:35:43.197607 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.197548 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ad44feb0-98db-4e8f-b9f9-b7495d6adf97-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-tzpfp\" (UID: \"ad44feb0-98db-4e8f-b9f9-b7495d6adf97\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-tzpfp" Jul 24 14:35:43.197607 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.197567 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-545sl\" (UniqueName: \"kubernetes.io/projected/ad44feb0-98db-4e8f-b9f9-b7495d6adf97-kube-api-access-545sl\") pod \"cluster-monitoring-operator-548b489cb8-tzpfp\" (UID: \"ad44feb0-98db-4e8f-b9f9-b7495d6adf97\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-tzpfp" Jul 24 14:35:43.197607 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.197587 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef917c53-72f3-4267-a655-84607918a723-metrics-certs\") pod \"router-default-78dd4996b7-bzkqg\" (UID: \"ef917c53-72f3-4267-a655-84607918a723\") " pod="openshift-ingress/router-default-78dd4996b7-bzkqg" Jul 24 14:35:43.197728 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.197620 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef917c53-72f3-4267-a655-84607918a723-service-ca-bundle\") pod \"router-default-78dd4996b7-bzkqg\" (UID: \"ef917c53-72f3-4267-a655-84607918a723\") " pod="openshift-ingress/router-default-78dd4996b7-bzkqg" Jul 24 14:35:43.197728 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.197664 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad44feb0-98db-4e8f-b9f9-b7495d6adf97-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-tzpfp\" (UID: \"ad44feb0-98db-4e8f-b9f9-b7495d6adf97\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-tzpfp" Jul 24 14:35:43.197728 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.197689 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ef917c53-72f3-4267-a655-84607918a723-stats-auth\") pod \"router-default-78dd4996b7-bzkqg\" (UID: \"ef917c53-72f3-4267-a655-84607918a723\") " pod="openshift-ingress/router-default-78dd4996b7-bzkqg" Jul 24 14:35:43.197728 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.197712 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6psg\" (UniqueName: \"kubernetes.io/projected/ef917c53-72f3-4267-a655-84607918a723-kube-api-access-z6psg\") pod \"router-default-78dd4996b7-bzkqg\" (UID: \"ef917c53-72f3-4267-a655-84607918a723\") " pod="openshift-ingress/router-default-78dd4996b7-bzkqg" Jul 24 14:35:43.197912 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:43.197733 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 14:35:43.197912 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:43.197779 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 14:35:43.197912 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:43.197793 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef917c53-72f3-4267-a655-84607918a723-metrics-certs podName:ef917c53-72f3-4267-a655-84607918a723 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:43.69777294 +0000 UTC m=+84.235028906 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef917c53-72f3-4267-a655-84607918a723-metrics-certs") pod "router-default-78dd4996b7-bzkqg" (UID: "ef917c53-72f3-4267-a655-84607918a723") : secret "router-metrics-certs-default" not found Jul 24 14:35:43.197912 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:43.197811 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ef917c53-72f3-4267-a655-84607918a723-service-ca-bundle podName:ef917c53-72f3-4267-a655-84607918a723 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:43.69780242 +0000 UTC m=+84.235058349 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ef917c53-72f3-4267-a655-84607918a723-service-ca-bundle") pod "router-default-78dd4996b7-bzkqg" (UID: "ef917c53-72f3-4267-a655-84607918a723") : configmap references non-existent config key: service-ca.crt Jul 24 14:35:43.197912 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:43.197851 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad44feb0-98db-4e8f-b9f9-b7495d6adf97-cluster-monitoring-operator-tls podName:ad44feb0-98db-4e8f-b9f9-b7495d6adf97 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:43.697831693 +0000 UTC m=+84.235087625 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ad44feb0-98db-4e8f-b9f9-b7495d6adf97-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-tzpfp" (UID: "ad44feb0-98db-4e8f-b9f9-b7495d6adf97") : secret "cluster-monitoring-operator-tls" not found Jul 24 14:35:43.198303 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.198282 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ad44feb0-98db-4e8f-b9f9-b7495d6adf97-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-tzpfp\" (UID: \"ad44feb0-98db-4e8f-b9f9-b7495d6adf97\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-tzpfp" Jul 24 14:35:43.200053 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.200030 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ef917c53-72f3-4267-a655-84607918a723-default-certificate\") pod \"router-default-78dd4996b7-bzkqg\" (UID: \"ef917c53-72f3-4267-a655-84607918a723\") " pod="openshift-ingress/router-default-78dd4996b7-bzkqg" Jul 24 14:35:43.200133 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.200059 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ef917c53-72f3-4267-a655-84607918a723-stats-auth\") pod \"router-default-78dd4996b7-bzkqg\" (UID: \"ef917c53-72f3-4267-a655-84607918a723\") " pod="openshift-ingress/router-default-78dd4996b7-bzkqg" Jul 24 14:35:43.206299 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.206275 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-545sl\" (UniqueName: \"kubernetes.io/projected/ad44feb0-98db-4e8f-b9f9-b7495d6adf97-kube-api-access-545sl\") pod \"cluster-monitoring-operator-548b489cb8-tzpfp\" (UID: \"ad44feb0-98db-4e8f-b9f9-b7495d6adf97\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-tzpfp" Jul 24 14:35:43.206927 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.206909 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6psg\" (UniqueName: \"kubernetes.io/projected/ef917c53-72f3-4267-a655-84607918a723-kube-api-access-z6psg\") pod \"router-default-78dd4996b7-bzkqg\" (UID: \"ef917c53-72f3-4267-a655-84607918a723\") " pod="openshift-ingress/router-default-78dd4996b7-bzkqg" Jul 24 14:35:43.700888 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.700854 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef917c53-72f3-4267-a655-84607918a723-metrics-certs\") pod \"router-default-78dd4996b7-bzkqg\" (UID: \"ef917c53-72f3-4267-a655-84607918a723\") " pod="openshift-ingress/router-default-78dd4996b7-bzkqg" Jul 24 14:35:43.700888 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.700891 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef917c53-72f3-4267-a655-84607918a723-service-ca-bundle\") pod \"router-default-78dd4996b7-bzkqg\" (UID: \"ef917c53-72f3-4267-a655-84607918a723\") " pod="openshift-ingress/router-default-78dd4996b7-bzkqg" Jul 24 14:35:43.701122 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:43.700919 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad44feb0-98db-4e8f-b9f9-b7495d6adf97-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-tzpfp\" (UID: \"ad44feb0-98db-4e8f-b9f9-b7495d6adf97\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-tzpfp" Jul 24 14:35:43.701122 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:43.700993 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 14:35:43.701122 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:43.701005 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 14:35:43.701122 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:43.701052 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad44feb0-98db-4e8f-b9f9-b7495d6adf97-cluster-monitoring-operator-tls podName:ad44feb0-98db-4e8f-b9f9-b7495d6adf97 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:44.701038352 +0000 UTC m=+85.238294282 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ad44feb0-98db-4e8f-b9f9-b7495d6adf97-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-tzpfp" (UID: "ad44feb0-98db-4e8f-b9f9-b7495d6adf97") : secret "cluster-monitoring-operator-tls" not found Jul 24 14:35:43.701122 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:43.701065 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef917c53-72f3-4267-a655-84607918a723-metrics-certs podName:ef917c53-72f3-4267-a655-84607918a723 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:44.701058109 +0000 UTC m=+85.238314039 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef917c53-72f3-4267-a655-84607918a723-metrics-certs") pod "router-default-78dd4996b7-bzkqg" (UID: "ef917c53-72f3-4267-a655-84607918a723") : secret "router-metrics-certs-default" not found Jul 24 14:35:43.701122 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:43.701078 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ef917c53-72f3-4267-a655-84607918a723-service-ca-bundle podName:ef917c53-72f3-4267-a655-84607918a723 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:44.701070669 +0000 UTC m=+85.238326599 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ef917c53-72f3-4267-a655-84607918a723-service-ca-bundle") pod "router-default-78dd4996b7-bzkqg" (UID: "ef917c53-72f3-4267-a655-84607918a723") : configmap references non-existent config key: service-ca.crt Jul 24 14:35:44.707285 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:44.707236 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef917c53-72f3-4267-a655-84607918a723-service-ca-bundle\") pod \"router-default-78dd4996b7-bzkqg\" (UID: \"ef917c53-72f3-4267-a655-84607918a723\") " pod="openshift-ingress/router-default-78dd4996b7-bzkqg" Jul 24 14:35:44.707285 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:44.707293 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad44feb0-98db-4e8f-b9f9-b7495d6adf97-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-tzpfp\" (UID: \"ad44feb0-98db-4e8f-b9f9-b7495d6adf97\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-tzpfp" Jul 24 14:35:44.707802 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:44.707381 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 14:35:44.707802 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:44.707401 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ef917c53-72f3-4267-a655-84607918a723-service-ca-bundle podName:ef917c53-72f3-4267-a655-84607918a723 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:46.707384024 +0000 UTC m=+87.244639957 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ef917c53-72f3-4267-a655-84607918a723-service-ca-bundle") pod "router-default-78dd4996b7-bzkqg" (UID: "ef917c53-72f3-4267-a655-84607918a723") : configmap references non-existent config key: service-ca.crt Jul 24 14:35:44.707802 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:44.707425 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad44feb0-98db-4e8f-b9f9-b7495d6adf97-cluster-monitoring-operator-tls podName:ad44feb0-98db-4e8f-b9f9-b7495d6adf97 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:46.707418252 +0000 UTC m=+87.244674182 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ad44feb0-98db-4e8f-b9f9-b7495d6adf97-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-tzpfp" (UID: "ad44feb0-98db-4e8f-b9f9-b7495d6adf97") : secret "cluster-monitoring-operator-tls" not found Jul 24 14:35:44.707802 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:44.707463 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef917c53-72f3-4267-a655-84607918a723-metrics-certs\") pod \"router-default-78dd4996b7-bzkqg\" (UID: \"ef917c53-72f3-4267-a655-84607918a723\") " pod="openshift-ingress/router-default-78dd4996b7-bzkqg" Jul 24 14:35:44.707802 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:44.707533 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 14:35:44.707802 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:44.707557 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef917c53-72f3-4267-a655-84607918a723-metrics-certs podName:ef917c53-72f3-4267-a655-84607918a723 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:46.707549952 +0000 UTC m=+87.244805882 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef917c53-72f3-4267-a655-84607918a723-metrics-certs") pod "router-default-78dd4996b7-bzkqg" (UID: "ef917c53-72f3-4267-a655-84607918a723") : secret "router-metrics-certs-default" not found Jul 24 14:35:46.116387 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:46.116350 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-j9286"] Jul 24 14:35:46.121796 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:46.121765 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j9286" Jul 24 14:35:46.125084 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:46.125055 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 24 14:35:46.125269 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:46.125164 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 24 14:35:46.125428 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:46.125410 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 24 14:35:46.125428 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:46.125418 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 24 14:35:46.126377 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:46.126355 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-slrpn\"" Jul 24 14:35:46.136626 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:46.136602 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j9286"] Jul 24 14:35:46.218641 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:46.218615 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-crio-socket\") pod \"insights-runtime-extractor-j9286\" (UID: \"df7771c3-8bfb-4c8d-a827-a6ed71b7ced8\") " pod="openshift-insights/insights-runtime-extractor-j9286" Jul 24 14:35:46.218737 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:46.218650 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmr7j\" (UniqueName: \"kubernetes.io/projected/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-kube-api-access-tmr7j\") pod \"insights-runtime-extractor-j9286\" (UID: \"df7771c3-8bfb-4c8d-a827-a6ed71b7ced8\") " pod="openshift-insights/insights-runtime-extractor-j9286" Jul 24 14:35:46.218737 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:46.218685 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j9286\" (UID: \"df7771c3-8bfb-4c8d-a827-a6ed71b7ced8\") " pod="openshift-insights/insights-runtime-extractor-j9286" Jul 24 14:35:46.218820 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:46.218755 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j9286\" (UID: \"df7771c3-8bfb-4c8d-a827-a6ed71b7ced8\") " pod="openshift-insights/insights-runtime-extractor-j9286" Jul 24 14:35:46.218820 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:46.218784 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-data-volume\") pod \"insights-runtime-extractor-j9286\" (UID: \"df7771c3-8bfb-4c8d-a827-a6ed71b7ced8\") " pod="openshift-insights/insights-runtime-extractor-j9286" Jul 24 14:35:46.319779 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:46.319752 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j9286\" (UID: \"df7771c3-8bfb-4c8d-a827-a6ed71b7ced8\") " pod="openshift-insights/insights-runtime-extractor-j9286" Jul 24 14:35:46.319875 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:46.319800 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j9286\" (UID: \"df7771c3-8bfb-4c8d-a827-a6ed71b7ced8\") " pod="openshift-insights/insights-runtime-extractor-j9286" Jul 24 14:35:46.319875 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:46.319820 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-data-volume\") pod \"insights-runtime-extractor-j9286\" (UID: \"df7771c3-8bfb-4c8d-a827-a6ed71b7ced8\") " pod="openshift-insights/insights-runtime-extractor-j9286" Jul 24 14:35:46.319957 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:46.319891 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 14:35:46.319957 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:46.319904 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-crio-socket\") pod \"insights-runtime-extractor-j9286\" (UID: \"df7771c3-8bfb-4c8d-a827-a6ed71b7ced8\") " pod="openshift-insights/insights-runtime-extractor-j9286" Jul 24 14:35:46.319957 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:46.319943 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmr7j\" (UniqueName: \"kubernetes.io/projected/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-kube-api-access-tmr7j\") pod \"insights-runtime-extractor-j9286\" (UID: \"df7771c3-8bfb-4c8d-a827-a6ed71b7ced8\") " pod="openshift-insights/insights-runtime-extractor-j9286" Jul 24 14:35:46.319957 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:46.319953 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-insights-runtime-extractor-tls podName:df7771c3-8bfb-4c8d-a827-a6ed71b7ced8 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:46.819937744 +0000 UTC m=+87.357193673 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j9286" (UID: "df7771c3-8bfb-4c8d-a827-a6ed71b7ced8") : secret "insights-runtime-extractor-tls" not found Jul 24 14:35:46.320111 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:46.320027 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 14:35:46.320111 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:46.320032 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-crio-socket\") pod \"insights-runtime-extractor-j9286\" (UID: \"df7771c3-8bfb-4c8d-a827-a6ed71b7ced8\") " pod="openshift-insights/insights-runtime-extractor-j9286" Jul 24 14:35:46.320111 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:46.320085 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-kube-rbac-proxy-cm podName:df7771c3-8bfb-4c8d-a827-a6ed71b7ced8 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:46.820071659 +0000 UTC m=+87.357327609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j9286" (UID: "df7771c3-8bfb-4c8d-a827-a6ed71b7ced8") : configmap "kube-rbac-proxy" not found Jul 24 14:35:46.320251 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:46.320131 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-data-volume\") pod \"insights-runtime-extractor-j9286\" (UID: \"df7771c3-8bfb-4c8d-a827-a6ed71b7ced8\") " pod="openshift-insights/insights-runtime-extractor-j9286" Jul 24 14:35:46.331665 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:46.331636 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmr7j\" (UniqueName: \"kubernetes.io/projected/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-kube-api-access-tmr7j\") pod \"insights-runtime-extractor-j9286\" (UID: \"df7771c3-8bfb-4c8d-a827-a6ed71b7ced8\") " pod="openshift-insights/insights-runtime-extractor-j9286" Jul 24 14:35:46.722669 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:46.722642 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef917c53-72f3-4267-a655-84607918a723-metrics-certs\") pod \"router-default-78dd4996b7-bzkqg\" (UID: \"ef917c53-72f3-4267-a655-84607918a723\") " pod="openshift-ingress/router-default-78dd4996b7-bzkqg" Jul 24 14:35:46.722822 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:46.722685 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef917c53-72f3-4267-a655-84607918a723-service-ca-bundle\") pod \"router-default-78dd4996b7-bzkqg\" (UID: \"ef917c53-72f3-4267-a655-84607918a723\") " pod="openshift-ingress/router-default-78dd4996b7-bzkqg" Jul 24 14:35:46.722822 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:46.722714 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad44feb0-98db-4e8f-b9f9-b7495d6adf97-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-tzpfp\" (UID: \"ad44feb0-98db-4e8f-b9f9-b7495d6adf97\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-tzpfp" Jul 24 14:35:46.722822 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:46.722787 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 14:35:46.722822 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:46.722802 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 14:35:46.722822 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:46.722818 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ef917c53-72f3-4267-a655-84607918a723-service-ca-bundle podName:ef917c53-72f3-4267-a655-84607918a723 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:50.72280131 +0000 UTC m=+91.260057239 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ef917c53-72f3-4267-a655-84607918a723-service-ca-bundle") pod "router-default-78dd4996b7-bzkqg" (UID: "ef917c53-72f3-4267-a655-84607918a723") : configmap references non-existent config key: service-ca.crt Jul 24 14:35:46.722983 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:46.722847 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad44feb0-98db-4e8f-b9f9-b7495d6adf97-cluster-monitoring-operator-tls podName:ad44feb0-98db-4e8f-b9f9-b7495d6adf97 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:50.722836246 +0000 UTC m=+91.260092177 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ad44feb0-98db-4e8f-b9f9-b7495d6adf97-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-tzpfp" (UID: "ad44feb0-98db-4e8f-b9f9-b7495d6adf97") : secret "cluster-monitoring-operator-tls" not found Jul 24 14:35:46.722983 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:46.722861 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef917c53-72f3-4267-a655-84607918a723-metrics-certs podName:ef917c53-72f3-4267-a655-84607918a723 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:50.722853406 +0000 UTC m=+91.260109336 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef917c53-72f3-4267-a655-84607918a723-metrics-certs") pod "router-default-78dd4996b7-bzkqg" (UID: "ef917c53-72f3-4267-a655-84607918a723") : secret "router-metrics-certs-default" not found Jul 24 14:35:46.823440 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:46.823418 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j9286\" (UID: \"df7771c3-8bfb-4c8d-a827-a6ed71b7ced8\") " pod="openshift-insights/insights-runtime-extractor-j9286" Jul 24 14:35:46.823556 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:46.823464 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j9286\" (UID: \"df7771c3-8bfb-4c8d-a827-a6ed71b7ced8\") " pod="openshift-insights/insights-runtime-extractor-j9286" Jul 24 14:35:46.823594 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:46.823562 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 14:35:46.823594 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:46.823580 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 14:35:46.823705 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:46.823616 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-insights-runtime-extractor-tls podName:df7771c3-8bfb-4c8d-a827-a6ed71b7ced8 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:47.82360057 +0000 UTC m=+88.360856514 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j9286" (UID: "df7771c3-8bfb-4c8d-a827-a6ed71b7ced8") : secret "insights-runtime-extractor-tls" not found Jul 24 14:35:46.823705 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:46.823630 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-kube-rbac-proxy-cm podName:df7771c3-8bfb-4c8d-a827-a6ed71b7ced8 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:47.823623625 +0000 UTC m=+88.360879556 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j9286" (UID: "df7771c3-8bfb-4c8d-a827-a6ed71b7ced8") : configmap "kube-rbac-proxy" not found Jul 24 14:35:47.831786 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:47.831755 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j9286\" (UID: \"df7771c3-8bfb-4c8d-a827-a6ed71b7ced8\") " pod="openshift-insights/insights-runtime-extractor-j9286" Jul 24 14:35:47.832383 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:47.831806 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j9286\" (UID: \"df7771c3-8bfb-4c8d-a827-a6ed71b7ced8\") " pod="openshift-insights/insights-runtime-extractor-j9286" Jul 24 14:35:47.832383 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:47.831895 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 14:35:47.832383 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:47.831946 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-kube-rbac-proxy-cm podName:df7771c3-8bfb-4c8d-a827-a6ed71b7ced8 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:49.831933449 +0000 UTC m=+90.369189392 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j9286" (UID: "df7771c3-8bfb-4c8d-a827-a6ed71b7ced8") : configmap "kube-rbac-proxy" not found Jul 24 14:35:47.832383 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:47.831947 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 14:35:47.832383 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:47.832012 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-insights-runtime-extractor-tls podName:df7771c3-8bfb-4c8d-a827-a6ed71b7ced8 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:49.83199392 +0000 UTC m=+90.369249883 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j9286" (UID: "df7771c3-8bfb-4c8d-a827-a6ed71b7ced8") : secret "insights-runtime-extractor-tls" not found Jul 24 14:35:48.097233 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:48.097141 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-shsqx_df66942e-5c07-46e0-93fe-04ad53865c89/dns-node-resolver/0.log" Jul 24 14:35:48.896017 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:48.895988 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rrxgj_76abe981-1c84-4f65-82ff-a837b3e20722/node-ca/0.log" Jul 24 14:35:49.497085 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:49.497048 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-df8sl_95c5e482-1abe-49b4-bb3e-154df4ac5486/serve-healthcheck-canary/0.log" Jul 24 14:35:49.845902 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:49.845874 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j9286\" (UID: \"df7771c3-8bfb-4c8d-a827-a6ed71b7ced8\") " pod="openshift-insights/insights-runtime-extractor-j9286" Jul 24 14:35:49.846053 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:49.845994 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 14:35:49.846094 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:49.846047 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j9286\" (UID: \"df7771c3-8bfb-4c8d-a827-a6ed71b7ced8\") " pod="openshift-insights/insights-runtime-extractor-j9286" Jul 24 14:35:49.846094 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:49.846066 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-kube-rbac-proxy-cm podName:df7771c3-8bfb-4c8d-a827-a6ed71b7ced8 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:53.846045571 +0000 UTC m=+94.383301531 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j9286" (UID: "df7771c3-8bfb-4c8d-a827-a6ed71b7ced8") : configmap "kube-rbac-proxy" not found Jul 24 14:35:49.846188 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:49.846139 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 14:35:49.846228 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:49.846217 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-insights-runtime-extractor-tls podName:df7771c3-8bfb-4c8d-a827-a6ed71b7ced8 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:53.846207263 +0000 UTC m=+94.383463193 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j9286" (UID: "df7771c3-8bfb-4c8d-a827-a6ed71b7ced8") : secret "insights-runtime-extractor-tls" not found Jul 24 14:35:50.754250 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:50.754212 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef917c53-72f3-4267-a655-84607918a723-metrics-certs\") pod \"router-default-78dd4996b7-bzkqg\" (UID: \"ef917c53-72f3-4267-a655-84607918a723\") " pod="openshift-ingress/router-default-78dd4996b7-bzkqg" Jul 24 14:35:50.754687 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:50.754261 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef917c53-72f3-4267-a655-84607918a723-service-ca-bundle\") pod \"router-default-78dd4996b7-bzkqg\" (UID: \"ef917c53-72f3-4267-a655-84607918a723\") " pod="openshift-ingress/router-default-78dd4996b7-bzkqg" Jul 24 14:35:50.754687 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:50.754290 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad44feb0-98db-4e8f-b9f9-b7495d6adf97-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-tzpfp\" (UID: \"ad44feb0-98db-4e8f-b9f9-b7495d6adf97\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-tzpfp" Jul 24 14:35:50.754687 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:50.754371 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 14:35:50.754687 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:50.754393 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 14:35:50.754687 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:50.754433 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ef917c53-72f3-4267-a655-84607918a723-service-ca-bundle podName:ef917c53-72f3-4267-a655-84607918a723 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:58.754416742 +0000 UTC m=+99.291672712 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ef917c53-72f3-4267-a655-84607918a723-service-ca-bundle") pod "router-default-78dd4996b7-bzkqg" (UID: "ef917c53-72f3-4267-a655-84607918a723") : configmap references non-existent config key: service-ca.crt Jul 24 14:35:50.754687 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:50.754457 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad44feb0-98db-4e8f-b9f9-b7495d6adf97-cluster-monitoring-operator-tls podName:ad44feb0-98db-4e8f-b9f9-b7495d6adf97 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:58.754450359 +0000 UTC m=+99.291706289 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ad44feb0-98db-4e8f-b9f9-b7495d6adf97-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-tzpfp" (UID: "ad44feb0-98db-4e8f-b9f9-b7495d6adf97") : secret "cluster-monitoring-operator-tls" not found Jul 24 14:35:50.754687 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:50.754482 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef917c53-72f3-4267-a655-84607918a723-metrics-certs podName:ef917c53-72f3-4267-a655-84607918a723 nodeName:}" failed. No retries permitted until 2026-07-24 14:35:58.754462473 +0000 UTC m=+99.291718416 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef917c53-72f3-4267-a655-84607918a723-metrics-certs") pod "router-default-78dd4996b7-bzkqg" (UID: "ef917c53-72f3-4267-a655-84607918a723") : secret "router-metrics-certs-default" not found Jul 24 14:35:52.861884 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:52.861852 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-mznsz"] Jul 24 14:35:52.864950 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:52.864935 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-mznsz" Jul 24 14:35:52.867564 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:52.867540 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-j8jvh\"" Jul 24 14:35:52.882231 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:52.882211 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-mznsz"] Jul 24 14:35:52.967223 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:52.967200 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxbdx\" (UniqueName: \"kubernetes.io/projected/f6be018f-08a6-41ab-9281-76b9b5e36ccc-kube-api-access-rxbdx\") pod \"network-check-source-7d88cb55d8-mznsz\" (UID: \"f6be018f-08a6-41ab-9281-76b9b5e36ccc\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-mznsz" Jul 24 14:35:53.068141 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:53.068111 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxbdx\" (UniqueName: \"kubernetes.io/projected/f6be018f-08a6-41ab-9281-76b9b5e36ccc-kube-api-access-rxbdx\") pod \"network-check-source-7d88cb55d8-mznsz\" (UID: \"f6be018f-08a6-41ab-9281-76b9b5e36ccc\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-mznsz" Jul 24 14:35:53.076819 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:53.076794 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxbdx\" (UniqueName: \"kubernetes.io/projected/f6be018f-08a6-41ab-9281-76b9b5e36ccc-kube-api-access-rxbdx\") pod \"network-check-source-7d88cb55d8-mznsz\" (UID: \"f6be018f-08a6-41ab-9281-76b9b5e36ccc\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-mznsz" Jul 24 14:35:53.174040 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:53.173985 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-mznsz" Jul 24 14:35:53.291830 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:53.291803 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-mznsz"] Jul 24 14:35:53.294833 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:35:53.294797 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6be018f_08a6_41ab_9281_76b9b5e36ccc.slice/crio-6fd4ce3803105d612739b85b06451ea1bbb980da04d20eedb4fc4f5a8b48fdea WatchSource:0}: Error finding container 6fd4ce3803105d612739b85b06451ea1bbb980da04d20eedb4fc4f5a8b48fdea: Status 404 returned error can't find the container with id 6fd4ce3803105d612739b85b06451ea1bbb980da04d20eedb4fc4f5a8b48fdea Jul 24 14:35:53.419756 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:53.419721 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-mznsz" event={"ID":"f6be018f-08a6-41ab-9281-76b9b5e36ccc","Type":"ContainerStarted","Data":"4bed57c50b30f187d535e461dd3c30459f2a139291ef42f4102b3630376662df"} Jul 24 14:35:53.419936 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:53.419811 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-mznsz" event={"ID":"f6be018f-08a6-41ab-9281-76b9b5e36ccc","Type":"ContainerStarted","Data":"6fd4ce3803105d612739b85b06451ea1bbb980da04d20eedb4fc4f5a8b48fdea"} Jul 24 14:35:53.444918 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:53.444839 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-mznsz" podStartSLOduration=1.44482322 podStartE2EDuration="1.44482322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:35:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:35:53.443355839 +0000 UTC m=+93.980611791" watchObservedRunningTime="2026-07-24 14:35:53.44482322 +0000 UTC m=+93.982079171" Jul 24 14:35:53.874354 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:53.874320 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j9286\" (UID: \"df7771c3-8bfb-4c8d-a827-a6ed71b7ced8\") " pod="openshift-insights/insights-runtime-extractor-j9286" Jul 24 14:35:53.874754 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:53.874381 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j9286\" (UID: \"df7771c3-8bfb-4c8d-a827-a6ed71b7ced8\") " pod="openshift-insights/insights-runtime-extractor-j9286" Jul 24 14:35:53.874754 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:53.874461 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 14:35:53.874754 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:53.874487 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 14:35:53.874754 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:53.874532 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-insights-runtime-extractor-tls podName:df7771c3-8bfb-4c8d-a827-a6ed71b7ced8 nodeName:}" failed. No retries permitted until 2026-07-24 14:36:01.874517279 +0000 UTC m=+102.411773212 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j9286" (UID: "df7771c3-8bfb-4c8d-a827-a6ed71b7ced8") : secret "insights-runtime-extractor-tls" not found Jul 24 14:35:53.874754 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:53.874547 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-kube-rbac-proxy-cm podName:df7771c3-8bfb-4c8d-a827-a6ed71b7ced8 nodeName:}" failed. No retries permitted until 2026-07-24 14:36:01.874540486 +0000 UTC m=+102.411796416 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j9286" (UID: "df7771c3-8bfb-4c8d-a827-a6ed71b7ced8") : configmap "kube-rbac-proxy" not found Jul 24 14:35:57.217801 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:57.217773 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-xpt99"] Jul 24 14:35:57.220703 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:57.220688 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-xpt99" Jul 24 14:35:57.223800 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:57.223783 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-cfwwg\"" Jul 24 14:35:57.224734 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:57.224716 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 24 14:35:57.224734 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:57.224730 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 24 14:35:57.238006 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:57.237986 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-xpt99"] Jul 24 14:35:57.299388 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:57.299357 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkddz\" (UniqueName: \"kubernetes.io/projected/d2669faf-0fa7-41fe-9672-39018dfab799-kube-api-access-dkddz\") pod \"migrator-6865c9967-xpt99\" (UID: \"d2669faf-0fa7-41fe-9672-39018dfab799\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-xpt99" Jul 24 14:35:57.399917 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:57.399895 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkddz\" (UniqueName: \"kubernetes.io/projected/d2669faf-0fa7-41fe-9672-39018dfab799-kube-api-access-dkddz\") pod \"migrator-6865c9967-xpt99\" (UID: \"d2669faf-0fa7-41fe-9672-39018dfab799\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-xpt99" Jul 24 14:35:57.410908 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:57.410882 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkddz\" (UniqueName: \"kubernetes.io/projected/d2669faf-0fa7-41fe-9672-39018dfab799-kube-api-access-dkddz\") pod \"migrator-6865c9967-xpt99\" (UID: \"d2669faf-0fa7-41fe-9672-39018dfab799\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-xpt99" Jul 24 14:35:57.529580 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:57.529565 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-xpt99" Jul 24 14:35:57.644125 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:57.644101 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-xpt99"] Jul 24 14:35:57.646394 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:35:57.646363 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2669faf_0fa7_41fe_9672_39018dfab799.slice/crio-a52f0e4c198994c4e7552b61640295397403e0867ffc7173d73128b49e2acb33 WatchSource:0}: Error finding container a52f0e4c198994c4e7552b61640295397403e0867ffc7173d73128b49e2acb33: Status 404 returned error can't find the container with id a52f0e4c198994c4e7552b61640295397403e0867ffc7173d73128b49e2acb33 Jul 24 14:35:58.433187 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:58.433133 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-xpt99" event={"ID":"d2669faf-0fa7-41fe-9672-39018dfab799","Type":"ContainerStarted","Data":"a52f0e4c198994c4e7552b61640295397403e0867ffc7173d73128b49e2acb33"} Jul 24 14:35:58.812341 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:58.812318 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad44feb0-98db-4e8f-b9f9-b7495d6adf97-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-tzpfp\" (UID: \"ad44feb0-98db-4e8f-b9f9-b7495d6adf97\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-tzpfp" Jul 24 14:35:58.812437 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:58.812385 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef917c53-72f3-4267-a655-84607918a723-metrics-certs\") pod \"router-default-78dd4996b7-bzkqg\" (UID: \"ef917c53-72f3-4267-a655-84607918a723\") " pod="openshift-ingress/router-default-78dd4996b7-bzkqg" Jul 24 14:35:58.812488 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:58.812460 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 14:35:58.812488 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:58.812462 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 14:35:58.812553 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:58.812498 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef917c53-72f3-4267-a655-84607918a723-metrics-certs podName:ef917c53-72f3-4267-a655-84607918a723 nodeName:}" failed. No retries permitted until 2026-07-24 14:36:14.812486161 +0000 UTC m=+115.349742090 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef917c53-72f3-4267-a655-84607918a723-metrics-certs") pod "router-default-78dd4996b7-bzkqg" (UID: "ef917c53-72f3-4267-a655-84607918a723") : secret "router-metrics-certs-default" not found Jul 24 14:35:58.812553 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:58.812515 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad44feb0-98db-4e8f-b9f9-b7495d6adf97-cluster-monitoring-operator-tls podName:ad44feb0-98db-4e8f-b9f9-b7495d6adf97 nodeName:}" failed. No retries permitted until 2026-07-24 14:36:14.812505668 +0000 UTC m=+115.349761599 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ad44feb0-98db-4e8f-b9f9-b7495d6adf97-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-tzpfp" (UID: "ad44feb0-98db-4e8f-b9f9-b7495d6adf97") : secret "cluster-monitoring-operator-tls" not found Jul 24 14:35:58.812623 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:58.812552 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef917c53-72f3-4267-a655-84607918a723-service-ca-bundle\") pod \"router-default-78dd4996b7-bzkqg\" (UID: \"ef917c53-72f3-4267-a655-84607918a723\") " pod="openshift-ingress/router-default-78dd4996b7-bzkqg" Jul 24 14:35:58.812660 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:58.812639 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ef917c53-72f3-4267-a655-84607918a723-service-ca-bundle podName:ef917c53-72f3-4267-a655-84607918a723 nodeName:}" failed. No retries permitted until 2026-07-24 14:36:14.812629936 +0000 UTC m=+115.349885880 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ef917c53-72f3-4267-a655-84607918a723-service-ca-bundle") pod "router-default-78dd4996b7-bzkqg" (UID: "ef917c53-72f3-4267-a655-84607918a723") : configmap references non-existent config key: service-ca.crt Jul 24 14:35:59.115849 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:59.115824 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1af447a-c7f6-4788-b687-514e2f6f732e-metrics-tls\") pod \"dns-default-lxwhk\" (UID: \"f1af447a-c7f6-4788-b687-514e2f6f732e\") " pod="openshift-dns/dns-default-lxwhk" Jul 24 14:35:59.115981 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:59.115963 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 14:35:59.116028 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:35:59.116021 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1af447a-c7f6-4788-b687-514e2f6f732e-metrics-tls podName:f1af447a-c7f6-4788-b687-514e2f6f732e nodeName:}" failed. No retries permitted until 2026-07-24 14:37:03.116006305 +0000 UTC m=+163.653262235 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f1af447a-c7f6-4788-b687-514e2f6f732e-metrics-tls") pod "dns-default-lxwhk" (UID: "f1af447a-c7f6-4788-b687-514e2f6f732e") : secret "dns-default-metrics-tls" not found Jul 24 14:35:59.437387 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:59.437304 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-xpt99" event={"ID":"d2669faf-0fa7-41fe-9672-39018dfab799","Type":"ContainerStarted","Data":"fa7119b57362434abfe32035a3fa279f2bdfa02c66a3d241e4b686bcb1dbee24"} Jul 24 14:35:59.437387 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:59.437364 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-xpt99" event={"ID":"d2669faf-0fa7-41fe-9672-39018dfab799","Type":"ContainerStarted","Data":"c066cc49bef893eadddac23bd229c2d2cc01f9838873f60740de2438e3e8d4b7"} Jul 24 14:35:59.460579 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:35:59.460533 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-xpt99" podStartSLOduration=1.375048208 podStartE2EDuration="2.460518025s" totalImagesPullingTime="1.085469817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:35:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:35:59.45965611 +0000 UTC m=+99.996912062" watchObservedRunningTime="2026-07-24 14:35:59.460518025 +0000 UTC m=+99.997773976" Jul 24 14:36:01.937003 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:01.936967 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j9286\" (UID: \"df7771c3-8bfb-4c8d-a827-a6ed71b7ced8\") " pod="openshift-insights/insights-runtime-extractor-j9286" Jul 24 14:36:01.937454 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:01.937017 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j9286\" (UID: \"df7771c3-8bfb-4c8d-a827-a6ed71b7ced8\") " pod="openshift-insights/insights-runtime-extractor-j9286" Jul 24 14:36:01.937454 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:36:01.937091 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 14:36:01.937454 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:36:01.937162 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-insights-runtime-extractor-tls podName:df7771c3-8bfb-4c8d-a827-a6ed71b7ced8 nodeName:}" failed. No retries permitted until 2026-07-24 14:36:17.937135521 +0000 UTC m=+118.474391451 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j9286" (UID: "df7771c3-8bfb-4c8d-a827-a6ed71b7ced8") : secret "insights-runtime-extractor-tls" not found Jul 24 14:36:01.937569 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:01.937466 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j9286\" (UID: \"df7771c3-8bfb-4c8d-a827-a6ed71b7ced8\") " pod="openshift-insights/insights-runtime-extractor-j9286" Jul 24 14:36:02.370257 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:02.370231 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hcq7x" Jul 24 14:36:14.823011 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:14.822962 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef917c53-72f3-4267-a655-84607918a723-metrics-certs\") pod \"router-default-78dd4996b7-bzkqg\" (UID: \"ef917c53-72f3-4267-a655-84607918a723\") " pod="openshift-ingress/router-default-78dd4996b7-bzkqg" Jul 24 14:36:14.823664 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:14.823022 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef917c53-72f3-4267-a655-84607918a723-service-ca-bundle\") pod \"router-default-78dd4996b7-bzkqg\" (UID: \"ef917c53-72f3-4267-a655-84607918a723\") " pod="openshift-ingress/router-default-78dd4996b7-bzkqg" Jul 24 14:36:14.823664 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:14.823060 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad44feb0-98db-4e8f-b9f9-b7495d6adf97-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-tzpfp\" (UID: \"ad44feb0-98db-4e8f-b9f9-b7495d6adf97\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-tzpfp" Jul 24 14:36:14.823664 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:36:14.823087 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 14:36:14.823664 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:36:14.823198 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 14:36:14.823664 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:36:14.823209 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef917c53-72f3-4267-a655-84607918a723-metrics-certs podName:ef917c53-72f3-4267-a655-84607918a723 nodeName:}" failed. No retries permitted until 2026-07-24 14:36:46.823180905 +0000 UTC m=+147.360436875 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef917c53-72f3-4267-a655-84607918a723-metrics-certs") pod "router-default-78dd4996b7-bzkqg" (UID: "ef917c53-72f3-4267-a655-84607918a723") : secret "router-metrics-certs-default" not found Jul 24 14:36:14.823664 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:36:14.823267 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad44feb0-98db-4e8f-b9f9-b7495d6adf97-cluster-monitoring-operator-tls podName:ad44feb0-98db-4e8f-b9f9-b7495d6adf97 nodeName:}" failed. No retries permitted until 2026-07-24 14:36:46.823252985 +0000 UTC m=+147.360508915 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ad44feb0-98db-4e8f-b9f9-b7495d6adf97-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-tzpfp" (UID: "ad44feb0-98db-4e8f-b9f9-b7495d6adf97") : secret "cluster-monitoring-operator-tls" not found Jul 24 14:36:14.823664 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:36:14.823284 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ef917c53-72f3-4267-a655-84607918a723-service-ca-bundle podName:ef917c53-72f3-4267-a655-84607918a723 nodeName:}" failed. No retries permitted until 2026-07-24 14:36:46.823276973 +0000 UTC m=+147.360532902 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ef917c53-72f3-4267-a655-84607918a723-service-ca-bundle") pod "router-default-78dd4996b7-bzkqg" (UID: "ef917c53-72f3-4267-a655-84607918a723") : configmap references non-existent config key: service-ca.crt Jul 24 14:36:17.947283 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:17.947246 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j9286\" (UID: \"df7771c3-8bfb-4c8d-a827-a6ed71b7ced8\") " pod="openshift-insights/insights-runtime-extractor-j9286" Jul 24 14:36:17.949619 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:17.949586 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df7771c3-8bfb-4c8d-a827-a6ed71b7ced8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j9286\" (UID: \"df7771c3-8bfb-4c8d-a827-a6ed71b7ced8\") " pod="openshift-insights/insights-runtime-extractor-j9286" Jul 24 14:36:18.232521 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:18.232444 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j9286" Jul 24 14:36:18.354736 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:18.354618 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j9286"] Jul 24 14:36:18.357302 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:36:18.357275 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf7771c3_8bfb_4c8d_a827_a6ed71b7ced8.slice/crio-c45cac1b8535a85a0b2222598f02be633865fee5d696f35f6d408922eeb256a5 WatchSource:0}: Error finding container c45cac1b8535a85a0b2222598f02be633865fee5d696f35f6d408922eeb256a5: Status 404 returned error can't find the container with id c45cac1b8535a85a0b2222598f02be633865fee5d696f35f6d408922eeb256a5 Jul 24 14:36:18.492750 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:18.492685 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j9286" event={"ID":"df7771c3-8bfb-4c8d-a827-a6ed71b7ced8","Type":"ContainerStarted","Data":"c45cac1b8535a85a0b2222598f02be633865fee5d696f35f6d408922eeb256a5"} Jul 24 14:36:23.512667 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:23.512542 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j9286" event={"ID":"df7771c3-8bfb-4c8d-a827-a6ed71b7ced8","Type":"ContainerStarted","Data":"72f0bcea8521d4220d9e53acd3bf432721885ef322bd6dd7ac4d2596fee0d987"} Jul 24 14:36:26.524794 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:26.524755 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j9286" event={"ID":"df7771c3-8bfb-4c8d-a827-a6ed71b7ced8","Type":"ContainerStarted","Data":"c219453b9b326ad1152a429f3b847d4f6dab9d62bf32129dab1a88a39c88fe21"} Jul 24 14:36:29.846928 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:29.846905 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d6fca35-b619-48ce-9227-1f10e1b2fda1-metrics-certs\") pod \"network-metrics-daemon-wjgg5\" (UID: \"5d6fca35-b619-48ce-9227-1f10e1b2fda1\") " pod="openshift-multus/network-metrics-daemon-wjgg5" Jul 24 14:36:29.849088 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:29.849065 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d6fca35-b619-48ce-9227-1f10e1b2fda1-metrics-certs\") pod \"network-metrics-daemon-wjgg5\" (UID: \"5d6fca35-b619-48ce-9227-1f10e1b2fda1\") " pod="openshift-multus/network-metrics-daemon-wjgg5" Jul 24 14:36:30.130271 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:30.130200 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d7cdd\"" Jul 24 14:36:30.138416 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:30.138393 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjgg5" Jul 24 14:36:30.293437 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:30.293405 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wjgg5"] Jul 24 14:36:30.296167 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:36:30.296125 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d6fca35_b619_48ce_9227_1f10e1b2fda1.slice/crio-19c5f85f471f94e3a094efa9dfedae3fcbb962217c253ffd54a80e0ee9b4d73a WatchSource:0}: Error finding container 19c5f85f471f94e3a094efa9dfedae3fcbb962217c253ffd54a80e0ee9b4d73a: Status 404 returned error can't find the container with id 19c5f85f471f94e3a094efa9dfedae3fcbb962217c253ffd54a80e0ee9b4d73a Jul 24 14:36:30.538542 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:30.538515 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j9286" event={"ID":"df7771c3-8bfb-4c8d-a827-a6ed71b7ced8","Type":"ContainerStarted","Data":"d7d1aa009166bf71a414a07a9e57d8808ffdebed36ee60b674852d542e65dfc5"} Jul 24 14:36:30.539596 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:30.539573 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wjgg5" event={"ID":"5d6fca35-b619-48ce-9227-1f10e1b2fda1","Type":"ContainerStarted","Data":"19c5f85f471f94e3a094efa9dfedae3fcbb962217c253ffd54a80e0ee9b4d73a"} Jul 24 14:36:30.559091 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:30.559049 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-j9286" podStartSLOduration=33.223815164 podStartE2EDuration="44.559036043s" totalImagesPullingTime="11.335220879s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:35:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:36:30.558059833 +0000 UTC m=+131.095315784" watchObservedRunningTime="2026-07-24 14:36:30.559036043 +0000 UTC m=+131.096291995" Jul 24 14:36:31.545141 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:31.545106 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wjgg5" event={"ID":"5d6fca35-b619-48ce-9227-1f10e1b2fda1","Type":"ContainerStarted","Data":"658f04466a856ebbd1cd8b03d373056ec3fa6c36564efee1f49786c7a0edab4a"} Jul 24 14:36:31.545497 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:31.545228 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wjgg5" event={"ID":"5d6fca35-b619-48ce-9227-1f10e1b2fda1","Type":"ContainerStarted","Data":"fefaef2ae0f64bc2420ac0d01541d437860f1cc71c37c7d4a0600d6f1ee3e7d6"} Jul 24 14:36:31.563173 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:31.563067 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wjgg5" podStartSLOduration=129.562660282 podStartE2EDuration="2m10.563052333s" totalImagesPullingTime="1.000392051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:36:31.561327893 +0000 UTC m=+132.098583848" watchObservedRunningTime="2026-07-24 14:36:31.563052333 +0000 UTC m=+132.100308286" Jul 24 14:36:31.868801 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:31.868720 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-njtks"] Jul 24 14:36:31.871804 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:31.871785 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-njtks" Jul 24 14:36:31.876026 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:31.876009 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-gw42v\"" Jul 24 14:36:31.882140 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:31.882121 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 24 14:36:31.884023 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:31.884005 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 24 14:36:31.917452 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:31.917429 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-njtks"] Jul 24 14:36:31.963986 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:31.963967 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4ca60a05-a187-4eff-85e3-6fff76c4d980-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-njtks\" (UID: \"4ca60a05-a187-4eff-85e3-6fff76c4d980\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-njtks" Jul 24 14:36:31.964069 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:31.964010 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ca60a05-a187-4eff-85e3-6fff76c4d980-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-njtks\" (UID: \"4ca60a05-a187-4eff-85e3-6fff76c4d980\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-njtks" Jul 24 14:36:31.982985 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:31.982966 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-d88fcb476-xt485"] Jul 24 14:36:31.985851 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:31.985834 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d88fcb476-xt485" Jul 24 14:36:31.989440 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:31.989420 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 24 14:36:31.989566 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:31.989541 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pzwk4\"" Jul 24 14:36:31.989846 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:31.989832 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 24 14:36:31.989846 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:31.989839 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 24 14:36:31.994743 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:31.994727 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 24 14:36:32.002707 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.002679 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d88fcb476-xt485"] Jul 24 14:36:32.064954 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.064926 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttshn\" (UniqueName: \"kubernetes.io/projected/e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1-kube-api-access-ttshn\") pod \"image-registry-d88fcb476-xt485\" (UID: \"e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1\") " pod="openshift-image-registry/image-registry-d88fcb476-xt485" Jul 24 14:36:32.065070 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.064961 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1-installation-pull-secrets\") pod \"image-registry-d88fcb476-xt485\" (UID: \"e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1\") " pod="openshift-image-registry/image-registry-d88fcb476-xt485" Jul 24 14:36:32.065070 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.065003 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ca60a05-a187-4eff-85e3-6fff76c4d980-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-njtks\" (UID: \"4ca60a05-a187-4eff-85e3-6fff76c4d980\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-njtks" Jul 24 14:36:32.065070 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.065030 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1-trusted-ca\") pod \"image-registry-d88fcb476-xt485\" (UID: \"e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1\") " pod="openshift-image-registry/image-registry-d88fcb476-xt485" Jul 24 14:36:32.065247 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.065091 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1-ca-trust-extracted\") pod \"image-registry-d88fcb476-xt485\" (UID: \"e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1\") " pod="openshift-image-registry/image-registry-d88fcb476-xt485" Jul 24 14:36:32.065247 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.065115 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1-bound-sa-token\") pod \"image-registry-d88fcb476-xt485\" (UID: \"e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1\") " pod="openshift-image-registry/image-registry-d88fcb476-xt485" Jul 24 14:36:32.065247 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.065166 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4ca60a05-a187-4eff-85e3-6fff76c4d980-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-njtks\" (UID: \"4ca60a05-a187-4eff-85e3-6fff76c4d980\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-njtks" Jul 24 14:36:32.065366 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.065254 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1-registry-certificates\") pod \"image-registry-d88fcb476-xt485\" (UID: \"e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1\") " pod="openshift-image-registry/image-registry-d88fcb476-xt485" Jul 24 14:36:32.065366 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.065293 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1-registry-tls\") pod \"image-registry-d88fcb476-xt485\" (UID: \"e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1\") " pod="openshift-image-registry/image-registry-d88fcb476-xt485" Jul 24 14:36:32.065366 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.065345 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1-image-registry-private-configuration\") pod \"image-registry-d88fcb476-xt485\" (UID: \"e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1\") " pod="openshift-image-registry/image-registry-d88fcb476-xt485" Jul 24 14:36:32.065729 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.065712 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4ca60a05-a187-4eff-85e3-6fff76c4d980-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-njtks\" (UID: \"4ca60a05-a187-4eff-85e3-6fff76c4d980\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-njtks" Jul 24 14:36:32.067359 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.067336 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ca60a05-a187-4eff-85e3-6fff76c4d980-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-njtks\" (UID: \"4ca60a05-a187-4eff-85e3-6fff76c4d980\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-njtks" Jul 24 14:36:32.166265 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.166215 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1-ca-trust-extracted\") pod \"image-registry-d88fcb476-xt485\" (UID: \"e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1\") " pod="openshift-image-registry/image-registry-d88fcb476-xt485" Jul 24 14:36:32.166265 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.166239 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1-bound-sa-token\") pod \"image-registry-d88fcb476-xt485\" (UID: \"e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1\") " pod="openshift-image-registry/image-registry-d88fcb476-xt485" Jul 24 14:36:32.166420 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.166266 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1-registry-certificates\") pod \"image-registry-d88fcb476-xt485\" (UID: \"e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1\") " pod="openshift-image-registry/image-registry-d88fcb476-xt485" Jul 24 14:36:32.166420 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.166299 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1-registry-tls\") pod \"image-registry-d88fcb476-xt485\" (UID: \"e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1\") " pod="openshift-image-registry/image-registry-d88fcb476-xt485" Jul 24 14:36:32.166420 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.166326 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1-image-registry-private-configuration\") pod \"image-registry-d88fcb476-xt485\" (UID: \"e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1\") " pod="openshift-image-registry/image-registry-d88fcb476-xt485" Jul 24 14:36:32.166420 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.166371 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttshn\" (UniqueName: \"kubernetes.io/projected/e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1-kube-api-access-ttshn\") pod \"image-registry-d88fcb476-xt485\" (UID: \"e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1\") " pod="openshift-image-registry/image-registry-d88fcb476-xt485" Jul 24 14:36:32.166420 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.166398 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1-installation-pull-secrets\") pod \"image-registry-d88fcb476-xt485\" (UID: \"e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1\") " pod="openshift-image-registry/image-registry-d88fcb476-xt485" Jul 24 14:36:32.166671 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.166438 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1-trusted-ca\") pod \"image-registry-d88fcb476-xt485\" (UID: \"e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1\") " pod="openshift-image-registry/image-registry-d88fcb476-xt485" Jul 24 14:36:32.166671 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.166580 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1-ca-trust-extracted\") pod \"image-registry-d88fcb476-xt485\" (UID: \"e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1\") " pod="openshift-image-registry/image-registry-d88fcb476-xt485" Jul 24 14:36:32.167111 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.167084 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1-registry-certificates\") pod \"image-registry-d88fcb476-xt485\" (UID: \"e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1\") " pod="openshift-image-registry/image-registry-d88fcb476-xt485" Jul 24 14:36:32.167258 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.167239 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1-trusted-ca\") pod \"image-registry-d88fcb476-xt485\" (UID: \"e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1\") " pod="openshift-image-registry/image-registry-d88fcb476-xt485" Jul 24 14:36:32.168589 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.168568 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1-registry-tls\") pod \"image-registry-d88fcb476-xt485\" (UID: \"e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1\") " pod="openshift-image-registry/image-registry-d88fcb476-xt485" Jul 24 14:36:32.168861 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.168845 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1-image-registry-private-configuration\") pod \"image-registry-d88fcb476-xt485\" (UID: \"e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1\") " pod="openshift-image-registry/image-registry-d88fcb476-xt485" Jul 24 14:36:32.169012 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.168996 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1-installation-pull-secrets\") pod \"image-registry-d88fcb476-xt485\" (UID: \"e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1\") " pod="openshift-image-registry/image-registry-d88fcb476-xt485" Jul 24 14:36:32.179881 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.179865 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-njtks" Jul 24 14:36:32.185060 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.185043 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1-bound-sa-token\") pod \"image-registry-d88fcb476-xt485\" (UID: \"e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1\") " pod="openshift-image-registry/image-registry-d88fcb476-xt485" Jul 24 14:36:32.185210 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.185188 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttshn\" (UniqueName: \"kubernetes.io/projected/e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1-kube-api-access-ttshn\") pod \"image-registry-d88fcb476-xt485\" (UID: \"e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1\") " pod="openshift-image-registry/image-registry-d88fcb476-xt485" Jul 24 14:36:32.294255 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.294226 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d88fcb476-xt485" Jul 24 14:36:32.318378 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.318309 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-njtks"] Jul 24 14:36:32.321763 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:36:32.321729 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ca60a05_a187_4eff_85e3_6fff76c4d980.slice/crio-64d9c122f9d4a27bbdb476a74548bd8be234456bf4cddfb37816a7e1d5338b64 WatchSource:0}: Error finding container 64d9c122f9d4a27bbdb476a74548bd8be234456bf4cddfb37816a7e1d5338b64: Status 404 returned error can't find the container with id 64d9c122f9d4a27bbdb476a74548bd8be234456bf4cddfb37816a7e1d5338b64 Jul 24 14:36:32.442553 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.442514 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d88fcb476-xt485"] Jul 24 14:36:32.444910 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:36:32.444879 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1ef4d3b_21c2_4fb4_9e4d_9c01393052f1.slice/crio-6dabfead2533d66f7fb038053ca5f97bd2afc76b02a1777f1f193679400cc3fa WatchSource:0}: Error finding container 6dabfead2533d66f7fb038053ca5f97bd2afc76b02a1777f1f193679400cc3fa: Status 404 returned error can't find the container with id 6dabfead2533d66f7fb038053ca5f97bd2afc76b02a1777f1f193679400cc3fa Jul 24 14:36:32.549947 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.549920 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d88fcb476-xt485" event={"ID":"e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1","Type":"ContainerStarted","Data":"6c366a0c27e52e0f13c53ee98295359c16b0115219c5f73ecf63517425e00ce3"} Jul 24 14:36:32.550263 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.549966 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d88fcb476-xt485" event={"ID":"e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1","Type":"ContainerStarted","Data":"6dabfead2533d66f7fb038053ca5f97bd2afc76b02a1777f1f193679400cc3fa"} Jul 24 14:36:32.550263 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.550014 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-d88fcb476-xt485" Jul 24 14:36:32.551185 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.551148 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-njtks" event={"ID":"4ca60a05-a187-4eff-85e3-6fff76c4d980","Type":"ContainerStarted","Data":"64d9c122f9d4a27bbdb476a74548bd8be234456bf4cddfb37816a7e1d5338b64"} Jul 24 14:36:32.613328 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:32.613286 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-d88fcb476-xt485" podStartSLOduration=1.613271006 podStartE2EDuration="1.613271006s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:36:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:36:32.612968589 +0000 UTC m=+133.150224540" watchObservedRunningTime="2026-07-24 14:36:32.613271006 +0000 UTC m=+133.150526959" Jul 24 14:36:34.559914 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:34.559877 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-njtks" event={"ID":"4ca60a05-a187-4eff-85e3-6fff76c4d980","Type":"ContainerStarted","Data":"f6d78bf771c8ca868373fbd8eb636e0aaf47c1c20848eb47c82f53eed82f27a1"} Jul 24 14:36:34.580555 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:34.580510 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-njtks" podStartSLOduration=1.7301024790000001 podStartE2EDuration="3.580494664s" totalImagesPullingTime="1.850392185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:36:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:36:34.579913645 +0000 UTC m=+135.117169612" watchObservedRunningTime="2026-07-24 14:36:34.580494664 +0000 UTC m=+135.117750615" Jul 24 14:36:46.873645 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:46.873603 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef917c53-72f3-4267-a655-84607918a723-service-ca-bundle\") pod \"router-default-78dd4996b7-bzkqg\" (UID: \"ef917c53-72f3-4267-a655-84607918a723\") " pod="openshift-ingress/router-default-78dd4996b7-bzkqg" Jul 24 14:36:46.873645 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:46.873652 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad44feb0-98db-4e8f-b9f9-b7495d6adf97-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-tzpfp\" (UID: \"ad44feb0-98db-4e8f-b9f9-b7495d6adf97\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-tzpfp" Jul 24 14:36:46.874133 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:46.873678 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef917c53-72f3-4267-a655-84607918a723-metrics-certs\") pod \"router-default-78dd4996b7-bzkqg\" (UID: \"ef917c53-72f3-4267-a655-84607918a723\") " pod="openshift-ingress/router-default-78dd4996b7-bzkqg" Jul 24 14:36:46.874193 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:46.874175 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef917c53-72f3-4267-a655-84607918a723-service-ca-bundle\") pod \"router-default-78dd4996b7-bzkqg\" (UID: \"ef917c53-72f3-4267-a655-84607918a723\") " pod="openshift-ingress/router-default-78dd4996b7-bzkqg" Jul 24 14:36:46.875918 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:46.875898 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad44feb0-98db-4e8f-b9f9-b7495d6adf97-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-tzpfp\" (UID: \"ad44feb0-98db-4e8f-b9f9-b7495d6adf97\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-tzpfp" Jul 24 14:36:46.875973 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:46.875934 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef917c53-72f3-4267-a655-84607918a723-metrics-certs\") pod \"router-default-78dd4996b7-bzkqg\" (UID: \"ef917c53-72f3-4267-a655-84607918a723\") " pod="openshift-ingress/router-default-78dd4996b7-bzkqg" Jul 24 14:36:46.925821 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:46.925800 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rhdrn\"" Jul 24 14:36:46.931935 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:46.931920 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-m7xtk\"" Jul 24 14:36:46.933963 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:46.933950 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-tzpfp" Jul 24 14:36:46.940373 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:46.940358 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-78dd4996b7-bzkqg" Jul 24 14:36:47.121457 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:47.121435 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-tzpfp"] Jul 24 14:36:47.123193 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:36:47.123143 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad44feb0_98db_4e8f_b9f9_b7495d6adf97.slice/crio-cb77ec989348e085f986e515259ccf16784d2a2367d819678f41887ed5963779 WatchSource:0}: Error finding container cb77ec989348e085f986e515259ccf16784d2a2367d819678f41887ed5963779: Status 404 returned error can't find the container with id cb77ec989348e085f986e515259ccf16784d2a2367d819678f41887ed5963779 Jul 24 14:36:47.125347 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:47.125306 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-78dd4996b7-bzkqg"] Jul 24 14:36:47.127232 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:36:47.127204 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef917c53_72f3_4267_a655_84607918a723.slice/crio-0fa48478d553fc87e9fd422d11b1eb480644c12868df8c8ed249c8c07c1b454f WatchSource:0}: Error finding container 0fa48478d553fc87e9fd422d11b1eb480644c12868df8c8ed249c8c07c1b454f: Status 404 returned error can't find the container with id 0fa48478d553fc87e9fd422d11b1eb480644c12868df8c8ed249c8c07c1b454f Jul 24 14:36:47.603692 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:47.603656 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-78dd4996b7-bzkqg" event={"ID":"ef917c53-72f3-4267-a655-84607918a723","Type":"ContainerStarted","Data":"df22453d3f3b81f0cffea430acdb578ae10707ae43afc444b60d0883c1aaa36e"} Jul 24 14:36:47.603881 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:47.603706 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-78dd4996b7-bzkqg" event={"ID":"ef917c53-72f3-4267-a655-84607918a723","Type":"ContainerStarted","Data":"0fa48478d553fc87e9fd422d11b1eb480644c12868df8c8ed249c8c07c1b454f"} Jul 24 14:36:47.604696 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:47.604674 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-tzpfp" event={"ID":"ad44feb0-98db-4e8f-b9f9-b7495d6adf97","Type":"ContainerStarted","Data":"cb77ec989348e085f986e515259ccf16784d2a2367d819678f41887ed5963779"} Jul 24 14:36:47.631828 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:47.631787 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-78dd4996b7-bzkqg" podStartSLOduration=65.631774093 podStartE2EDuration="1m5.631774093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:35:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:36:47.631007681 +0000 UTC m=+148.168263632" watchObservedRunningTime="2026-07-24 14:36:47.631774093 +0000 UTC m=+148.169030046" Jul 24 14:36:47.941209 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:47.941127 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-78dd4996b7-bzkqg" Jul 24 14:36:47.944077 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:47.944054 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-78dd4996b7-bzkqg" Jul 24 14:36:48.608040 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:48.608008 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-78dd4996b7-bzkqg" Jul 24 14:36:48.609394 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:48.609375 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-78dd4996b7-bzkqg" Jul 24 14:36:49.612485 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:49.612451 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-tzpfp" event={"ID":"ad44feb0-98db-4e8f-b9f9-b7495d6adf97","Type":"ContainerStarted","Data":"57f6800691cf317978c2826e03b9a73a365061b7ccac509fe7d8c5e03ff7d0ce"} Jul 24 14:36:49.633357 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:49.633314 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-tzpfp" podStartSLOduration=65.810884039 podStartE2EDuration="1m7.63330097s" totalImagesPullingTime="1.822416931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:35:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:36:49.632384701 +0000 UTC m=+150.169640655" watchObservedRunningTime="2026-07-24 14:36:49.63330097 +0000 UTC m=+150.170556918" Jul 24 14:36:53.560260 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:53.560234 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-d88fcb476-xt485" Jul 24 14:36:58.211806 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.211771 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-kcpd8"] Jul 24 14:36:58.250238 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.250206 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9k5wm"] Jul 24 14:36:58.250238 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.250236 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kcpd8" Jul 24 14:36:58.253294 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.253270 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 24 14:36:58.253450 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.253423 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-dxmsh\"" Jul 24 14:36:58.253742 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.253723 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-kcpd8"] Jul 24 14:36:58.253831 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.253808 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9k5wm" Jul 24 14:36:58.254401 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.254381 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 24 14:36:58.254539 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.254518 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 24 14:36:58.254602 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.254537 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 24 14:36:58.256360 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.256341 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 24 14:36:58.256472 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.256397 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 24 14:36:58.256535 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.256498 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2fgzq\"" Jul 24 14:36:58.256638 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.256612 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 24 14:36:58.299631 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:36:58.299608 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-lxwhk" podUID="f1af447a-c7f6-4788-b687-514e2f6f732e" Jul 24 14:36:58.349364 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.349337 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d34526b7-53c8-413d-8bd4-5ce333d5110f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-kcpd8\" (UID: \"d34526b7-53c8-413d-8bd4-5ce333d5110f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kcpd8" Jul 24 14:36:58.349459 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.349367 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1daa7811-550d-40f9-b791-ddb7c2ee0e49-sys\") pod \"node-exporter-9k5wm\" (UID: \"1daa7811-550d-40f9-b791-ddb7c2ee0e49\") " pod="openshift-monitoring/node-exporter-9k5wm" Jul 24 14:36:58.349459 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.349384 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1daa7811-550d-40f9-b791-ddb7c2ee0e49-node-exporter-accelerators-collector-config\") pod \"node-exporter-9k5wm\" (UID: \"1daa7811-550d-40f9-b791-ddb7c2ee0e49\") " pod="openshift-monitoring/node-exporter-9k5wm" Jul 24 14:36:58.349548 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.349455 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1daa7811-550d-40f9-b791-ddb7c2ee0e49-root\") pod \"node-exporter-9k5wm\" (UID: \"1daa7811-550d-40f9-b791-ddb7c2ee0e49\") " pod="openshift-monitoring/node-exporter-9k5wm" Jul 24 14:36:58.349548 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.349477 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1daa7811-550d-40f9-b791-ddb7c2ee0e49-node-exporter-wtmp\") pod \"node-exporter-9k5wm\" (UID: \"1daa7811-550d-40f9-b791-ddb7c2ee0e49\") " pod="openshift-monitoring/node-exporter-9k5wm" Jul 24 14:36:58.349548 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.349505 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1daa7811-550d-40f9-b791-ddb7c2ee0e49-metrics-client-ca\") pod \"node-exporter-9k5wm\" (UID: \"1daa7811-550d-40f9-b791-ddb7c2ee0e49\") " pod="openshift-monitoring/node-exporter-9k5wm" Jul 24 14:36:58.349548 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.349522 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d34526b7-53c8-413d-8bd4-5ce333d5110f-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-kcpd8\" (UID: \"d34526b7-53c8-413d-8bd4-5ce333d5110f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kcpd8" Jul 24 14:36:58.349548 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.349537 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c44ql\" (UniqueName: \"kubernetes.io/projected/d34526b7-53c8-413d-8bd4-5ce333d5110f-kube-api-access-c44ql\") pod \"kube-state-metrics-56d9f944b4-kcpd8\" (UID: \"d34526b7-53c8-413d-8bd4-5ce333d5110f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kcpd8" Jul 24 14:36:58.349735 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.349575 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d34526b7-53c8-413d-8bd4-5ce333d5110f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-kcpd8\" (UID: \"d34526b7-53c8-413d-8bd4-5ce333d5110f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kcpd8" Jul 24 14:36:58.349735 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.349602 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d34526b7-53c8-413d-8bd4-5ce333d5110f-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-kcpd8\" (UID: \"d34526b7-53c8-413d-8bd4-5ce333d5110f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kcpd8" Jul 24 14:36:58.349735 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.349622 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1daa7811-550d-40f9-b791-ddb7c2ee0e49-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9k5wm\" (UID: \"1daa7811-550d-40f9-b791-ddb7c2ee0e49\") " pod="openshift-monitoring/node-exporter-9k5wm" Jul 24 14:36:58.349735 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.349652 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1daa7811-550d-40f9-b791-ddb7c2ee0e49-node-exporter-tls\") pod \"node-exporter-9k5wm\" (UID: \"1daa7811-550d-40f9-b791-ddb7c2ee0e49\") " pod="openshift-monitoring/node-exporter-9k5wm" Jul 24 14:36:58.349735 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.349681 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d34526b7-53c8-413d-8bd4-5ce333d5110f-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-kcpd8\" (UID: \"d34526b7-53c8-413d-8bd4-5ce333d5110f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kcpd8" Jul 24 14:36:58.349735 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.349714 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcvwv\" (UniqueName: \"kubernetes.io/projected/1daa7811-550d-40f9-b791-ddb7c2ee0e49-kube-api-access-pcvwv\") pod \"node-exporter-9k5wm\" (UID: \"1daa7811-550d-40f9-b791-ddb7c2ee0e49\") " pod="openshift-monitoring/node-exporter-9k5wm" Jul 24 14:36:58.349955 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.349736 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1daa7811-550d-40f9-b791-ddb7c2ee0e49-node-exporter-textfile\") pod \"node-exporter-9k5wm\" (UID: \"1daa7811-550d-40f9-b791-ddb7c2ee0e49\") " pod="openshift-monitoring/node-exporter-9k5wm" Jul 24 14:36:58.450605 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.450573 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d34526b7-53c8-413d-8bd4-5ce333d5110f-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-kcpd8\" (UID: \"d34526b7-53c8-413d-8bd4-5ce333d5110f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kcpd8" Jul 24 14:36:58.450712 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.450616 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcvwv\" (UniqueName: \"kubernetes.io/projected/1daa7811-550d-40f9-b791-ddb7c2ee0e49-kube-api-access-pcvwv\") pod \"node-exporter-9k5wm\" (UID: \"1daa7811-550d-40f9-b791-ddb7c2ee0e49\") " pod="openshift-monitoring/node-exporter-9k5wm" Jul 24 14:36:58.450712 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.450646 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1daa7811-550d-40f9-b791-ddb7c2ee0e49-node-exporter-textfile\") pod \"node-exporter-9k5wm\" (UID: \"1daa7811-550d-40f9-b791-ddb7c2ee0e49\") " pod="openshift-monitoring/node-exporter-9k5wm" Jul 24 14:36:58.450712 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.450682 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d34526b7-53c8-413d-8bd4-5ce333d5110f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-kcpd8\" (UID: \"d34526b7-53c8-413d-8bd4-5ce333d5110f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kcpd8" Jul 24 14:36:58.450712 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.450709 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1daa7811-550d-40f9-b791-ddb7c2ee0e49-sys\") pod \"node-exporter-9k5wm\" (UID: \"1daa7811-550d-40f9-b791-ddb7c2ee0e49\") " pod="openshift-monitoring/node-exporter-9k5wm" Jul 24 14:36:58.450923 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.450732 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1daa7811-550d-40f9-b791-ddb7c2ee0e49-node-exporter-accelerators-collector-config\") pod \"node-exporter-9k5wm\" (UID: \"1daa7811-550d-40f9-b791-ddb7c2ee0e49\") " pod="openshift-monitoring/node-exporter-9k5wm" Jul 24 14:36:58.450923 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.450781 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1daa7811-550d-40f9-b791-ddb7c2ee0e49-root\") pod \"node-exporter-9k5wm\" (UID: \"1daa7811-550d-40f9-b791-ddb7c2ee0e49\") " pod="openshift-monitoring/node-exporter-9k5wm" Jul 24 14:36:58.450923 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.450802 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1daa7811-550d-40f9-b791-ddb7c2ee0e49-node-exporter-wtmp\") pod \"node-exporter-9k5wm\" (UID: \"1daa7811-550d-40f9-b791-ddb7c2ee0e49\") " pod="openshift-monitoring/node-exporter-9k5wm" Jul 24 14:36:58.450923 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.450836 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1daa7811-550d-40f9-b791-ddb7c2ee0e49-metrics-client-ca\") pod \"node-exporter-9k5wm\" (UID: \"1daa7811-550d-40f9-b791-ddb7c2ee0e49\") " pod="openshift-monitoring/node-exporter-9k5wm" Jul 24 14:36:58.450923 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.450859 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d34526b7-53c8-413d-8bd4-5ce333d5110f-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-kcpd8\" (UID: \"d34526b7-53c8-413d-8bd4-5ce333d5110f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kcpd8" Jul 24 14:36:58.451198 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.450902 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c44ql\" (UniqueName: \"kubernetes.io/projected/d34526b7-53c8-413d-8bd4-5ce333d5110f-kube-api-access-c44ql\") pod \"kube-state-metrics-56d9f944b4-kcpd8\" (UID: \"d34526b7-53c8-413d-8bd4-5ce333d5110f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kcpd8" Jul 24 14:36:58.451198 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.450959 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1daa7811-550d-40f9-b791-ddb7c2ee0e49-node-exporter-textfile\") pod \"node-exporter-9k5wm\" (UID: \"1daa7811-550d-40f9-b791-ddb7c2ee0e49\") " pod="openshift-monitoring/node-exporter-9k5wm" Jul 24 14:36:58.451198 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.450972 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d34526b7-53c8-413d-8bd4-5ce333d5110f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-kcpd8\" (UID: \"d34526b7-53c8-413d-8bd4-5ce333d5110f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kcpd8" Jul 24 14:36:58.451198 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.451005 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d34526b7-53c8-413d-8bd4-5ce333d5110f-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-kcpd8\" (UID: \"d34526b7-53c8-413d-8bd4-5ce333d5110f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kcpd8" Jul 24 14:36:58.451198 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.451044 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1daa7811-550d-40f9-b791-ddb7c2ee0e49-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9k5wm\" (UID: \"1daa7811-550d-40f9-b791-ddb7c2ee0e49\") " pod="openshift-monitoring/node-exporter-9k5wm" Jul 24 14:36:58.451198 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.451082 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1daa7811-550d-40f9-b791-ddb7c2ee0e49-node-exporter-tls\") pod \"node-exporter-9k5wm\" (UID: \"1daa7811-550d-40f9-b791-ddb7c2ee0e49\") " pod="openshift-monitoring/node-exporter-9k5wm" Jul 24 14:36:58.451198 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.451134 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1daa7811-550d-40f9-b791-ddb7c2ee0e49-root\") pod \"node-exporter-9k5wm\" (UID: \"1daa7811-550d-40f9-b791-ddb7c2ee0e49\") " pod="openshift-monitoring/node-exporter-9k5wm" Jul 24 14:36:58.451537 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:36:58.451228 2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 24 14:36:58.451537 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:36:58.451287 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1daa7811-550d-40f9-b791-ddb7c2ee0e49-node-exporter-tls podName:1daa7811-550d-40f9-b791-ddb7c2ee0e49 nodeName:}" failed. No retries permitted until 2026-07-24 14:36:58.951266201 +0000 UTC m=+159.488522154 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/1daa7811-550d-40f9-b791-ddb7c2ee0e49-node-exporter-tls") pod "node-exporter-9k5wm" (UID: "1daa7811-550d-40f9-b791-ddb7c2ee0e49") : secret "node-exporter-tls" not found Jul 24 14:36:58.451537 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.451290 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1daa7811-550d-40f9-b791-ddb7c2ee0e49-node-exporter-wtmp\") pod \"node-exporter-9k5wm\" (UID: \"1daa7811-550d-40f9-b791-ddb7c2ee0e49\") " pod="openshift-monitoring/node-exporter-9k5wm" Jul 24 14:36:58.451537 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.450800 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1daa7811-550d-40f9-b791-ddb7c2ee0e49-sys\") pod \"node-exporter-9k5wm\" (UID: \"1daa7811-550d-40f9-b791-ddb7c2ee0e49\") " pod="openshift-monitoring/node-exporter-9k5wm" Jul 24 14:36:58.451537 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.451452 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1daa7811-550d-40f9-b791-ddb7c2ee0e49-node-exporter-accelerators-collector-config\") pod \"node-exporter-9k5wm\" (UID: \"1daa7811-550d-40f9-b791-ddb7c2ee0e49\") " pod="openshift-monitoring/node-exporter-9k5wm" Jul 24 14:36:58.451793 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.451605 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d34526b7-53c8-413d-8bd4-5ce333d5110f-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-kcpd8\" (UID: \"d34526b7-53c8-413d-8bd4-5ce333d5110f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kcpd8" Jul 24 14:36:58.451793 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.451645 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d34526b7-53c8-413d-8bd4-5ce333d5110f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-kcpd8\" (UID: \"d34526b7-53c8-413d-8bd4-5ce333d5110f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kcpd8" Jul 24 14:36:58.451793 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.451682 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1daa7811-550d-40f9-b791-ddb7c2ee0e49-metrics-client-ca\") pod \"node-exporter-9k5wm\" (UID: \"1daa7811-550d-40f9-b791-ddb7c2ee0e49\") " pod="openshift-monitoring/node-exporter-9k5wm" Jul 24 14:36:58.451923 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.451819 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d34526b7-53c8-413d-8bd4-5ce333d5110f-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-kcpd8\" (UID: \"d34526b7-53c8-413d-8bd4-5ce333d5110f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kcpd8" Jul 24 14:36:58.453704 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.453680 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1daa7811-550d-40f9-b791-ddb7c2ee0e49-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9k5wm\" (UID: \"1daa7811-550d-40f9-b791-ddb7c2ee0e49\") " pod="openshift-monitoring/node-exporter-9k5wm" Jul 24 14:36:58.453934 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.453903 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d34526b7-53c8-413d-8bd4-5ce333d5110f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-kcpd8\" (UID: \"d34526b7-53c8-413d-8bd4-5ce333d5110f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kcpd8" Jul 24 14:36:58.454015 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.453966 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d34526b7-53c8-413d-8bd4-5ce333d5110f-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-kcpd8\" (UID: \"d34526b7-53c8-413d-8bd4-5ce333d5110f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kcpd8" Jul 24 14:36:58.475365 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.475319 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c44ql\" (UniqueName: \"kubernetes.io/projected/d34526b7-53c8-413d-8bd4-5ce333d5110f-kube-api-access-c44ql\") pod \"kube-state-metrics-56d9f944b4-kcpd8\" (UID: \"d34526b7-53c8-413d-8bd4-5ce333d5110f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kcpd8" Jul 24 14:36:58.475542 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.475526 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcvwv\" (UniqueName: \"kubernetes.io/projected/1daa7811-550d-40f9-b791-ddb7c2ee0e49-kube-api-access-pcvwv\") pod \"node-exporter-9k5wm\" (UID: \"1daa7811-550d-40f9-b791-ddb7c2ee0e49\") " pod="openshift-monitoring/node-exporter-9k5wm" Jul 24 14:36:58.561799 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.561776 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kcpd8" Jul 24 14:36:58.644547 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.644522 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lxwhk" Jul 24 14:36:58.693703 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.693675 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-kcpd8"] Jul 24 14:36:58.696982 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:36:58.696954 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd34526b7_53c8_413d_8bd4_5ce333d5110f.slice/crio-5f57fa25e31df40a229ef01efc23161a37baef4c5a682de7cb51322bf5c1aef9 WatchSource:0}: Error finding container 5f57fa25e31df40a229ef01efc23161a37baef4c5a682de7cb51322bf5c1aef9: Status 404 returned error can't find the container with id 5f57fa25e31df40a229ef01efc23161a37baef4c5a682de7cb51322bf5c1aef9 Jul 24 14:36:58.954369 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.954340 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1daa7811-550d-40f9-b791-ddb7c2ee0e49-node-exporter-tls\") pod \"node-exporter-9k5wm\" (UID: \"1daa7811-550d-40f9-b791-ddb7c2ee0e49\") " pod="openshift-monitoring/node-exporter-9k5wm" Jul 24 14:36:58.956404 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:58.956388 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1daa7811-550d-40f9-b791-ddb7c2ee0e49-node-exporter-tls\") pod \"node-exporter-9k5wm\" (UID: \"1daa7811-550d-40f9-b791-ddb7c2ee0e49\") " pod="openshift-monitoring/node-exporter-9k5wm" Jul 24 14:36:59.168686 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:59.168661 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9k5wm" Jul 24 14:36:59.179437 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:36:59.179414 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1daa7811_550d_40f9_b791_ddb7c2ee0e49.slice/crio-57fee813aebc3618cf7e078629cac9a843e2dccec0d8ee5e316a366de5883d06 WatchSource:0}: Error finding container 57fee813aebc3618cf7e078629cac9a843e2dccec0d8ee5e316a366de5883d06: Status 404 returned error can't find the container with id 57fee813aebc3618cf7e078629cac9a843e2dccec0d8ee5e316a366de5883d06 Jul 24 14:36:59.649798 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:59.649760 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9k5wm" event={"ID":"1daa7811-550d-40f9-b791-ddb7c2ee0e49","Type":"ContainerStarted","Data":"57fee813aebc3618cf7e078629cac9a843e2dccec0d8ee5e316a366de5883d06"} Jul 24 14:36:59.651212 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:36:59.651173 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kcpd8" event={"ID":"d34526b7-53c8-413d-8bd4-5ce333d5110f","Type":"ContainerStarted","Data":"5f57fa25e31df40a229ef01efc23161a37baef4c5a682de7cb51322bf5c1aef9"} Jul 24 14:37:00.656487 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:00.656397 2581 generic.go:356] "Generic (PLEG): container finished" podID="1daa7811-550d-40f9-b791-ddb7c2ee0e49" containerID="6e26406d0f2ba430ad834076368c4861f45f32a03c5ad735b46652de5b9bde5d" exitCode=0 Jul 24 14:37:00.656901 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:00.656484 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9k5wm" event={"ID":"1daa7811-550d-40f9-b791-ddb7c2ee0e49","Type":"ContainerDied","Data":"6e26406d0f2ba430ad834076368c4861f45f32a03c5ad735b46652de5b9bde5d"} Jul 24 14:37:00.658729 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:00.658702 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kcpd8" event={"ID":"d34526b7-53c8-413d-8bd4-5ce333d5110f","Type":"ContainerStarted","Data":"a971518bee13f68ba704b251df8078666338b21ea12ad2d184ce50541a4e1a03"} Jul 24 14:37:00.658840 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:00.658753 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kcpd8" event={"ID":"d34526b7-53c8-413d-8bd4-5ce333d5110f","Type":"ContainerStarted","Data":"2a3e8e6c864495a182e630027da3c03faaf059fe95056f011aa1f4f553208544"} Jul 24 14:37:00.658840 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:00.658775 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kcpd8" event={"ID":"d34526b7-53c8-413d-8bd4-5ce333d5110f","Type":"ContainerStarted","Data":"c604477f53ea9de5611263b6b5d9f2b87194cf458bdb91bd7e7839048503bafb"} Jul 24 14:37:00.701510 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:00.701463 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kcpd8" podStartSLOduration=1.092668647 podStartE2EDuration="2.701443457s" totalImagesPullingTime="1.60877481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:36:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:37:00.700366464 +0000 UTC m=+161.237622418" watchObservedRunningTime="2026-07-24 14:37:00.701443457 +0000 UTC m=+161.238699412" Jul 24 14:37:01.212649 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.212616 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-54544f6d4-4tx42"] Jul 24 14:37:01.215881 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.215864 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-54544f6d4-4tx42" Jul 24 14:37:01.219106 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.219086 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9b25l0ir53qcl\"" Jul 24 14:37:01.219415 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.219390 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 24 14:37:01.219415 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.219412 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 24 14:37:01.219575 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.219442 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 24 14:37:01.219575 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.219444 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 24 14:37:01.219848 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.219836 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-2hnww\"" Jul 24 14:37:01.219905 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.219836 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 24 14:37:01.240428 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.240404 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-54544f6d4-4tx42"] Jul 24 14:37:01.272061 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.272035 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e9cfbc54-2b5d-45e2-83c8-6785654d79a5-secret-grpc-tls\") pod \"thanos-querier-54544f6d4-4tx42\" (UID: \"e9cfbc54-2b5d-45e2-83c8-6785654d79a5\") " pod="openshift-monitoring/thanos-querier-54544f6d4-4tx42" Jul 24 14:37:01.272175 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.272071 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e9cfbc54-2b5d-45e2-83c8-6785654d79a5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-54544f6d4-4tx42\" (UID: \"e9cfbc54-2b5d-45e2-83c8-6785654d79a5\") " pod="openshift-monitoring/thanos-querier-54544f6d4-4tx42" Jul 24 14:37:01.272175 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.272090 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59vqg\" (UniqueName: \"kubernetes.io/projected/e9cfbc54-2b5d-45e2-83c8-6785654d79a5-kube-api-access-59vqg\") pod \"thanos-querier-54544f6d4-4tx42\" (UID: \"e9cfbc54-2b5d-45e2-83c8-6785654d79a5\") " pod="openshift-monitoring/thanos-querier-54544f6d4-4tx42" Jul 24 14:37:01.272175 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.272106 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e9cfbc54-2b5d-45e2-83c8-6785654d79a5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-54544f6d4-4tx42\" (UID: \"e9cfbc54-2b5d-45e2-83c8-6785654d79a5\") " pod="openshift-monitoring/thanos-querier-54544f6d4-4tx42" Jul 24 14:37:01.272175 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.272122 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e9cfbc54-2b5d-45e2-83c8-6785654d79a5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-54544f6d4-4tx42\" (UID: \"e9cfbc54-2b5d-45e2-83c8-6785654d79a5\") " pod="openshift-monitoring/thanos-querier-54544f6d4-4tx42" Jul 24 14:37:01.272348 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.272183 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e9cfbc54-2b5d-45e2-83c8-6785654d79a5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-54544f6d4-4tx42\" (UID: \"e9cfbc54-2b5d-45e2-83c8-6785654d79a5\") " pod="openshift-monitoring/thanos-querier-54544f6d4-4tx42" Jul 24 14:37:01.272348 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.272214 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9cfbc54-2b5d-45e2-83c8-6785654d79a5-metrics-client-ca\") pod \"thanos-querier-54544f6d4-4tx42\" (UID: \"e9cfbc54-2b5d-45e2-83c8-6785654d79a5\") " pod="openshift-monitoring/thanos-querier-54544f6d4-4tx42" Jul 24 14:37:01.272348 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.272253 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e9cfbc54-2b5d-45e2-83c8-6785654d79a5-secret-thanos-querier-tls\") pod \"thanos-querier-54544f6d4-4tx42\" (UID: \"e9cfbc54-2b5d-45e2-83c8-6785654d79a5\") " pod="openshift-monitoring/thanos-querier-54544f6d4-4tx42" Jul 24 14:37:01.373307 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.373280 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e9cfbc54-2b5d-45e2-83c8-6785654d79a5-secret-thanos-querier-tls\") pod \"thanos-querier-54544f6d4-4tx42\" (UID: \"e9cfbc54-2b5d-45e2-83c8-6785654d79a5\") " pod="openshift-monitoring/thanos-querier-54544f6d4-4tx42" Jul 24 14:37:01.373399 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.373352 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e9cfbc54-2b5d-45e2-83c8-6785654d79a5-secret-grpc-tls\") pod \"thanos-querier-54544f6d4-4tx42\" (UID: \"e9cfbc54-2b5d-45e2-83c8-6785654d79a5\") " pod="openshift-monitoring/thanos-querier-54544f6d4-4tx42" Jul 24 14:37:01.373399 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.373383 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e9cfbc54-2b5d-45e2-83c8-6785654d79a5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-54544f6d4-4tx42\" (UID: \"e9cfbc54-2b5d-45e2-83c8-6785654d79a5\") " pod="openshift-monitoring/thanos-querier-54544f6d4-4tx42" Jul 24 14:37:01.373496 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.373401 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59vqg\" (UniqueName: \"kubernetes.io/projected/e9cfbc54-2b5d-45e2-83c8-6785654d79a5-kube-api-access-59vqg\") pod \"thanos-querier-54544f6d4-4tx42\" (UID: \"e9cfbc54-2b5d-45e2-83c8-6785654d79a5\") " pod="openshift-monitoring/thanos-querier-54544f6d4-4tx42" Jul 24 14:37:01.373496 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.373419 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e9cfbc54-2b5d-45e2-83c8-6785654d79a5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-54544f6d4-4tx42\" (UID: \"e9cfbc54-2b5d-45e2-83c8-6785654d79a5\") " pod="openshift-monitoring/thanos-querier-54544f6d4-4tx42" Jul 24 14:37:01.373496 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.373440 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e9cfbc54-2b5d-45e2-83c8-6785654d79a5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-54544f6d4-4tx42\" (UID: \"e9cfbc54-2b5d-45e2-83c8-6785654d79a5\") " pod="openshift-monitoring/thanos-querier-54544f6d4-4tx42" Jul 24 14:37:01.373496 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.373465 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e9cfbc54-2b5d-45e2-83c8-6785654d79a5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-54544f6d4-4tx42\" (UID: \"e9cfbc54-2b5d-45e2-83c8-6785654d79a5\") " pod="openshift-monitoring/thanos-querier-54544f6d4-4tx42" Jul 24 14:37:01.373496 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.373492 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9cfbc54-2b5d-45e2-83c8-6785654d79a5-metrics-client-ca\") pod \"thanos-querier-54544f6d4-4tx42\" (UID: \"e9cfbc54-2b5d-45e2-83c8-6785654d79a5\") " pod="openshift-monitoring/thanos-querier-54544f6d4-4tx42" Jul 24 14:37:01.374333 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.374309 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9cfbc54-2b5d-45e2-83c8-6785654d79a5-metrics-client-ca\") pod \"thanos-querier-54544f6d4-4tx42\" (UID: \"e9cfbc54-2b5d-45e2-83c8-6785654d79a5\") " pod="openshift-monitoring/thanos-querier-54544f6d4-4tx42" Jul 24 14:37:01.375997 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.375971 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e9cfbc54-2b5d-45e2-83c8-6785654d79a5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-54544f6d4-4tx42\" (UID: \"e9cfbc54-2b5d-45e2-83c8-6785654d79a5\") " pod="openshift-monitoring/thanos-querier-54544f6d4-4tx42" Jul 24 14:37:01.376099 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.376027 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e9cfbc54-2b5d-45e2-83c8-6785654d79a5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-54544f6d4-4tx42\" (UID: \"e9cfbc54-2b5d-45e2-83c8-6785654d79a5\") " pod="openshift-monitoring/thanos-querier-54544f6d4-4tx42" Jul 24 14:37:01.376291 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.376267 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e9cfbc54-2b5d-45e2-83c8-6785654d79a5-secret-thanos-querier-tls\") pod \"thanos-querier-54544f6d4-4tx42\" (UID: \"e9cfbc54-2b5d-45e2-83c8-6785654d79a5\") " pod="openshift-monitoring/thanos-querier-54544f6d4-4tx42" Jul 24 14:37:01.376291 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.376278 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e9cfbc54-2b5d-45e2-83c8-6785654d79a5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-54544f6d4-4tx42\" (UID: \"e9cfbc54-2b5d-45e2-83c8-6785654d79a5\") " pod="openshift-monitoring/thanos-querier-54544f6d4-4tx42" Jul 24 14:37:01.376392 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.376292 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e9cfbc54-2b5d-45e2-83c8-6785654d79a5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-54544f6d4-4tx42\" (UID: \"e9cfbc54-2b5d-45e2-83c8-6785654d79a5\") " pod="openshift-monitoring/thanos-querier-54544f6d4-4tx42" Jul 24 14:37:01.376392 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.376346 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e9cfbc54-2b5d-45e2-83c8-6785654d79a5-secret-grpc-tls\") pod \"thanos-querier-54544f6d4-4tx42\" (UID: \"e9cfbc54-2b5d-45e2-83c8-6785654d79a5\") " pod="openshift-monitoring/thanos-querier-54544f6d4-4tx42" Jul 24 14:37:01.382674 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.382657 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59vqg\" (UniqueName: \"kubernetes.io/projected/e9cfbc54-2b5d-45e2-83c8-6785654d79a5-kube-api-access-59vqg\") pod \"thanos-querier-54544f6d4-4tx42\" (UID: \"e9cfbc54-2b5d-45e2-83c8-6785654d79a5\") " pod="openshift-monitoring/thanos-querier-54544f6d4-4tx42" Jul 24 14:37:01.524907 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.524858 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-54544f6d4-4tx42" Jul 24 14:37:01.658619 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.658590 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-54544f6d4-4tx42"] Jul 24 14:37:01.663126 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:37:01.663090 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9cfbc54_2b5d_45e2_83c8_6785654d79a5.slice/crio-82e3df053446529c6fa87e11734e7d5c4754290b101b537141c282a91af083a3 WatchSource:0}: Error finding container 82e3df053446529c6fa87e11734e7d5c4754290b101b537141c282a91af083a3: Status 404 returned error can't find the container with id 82e3df053446529c6fa87e11734e7d5c4754290b101b537141c282a91af083a3 Jul 24 14:37:01.665031 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.664996 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9k5wm" event={"ID":"1daa7811-550d-40f9-b791-ddb7c2ee0e49","Type":"ContainerStarted","Data":"22ce6cbeb1b91850d0e9da34567e4bb64e1903af8e0d85948a2fe8d2b50cb0be"} Jul 24 14:37:01.665143 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.665056 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9k5wm" event={"ID":"1daa7811-550d-40f9-b791-ddb7c2ee0e49","Type":"ContainerStarted","Data":"aa1d761cfce9019d117ba64437d43df89007ba6143fa27c9b5c0217d363ea501"} Jul 24 14:37:01.698421 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:01.698380 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9k5wm" podStartSLOduration=2.489525484 podStartE2EDuration="3.698365937s" totalImagesPullingTime="1.12888753s" totalInitContainerRuntime="79.952923ms" isStatefulPod=true podCreationTimestamp="2026-07-24 14:36:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:37:01.697637098 +0000 UTC m=+162.234893052" watchObservedRunningTime="2026-07-24 14:37:01.698365937 +0000 UTC m=+162.235621889" Jul 24 14:37:02.669474 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:02.669435 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54544f6d4-4tx42" event={"ID":"e9cfbc54-2b5d-45e2-83c8-6785654d79a5","Type":"ContainerStarted","Data":"82e3df053446529c6fa87e11734e7d5c4754290b101b537141c282a91af083a3"} Jul 24 14:37:02.866501 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:02.866471 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-lf8fr"] Jul 24 14:37:02.873253 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:02.873221 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lf8fr" Jul 24 14:37:02.877415 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:02.877399 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 24 14:37:02.877914 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:02.877900 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-nx6fx\"" Jul 24 14:37:02.885840 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:02.885821 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-lf8fr"] Jul 24 14:37:02.885924 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:02.885898 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmvpf\" (UniqueName: \"kubernetes.io/projected/227b4e8c-bd3a-4d46-bad6-646a0f602d8f-kube-api-access-vmvpf\") pod \"monitoring-plugin-68b7fc9574-lf8fr\" (UID: \"227b4e8c-bd3a-4d46-bad6-646a0f602d8f\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lf8fr" Jul 24 14:37:02.885982 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:02.885927 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/227b4e8c-bd3a-4d46-bad6-646a0f602d8f-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-lf8fr\" (UID: \"227b4e8c-bd3a-4d46-bad6-646a0f602d8f\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lf8fr" Jul 24 14:37:02.986700 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:02.986631 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmvpf\" (UniqueName: \"kubernetes.io/projected/227b4e8c-bd3a-4d46-bad6-646a0f602d8f-kube-api-access-vmvpf\") pod \"monitoring-plugin-68b7fc9574-lf8fr\" (UID: \"227b4e8c-bd3a-4d46-bad6-646a0f602d8f\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lf8fr" Jul 24 14:37:02.986700 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:02.986680 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/227b4e8c-bd3a-4d46-bad6-646a0f602d8f-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-lf8fr\" (UID: \"227b4e8c-bd3a-4d46-bad6-646a0f602d8f\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lf8fr" Jul 24 14:37:02.986872 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:37:02.986851 2581 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 24 14:37:02.987254 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:37:02.987238 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/227b4e8c-bd3a-4d46-bad6-646a0f602d8f-monitoring-plugin-cert podName:227b4e8c-bd3a-4d46-bad6-646a0f602d8f nodeName:}" failed. No retries permitted until 2026-07-24 14:37:03.487213953 +0000 UTC m=+164.024469886 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/227b4e8c-bd3a-4d46-bad6-646a0f602d8f-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-lf8fr" (UID: "227b4e8c-bd3a-4d46-bad6-646a0f602d8f") : secret "monitoring-plugin-cert" not found Jul 24 14:37:03.000107 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.000081 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmvpf\" (UniqueName: \"kubernetes.io/projected/227b4e8c-bd3a-4d46-bad6-646a0f602d8f-kube-api-access-vmvpf\") pod \"monitoring-plugin-68b7fc9574-lf8fr\" (UID: \"227b4e8c-bd3a-4d46-bad6-646a0f602d8f\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lf8fr" Jul 24 14:37:03.188911 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.188885 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1af447a-c7f6-4788-b687-514e2f6f732e-metrics-tls\") pod \"dns-default-lxwhk\" (UID: \"f1af447a-c7f6-4788-b687-514e2f6f732e\") " pod="openshift-dns/dns-default-lxwhk" Jul 24 14:37:03.190964 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.190941 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1af447a-c7f6-4788-b687-514e2f6f732e-metrics-tls\") pod \"dns-default-lxwhk\" (UID: \"f1af447a-c7f6-4788-b687-514e2f6f732e\") " pod="openshift-dns/dns-default-lxwhk" Jul 24 14:37:03.349300 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.349266 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-9fb9f9d68-847dm"] Jul 24 14:37:03.365545 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.365517 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-9fb9f9d68-847dm" Jul 24 14:37:03.366382 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.366325 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-9fb9f9d68-847dm"] Jul 24 14:37:03.368376 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.368351 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 24 14:37:03.368376 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.368372 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 24 14:37:03.368609 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.368492 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 24 14:37:03.368609 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.368595 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 24 14:37:03.368609 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.368595 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 24 14:37:03.368790 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.368758 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-67frz\"" Jul 24 14:37:03.375681 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.375657 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 24 14:37:03.390528 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.390504 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbdeb103-dbf4-4218-848a-b28616f0da5d-serving-certs-ca-bundle\") pod \"telemeter-client-9fb9f9d68-847dm\" (UID: \"dbdeb103-dbf4-4218-848a-b28616f0da5d\") " pod="openshift-monitoring/telemeter-client-9fb9f9d68-847dm" Jul 24 14:37:03.390636 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.390571 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/dbdeb103-dbf4-4218-848a-b28616f0da5d-telemeter-client-tls\") pod \"telemeter-client-9fb9f9d68-847dm\" (UID: \"dbdeb103-dbf4-4218-848a-b28616f0da5d\") " pod="openshift-monitoring/telemeter-client-9fb9f9d68-847dm" Jul 24 14:37:03.390636 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.390607 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dbdeb103-dbf4-4218-848a-b28616f0da5d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-9fb9f9d68-847dm\" (UID: \"dbdeb103-dbf4-4218-848a-b28616f0da5d\") " pod="openshift-monitoring/telemeter-client-9fb9f9d68-847dm" Jul 24 14:37:03.390753 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.390641 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbdeb103-dbf4-4218-848a-b28616f0da5d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-9fb9f9d68-847dm\" (UID: \"dbdeb103-dbf4-4218-848a-b28616f0da5d\") " pod="openshift-monitoring/telemeter-client-9fb9f9d68-847dm" Jul 24 14:37:03.390753 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.390685 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8msx\" (UniqueName: \"kubernetes.io/projected/dbdeb103-dbf4-4218-848a-b28616f0da5d-kube-api-access-v8msx\") pod \"telemeter-client-9fb9f9d68-847dm\" (UID: \"dbdeb103-dbf4-4218-848a-b28616f0da5d\") " pod="openshift-monitoring/telemeter-client-9fb9f9d68-847dm" Jul 24 14:37:03.390847 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.390773 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbdeb103-dbf4-4218-848a-b28616f0da5d-metrics-client-ca\") pod \"telemeter-client-9fb9f9d68-847dm\" (UID: \"dbdeb103-dbf4-4218-848a-b28616f0da5d\") " pod="openshift-monitoring/telemeter-client-9fb9f9d68-847dm" Jul 24 14:37:03.390847 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.390819 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/dbdeb103-dbf4-4218-848a-b28616f0da5d-secret-telemeter-client\") pod \"telemeter-client-9fb9f9d68-847dm\" (UID: \"dbdeb103-dbf4-4218-848a-b28616f0da5d\") " pod="openshift-monitoring/telemeter-client-9fb9f9d68-847dm" Jul 24 14:37:03.390974 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.390914 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/dbdeb103-dbf4-4218-848a-b28616f0da5d-federate-client-tls\") pod \"telemeter-client-9fb9f9d68-847dm\" (UID: \"dbdeb103-dbf4-4218-848a-b28616f0da5d\") " pod="openshift-monitoring/telemeter-client-9fb9f9d68-847dm" Jul 24 14:37:03.452871 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.452804 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-26zbb\"" Jul 24 14:37:03.456142 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.456114 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lxwhk" Jul 24 14:37:03.491768 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.491738 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbdeb103-dbf4-4218-848a-b28616f0da5d-serving-certs-ca-bundle\") pod \"telemeter-client-9fb9f9d68-847dm\" (UID: \"dbdeb103-dbf4-4218-848a-b28616f0da5d\") " pod="openshift-monitoring/telemeter-client-9fb9f9d68-847dm" Jul 24 14:37:03.491914 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.491784 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/dbdeb103-dbf4-4218-848a-b28616f0da5d-telemeter-client-tls\") pod \"telemeter-client-9fb9f9d68-847dm\" (UID: \"dbdeb103-dbf4-4218-848a-b28616f0da5d\") " pod="openshift-monitoring/telemeter-client-9fb9f9d68-847dm" Jul 24 14:37:03.491914 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.491890 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dbdeb103-dbf4-4218-848a-b28616f0da5d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-9fb9f9d68-847dm\" (UID: \"dbdeb103-dbf4-4218-848a-b28616f0da5d\") " pod="openshift-monitoring/telemeter-client-9fb9f9d68-847dm" Jul 24 14:37:03.492061 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.491927 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbdeb103-dbf4-4218-848a-b28616f0da5d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-9fb9f9d68-847dm\" (UID: \"dbdeb103-dbf4-4218-848a-b28616f0da5d\") " pod="openshift-monitoring/telemeter-client-9fb9f9d68-847dm" Jul 24 14:37:03.492061 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.491971 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8msx\" (UniqueName: \"kubernetes.io/projected/dbdeb103-dbf4-4218-848a-b28616f0da5d-kube-api-access-v8msx\") pod \"telemeter-client-9fb9f9d68-847dm\" (UID: \"dbdeb103-dbf4-4218-848a-b28616f0da5d\") " pod="openshift-monitoring/telemeter-client-9fb9f9d68-847dm" Jul 24 14:37:03.492061 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.492010 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbdeb103-dbf4-4218-848a-b28616f0da5d-metrics-client-ca\") pod \"telemeter-client-9fb9f9d68-847dm\" (UID: \"dbdeb103-dbf4-4218-848a-b28616f0da5d\") " pod="openshift-monitoring/telemeter-client-9fb9f9d68-847dm" Jul 24 14:37:03.492061 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.492042 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/dbdeb103-dbf4-4218-848a-b28616f0da5d-secret-telemeter-client\") pod \"telemeter-client-9fb9f9d68-847dm\" (UID: \"dbdeb103-dbf4-4218-848a-b28616f0da5d\") " pod="openshift-monitoring/telemeter-client-9fb9f9d68-847dm" Jul 24 14:37:03.492286 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.492081 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/227b4e8c-bd3a-4d46-bad6-646a0f602d8f-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-lf8fr\" (UID: \"227b4e8c-bd3a-4d46-bad6-646a0f602d8f\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lf8fr" Jul 24 14:37:03.492286 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.492107 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/dbdeb103-dbf4-4218-848a-b28616f0da5d-federate-client-tls\") pod \"telemeter-client-9fb9f9d68-847dm\" (UID: \"dbdeb103-dbf4-4218-848a-b28616f0da5d\") " pod="openshift-monitoring/telemeter-client-9fb9f9d68-847dm" Jul 24 14:37:03.493428 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.492633 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbdeb103-dbf4-4218-848a-b28616f0da5d-serving-certs-ca-bundle\") pod \"telemeter-client-9fb9f9d68-847dm\" (UID: \"dbdeb103-dbf4-4218-848a-b28616f0da5d\") " pod="openshift-monitoring/telemeter-client-9fb9f9d68-847dm" Jul 24 14:37:03.493428 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.493375 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbdeb103-dbf4-4218-848a-b28616f0da5d-metrics-client-ca\") pod \"telemeter-client-9fb9f9d68-847dm\" (UID: \"dbdeb103-dbf4-4218-848a-b28616f0da5d\") " pod="openshift-monitoring/telemeter-client-9fb9f9d68-847dm" Jul 24 14:37:03.493614 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.493553 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbdeb103-dbf4-4218-848a-b28616f0da5d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-9fb9f9d68-847dm\" (UID: \"dbdeb103-dbf4-4218-848a-b28616f0da5d\") " pod="openshift-monitoring/telemeter-client-9fb9f9d68-847dm" Jul 24 14:37:03.495523 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.495498 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/dbdeb103-dbf4-4218-848a-b28616f0da5d-federate-client-tls\") pod \"telemeter-client-9fb9f9d68-847dm\" (UID: \"dbdeb103-dbf4-4218-848a-b28616f0da5d\") " pod="openshift-monitoring/telemeter-client-9fb9f9d68-847dm" Jul 24 14:37:03.496073 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.495777 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/227b4e8c-bd3a-4d46-bad6-646a0f602d8f-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-lf8fr\" (UID: \"227b4e8c-bd3a-4d46-bad6-646a0f602d8f\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lf8fr" Jul 24 14:37:03.496073 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.495975 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/dbdeb103-dbf4-4218-848a-b28616f0da5d-secret-telemeter-client\") pod \"telemeter-client-9fb9f9d68-847dm\" (UID: \"dbdeb103-dbf4-4218-848a-b28616f0da5d\") " pod="openshift-monitoring/telemeter-client-9fb9f9d68-847dm" Jul 24 14:37:03.496073 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.495981 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/dbdeb103-dbf4-4218-848a-b28616f0da5d-telemeter-client-tls\") pod \"telemeter-client-9fb9f9d68-847dm\" (UID: \"dbdeb103-dbf4-4218-848a-b28616f0da5d\") " pod="openshift-monitoring/telemeter-client-9fb9f9d68-847dm" Jul 24 14:37:03.497273 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.497235 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dbdeb103-dbf4-4218-848a-b28616f0da5d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-9fb9f9d68-847dm\" (UID: \"dbdeb103-dbf4-4218-848a-b28616f0da5d\") " pod="openshift-monitoring/telemeter-client-9fb9f9d68-847dm" Jul 24 14:37:03.504075 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.504053 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8msx\" (UniqueName: \"kubernetes.io/projected/dbdeb103-dbf4-4218-848a-b28616f0da5d-kube-api-access-v8msx\") pod \"telemeter-client-9fb9f9d68-847dm\" (UID: \"dbdeb103-dbf4-4218-848a-b28616f0da5d\") " pod="openshift-monitoring/telemeter-client-9fb9f9d68-847dm" Jul 24 14:37:03.678784 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.678709 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-9fb9f9d68-847dm" Jul 24 14:37:03.783274 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.783244 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lf8fr" Jul 24 14:37:03.911771 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.911722 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lxwhk"] Jul 24 14:37:03.937498 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.937431 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-9fb9f9d68-847dm"] Jul 24 14:37:03.946329 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:03.946301 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-lf8fr"] Jul 24 14:37:03.976784 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:37:03.976761 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1af447a_c7f6_4788_b687_514e2f6f732e.slice/crio-8cc67f0f6428cee7649d8ee399c8b18d4a9910f61a3164117bd617627124cddb WatchSource:0}: Error finding container 8cc67f0f6428cee7649d8ee399c8b18d4a9910f61a3164117bd617627124cddb: Status 404 returned error can't find the container with id 8cc67f0f6428cee7649d8ee399c8b18d4a9910f61a3164117bd617627124cddb Jul 24 14:37:03.977438 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:37:03.977414 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbdeb103_dbf4_4218_848a_b28616f0da5d.slice/crio-8669d93d640d6b9bc9b9bc366f2c8c30553011743b6087095f4e6cb0be61c9d0 WatchSource:0}: Error finding container 8669d93d640d6b9bc9b9bc366f2c8c30553011743b6087095f4e6cb0be61c9d0: Status 404 returned error can't find the container with id 8669d93d640d6b9bc9b9bc366f2c8c30553011743b6087095f4e6cb0be61c9d0 Jul 24 14:37:03.978523 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:37:03.978499 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod227b4e8c_bd3a_4d46_bad6_646a0f602d8f.slice/crio-5d46cabe3ed93792c0b21ce886120bfb036a86151493930e603382d79beef6eb WatchSource:0}: Error finding container 5d46cabe3ed93792c0b21ce886120bfb036a86151493930e603382d79beef6eb: Status 404 returned error can't find the container with id 5d46cabe3ed93792c0b21ce886120bfb036a86151493930e603382d79beef6eb Jul 24 14:37:04.680741 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:04.680702 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lf8fr" event={"ID":"227b4e8c-bd3a-4d46-bad6-646a0f602d8f","Type":"ContainerStarted","Data":"5d46cabe3ed93792c0b21ce886120bfb036a86151493930e603382d79beef6eb"} Jul 24 14:37:04.682253 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:04.682130 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9fb9f9d68-847dm" event={"ID":"dbdeb103-dbf4-4218-848a-b28616f0da5d","Type":"ContainerStarted","Data":"8669d93d640d6b9bc9b9bc366f2c8c30553011743b6087095f4e6cb0be61c9d0"} Jul 24 14:37:04.683637 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:04.683608 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lxwhk" event={"ID":"f1af447a-c7f6-4788-b687-514e2f6f732e","Type":"ContainerStarted","Data":"8cc67f0f6428cee7649d8ee399c8b18d4a9910f61a3164117bd617627124cddb"} Jul 24 14:37:04.686027 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:04.686001 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54544f6d4-4tx42" event={"ID":"e9cfbc54-2b5d-45e2-83c8-6785654d79a5","Type":"ContainerStarted","Data":"bc613b1367ed03bc6ab45bede6d308dab06b6cd3110b319cdd5e9ce740741397"} Jul 24 14:37:04.686200 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:04.686074 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54544f6d4-4tx42" event={"ID":"e9cfbc54-2b5d-45e2-83c8-6785654d79a5","Type":"ContainerStarted","Data":"572d79d737deb80fba0d2a9f6be83bbf4f4d10c183387e942e4b4ca9af5c65c5"} Jul 24 14:37:04.686200 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:04.686118 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54544f6d4-4tx42" event={"ID":"e9cfbc54-2b5d-45e2-83c8-6785654d79a5","Type":"ContainerStarted","Data":"d1e113f725f36664b67c1c0566fbf8441571bf8cf55a5151aa2f278cb7848b0d"} Jul 24 14:37:05.172415 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:05.172374 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-dc778c956-tcb9v"] Jul 24 14:37:05.176129 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:05.175967 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dc778c956-tcb9v" Jul 24 14:37:05.178867 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:05.178844 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 24 14:37:05.178978 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:05.178874 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 24 14:37:05.180308 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:05.180056 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 24 14:37:05.180308 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:05.180177 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 24 14:37:05.180308 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:05.180181 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 24 14:37:05.180308 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:05.180292 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 24 14:37:05.180308 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:05.180295 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hzw4q\"" Jul 24 14:37:05.181383 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:05.181365 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 24 14:37:05.185370 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:05.185347 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 24 14:37:05.187834 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:05.187776 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dc778c956-tcb9v"] Jul 24 14:37:05.207005 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:05.206982 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14c86847-926a-46c8-abbc-26e081c679fe-console-oauth-config\") pod \"console-dc778c956-tcb9v\" (UID: \"14c86847-926a-46c8-abbc-26e081c679fe\") " pod="openshift-console/console-dc778c956-tcb9v" Jul 24 14:37:05.207100 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:05.207019 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14c86847-926a-46c8-abbc-26e081c679fe-console-config\") pod \"console-dc778c956-tcb9v\" (UID: \"14c86847-926a-46c8-abbc-26e081c679fe\") " pod="openshift-console/console-dc778c956-tcb9v" Jul 24 14:37:05.207100 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:05.207054 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14c86847-926a-46c8-abbc-26e081c679fe-trusted-ca-bundle\") pod \"console-dc778c956-tcb9v\" (UID: \"14c86847-926a-46c8-abbc-26e081c679fe\") " pod="openshift-console/console-dc778c956-tcb9v" Jul 24 14:37:05.207220 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:05.207181 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14c86847-926a-46c8-abbc-26e081c679fe-oauth-serving-cert\") pod \"console-dc778c956-tcb9v\" (UID: \"14c86847-926a-46c8-abbc-26e081c679fe\") " pod="openshift-console/console-dc778c956-tcb9v" Jul 24 14:37:05.207278 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:05.207244 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rmz8\" (UniqueName: \"kubernetes.io/projected/14c86847-926a-46c8-abbc-26e081c679fe-kube-api-access-5rmz8\") pod \"console-dc778c956-tcb9v\" (UID: \"14c86847-926a-46c8-abbc-26e081c679fe\") " pod="openshift-console/console-dc778c956-tcb9v" Jul 24 14:37:05.207327 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:05.207275 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14c86847-926a-46c8-abbc-26e081c679fe-console-serving-cert\") pod \"console-dc778c956-tcb9v\" (UID: \"14c86847-926a-46c8-abbc-26e081c679fe\") " pod="openshift-console/console-dc778c956-tcb9v" Jul 24 14:37:05.207327 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:05.207310 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14c86847-926a-46c8-abbc-26e081c679fe-service-ca\") pod \"console-dc778c956-tcb9v\" (UID: \"14c86847-926a-46c8-abbc-26e081c679fe\") " pod="openshift-console/console-dc778c956-tcb9v" Jul 24 14:37:05.307845 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:05.307810 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rmz8\" (UniqueName: \"kubernetes.io/projected/14c86847-926a-46c8-abbc-26e081c679fe-kube-api-access-5rmz8\") pod \"console-dc778c956-tcb9v\" (UID: \"14c86847-926a-46c8-abbc-26e081c679fe\") " pod="openshift-console/console-dc778c956-tcb9v" Jul 24 14:37:05.308005 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:05.307863 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14c86847-926a-46c8-abbc-26e081c679fe-console-serving-cert\") pod \"console-dc778c956-tcb9v\" (UID: \"14c86847-926a-46c8-abbc-26e081c679fe\") " pod="openshift-console/console-dc778c956-tcb9v" Jul 24 14:37:05.308005 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:05.307906 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14c86847-926a-46c8-abbc-26e081c679fe-service-ca\") pod \"console-dc778c956-tcb9v\" (UID: \"14c86847-926a-46c8-abbc-26e081c679fe\") " pod="openshift-console/console-dc778c956-tcb9v" Jul 24 14:37:05.308005 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:05.307961 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14c86847-926a-46c8-abbc-26e081c679fe-console-oauth-config\") pod \"console-dc778c956-tcb9v\" (UID: \"14c86847-926a-46c8-abbc-26e081c679fe\") " pod="openshift-console/console-dc778c956-tcb9v" Jul 24 14:37:05.308005 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:05.307985 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14c86847-926a-46c8-abbc-26e081c679fe-console-config\") pod \"console-dc778c956-tcb9v\" (UID: \"14c86847-926a-46c8-abbc-26e081c679fe\") " pod="openshift-console/console-dc778c956-tcb9v" Jul 24 14:37:05.308256 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:05.308022 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14c86847-926a-46c8-abbc-26e081c679fe-trusted-ca-bundle\") pod \"console-dc778c956-tcb9v\" (UID: \"14c86847-926a-46c8-abbc-26e081c679fe\") " pod="openshift-console/console-dc778c956-tcb9v" Jul 24 14:37:05.308256 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:05.308076 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14c86847-926a-46c8-abbc-26e081c679fe-oauth-serving-cert\") pod \"console-dc778c956-tcb9v\" (UID: \"14c86847-926a-46c8-abbc-26e081c679fe\") " pod="openshift-console/console-dc778c956-tcb9v" Jul 24 14:37:05.308744 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:05.308697 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14c86847-926a-46c8-abbc-26e081c679fe-service-ca\") pod \"console-dc778c956-tcb9v\" (UID: \"14c86847-926a-46c8-abbc-26e081c679fe\") " pod="openshift-console/console-dc778c956-tcb9v" Jul 24 14:37:05.309060 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:05.309015 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14c86847-926a-46c8-abbc-26e081c679fe-oauth-serving-cert\") pod \"console-dc778c956-tcb9v\" (UID: \"14c86847-926a-46c8-abbc-26e081c679fe\") " pod="openshift-console/console-dc778c956-tcb9v" Jul 24 14:37:05.309804 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:05.309777 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14c86847-926a-46c8-abbc-26e081c679fe-console-config\") pod \"console-dc778c956-tcb9v\" (UID: \"14c86847-926a-46c8-abbc-26e081c679fe\") " pod="openshift-console/console-dc778c956-tcb9v" Jul 24 14:37:05.309927 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:05.309819 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14c86847-926a-46c8-abbc-26e081c679fe-trusted-ca-bundle\") pod \"console-dc778c956-tcb9v\" (UID: \"14c86847-926a-46c8-abbc-26e081c679fe\") " pod="openshift-console/console-dc778c956-tcb9v" Jul 24 14:37:05.311543 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:05.311522 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14c86847-926a-46c8-abbc-26e081c679fe-console-serving-cert\") pod \"console-dc778c956-tcb9v\" (UID: \"14c86847-926a-46c8-abbc-26e081c679fe\") " pod="openshift-console/console-dc778c956-tcb9v" Jul 24 14:37:05.312118 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:05.312095 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14c86847-926a-46c8-abbc-26e081c679fe-console-oauth-config\") pod \"console-dc778c956-tcb9v\" (UID: \"14c86847-926a-46c8-abbc-26e081c679fe\") " pod="openshift-console/console-dc778c956-tcb9v" Jul 24 14:37:05.317401 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:05.317376 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rmz8\" (UniqueName: \"kubernetes.io/projected/14c86847-926a-46c8-abbc-26e081c679fe-kube-api-access-5rmz8\") pod \"console-dc778c956-tcb9v\" (UID: \"14c86847-926a-46c8-abbc-26e081c679fe\") " pod="openshift-console/console-dc778c956-tcb9v" Jul 24 14:37:05.488691 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:05.488614 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dc778c956-tcb9v" Jul 24 14:37:06.529537 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:06.529373 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dc778c956-tcb9v"] Jul 24 14:37:06.536028 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:37:06.535998 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14c86847_926a_46c8_abbc_26e081c679fe.slice/crio-ef93b449af27fc8b627589433d84dffcbde2a63266a1def505082c08781acb37 WatchSource:0}: Error finding container ef93b449af27fc8b627589433d84dffcbde2a63266a1def505082c08781acb37: Status 404 returned error can't find the container with id ef93b449af27fc8b627589433d84dffcbde2a63266a1def505082c08781acb37 Jul 24 14:37:06.694899 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:06.694864 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9fb9f9d68-847dm" event={"ID":"dbdeb103-dbf4-4218-848a-b28616f0da5d","Type":"ContainerStarted","Data":"1b17c1b4f09fac2e09afb1bc41c628793a8c8e2f8990351c836b9ca92d65fb07"} Jul 24 14:37:06.696588 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:06.696560 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lxwhk" event={"ID":"f1af447a-c7f6-4788-b687-514e2f6f732e","Type":"ContainerStarted","Data":"69122741b7abb84b45f95b34a5b64048ffb8191cb528ad74978302507571361f"} Jul 24 14:37:06.696700 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:06.696618 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lxwhk" event={"ID":"f1af447a-c7f6-4788-b687-514e2f6f732e","Type":"ContainerStarted","Data":"7620b575e856f8710bad192f17025e91068da67c9ad9e9be830f63845eff9c14"} Jul 24 14:37:06.697383 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:06.697362 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lxwhk" Jul 24 14:37:06.697939 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:06.697917 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dc778c956-tcb9v" event={"ID":"14c86847-926a-46c8-abbc-26e081c679fe","Type":"ContainerStarted","Data":"ef93b449af27fc8b627589433d84dffcbde2a63266a1def505082c08781acb37"} Jul 24 14:37:06.700726 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:06.700692 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54544f6d4-4tx42" event={"ID":"e9cfbc54-2b5d-45e2-83c8-6785654d79a5","Type":"ContainerStarted","Data":"bf0c7bd144a36b240f8748563e339c05487ead726794f1fe12fa8013080f1de4"} Jul 24 14:37:06.700835 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:06.700749 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54544f6d4-4tx42" event={"ID":"e9cfbc54-2b5d-45e2-83c8-6785654d79a5","Type":"ContainerStarted","Data":"f3ff98de5034eeaa4c46feba24a965beb63926e23b2c0e0df0328b990b748a90"} Jul 24 14:37:06.700900 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:06.700856 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-54544f6d4-4tx42" Jul 24 14:37:06.702190 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:06.702142 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lf8fr" event={"ID":"227b4e8c-bd3a-4d46-bad6-646a0f602d8f","Type":"ContainerStarted","Data":"af8fcc36400301995485451a803a84e16779bdadcc73f4a7252a27d4ac117c8c"} Jul 24 14:37:06.702288 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:06.702271 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lf8fr" Jul 24 14:37:06.708586 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:06.708568 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lf8fr" Jul 24 14:37:06.740294 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:06.740246 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lxwhk" podStartSLOduration=129.286764919 podStartE2EDuration="2m11.740233158s" totalImagesPullingTime="2.453468239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:34:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:37:06.715872288 +0000 UTC m=+167.253128242" watchObservedRunningTime="2026-07-24 14:37:06.740233158 +0000 UTC m=+167.277489112" Jul 24 14:37:06.740700 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:06.740671 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-54544f6d4-4tx42" podStartSLOduration=1.286226466 podStartE2EDuration="5.740661784s" totalImagesPullingTime="4.454435318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:37:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:37:06.739057639 +0000 UTC m=+167.276313590" watchObservedRunningTime="2026-07-24 14:37:06.740661784 +0000 UTC m=+167.277917736" Jul 24 14:37:06.756749 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:06.756712 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lf8fr" podStartSLOduration=2.35983033 podStartE2EDuration="4.756704488s" totalImagesPullingTime="2.396874158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:37:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:37:06.755403842 +0000 UTC m=+167.292659795" watchObservedRunningTime="2026-07-24 14:37:06.756704488 +0000 UTC m=+167.293960439" Jul 24 14:37:07.710868 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:07.710830 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54544f6d4-4tx42" event={"ID":"e9cfbc54-2b5d-45e2-83c8-6785654d79a5","Type":"ContainerStarted","Data":"f98ba1302bd69c20b55776248188962f474bb490290e01d0c73f5486df2cd1bd"} Jul 24 14:37:07.712955 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:07.712929 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9fb9f9d68-847dm" event={"ID":"dbdeb103-dbf4-4218-848a-b28616f0da5d","Type":"ContainerStarted","Data":"00ee684d1ab60c4995ca86f5c67adc7e94fca178acf9185b9e493ef19cd6fba6"} Jul 24 14:37:08.719473 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:08.719440 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9fb9f9d68-847dm" event={"ID":"dbdeb103-dbf4-4218-848a-b28616f0da5d","Type":"ContainerStarted","Data":"a5d9bb2a0c72ce6e8c5a4f8e9d39c8e89b21969e9eff9a9022ec299faa645f1d"} Jul 24 14:37:08.749271 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:08.749211 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-9fb9f9d68-847dm" podStartSLOduration=2.330605911 podStartE2EDuration="5.749189781s" totalImagesPullingTime="3.41858387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:37:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:37:08.747804104 +0000 UTC m=+169.285060057" watchObservedRunningTime="2026-07-24 14:37:08.749189781 +0000 UTC m=+169.286445734" Jul 24 14:37:09.707123 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:09.707053 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c4fc58c6d-nrszz"] Jul 24 14:37:09.710220 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:09.710202 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c4fc58c6d-nrszz" Jul 24 14:37:09.728563 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:09.728537 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c4fc58c6d-nrszz"] Jul 24 14:37:09.729900 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:09.729875 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dc778c956-tcb9v" event={"ID":"14c86847-926a-46c8-abbc-26e081c679fe","Type":"ContainerStarted","Data":"2646d9bfb70db5a184c8edde27e86eebdf3724798ba2680d8f710dd664ee90c0"} Jul 24 14:37:09.747978 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:09.747955 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbdc3444-d443-4975-b2d5-0ba2243dc655-trusted-ca-bundle\") pod \"console-6c4fc58c6d-nrszz\" (UID: \"cbdc3444-d443-4975-b2d5-0ba2243dc655\") " pod="openshift-console/console-6c4fc58c6d-nrszz" Jul 24 14:37:09.748050 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:09.748012 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cbdc3444-d443-4975-b2d5-0ba2243dc655-console-serving-cert\") pod \"console-6c4fc58c6d-nrszz\" (UID: \"cbdc3444-d443-4975-b2d5-0ba2243dc655\") " pod="openshift-console/console-6c4fc58c6d-nrszz" Jul 24 14:37:09.748084 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:09.748048 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cbdc3444-d443-4975-b2d5-0ba2243dc655-service-ca\") pod \"console-6c4fc58c6d-nrszz\" (UID: \"cbdc3444-d443-4975-b2d5-0ba2243dc655\") " pod="openshift-console/console-6c4fc58c6d-nrszz" Jul 24 14:37:09.748084 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:09.748071 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cbdc3444-d443-4975-b2d5-0ba2243dc655-oauth-serving-cert\") pod \"console-6c4fc58c6d-nrszz\" (UID: \"cbdc3444-d443-4975-b2d5-0ba2243dc655\") " pod="openshift-console/console-6c4fc58c6d-nrszz" Jul 24 14:37:09.748171 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:09.748139 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgx2l\" (UniqueName: \"kubernetes.io/projected/cbdc3444-d443-4975-b2d5-0ba2243dc655-kube-api-access-kgx2l\") pod \"console-6c4fc58c6d-nrszz\" (UID: \"cbdc3444-d443-4975-b2d5-0ba2243dc655\") " pod="openshift-console/console-6c4fc58c6d-nrszz" Jul 24 14:37:09.748217 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:09.748185 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cbdc3444-d443-4975-b2d5-0ba2243dc655-console-config\") pod \"console-6c4fc58c6d-nrszz\" (UID: \"cbdc3444-d443-4975-b2d5-0ba2243dc655\") " pod="openshift-console/console-6c4fc58c6d-nrszz" Jul 24 14:37:09.748217 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:09.748204 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cbdc3444-d443-4975-b2d5-0ba2243dc655-console-oauth-config\") pod \"console-6c4fc58c6d-nrszz\" (UID: \"cbdc3444-d443-4975-b2d5-0ba2243dc655\") " pod="openshift-console/console-6c4fc58c6d-nrszz" Jul 24 14:37:09.785659 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:09.785620 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-dc778c956-tcb9v" podStartSLOduration=2.011885316 podStartE2EDuration="4.785608413s" totalImagesPullingTime="2.773723097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:37:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:37:09.785384168 +0000 UTC m=+170.322640120" watchObservedRunningTime="2026-07-24 14:37:09.785608413 +0000 UTC m=+170.322864366" Jul 24 14:37:09.849471 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:09.849430 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cbdc3444-d443-4975-b2d5-0ba2243dc655-console-config\") pod \"console-6c4fc58c6d-nrszz\" (UID: \"cbdc3444-d443-4975-b2d5-0ba2243dc655\") " pod="openshift-console/console-6c4fc58c6d-nrszz" Jul 24 14:37:09.849605 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:09.849584 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cbdc3444-d443-4975-b2d5-0ba2243dc655-console-oauth-config\") pod \"console-6c4fc58c6d-nrszz\" (UID: \"cbdc3444-d443-4975-b2d5-0ba2243dc655\") " pod="openshift-console/console-6c4fc58c6d-nrszz" Jul 24 14:37:09.849676 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:09.849639 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbdc3444-d443-4975-b2d5-0ba2243dc655-trusted-ca-bundle\") pod \"console-6c4fc58c6d-nrszz\" (UID: \"cbdc3444-d443-4975-b2d5-0ba2243dc655\") " pod="openshift-console/console-6c4fc58c6d-nrszz" Jul 24 14:37:09.849832 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:09.849787 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cbdc3444-d443-4975-b2d5-0ba2243dc655-console-serving-cert\") pod \"console-6c4fc58c6d-nrszz\" (UID: \"cbdc3444-d443-4975-b2d5-0ba2243dc655\") " pod="openshift-console/console-6c4fc58c6d-nrszz" Jul 24 14:37:09.849900 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:09.849874 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cbdc3444-d443-4975-b2d5-0ba2243dc655-service-ca\") pod \"console-6c4fc58c6d-nrszz\" (UID: \"cbdc3444-d443-4975-b2d5-0ba2243dc655\") " pod="openshift-console/console-6c4fc58c6d-nrszz" Jul 24 14:37:09.849951 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:09.849941 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cbdc3444-d443-4975-b2d5-0ba2243dc655-oauth-serving-cert\") pod \"console-6c4fc58c6d-nrszz\" (UID: \"cbdc3444-d443-4975-b2d5-0ba2243dc655\") " pod="openshift-console/console-6c4fc58c6d-nrszz" Jul 24 14:37:09.850042 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:09.850023 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgx2l\" (UniqueName: \"kubernetes.io/projected/cbdc3444-d443-4975-b2d5-0ba2243dc655-kube-api-access-kgx2l\") pod \"console-6c4fc58c6d-nrszz\" (UID: \"cbdc3444-d443-4975-b2d5-0ba2243dc655\") " pod="openshift-console/console-6c4fc58c6d-nrszz" Jul 24 14:37:09.850599 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:09.850578 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cbdc3444-d443-4975-b2d5-0ba2243dc655-console-config\") pod \"console-6c4fc58c6d-nrszz\" (UID: \"cbdc3444-d443-4975-b2d5-0ba2243dc655\") " pod="openshift-console/console-6c4fc58c6d-nrszz" Jul 24 14:37:09.850805 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:09.850634 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cbdc3444-d443-4975-b2d5-0ba2243dc655-service-ca\") pod \"console-6c4fc58c6d-nrszz\" (UID: \"cbdc3444-d443-4975-b2d5-0ba2243dc655\") " pod="openshift-console/console-6c4fc58c6d-nrszz" Jul 24 14:37:09.850955 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:09.850736 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cbdc3444-d443-4975-b2d5-0ba2243dc655-oauth-serving-cert\") pod \"console-6c4fc58c6d-nrszz\" (UID: \"cbdc3444-d443-4975-b2d5-0ba2243dc655\") " pod="openshift-console/console-6c4fc58c6d-nrszz" Jul 24 14:37:09.851061 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:09.851044 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbdc3444-d443-4975-b2d5-0ba2243dc655-trusted-ca-bundle\") pod \"console-6c4fc58c6d-nrszz\" (UID: \"cbdc3444-d443-4975-b2d5-0ba2243dc655\") " pod="openshift-console/console-6c4fc58c6d-nrszz" Jul 24 14:37:09.852429 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:09.852393 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cbdc3444-d443-4975-b2d5-0ba2243dc655-console-oauth-config\") pod \"console-6c4fc58c6d-nrszz\" (UID: \"cbdc3444-d443-4975-b2d5-0ba2243dc655\") " pod="openshift-console/console-6c4fc58c6d-nrszz" Jul 24 14:37:09.852631 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:09.852613 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cbdc3444-d443-4975-b2d5-0ba2243dc655-console-serving-cert\") pod \"console-6c4fc58c6d-nrszz\" (UID: \"cbdc3444-d443-4975-b2d5-0ba2243dc655\") " pod="openshift-console/console-6c4fc58c6d-nrszz" Jul 24 14:37:09.861377 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:09.861359 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgx2l\" (UniqueName: \"kubernetes.io/projected/cbdc3444-d443-4975-b2d5-0ba2243dc655-kube-api-access-kgx2l\") pod \"console-6c4fc58c6d-nrszz\" (UID: \"cbdc3444-d443-4975-b2d5-0ba2243dc655\") " pod="openshift-console/console-6c4fc58c6d-nrszz" Jul 24 14:37:10.019651 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:10.019590 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c4fc58c6d-nrszz" Jul 24 14:37:10.162891 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:10.162863 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c4fc58c6d-nrszz"] Jul 24 14:37:10.165193 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:37:10.165165 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbdc3444_d443_4975_b2d5_0ba2243dc655.slice/crio-02f1c7fa780abecac41b25be41ac631c49bdedc5942e3c19c24d31f7b00bfe6c WatchSource:0}: Error finding container 02f1c7fa780abecac41b25be41ac631c49bdedc5942e3c19c24d31f7b00bfe6c: Status 404 returned error can't find the container with id 02f1c7fa780abecac41b25be41ac631c49bdedc5942e3c19c24d31f7b00bfe6c Jul 24 14:37:10.735444 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:10.735407 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c4fc58c6d-nrszz" event={"ID":"cbdc3444-d443-4975-b2d5-0ba2243dc655","Type":"ContainerStarted","Data":"d8d42c4dfee00e0b3941be4011260e366dbf8cbb9b61f3d6081ebdbefe7553a4"} Jul 24 14:37:10.735902 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:10.735462 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c4fc58c6d-nrszz" event={"ID":"cbdc3444-d443-4975-b2d5-0ba2243dc655","Type":"ContainerStarted","Data":"02f1c7fa780abecac41b25be41ac631c49bdedc5942e3c19c24d31f7b00bfe6c"} Jul 24 14:37:10.794671 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:10.794626 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c4fc58c6d-nrszz" podStartSLOduration=1.794610343 podStartE2EDuration="1.794610343s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:37:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:37:10.793841902 +0000 UTC m=+171.331097873" watchObservedRunningTime="2026-07-24 14:37:10.794610343 +0000 UTC m=+171.331866295" Jul 24 14:37:13.725352 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:13.725275 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-54544f6d4-4tx42" Jul 24 14:37:15.489331 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:15.489290 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-dc778c956-tcb9v" Jul 24 14:37:15.489700 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:15.489353 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-dc778c956-tcb9v" Jul 24 14:37:15.494031 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:15.494009 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-dc778c956-tcb9v" Jul 24 14:37:15.758345 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:15.758265 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-dc778c956-tcb9v" Jul 24 14:37:16.715853 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:16.715824 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lxwhk" Jul 24 14:37:20.020266 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:20.020240 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c4fc58c6d-nrszz" Jul 24 14:37:20.020659 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:20.020286 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c4fc58c6d-nrszz" Jul 24 14:37:20.024917 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:20.024898 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c4fc58c6d-nrszz" Jul 24 14:37:20.776815 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:20.776783 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c4fc58c6d-nrszz" Jul 24 14:37:20.831377 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:20.831345 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dc778c956-tcb9v"] Jul 24 14:37:45.850543 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:45.850468 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-dc778c956-tcb9v" podUID="14c86847-926a-46c8-abbc-26e081c679fe" containerName="console" containerID="cri-o://2646d9bfb70db5a184c8edde27e86eebdf3724798ba2680d8f710dd664ee90c0" gracePeriod=15 Jul 24 14:37:46.093373 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:46.093351 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dc778c956-tcb9v" Jul 24 14:37:46.216944 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:46.216854 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14c86847-926a-46c8-abbc-26e081c679fe-service-ca\") pod \"14c86847-926a-46c8-abbc-26e081c679fe\" (UID: \"14c86847-926a-46c8-abbc-26e081c679fe\") " Jul 24 14:37:46.216944 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:46.216905 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14c86847-926a-46c8-abbc-26e081c679fe-console-serving-cert\") pod \"14c86847-926a-46c8-abbc-26e081c679fe\" (UID: \"14c86847-926a-46c8-abbc-26e081c679fe\") " Jul 24 14:37:46.216944 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:46.216943 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14c86847-926a-46c8-abbc-26e081c679fe-console-oauth-config\") pod \"14c86847-926a-46c8-abbc-26e081c679fe\" (UID: \"14c86847-926a-46c8-abbc-26e081c679fe\") " Jul 24 14:37:46.217212 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:46.216980 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14c86847-926a-46c8-abbc-26e081c679fe-trusted-ca-bundle\") pod \"14c86847-926a-46c8-abbc-26e081c679fe\" (UID: \"14c86847-926a-46c8-abbc-26e081c679fe\") " Jul 24 14:37:46.217212 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:46.217016 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rmz8\" (UniqueName: \"kubernetes.io/projected/14c86847-926a-46c8-abbc-26e081c679fe-kube-api-access-5rmz8\") pod \"14c86847-926a-46c8-abbc-26e081c679fe\" (UID: \"14c86847-926a-46c8-abbc-26e081c679fe\") " Jul 24 14:37:46.217212 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:46.217055 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14c86847-926a-46c8-abbc-26e081c679fe-console-config\") pod \"14c86847-926a-46c8-abbc-26e081c679fe\" (UID: \"14c86847-926a-46c8-abbc-26e081c679fe\") " Jul 24 14:37:46.217212 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:46.217174 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14c86847-926a-46c8-abbc-26e081c679fe-oauth-serving-cert\") pod \"14c86847-926a-46c8-abbc-26e081c679fe\" (UID: \"14c86847-926a-46c8-abbc-26e081c679fe\") " Jul 24 14:37:46.217433 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:46.217360 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14c86847-926a-46c8-abbc-26e081c679fe-service-ca" (OuterVolumeSpecName: "service-ca") pod "14c86847-926a-46c8-abbc-26e081c679fe" (UID: "14c86847-926a-46c8-abbc-26e081c679fe"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:37:46.217491 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:46.217455 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14c86847-926a-46c8-abbc-26e081c679fe-console-config" (OuterVolumeSpecName: "console-config") pod "14c86847-926a-46c8-abbc-26e081c679fe" (UID: "14c86847-926a-46c8-abbc-26e081c679fe"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:37:46.217491 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:46.217465 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14c86847-926a-46c8-abbc-26e081c679fe-service-ca\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:37:46.217491 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:46.217471 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14c86847-926a-46c8-abbc-26e081c679fe-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "14c86847-926a-46c8-abbc-26e081c679fe" (UID: "14c86847-926a-46c8-abbc-26e081c679fe"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:37:46.217663 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:46.217639 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14c86847-926a-46c8-abbc-26e081c679fe-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "14c86847-926a-46c8-abbc-26e081c679fe" (UID: "14c86847-926a-46c8-abbc-26e081c679fe"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:37:46.219136 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:46.219110 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14c86847-926a-46c8-abbc-26e081c679fe-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "14c86847-926a-46c8-abbc-26e081c679fe" (UID: "14c86847-926a-46c8-abbc-26e081c679fe"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:37:46.219583 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:46.219556 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14c86847-926a-46c8-abbc-26e081c679fe-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "14c86847-926a-46c8-abbc-26e081c679fe" (UID: "14c86847-926a-46c8-abbc-26e081c679fe"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:37:46.219583 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:46.219567 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14c86847-926a-46c8-abbc-26e081c679fe-kube-api-access-5rmz8" (OuterVolumeSpecName: "kube-api-access-5rmz8") pod "14c86847-926a-46c8-abbc-26e081c679fe" (UID: "14c86847-926a-46c8-abbc-26e081c679fe"). InnerVolumeSpecName "kube-api-access-5rmz8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:37:46.318563 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:46.318543 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14c86847-926a-46c8-abbc-26e081c679fe-trusted-ca-bundle\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:37:46.318563 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:46.318562 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rmz8\" (UniqueName: \"kubernetes.io/projected/14c86847-926a-46c8-abbc-26e081c679fe-kube-api-access-5rmz8\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:37:46.318683 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:46.318571 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14c86847-926a-46c8-abbc-26e081c679fe-console-config\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:37:46.318683 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:46.318579 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14c86847-926a-46c8-abbc-26e081c679fe-oauth-serving-cert\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:37:46.318683 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:46.318587 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14c86847-926a-46c8-abbc-26e081c679fe-console-serving-cert\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:37:46.318683 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:46.318597 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14c86847-926a-46c8-abbc-26e081c679fe-console-oauth-config\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:37:46.868910 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:46.868874 2581 generic.go:356] "Generic (PLEG): container finished" podID="14c86847-926a-46c8-abbc-26e081c679fe" containerID="2646d9bfb70db5a184c8edde27e86eebdf3724798ba2680d8f710dd664ee90c0" exitCode=0 Jul 24 14:37:46.869401 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:46.868917 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dc778c956-tcb9v" Jul 24 14:37:46.869401 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:46.868943 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dc778c956-tcb9v" event={"ID":"14c86847-926a-46c8-abbc-26e081c679fe","Type":"ContainerDied","Data":"2646d9bfb70db5a184c8edde27e86eebdf3724798ba2680d8f710dd664ee90c0"} Jul 24 14:37:46.869401 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:46.868985 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dc778c956-tcb9v" event={"ID":"14c86847-926a-46c8-abbc-26e081c679fe","Type":"ContainerDied","Data":"ef93b449af27fc8b627589433d84dffcbde2a63266a1def505082c08781acb37"} Jul 24 14:37:46.869401 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:46.869007 2581 scope.go:117] "RemoveContainer" containerID="2646d9bfb70db5a184c8edde27e86eebdf3724798ba2680d8f710dd664ee90c0" Jul 24 14:37:46.882217 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:46.882197 2581 scope.go:117] "RemoveContainer" containerID="2646d9bfb70db5a184c8edde27e86eebdf3724798ba2680d8f710dd664ee90c0" Jul 24 14:37:46.882486 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:37:46.882464 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2646d9bfb70db5a184c8edde27e86eebdf3724798ba2680d8f710dd664ee90c0\": container with ID starting with 2646d9bfb70db5a184c8edde27e86eebdf3724798ba2680d8f710dd664ee90c0 not found: ID does not exist" containerID="2646d9bfb70db5a184c8edde27e86eebdf3724798ba2680d8f710dd664ee90c0" Jul 24 14:37:46.882538 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:46.882493 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2646d9bfb70db5a184c8edde27e86eebdf3724798ba2680d8f710dd664ee90c0"} err="failed to get container status \"2646d9bfb70db5a184c8edde27e86eebdf3724798ba2680d8f710dd664ee90c0\": rpc error: code = NotFound desc = could not find container \"2646d9bfb70db5a184c8edde27e86eebdf3724798ba2680d8f710dd664ee90c0\": container with ID starting with 2646d9bfb70db5a184c8edde27e86eebdf3724798ba2680d8f710dd664ee90c0 not found: ID does not exist" Jul 24 14:37:46.895822 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:46.895802 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dc778c956-tcb9v"] Jul 24 14:37:46.899703 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:46.899678 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-dc778c956-tcb9v"] Jul 24 14:37:48.111011 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:37:48.110976 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14c86847-926a-46c8-abbc-26e081c679fe" path="/var/lib/kubelet/pods/14c86847-926a-46c8-abbc-26e081c679fe/volumes" Jul 24 14:38:52.257254 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:38:52.257173 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d98d99dd4-ndbmd"] Jul 24 14:38:52.257681 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:38:52.257495 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14c86847-926a-46c8-abbc-26e081c679fe" containerName="console" Jul 24 14:38:52.257681 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:38:52.257507 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="14c86847-926a-46c8-abbc-26e081c679fe" containerName="console" Jul 24 14:38:52.257681 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:38:52.257589 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="14c86847-926a-46c8-abbc-26e081c679fe" containerName="console" Jul 24 14:38:52.259741 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:38:52.259722 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d98d99dd4-ndbmd" Jul 24 14:38:52.275084 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:38:52.275065 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d98d99dd4-ndbmd"] Jul 24 14:38:52.388223 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:38:52.388194 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb656059-871b-46f1-9101-71c446dd772f-service-ca\") pod \"console-6d98d99dd4-ndbmd\" (UID: \"bb656059-871b-46f1-9101-71c446dd772f\") " pod="openshift-console/console-6d98d99dd4-ndbmd" Jul 24 14:38:52.388223 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:38:52.388225 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb656059-871b-46f1-9101-71c446dd772f-console-config\") pod \"console-6d98d99dd4-ndbmd\" (UID: \"bb656059-871b-46f1-9101-71c446dd772f\") " pod="openshift-console/console-6d98d99dd4-ndbmd" Jul 24 14:38:52.388420 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:38:52.388249 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb656059-871b-46f1-9101-71c446dd772f-trusted-ca-bundle\") pod \"console-6d98d99dd4-ndbmd\" (UID: \"bb656059-871b-46f1-9101-71c446dd772f\") " pod="openshift-console/console-6d98d99dd4-ndbmd" Jul 24 14:38:52.388420 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:38:52.388280 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb656059-871b-46f1-9101-71c446dd772f-console-oauth-config\") pod \"console-6d98d99dd4-ndbmd\" (UID: \"bb656059-871b-46f1-9101-71c446dd772f\") " pod="openshift-console/console-6d98d99dd4-ndbmd" Jul 24 14:38:52.388420 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:38:52.388330 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plz8t\" (UniqueName: \"kubernetes.io/projected/bb656059-871b-46f1-9101-71c446dd772f-kube-api-access-plz8t\") pod \"console-6d98d99dd4-ndbmd\" (UID: \"bb656059-871b-46f1-9101-71c446dd772f\") " pod="openshift-console/console-6d98d99dd4-ndbmd" Jul 24 14:38:52.388420 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:38:52.388386 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb656059-871b-46f1-9101-71c446dd772f-console-serving-cert\") pod \"console-6d98d99dd4-ndbmd\" (UID: \"bb656059-871b-46f1-9101-71c446dd772f\") " pod="openshift-console/console-6d98d99dd4-ndbmd" Jul 24 14:38:52.388574 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:38:52.388443 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb656059-871b-46f1-9101-71c446dd772f-oauth-serving-cert\") pod \"console-6d98d99dd4-ndbmd\" (UID: \"bb656059-871b-46f1-9101-71c446dd772f\") " pod="openshift-console/console-6d98d99dd4-ndbmd" Jul 24 14:38:52.488945 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:38:52.488921 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb656059-871b-46f1-9101-71c446dd772f-service-ca\") pod \"console-6d98d99dd4-ndbmd\" (UID: \"bb656059-871b-46f1-9101-71c446dd772f\") " pod="openshift-console/console-6d98d99dd4-ndbmd" Jul 24 14:38:52.489033 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:38:52.488949 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb656059-871b-46f1-9101-71c446dd772f-console-config\") pod \"console-6d98d99dd4-ndbmd\" (UID: \"bb656059-871b-46f1-9101-71c446dd772f\") " pod="openshift-console/console-6d98d99dd4-ndbmd" Jul 24 14:38:52.489033 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:38:52.488974 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb656059-871b-46f1-9101-71c446dd772f-trusted-ca-bundle\") pod \"console-6d98d99dd4-ndbmd\" (UID: \"bb656059-871b-46f1-9101-71c446dd772f\") " pod="openshift-console/console-6d98d99dd4-ndbmd" Jul 24 14:38:52.489033 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:38:52.488992 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb656059-871b-46f1-9101-71c446dd772f-console-oauth-config\") pod \"console-6d98d99dd4-ndbmd\" (UID: \"bb656059-871b-46f1-9101-71c446dd772f\") " pod="openshift-console/console-6d98d99dd4-ndbmd" Jul 24 14:38:52.489033 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:38:52.489017 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plz8t\" (UniqueName: \"kubernetes.io/projected/bb656059-871b-46f1-9101-71c446dd772f-kube-api-access-plz8t\") pod \"console-6d98d99dd4-ndbmd\" (UID: \"bb656059-871b-46f1-9101-71c446dd772f\") " pod="openshift-console/console-6d98d99dd4-ndbmd" Jul 24 14:38:52.489231 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:38:52.489068 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb656059-871b-46f1-9101-71c446dd772f-console-serving-cert\") pod \"console-6d98d99dd4-ndbmd\" (UID: \"bb656059-871b-46f1-9101-71c446dd772f\") " pod="openshift-console/console-6d98d99dd4-ndbmd" Jul 24 14:38:52.489231 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:38:52.489128 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb656059-871b-46f1-9101-71c446dd772f-oauth-serving-cert\") pod \"console-6d98d99dd4-ndbmd\" (UID: \"bb656059-871b-46f1-9101-71c446dd772f\") " pod="openshift-console/console-6d98d99dd4-ndbmd" Jul 24 14:38:52.489849 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:38:52.489826 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb656059-871b-46f1-9101-71c446dd772f-console-config\") pod \"console-6d98d99dd4-ndbmd\" (UID: \"bb656059-871b-46f1-9101-71c446dd772f\") " pod="openshift-console/console-6d98d99dd4-ndbmd" Jul 24 14:38:52.489920 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:38:52.489852 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb656059-871b-46f1-9101-71c446dd772f-service-ca\") pod \"console-6d98d99dd4-ndbmd\" (UID: \"bb656059-871b-46f1-9101-71c446dd772f\") " pod="openshift-console/console-6d98d99dd4-ndbmd" Jul 24 14:38:52.490334 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:38:52.490314 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb656059-871b-46f1-9101-71c446dd772f-oauth-serving-cert\") pod \"console-6d98d99dd4-ndbmd\" (UID: \"bb656059-871b-46f1-9101-71c446dd772f\") " pod="openshift-console/console-6d98d99dd4-ndbmd" Jul 24 14:38:52.490632 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:38:52.490596 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb656059-871b-46f1-9101-71c446dd772f-trusted-ca-bundle\") pod \"console-6d98d99dd4-ndbmd\" (UID: \"bb656059-871b-46f1-9101-71c446dd772f\") " pod="openshift-console/console-6d98d99dd4-ndbmd" Jul 24 14:38:52.492082 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:38:52.492060 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb656059-871b-46f1-9101-71c446dd772f-console-oauth-config\") pod \"console-6d98d99dd4-ndbmd\" (UID: \"bb656059-871b-46f1-9101-71c446dd772f\") " pod="openshift-console/console-6d98d99dd4-ndbmd" Jul 24 14:38:52.492216 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:38:52.492193 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb656059-871b-46f1-9101-71c446dd772f-console-serving-cert\") pod \"console-6d98d99dd4-ndbmd\" (UID: \"bb656059-871b-46f1-9101-71c446dd772f\") " pod="openshift-console/console-6d98d99dd4-ndbmd" Jul 24 14:38:52.499785 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:38:52.499764 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plz8t\" (UniqueName: \"kubernetes.io/projected/bb656059-871b-46f1-9101-71c446dd772f-kube-api-access-plz8t\") pod \"console-6d98d99dd4-ndbmd\" (UID: \"bb656059-871b-46f1-9101-71c446dd772f\") " pod="openshift-console/console-6d98d99dd4-ndbmd" Jul 24 14:38:52.568282 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:38:52.568261 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d98d99dd4-ndbmd" Jul 24 14:38:52.702958 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:38:52.700922 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d98d99dd4-ndbmd"] Jul 24 14:38:53.115859 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:38:53.115823 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d98d99dd4-ndbmd" event={"ID":"bb656059-871b-46f1-9101-71c446dd772f","Type":"ContainerStarted","Data":"e2de4db949f945f946c1ad0bcfe0f0dd79670e57dc7ff67324a619308df837d6"} Jul 24 14:38:53.116015 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:38:53.115872 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d98d99dd4-ndbmd" event={"ID":"bb656059-871b-46f1-9101-71c446dd772f","Type":"ContainerStarted","Data":"1c8cb73f7b5e0264fe7de32d8cb96d8536349231b9d7ae18982a34b9e9b85e59"} Jul 24 14:38:53.139027 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:38:53.138981 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d98d99dd4-ndbmd" podStartSLOduration=1.138963403 podStartE2EDuration="1.138963403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:38:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:38:53.138191599 +0000 UTC m=+273.675447613" watchObservedRunningTime="2026-07-24 14:38:53.138963403 +0000 UTC m=+273.676219356" Jul 24 14:39:02.569279 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:02.569242 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d98d99dd4-ndbmd" Jul 24 14:39:02.569694 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:02.569498 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d98d99dd4-ndbmd" Jul 24 14:39:02.574111 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:02.574093 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d98d99dd4-ndbmd" Jul 24 14:39:03.155336 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:03.155305 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d98d99dd4-ndbmd" Jul 24 14:39:03.207769 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:03.207729 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c4fc58c6d-nrszz"] Jul 24 14:39:19.849359 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:19.849333 2581 kubelet.go:1648] "Image garbage collection succeeded" Jul 24 14:39:28.228312 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:28.228260 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6c4fc58c6d-nrszz" podUID="cbdc3444-d443-4975-b2d5-0ba2243dc655" containerName="console" containerID="cri-o://d8d42c4dfee00e0b3941be4011260e366dbf8cbb9b61f3d6081ebdbefe7553a4" gracePeriod=15 Jul 24 14:39:28.470694 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:28.470668 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c4fc58c6d-nrszz" Jul 24 14:39:28.566430 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:28.566404 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbdc3444-d443-4975-b2d5-0ba2243dc655-trusted-ca-bundle\") pod \"cbdc3444-d443-4975-b2d5-0ba2243dc655\" (UID: \"cbdc3444-d443-4975-b2d5-0ba2243dc655\") " Jul 24 14:39:28.566623 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:28.566449 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cbdc3444-d443-4975-b2d5-0ba2243dc655-console-serving-cert\") pod \"cbdc3444-d443-4975-b2d5-0ba2243dc655\" (UID: \"cbdc3444-d443-4975-b2d5-0ba2243dc655\") " Jul 24 14:39:28.566696 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:28.566631 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cbdc3444-d443-4975-b2d5-0ba2243dc655-console-oauth-config\") pod \"cbdc3444-d443-4975-b2d5-0ba2243dc655\" (UID: \"cbdc3444-d443-4975-b2d5-0ba2243dc655\") " Jul 24 14:39:28.566696 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:28.566670 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cbdc3444-d443-4975-b2d5-0ba2243dc655-service-ca\") pod \"cbdc3444-d443-4975-b2d5-0ba2243dc655\" (UID: \"cbdc3444-d443-4975-b2d5-0ba2243dc655\") " Jul 24 14:39:28.566696 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:28.566688 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cbdc3444-d443-4975-b2d5-0ba2243dc655-console-config\") pod \"cbdc3444-d443-4975-b2d5-0ba2243dc655\" (UID: \"cbdc3444-d443-4975-b2d5-0ba2243dc655\") " Jul 24 14:39:28.566837 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:28.566716 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgx2l\" (UniqueName: \"kubernetes.io/projected/cbdc3444-d443-4975-b2d5-0ba2243dc655-kube-api-access-kgx2l\") pod \"cbdc3444-d443-4975-b2d5-0ba2243dc655\" (UID: \"cbdc3444-d443-4975-b2d5-0ba2243dc655\") " Jul 24 14:39:28.566837 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:28.566771 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cbdc3444-d443-4975-b2d5-0ba2243dc655-oauth-serving-cert\") pod \"cbdc3444-d443-4975-b2d5-0ba2243dc655\" (UID: \"cbdc3444-d443-4975-b2d5-0ba2243dc655\") " Jul 24 14:39:28.566837 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:28.566769 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbdc3444-d443-4975-b2d5-0ba2243dc655-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cbdc3444-d443-4975-b2d5-0ba2243dc655" (UID: "cbdc3444-d443-4975-b2d5-0ba2243dc655"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:39:28.567012 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:28.566995 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbdc3444-d443-4975-b2d5-0ba2243dc655-trusted-ca-bundle\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:39:28.567072 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:28.567057 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbdc3444-d443-4975-b2d5-0ba2243dc655-console-config" (OuterVolumeSpecName: "console-config") pod "cbdc3444-d443-4975-b2d5-0ba2243dc655" (UID: "cbdc3444-d443-4975-b2d5-0ba2243dc655"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:39:28.567171 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:28.567032 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbdc3444-d443-4975-b2d5-0ba2243dc655-service-ca" (OuterVolumeSpecName: "service-ca") pod "cbdc3444-d443-4975-b2d5-0ba2243dc655" (UID: "cbdc3444-d443-4975-b2d5-0ba2243dc655"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:39:28.567246 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:28.567222 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbdc3444-d443-4975-b2d5-0ba2243dc655-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cbdc3444-d443-4975-b2d5-0ba2243dc655" (UID: "cbdc3444-d443-4975-b2d5-0ba2243dc655"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:39:28.568740 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:28.568719 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbdc3444-d443-4975-b2d5-0ba2243dc655-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cbdc3444-d443-4975-b2d5-0ba2243dc655" (UID: "cbdc3444-d443-4975-b2d5-0ba2243dc655"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:39:28.568823 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:28.568737 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbdc3444-d443-4975-b2d5-0ba2243dc655-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cbdc3444-d443-4975-b2d5-0ba2243dc655" (UID: "cbdc3444-d443-4975-b2d5-0ba2243dc655"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:39:28.568823 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:28.568770 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbdc3444-d443-4975-b2d5-0ba2243dc655-kube-api-access-kgx2l" (OuterVolumeSpecName: "kube-api-access-kgx2l") pod "cbdc3444-d443-4975-b2d5-0ba2243dc655" (UID: "cbdc3444-d443-4975-b2d5-0ba2243dc655"). InnerVolumeSpecName "kube-api-access-kgx2l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:39:28.668199 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:28.668174 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cbdc3444-d443-4975-b2d5-0ba2243dc655-console-oauth-config\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:39:28.668199 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:28.668194 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cbdc3444-d443-4975-b2d5-0ba2243dc655-service-ca\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:39:28.668337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:28.668205 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cbdc3444-d443-4975-b2d5-0ba2243dc655-console-config\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:39:28.668337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:28.668214 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgx2l\" (UniqueName: \"kubernetes.io/projected/cbdc3444-d443-4975-b2d5-0ba2243dc655-kube-api-access-kgx2l\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:39:28.668337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:28.668222 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cbdc3444-d443-4975-b2d5-0ba2243dc655-oauth-serving-cert\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:39:28.668337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:28.668230 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cbdc3444-d443-4975-b2d5-0ba2243dc655-console-serving-cert\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:39:29.248672 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:29.248641 2581 generic.go:356] "Generic (PLEG): container finished" podID="cbdc3444-d443-4975-b2d5-0ba2243dc655" containerID="d8d42c4dfee00e0b3941be4011260e366dbf8cbb9b61f3d6081ebdbefe7553a4" exitCode=0 Jul 24 14:39:29.249091 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:29.248688 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c4fc58c6d-nrszz" Jul 24 14:39:29.249091 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:29.248701 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c4fc58c6d-nrszz" event={"ID":"cbdc3444-d443-4975-b2d5-0ba2243dc655","Type":"ContainerDied","Data":"d8d42c4dfee00e0b3941be4011260e366dbf8cbb9b61f3d6081ebdbefe7553a4"} Jul 24 14:39:29.249091 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:29.248739 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c4fc58c6d-nrszz" event={"ID":"cbdc3444-d443-4975-b2d5-0ba2243dc655","Type":"ContainerDied","Data":"02f1c7fa780abecac41b25be41ac631c49bdedc5942e3c19c24d31f7b00bfe6c"} Jul 24 14:39:29.249091 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:29.248758 2581 scope.go:117] "RemoveContainer" containerID="d8d42c4dfee00e0b3941be4011260e366dbf8cbb9b61f3d6081ebdbefe7553a4" Jul 24 14:39:29.256972 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:29.256957 2581 scope.go:117] "RemoveContainer" containerID="d8d42c4dfee00e0b3941be4011260e366dbf8cbb9b61f3d6081ebdbefe7553a4" Jul 24 14:39:29.257241 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:39:29.257222 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8d42c4dfee00e0b3941be4011260e366dbf8cbb9b61f3d6081ebdbefe7553a4\": container with ID starting with d8d42c4dfee00e0b3941be4011260e366dbf8cbb9b61f3d6081ebdbefe7553a4 not found: ID does not exist" containerID="d8d42c4dfee00e0b3941be4011260e366dbf8cbb9b61f3d6081ebdbefe7553a4" Jul 24 14:39:29.257294 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:29.257256 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8d42c4dfee00e0b3941be4011260e366dbf8cbb9b61f3d6081ebdbefe7553a4"} err="failed to get container status \"d8d42c4dfee00e0b3941be4011260e366dbf8cbb9b61f3d6081ebdbefe7553a4\": rpc error: code = NotFound desc = could not find container \"d8d42c4dfee00e0b3941be4011260e366dbf8cbb9b61f3d6081ebdbefe7553a4\": container with ID starting with d8d42c4dfee00e0b3941be4011260e366dbf8cbb9b61f3d6081ebdbefe7553a4 not found: ID does not exist" Jul 24 14:39:29.269669 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:29.269646 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c4fc58c6d-nrszz"] Jul 24 14:39:29.277310 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:29.277292 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c4fc58c6d-nrszz"] Jul 24 14:39:29.303973 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:29.303951 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z8n2w"] Jul 24 14:39:29.304257 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:29.304244 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbdc3444-d443-4975-b2d5-0ba2243dc655" containerName="console" Jul 24 14:39:29.304303 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:29.304259 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbdc3444-d443-4975-b2d5-0ba2243dc655" containerName="console" Jul 24 14:39:29.304343 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:29.304310 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbdc3444-d443-4975-b2d5-0ba2243dc655" containerName="console" Jul 24 14:39:29.308514 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:29.308499 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z8n2w" Jul 24 14:39:29.311218 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:29.311200 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 24 14:39:29.311332 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:29.311253 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-j9ztw\"" Jul 24 14:39:29.311332 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:29.311320 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 24 14:39:29.315805 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:29.315785 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z8n2w"] Jul 24 14:39:29.373521 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:29.373500 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f6471ae-7348-45ed-ae49-d1d90c51b9e9-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z8n2w\" (UID: \"9f6471ae-7348-45ed-ae49-d1d90c51b9e9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z8n2w" Jul 24 14:39:29.373643 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:29.373534 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldbpv\" (UniqueName: \"kubernetes.io/projected/9f6471ae-7348-45ed-ae49-d1d90c51b9e9-kube-api-access-ldbpv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z8n2w\" (UID: \"9f6471ae-7348-45ed-ae49-d1d90c51b9e9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z8n2w" Jul 24 14:39:29.373643 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:29.373558 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f6471ae-7348-45ed-ae49-d1d90c51b9e9-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z8n2w\" (UID: \"9f6471ae-7348-45ed-ae49-d1d90c51b9e9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z8n2w" Jul 24 14:39:29.474582 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:29.474559 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f6471ae-7348-45ed-ae49-d1d90c51b9e9-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z8n2w\" (UID: \"9f6471ae-7348-45ed-ae49-d1d90c51b9e9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z8n2w" Jul 24 14:39:29.474695 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:29.474595 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldbpv\" (UniqueName: \"kubernetes.io/projected/9f6471ae-7348-45ed-ae49-d1d90c51b9e9-kube-api-access-ldbpv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z8n2w\" (UID: \"9f6471ae-7348-45ed-ae49-d1d90c51b9e9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z8n2w" Jul 24 14:39:29.474695 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:29.474624 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f6471ae-7348-45ed-ae49-d1d90c51b9e9-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z8n2w\" (UID: \"9f6471ae-7348-45ed-ae49-d1d90c51b9e9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z8n2w" Jul 24 14:39:29.474986 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:29.474966 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f6471ae-7348-45ed-ae49-d1d90c51b9e9-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z8n2w\" (UID: \"9f6471ae-7348-45ed-ae49-d1d90c51b9e9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z8n2w" Jul 24 14:39:29.475022 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:29.474975 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f6471ae-7348-45ed-ae49-d1d90c51b9e9-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z8n2w\" (UID: \"9f6471ae-7348-45ed-ae49-d1d90c51b9e9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z8n2w" Jul 24 14:39:29.483257 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:29.483234 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldbpv\" (UniqueName: \"kubernetes.io/projected/9f6471ae-7348-45ed-ae49-d1d90c51b9e9-kube-api-access-ldbpv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z8n2w\" (UID: \"9f6471ae-7348-45ed-ae49-d1d90c51b9e9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z8n2w" Jul 24 14:39:29.617349 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:29.617330 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z8n2w" Jul 24 14:39:29.766407 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:29.766378 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z8n2w"] Jul 24 14:39:29.769902 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:39:29.769880 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f6471ae_7348_45ed_ae49_d1d90c51b9e9.slice/crio-5a4d9f528cd0c0ded69415312fe912a48328aae15cc98ff8ae8a8d8398d357b3 WatchSource:0}: Error finding container 5a4d9f528cd0c0ded69415312fe912a48328aae15cc98ff8ae8a8d8398d357b3: Status 404 returned error can't find the container with id 5a4d9f528cd0c0ded69415312fe912a48328aae15cc98ff8ae8a8d8398d357b3 Jul 24 14:39:29.771921 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:29.771905 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 14:39:30.116278 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:30.116248 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbdc3444-d443-4975-b2d5-0ba2243dc655" path="/var/lib/kubelet/pods/cbdc3444-d443-4975-b2d5-0ba2243dc655/volumes" Jul 24 14:39:30.254821 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:30.254784 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z8n2w" event={"ID":"9f6471ae-7348-45ed-ae49-d1d90c51b9e9","Type":"ContainerStarted","Data":"5a4d9f528cd0c0ded69415312fe912a48328aae15cc98ff8ae8a8d8398d357b3"} Jul 24 14:39:36.280707 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:36.280674 2581 generic.go:356] "Generic (PLEG): container finished" podID="9f6471ae-7348-45ed-ae49-d1d90c51b9e9" containerID="5bcea41ec7f0cc6f4fcfe4528de3bc25711425eb4d9a029c14cb192da63b4edf" exitCode=0 Jul 24 14:39:36.281209 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:36.280726 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z8n2w" event={"ID":"9f6471ae-7348-45ed-ae49-d1d90c51b9e9","Type":"ContainerDied","Data":"5bcea41ec7f0cc6f4fcfe4528de3bc25711425eb4d9a029c14cb192da63b4edf"} Jul 24 14:39:39.294115 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:39.294085 2581 generic.go:356] "Generic (PLEG): container finished" podID="9f6471ae-7348-45ed-ae49-d1d90c51b9e9" containerID="b0e6578afa7610b588e07f7d647ead5b3f0bc266218869c050ce9d63cd004d71" exitCode=0 Jul 24 14:39:39.294500 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:39.294135 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z8n2w" event={"ID":"9f6471ae-7348-45ed-ae49-d1d90c51b9e9","Type":"ContainerDied","Data":"b0e6578afa7610b588e07f7d647ead5b3f0bc266218869c050ce9d63cd004d71"} Jul 24 14:39:47.324840 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:47.324809 2581 generic.go:356] "Generic (PLEG): container finished" podID="9f6471ae-7348-45ed-ae49-d1d90c51b9e9" containerID="d56ee48523e3cb483ca0e9da65814255183379ef8a70de3fa5c2086b0895f95f" exitCode=0 Jul 24 14:39:47.325232 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:47.324850 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z8n2w" event={"ID":"9f6471ae-7348-45ed-ae49-d1d90c51b9e9","Type":"ContainerDied","Data":"d56ee48523e3cb483ca0e9da65814255183379ef8a70de3fa5c2086b0895f95f"} Jul 24 14:39:48.449634 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:48.449607 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z8n2w" Jul 24 14:39:48.538340 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:48.538315 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldbpv\" (UniqueName: \"kubernetes.io/projected/9f6471ae-7348-45ed-ae49-d1d90c51b9e9-kube-api-access-ldbpv\") pod \"9f6471ae-7348-45ed-ae49-d1d90c51b9e9\" (UID: \"9f6471ae-7348-45ed-ae49-d1d90c51b9e9\") " Jul 24 14:39:48.538450 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:48.538360 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f6471ae-7348-45ed-ae49-d1d90c51b9e9-util\") pod \"9f6471ae-7348-45ed-ae49-d1d90c51b9e9\" (UID: \"9f6471ae-7348-45ed-ae49-d1d90c51b9e9\") " Jul 24 14:39:48.538450 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:48.538426 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f6471ae-7348-45ed-ae49-d1d90c51b9e9-bundle\") pod \"9f6471ae-7348-45ed-ae49-d1d90c51b9e9\" (UID: \"9f6471ae-7348-45ed-ae49-d1d90c51b9e9\") " Jul 24 14:39:48.539086 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:48.539055 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f6471ae-7348-45ed-ae49-d1d90c51b9e9-bundle" (OuterVolumeSpecName: "bundle") pod "9f6471ae-7348-45ed-ae49-d1d90c51b9e9" (UID: "9f6471ae-7348-45ed-ae49-d1d90c51b9e9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:39:48.540443 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:48.540415 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f6471ae-7348-45ed-ae49-d1d90c51b9e9-kube-api-access-ldbpv" (OuterVolumeSpecName: "kube-api-access-ldbpv") pod "9f6471ae-7348-45ed-ae49-d1d90c51b9e9" (UID: "9f6471ae-7348-45ed-ae49-d1d90c51b9e9"). InnerVolumeSpecName "kube-api-access-ldbpv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:39:48.542436 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:48.542414 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f6471ae-7348-45ed-ae49-d1d90c51b9e9-util" (OuterVolumeSpecName: "util") pod "9f6471ae-7348-45ed-ae49-d1d90c51b9e9" (UID: "9f6471ae-7348-45ed-ae49-d1d90c51b9e9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:39:48.640041 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:48.639979 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f6471ae-7348-45ed-ae49-d1d90c51b9e9-bundle\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:39:48.640041 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:48.640004 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldbpv\" (UniqueName: \"kubernetes.io/projected/9f6471ae-7348-45ed-ae49-d1d90c51b9e9-kube-api-access-ldbpv\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:39:48.640041 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:48.640015 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f6471ae-7348-45ed-ae49-d1d90c51b9e9-util\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:39:49.338801 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:49.338765 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z8n2w" event={"ID":"9f6471ae-7348-45ed-ae49-d1d90c51b9e9","Type":"ContainerDied","Data":"5a4d9f528cd0c0ded69415312fe912a48328aae15cc98ff8ae8a8d8398d357b3"} Jul 24 14:39:49.338988 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:49.338837 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5a4d9f528cd0c0ded69415312fe912a48328aae15cc98ff8ae8a8d8398d357b3" Jul 24 14:39:49.338988 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:49.338778 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540z8n2w" Jul 24 14:39:52.491272 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:52.491239 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4bf4d"] Jul 24 14:39:52.491627 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:52.491543 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f6471ae-7348-45ed-ae49-d1d90c51b9e9" containerName="extract" Jul 24 14:39:52.491627 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:52.491554 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f6471ae-7348-45ed-ae49-d1d90c51b9e9" containerName="extract" Jul 24 14:39:52.491627 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:52.491568 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f6471ae-7348-45ed-ae49-d1d90c51b9e9" containerName="util" Jul 24 14:39:52.491627 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:52.491573 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f6471ae-7348-45ed-ae49-d1d90c51b9e9" containerName="util" Jul 24 14:39:52.491627 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:52.491579 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f6471ae-7348-45ed-ae49-d1d90c51b9e9" containerName="pull" Jul 24 14:39:52.491627 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:52.491585 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f6471ae-7348-45ed-ae49-d1d90c51b9e9" containerName="pull" Jul 24 14:39:52.491810 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:52.491647 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f6471ae-7348-45ed-ae49-d1d90c51b9e9" containerName="extract" Jul 24 14:39:52.522548 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:52.522525 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4bf4d"] Jul 24 14:39:52.522697 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:52.522609 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4bf4d" Jul 24 14:39:52.525375 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:52.525353 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 24 14:39:52.525499 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:52.525392 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-hpz4w\"" Jul 24 14:39:52.525499 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:52.525447 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 24 14:39:52.569564 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:52.569537 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0cad3d65-fff6-4c37-875b-918ca2c511e7-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4bf4d\" (UID: \"0cad3d65-fff6-4c37-875b-918ca2c511e7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4bf4d" Jul 24 14:39:52.569693 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:52.569618 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dwkv\" (UniqueName: \"kubernetes.io/projected/0cad3d65-fff6-4c37-875b-918ca2c511e7-kube-api-access-9dwkv\") pod \"cert-manager-operator-controller-manager-55c444bf86-4bf4d\" (UID: \"0cad3d65-fff6-4c37-875b-918ca2c511e7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4bf4d" Jul 24 14:39:52.670954 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:52.670929 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dwkv\" (UniqueName: \"kubernetes.io/projected/0cad3d65-fff6-4c37-875b-918ca2c511e7-kube-api-access-9dwkv\") pod \"cert-manager-operator-controller-manager-55c444bf86-4bf4d\" (UID: \"0cad3d65-fff6-4c37-875b-918ca2c511e7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4bf4d" Jul 24 14:39:52.671051 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:52.670969 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0cad3d65-fff6-4c37-875b-918ca2c511e7-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4bf4d\" (UID: \"0cad3d65-fff6-4c37-875b-918ca2c511e7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4bf4d" Jul 24 14:39:52.671279 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:52.671265 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0cad3d65-fff6-4c37-875b-918ca2c511e7-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4bf4d\" (UID: \"0cad3d65-fff6-4c37-875b-918ca2c511e7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4bf4d" Jul 24 14:39:52.682536 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:52.682509 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dwkv\" (UniqueName: \"kubernetes.io/projected/0cad3d65-fff6-4c37-875b-918ca2c511e7-kube-api-access-9dwkv\") pod \"cert-manager-operator-controller-manager-55c444bf86-4bf4d\" (UID: \"0cad3d65-fff6-4c37-875b-918ca2c511e7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4bf4d" Jul 24 14:39:52.831310 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:52.831275 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4bf4d" Jul 24 14:39:52.961129 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:52.960943 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4bf4d"] Jul 24 14:39:52.963893 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:39:52.963869 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cad3d65_fff6_4c37_875b_918ca2c511e7.slice/crio-b89398314a5168d6b483e67ad1c0708e2fc82ff599aafdb74138603095de113b WatchSource:0}: Error finding container b89398314a5168d6b483e67ad1c0708e2fc82ff599aafdb74138603095de113b: Status 404 returned error can't find the container with id b89398314a5168d6b483e67ad1c0708e2fc82ff599aafdb74138603095de113b Jul 24 14:39:53.354333 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:53.354304 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4bf4d" event={"ID":"0cad3d65-fff6-4c37-875b-918ca2c511e7","Type":"ContainerStarted","Data":"b89398314a5168d6b483e67ad1c0708e2fc82ff599aafdb74138603095de113b"} Jul 24 14:39:57.138240 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:57.138206 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-p5prw"] Jul 24 14:39:57.140418 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:57.140403 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-p5prw" Jul 24 14:39:57.143683 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:57.143661 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 24 14:39:57.145141 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:57.145126 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 24 14:39:57.145241 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:57.145225 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-kl59w\"" Jul 24 14:39:57.150807 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:57.150782 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-p5prw"] Jul 24 14:39:57.208126 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:57.208087 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffn8g\" (UniqueName: \"kubernetes.io/projected/0c40668a-b076-46a4-9784-6d5275fe5ae0-kube-api-access-ffn8g\") pod \"cert-manager-webhook-6486ffd997-p5prw\" (UID: \"0c40668a-b076-46a4-9784-6d5275fe5ae0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p5prw" Jul 24 14:39:57.208275 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:57.208226 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c40668a-b076-46a4-9784-6d5275fe5ae0-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-p5prw\" (UID: \"0c40668a-b076-46a4-9784-6d5275fe5ae0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p5prw" Jul 24 14:39:57.309061 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:57.309023 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c40668a-b076-46a4-9784-6d5275fe5ae0-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-p5prw\" (UID: \"0c40668a-b076-46a4-9784-6d5275fe5ae0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p5prw" Jul 24 14:39:57.309233 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:57.309104 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffn8g\" (UniqueName: \"kubernetes.io/projected/0c40668a-b076-46a4-9784-6d5275fe5ae0-kube-api-access-ffn8g\") pod \"cert-manager-webhook-6486ffd997-p5prw\" (UID: \"0c40668a-b076-46a4-9784-6d5275fe5ae0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p5prw" Jul 24 14:39:57.317992 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:57.317964 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c40668a-b076-46a4-9784-6d5275fe5ae0-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-p5prw\" (UID: \"0c40668a-b076-46a4-9784-6d5275fe5ae0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p5prw" Jul 24 14:39:57.318093 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:57.318020 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffn8g\" (UniqueName: \"kubernetes.io/projected/0c40668a-b076-46a4-9784-6d5275fe5ae0-kube-api-access-ffn8g\") pod \"cert-manager-webhook-6486ffd997-p5prw\" (UID: \"0c40668a-b076-46a4-9784-6d5275fe5ae0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p5prw" Jul 24 14:39:57.377860 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:57.377830 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4bf4d" event={"ID":"0cad3d65-fff6-4c37-875b-918ca2c511e7","Type":"ContainerStarted","Data":"8991d469ae5a5e4323cdd5afb3c243d729fffb7b119456b55f760cd4425a3d82"} Jul 24 14:39:57.400325 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:57.400227 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4bf4d" podStartSLOduration=2.050922751 podStartE2EDuration="5.400206641s" totalImagesPullingTime="3.34928389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:39:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:39:57.399461043 +0000 UTC m=+337.936716996" watchObservedRunningTime="2026-07-24 14:39:57.400206641 +0000 UTC m=+337.937462585" Jul 24 14:39:57.470416 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:57.470377 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-p5prw" Jul 24 14:39:57.593967 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:57.593944 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-p5prw"] Jul 24 14:39:57.595863 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:39:57.595832 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c40668a_b076_46a4_9784_6d5275fe5ae0.slice/crio-2d7278c8804dfb3c5d5854b235b0991dd33959c8c59ba5e65070968db921c53c WatchSource:0}: Error finding container 2d7278c8804dfb3c5d5854b235b0991dd33959c8c59ba5e65070968db921c53c: Status 404 returned error can't find the container with id 2d7278c8804dfb3c5d5854b235b0991dd33959c8c59ba5e65070968db921c53c Jul 24 14:39:57.872428 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:57.872397 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6kltw"] Jul 24 14:39:57.875508 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:57.875488 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6kltw" Jul 24 14:39:57.878592 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:57.878571 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 24 14:39:57.878690 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:57.878613 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 24 14:39:57.878690 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:57.878579 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-j9ztw\"" Jul 24 14:39:57.886914 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:57.886893 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6kltw"] Jul 24 14:39:58.015540 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:58.015514 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6kltw\" (UID: \"ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6kltw" Jul 24 14:39:58.015658 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:58.015562 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkpll\" (UniqueName: \"kubernetes.io/projected/ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7-kube-api-access-qkpll\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6kltw\" (UID: \"ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6kltw" Jul 24 14:39:58.015717 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:58.015670 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6kltw\" (UID: \"ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6kltw" Jul 24 14:39:58.116031 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:58.116005 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6kltw\" (UID: \"ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6kltw" Jul 24 14:39:58.116207 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:58.116044 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkpll\" (UniqueName: \"kubernetes.io/projected/ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7-kube-api-access-qkpll\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6kltw\" (UID: \"ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6kltw" Jul 24 14:39:58.116207 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:58.116092 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6kltw\" (UID: \"ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6kltw" Jul 24 14:39:58.116451 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:58.116435 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6kltw\" (UID: \"ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6kltw" Jul 24 14:39:58.116489 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:58.116437 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6kltw\" (UID: \"ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6kltw" Jul 24 14:39:58.125070 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:58.125021 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkpll\" (UniqueName: \"kubernetes.io/projected/ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7-kube-api-access-qkpll\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6kltw\" (UID: \"ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6kltw" Jul 24 14:39:58.184836 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:58.184797 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6kltw" Jul 24 14:39:58.332610 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:58.332394 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6kltw"] Jul 24 14:39:58.334821 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:39:58.334795 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef2cbd55_5f24_4d1b_b76f_0915bcfc57b7.slice/crio-69da31a86c7d84ea6607fc61c9511c05f8ac87b81d22b7488d7ae8f9ce2136ec WatchSource:0}: Error finding container 69da31a86c7d84ea6607fc61c9511c05f8ac87b81d22b7488d7ae8f9ce2136ec: Status 404 returned error can't find the container with id 69da31a86c7d84ea6607fc61c9511c05f8ac87b81d22b7488d7ae8f9ce2136ec Jul 24 14:39:58.384996 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:58.384964 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-p5prw" event={"ID":"0c40668a-b076-46a4-9784-6d5275fe5ae0","Type":"ContainerStarted","Data":"2d7278c8804dfb3c5d5854b235b0991dd33959c8c59ba5e65070968db921c53c"} Jul 24 14:39:58.386273 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:58.386247 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6kltw" event={"ID":"ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7","Type":"ContainerStarted","Data":"69da31a86c7d84ea6607fc61c9511c05f8ac87b81d22b7488d7ae8f9ce2136ec"} Jul 24 14:39:59.394179 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:59.394127 2581 generic.go:356] "Generic (PLEG): container finished" podID="ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7" containerID="421178e268dab59f1e526be790af0509ab2078b65c8cfa1a293b7845d7d5aba8" exitCode=0 Jul 24 14:39:59.394735 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:39:59.394219 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6kltw" event={"ID":"ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7","Type":"ContainerDied","Data":"421178e268dab59f1e526be790af0509ab2078b65c8cfa1a293b7845d7d5aba8"} Jul 24 14:40:00.401423 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:00.401334 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-p5prw" event={"ID":"0c40668a-b076-46a4-9784-6d5275fe5ae0","Type":"ContainerStarted","Data":"40c9c0de7d2f9dda1c64f3adcf25047a845ce789500adf062e82a10a70135060"} Jul 24 14:40:00.401423 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:00.401389 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-p5prw" Jul 24 14:40:00.421129 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:00.421085 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-p5prw" podStartSLOduration=0.904595579 podStartE2EDuration="3.421070658s" totalImagesPullingTime="2.516475079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:39:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:40:00.419368919 +0000 UTC m=+340.956624871" watchObservedRunningTime="2026-07-24 14:40:00.421070658 +0000 UTC m=+340.958326610" Jul 24 14:40:02.414866 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:02.414824 2581 generic.go:356] "Generic (PLEG): container finished" podID="ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7" containerID="112734804b80cf08cad52c73a574e866b4b8a9e453d37b6faa546e9517f115f0" exitCode=0 Jul 24 14:40:02.415244 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:02.414912 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6kltw" event={"ID":"ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7","Type":"ContainerDied","Data":"112734804b80cf08cad52c73a574e866b4b8a9e453d37b6faa546e9517f115f0"} Jul 24 14:40:03.421587 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:03.421553 2581 generic.go:356] "Generic (PLEG): container finished" podID="ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7" containerID="e15f028d12f05aae6d37acd4587936308e746204f0fa26ec9741e26b32132be0" exitCode=0 Jul 24 14:40:03.421949 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:03.421592 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6kltw" event={"ID":"ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7","Type":"ContainerDied","Data":"e15f028d12f05aae6d37acd4587936308e746204f0fa26ec9741e26b32132be0"} Jul 24 14:40:04.551201 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:04.551142 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6kltw" Jul 24 14:40:04.672450 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:04.672424 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7-util\") pod \"ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7\" (UID: \"ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7\") " Jul 24 14:40:04.672614 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:04.672498 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkpll\" (UniqueName: \"kubernetes.io/projected/ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7-kube-api-access-qkpll\") pod \"ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7\" (UID: \"ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7\") " Jul 24 14:40:04.672614 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:04.672528 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7-bundle\") pod \"ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7\" (UID: \"ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7\") " Jul 24 14:40:04.672897 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:04.672867 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7-bundle" (OuterVolumeSpecName: "bundle") pod "ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7" (UID: "ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:40:04.674542 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:04.674515 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7-kube-api-access-qkpll" (OuterVolumeSpecName: "kube-api-access-qkpll") pod "ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7" (UID: "ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7"). InnerVolumeSpecName "kube-api-access-qkpll". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:40:04.676852 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:04.676803 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7-util" (OuterVolumeSpecName: "util") pod "ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7" (UID: "ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:40:04.773559 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:04.773536 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7-bundle\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:40:04.773559 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:04.773556 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7-util\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:40:04.773705 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:04.773565 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkpll\" (UniqueName: \"kubernetes.io/projected/ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7-kube-api-access-qkpll\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:40:05.432034 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:05.432009 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6kltw" Jul 24 14:40:05.432201 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:05.432000 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6kltw" event={"ID":"ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7","Type":"ContainerDied","Data":"69da31a86c7d84ea6607fc61c9511c05f8ac87b81d22b7488d7ae8f9ce2136ec"} Jul 24 14:40:05.432201 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:05.432127 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="69da31a86c7d84ea6607fc61c9511c05f8ac87b81d22b7488d7ae8f9ce2136ec" Jul 24 14:40:06.409934 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:06.409905 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-p5prw" Jul 24 14:40:10.159211 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:10.159181 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-c5dp2"] Jul 24 14:40:10.159602 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:10.159471 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7" containerName="extract" Jul 24 14:40:10.159602 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:10.159482 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7" containerName="extract" Jul 24 14:40:10.159602 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:10.159495 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7" containerName="pull" Jul 24 14:40:10.159602 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:10.159501 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7" containerName="pull" Jul 24 14:40:10.159602 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:10.159513 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7" containerName="util" Jul 24 14:40:10.159602 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:10.159518 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7" containerName="util" Jul 24 14:40:10.159602 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:10.159571 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef2cbd55-5f24-4d1b-b76f-0915bcfc57b7" containerName="extract" Jul 24 14:40:10.163242 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:10.163226 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-c5dp2" Jul 24 14:40:10.165827 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:10.165811 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-fht8q\"" Jul 24 14:40:10.172549 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:10.172525 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-c5dp2"] Jul 24 14:40:10.315234 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:10.315204 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzbbx\" (UniqueName: \"kubernetes.io/projected/2c944a05-9f4a-4225-b890-6c92f5f87b76-kube-api-access-bzbbx\") pod \"cert-manager-55b4d954d5-c5dp2\" (UID: \"2c944a05-9f4a-4225-b890-6c92f5f87b76\") " pod="cert-manager/cert-manager-55b4d954d5-c5dp2" Jul 24 14:40:10.315402 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:10.315272 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c944a05-9f4a-4225-b890-6c92f5f87b76-bound-sa-token\") pod \"cert-manager-55b4d954d5-c5dp2\" (UID: \"2c944a05-9f4a-4225-b890-6c92f5f87b76\") " pod="cert-manager/cert-manager-55b4d954d5-c5dp2" Jul 24 14:40:10.416631 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:10.416560 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzbbx\" (UniqueName: \"kubernetes.io/projected/2c944a05-9f4a-4225-b890-6c92f5f87b76-kube-api-access-bzbbx\") pod \"cert-manager-55b4d954d5-c5dp2\" (UID: \"2c944a05-9f4a-4225-b890-6c92f5f87b76\") " pod="cert-manager/cert-manager-55b4d954d5-c5dp2" Jul 24 14:40:10.416631 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:10.416616 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c944a05-9f4a-4225-b890-6c92f5f87b76-bound-sa-token\") pod \"cert-manager-55b4d954d5-c5dp2\" (UID: \"2c944a05-9f4a-4225-b890-6c92f5f87b76\") " pod="cert-manager/cert-manager-55b4d954d5-c5dp2" Jul 24 14:40:10.425523 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:10.425499 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c944a05-9f4a-4225-b890-6c92f5f87b76-bound-sa-token\") pod \"cert-manager-55b4d954d5-c5dp2\" (UID: \"2c944a05-9f4a-4225-b890-6c92f5f87b76\") " pod="cert-manager/cert-manager-55b4d954d5-c5dp2" Jul 24 14:40:10.425689 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:10.425670 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzbbx\" (UniqueName: \"kubernetes.io/projected/2c944a05-9f4a-4225-b890-6c92f5f87b76-kube-api-access-bzbbx\") pod \"cert-manager-55b4d954d5-c5dp2\" (UID: \"2c944a05-9f4a-4225-b890-6c92f5f87b76\") " pod="cert-manager/cert-manager-55b4d954d5-c5dp2" Jul 24 14:40:10.472536 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:10.472514 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-c5dp2" Jul 24 14:40:10.595105 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:10.595084 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-c5dp2"] Jul 24 14:40:10.597191 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:40:10.597165 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c944a05_9f4a_4225_b890_6c92f5f87b76.slice/crio-fe1ed258f86ff5ed0119ac14f16b2738b904830f5a46331ac4411c61072f74d7 WatchSource:0}: Error finding container fe1ed258f86ff5ed0119ac14f16b2738b904830f5a46331ac4411c61072f74d7: Status 404 returned error can't find the container with id fe1ed258f86ff5ed0119ac14f16b2738b904830f5a46331ac4411c61072f74d7 Jul 24 14:40:11.458338 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:11.458258 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-c5dp2" event={"ID":"2c944a05-9f4a-4225-b890-6c92f5f87b76","Type":"ContainerStarted","Data":"3f6d5ea62c59cf613142b00ddfa06aeb792edaf910457dc019361ed58d58ebbd"} Jul 24 14:40:11.458338 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:11.458308 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-c5dp2" event={"ID":"2c944a05-9f4a-4225-b890-6c92f5f87b76","Type":"ContainerStarted","Data":"fe1ed258f86ff5ed0119ac14f16b2738b904830f5a46331ac4411c61072f74d7"} Jul 24 14:40:11.477090 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:11.477043 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-c5dp2" podStartSLOduration=1.477028079 podStartE2EDuration="1.477028079s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:40:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:40:11.475452019 +0000 UTC m=+352.012707972" watchObservedRunningTime="2026-07-24 14:40:11.477028079 +0000 UTC m=+352.014284031" Jul 24 14:40:16.202568 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:16.202537 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcdbsf"] Jul 24 14:40:16.206072 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:16.206056 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcdbsf" Jul 24 14:40:16.208953 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:16.208934 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 24 14:40:16.210078 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:16.210061 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-j9ztw\"" Jul 24 14:40:16.210168 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:16.210061 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 24 14:40:16.214542 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:16.214520 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcdbsf"] Jul 24 14:40:16.362033 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:16.361992 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92e34db3-5c4a-4a73-91b3-055cc0663309-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcdbsf\" (UID: \"92e34db3-5c4a-4a73-91b3-055cc0663309\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcdbsf" Jul 24 14:40:16.362217 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:16.362197 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqllx\" (UniqueName: \"kubernetes.io/projected/92e34db3-5c4a-4a73-91b3-055cc0663309-kube-api-access-hqllx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcdbsf\" (UID: \"92e34db3-5c4a-4a73-91b3-055cc0663309\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcdbsf" Jul 24 14:40:16.362298 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:16.362283 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92e34db3-5c4a-4a73-91b3-055cc0663309-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcdbsf\" (UID: \"92e34db3-5c4a-4a73-91b3-055cc0663309\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcdbsf" Jul 24 14:40:16.462915 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:16.462850 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92e34db3-5c4a-4a73-91b3-055cc0663309-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcdbsf\" (UID: \"92e34db3-5c4a-4a73-91b3-055cc0663309\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcdbsf" Jul 24 14:40:16.462915 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:16.462891 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqllx\" (UniqueName: \"kubernetes.io/projected/92e34db3-5c4a-4a73-91b3-055cc0663309-kube-api-access-hqllx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcdbsf\" (UID: \"92e34db3-5c4a-4a73-91b3-055cc0663309\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcdbsf" Jul 24 14:40:16.463074 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:16.462930 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92e34db3-5c4a-4a73-91b3-055cc0663309-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcdbsf\" (UID: \"92e34db3-5c4a-4a73-91b3-055cc0663309\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcdbsf" Jul 24 14:40:16.463215 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:16.463199 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92e34db3-5c4a-4a73-91b3-055cc0663309-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcdbsf\" (UID: \"92e34db3-5c4a-4a73-91b3-055cc0663309\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcdbsf" Jul 24 14:40:16.463260 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:16.463232 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92e34db3-5c4a-4a73-91b3-055cc0663309-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcdbsf\" (UID: \"92e34db3-5c4a-4a73-91b3-055cc0663309\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcdbsf" Jul 24 14:40:16.471651 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:16.471622 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqllx\" (UniqueName: \"kubernetes.io/projected/92e34db3-5c4a-4a73-91b3-055cc0663309-kube-api-access-hqllx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcdbsf\" (UID: \"92e34db3-5c4a-4a73-91b3-055cc0663309\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcdbsf" Jul 24 14:40:16.515575 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:16.515527 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcdbsf" Jul 24 14:40:16.642722 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:16.642697 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcdbsf"] Jul 24 14:40:16.644663 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:40:16.644636 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92e34db3_5c4a_4a73_91b3_055cc0663309.slice/crio-0a12f6d0949e220e69f1368277458567fec285d08ec65dba52a7012ee3a2faaf WatchSource:0}: Error finding container 0a12f6d0949e220e69f1368277458567fec285d08ec65dba52a7012ee3a2faaf: Status 404 returned error can't find the container with id 0a12f6d0949e220e69f1368277458567fec285d08ec65dba52a7012ee3a2faaf Jul 24 14:40:17.486994 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:17.486967 2581 generic.go:356] "Generic (PLEG): container finished" podID="92e34db3-5c4a-4a73-91b3-055cc0663309" containerID="960e1a0fa67e448cbe1267247ca175d862ecd5685b913ad3951034614a7ef580" exitCode=0 Jul 24 14:40:17.487322 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:17.487002 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcdbsf" event={"ID":"92e34db3-5c4a-4a73-91b3-055cc0663309","Type":"ContainerDied","Data":"960e1a0fa67e448cbe1267247ca175d862ecd5685b913ad3951034614a7ef580"} Jul 24 14:40:17.487322 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:17.487035 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcdbsf" event={"ID":"92e34db3-5c4a-4a73-91b3-055cc0663309","Type":"ContainerStarted","Data":"0a12f6d0949e220e69f1368277458567fec285d08ec65dba52a7012ee3a2faaf"} Jul 24 14:40:18.492301 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:18.492213 2581 generic.go:356] "Generic (PLEG): container finished" podID="92e34db3-5c4a-4a73-91b3-055cc0663309" containerID="8196c67b69a18d8e754989e53a937f08238afffd199046a86cc213739c780beb" exitCode=0 Jul 24 14:40:18.492301 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:18.492265 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcdbsf" event={"ID":"92e34db3-5c4a-4a73-91b3-055cc0663309","Type":"ContainerDied","Data":"8196c67b69a18d8e754989e53a937f08238afffd199046a86cc213739c780beb"} Jul 24 14:40:19.499337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:19.499300 2581 generic.go:356] "Generic (PLEG): container finished" podID="92e34db3-5c4a-4a73-91b3-055cc0663309" containerID="e57d94a2e3360f7819ba7f4d0b4e81516427803a7eea441d92a6916a211a7011" exitCode=0 Jul 24 14:40:19.499688 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:19.499373 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcdbsf" event={"ID":"92e34db3-5c4a-4a73-91b3-055cc0663309","Type":"ContainerDied","Data":"e57d94a2e3360f7819ba7f4d0b4e81516427803a7eea441d92a6916a211a7011"} Jul 24 14:40:20.648901 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:20.648877 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcdbsf" Jul 24 14:40:20.796400 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:20.796373 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqllx\" (UniqueName: \"kubernetes.io/projected/92e34db3-5c4a-4a73-91b3-055cc0663309-kube-api-access-hqllx\") pod \"92e34db3-5c4a-4a73-91b3-055cc0663309\" (UID: \"92e34db3-5c4a-4a73-91b3-055cc0663309\") " Jul 24 14:40:20.796547 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:20.796405 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92e34db3-5c4a-4a73-91b3-055cc0663309-bundle\") pod \"92e34db3-5c4a-4a73-91b3-055cc0663309\" (UID: \"92e34db3-5c4a-4a73-91b3-055cc0663309\") " Jul 24 14:40:20.796547 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:20.796445 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92e34db3-5c4a-4a73-91b3-055cc0663309-util\") pod \"92e34db3-5c4a-4a73-91b3-055cc0663309\" (UID: \"92e34db3-5c4a-4a73-91b3-055cc0663309\") " Jul 24 14:40:20.797055 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:20.797032 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92e34db3-5c4a-4a73-91b3-055cc0663309-bundle" (OuterVolumeSpecName: "bundle") pod "92e34db3-5c4a-4a73-91b3-055cc0663309" (UID: "92e34db3-5c4a-4a73-91b3-055cc0663309"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:40:20.798375 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:20.798350 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92e34db3-5c4a-4a73-91b3-055cc0663309-kube-api-access-hqllx" (OuterVolumeSpecName: "kube-api-access-hqllx") pod "92e34db3-5c4a-4a73-91b3-055cc0663309" (UID: "92e34db3-5c4a-4a73-91b3-055cc0663309"). InnerVolumeSpecName "kube-api-access-hqllx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:40:20.802089 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:20.802065 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92e34db3-5c4a-4a73-91b3-055cc0663309-util" (OuterVolumeSpecName: "util") pod "92e34db3-5c4a-4a73-91b3-055cc0663309" (UID: "92e34db3-5c4a-4a73-91b3-055cc0663309"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:40:20.897447 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:20.897422 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqllx\" (UniqueName: \"kubernetes.io/projected/92e34db3-5c4a-4a73-91b3-055cc0663309-kube-api-access-hqllx\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:40:20.897447 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:20.897444 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/92e34db3-5c4a-4a73-91b3-055cc0663309-bundle\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:40:20.897447 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:20.897453 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/92e34db3-5c4a-4a73-91b3-055cc0663309-util\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:40:21.510092 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:21.510059 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcdbsf" event={"ID":"92e34db3-5c4a-4a73-91b3-055cc0663309","Type":"ContainerDied","Data":"0a12f6d0949e220e69f1368277458567fec285d08ec65dba52a7012ee3a2faaf"} Jul 24 14:40:21.510280 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:21.510107 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a12f6d0949e220e69f1368277458567fec285d08ec65dba52a7012ee3a2faaf" Jul 24 14:40:21.510280 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:21.510072 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcdbsf" Jul 24 14:40:30.836769 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:30.836728 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-f8c8cf8c7-r6t8r"] Jul 24 14:40:30.837181 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:30.837145 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92e34db3-5c4a-4a73-91b3-055cc0663309" containerName="extract" Jul 24 14:40:30.837181 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:30.837177 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="92e34db3-5c4a-4a73-91b3-055cc0663309" containerName="extract" Jul 24 14:40:30.837261 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:30.837206 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92e34db3-5c4a-4a73-91b3-055cc0663309" containerName="util" Jul 24 14:40:30.837261 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:30.837215 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="92e34db3-5c4a-4a73-91b3-055cc0663309" containerName="util" Jul 24 14:40:30.837261 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:30.837239 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92e34db3-5c4a-4a73-91b3-055cc0663309" containerName="pull" Jul 24 14:40:30.837261 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:30.837249 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="92e34db3-5c4a-4a73-91b3-055cc0663309" containerName="pull" Jul 24 14:40:30.837391 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:30.837334 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="92e34db3-5c4a-4a73-91b3-055cc0663309" containerName="extract" Jul 24 14:40:30.845612 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:30.845587 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-r6t8r" Jul 24 14:40:30.849565 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:30.849542 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 24 14:40:30.850918 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:30.850752 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 24 14:40:30.850918 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:30.850776 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 24 14:40:30.850918 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:30.850812 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 24 14:40:30.850918 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:30.850752 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-c4kkn\"" Jul 24 14:40:30.850918 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:30.850900 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 24 14:40:30.861203 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:30.861187 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f8c8cf8c7-r6t8r"] Jul 24 14:40:30.878745 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:30.878724 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e4ebfb1c-4442-4d16-a8ae-697c94808a86-metrics-cert\") pod \"lws-controller-manager-f8c8cf8c7-r6t8r\" (UID: \"e4ebfb1c-4442-4d16-a8ae-697c94808a86\") " pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-r6t8r" Jul 24 14:40:30.878851 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:30.878761 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4ebfb1c-4442-4d16-a8ae-697c94808a86-cert\") pod \"lws-controller-manager-f8c8cf8c7-r6t8r\" (UID: \"e4ebfb1c-4442-4d16-a8ae-697c94808a86\") " pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-r6t8r" Jul 24 14:40:30.878851 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:30.878791 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e4ebfb1c-4442-4d16-a8ae-697c94808a86-manager-config\") pod \"lws-controller-manager-f8c8cf8c7-r6t8r\" (UID: \"e4ebfb1c-4442-4d16-a8ae-697c94808a86\") " pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-r6t8r" Jul 24 14:40:30.878851 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:30.878836 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqrfd\" (UniqueName: \"kubernetes.io/projected/e4ebfb1c-4442-4d16-a8ae-697c94808a86-kube-api-access-hqrfd\") pod \"lws-controller-manager-f8c8cf8c7-r6t8r\" (UID: \"e4ebfb1c-4442-4d16-a8ae-697c94808a86\") " pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-r6t8r" Jul 24 14:40:30.979271 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:30.979247 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4ebfb1c-4442-4d16-a8ae-697c94808a86-cert\") pod \"lws-controller-manager-f8c8cf8c7-r6t8r\" (UID: \"e4ebfb1c-4442-4d16-a8ae-697c94808a86\") " pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-r6t8r" Jul 24 14:40:30.979392 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:30.979290 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e4ebfb1c-4442-4d16-a8ae-697c94808a86-manager-config\") pod \"lws-controller-manager-f8c8cf8c7-r6t8r\" (UID: \"e4ebfb1c-4442-4d16-a8ae-697c94808a86\") " pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-r6t8r" Jul 24 14:40:30.979439 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:30.979409 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqrfd\" (UniqueName: \"kubernetes.io/projected/e4ebfb1c-4442-4d16-a8ae-697c94808a86-kube-api-access-hqrfd\") pod \"lws-controller-manager-f8c8cf8c7-r6t8r\" (UID: \"e4ebfb1c-4442-4d16-a8ae-697c94808a86\") " pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-r6t8r" Jul 24 14:40:30.979485 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:30.979470 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e4ebfb1c-4442-4d16-a8ae-697c94808a86-metrics-cert\") pod \"lws-controller-manager-f8c8cf8c7-r6t8r\" (UID: \"e4ebfb1c-4442-4d16-a8ae-697c94808a86\") " pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-r6t8r" Jul 24 14:40:30.979887 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:30.979870 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e4ebfb1c-4442-4d16-a8ae-697c94808a86-manager-config\") pod \"lws-controller-manager-f8c8cf8c7-r6t8r\" (UID: \"e4ebfb1c-4442-4d16-a8ae-697c94808a86\") " pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-r6t8r" Jul 24 14:40:30.981703 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:30.981684 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e4ebfb1c-4442-4d16-a8ae-697c94808a86-metrics-cert\") pod \"lws-controller-manager-f8c8cf8c7-r6t8r\" (UID: \"e4ebfb1c-4442-4d16-a8ae-697c94808a86\") " pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-r6t8r" Jul 24 14:40:30.981794 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:30.981732 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4ebfb1c-4442-4d16-a8ae-697c94808a86-cert\") pod \"lws-controller-manager-f8c8cf8c7-r6t8r\" (UID: \"e4ebfb1c-4442-4d16-a8ae-697c94808a86\") " pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-r6t8r" Jul 24 14:40:30.988730 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:30.988708 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqrfd\" (UniqueName: \"kubernetes.io/projected/e4ebfb1c-4442-4d16-a8ae-697c94808a86-kube-api-access-hqrfd\") pod \"lws-controller-manager-f8c8cf8c7-r6t8r\" (UID: \"e4ebfb1c-4442-4d16-a8ae-697c94808a86\") " pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-r6t8r" Jul 24 14:40:31.154328 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:31.154271 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-r6t8r" Jul 24 14:40:31.288174 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:31.285730 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f8c8cf8c7-r6t8r"] Jul 24 14:40:31.556218 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:31.556185 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-r6t8r" event={"ID":"e4ebfb1c-4442-4d16-a8ae-697c94808a86","Type":"ContainerStarted","Data":"8e18a725913fd01ba28a1b31594901dbe3ef714e797bb11857433db2ba9aff79"} Jul 24 14:40:33.490018 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:33.489985 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-696d5956bc-lzfmt"] Jul 24 14:40:33.521190 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:33.521139 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-696d5956bc-lzfmt"] Jul 24 14:40:33.521361 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:33.521295 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-lzfmt" Jul 24 14:40:33.524532 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:33.524508 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 24 14:40:33.524746 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:33.524510 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 24 14:40:33.524840 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:33.524546 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 24 14:40:33.524932 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:33.524665 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zx88k\"" Jul 24 14:40:33.525322 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:33.525113 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 24 14:40:33.567524 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:33.567499 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-r6t8r" event={"ID":"e4ebfb1c-4442-4d16-a8ae-697c94808a86","Type":"ContainerStarted","Data":"df213bb2e6600fd2c5959ad223fd230ead877cae31fea45cbdd37cbd3061a6ba"} Jul 24 14:40:33.567633 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:33.567619 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-r6t8r" Jul 24 14:40:33.589782 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:33.589729 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-r6t8r" podStartSLOduration=1.853268923 podStartE2EDuration="3.58971606s" totalImagesPullingTime="1.736447137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:40:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:40:33.58840997 +0000 UTC m=+374.125665923" watchObservedRunningTime="2026-07-24 14:40:33.58971606 +0000 UTC m=+374.126972011" Jul 24 14:40:33.601123 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:33.601094 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/25b1a60c-85f3-4c74-b7ee-e3923e616719-apiservice-cert\") pod \"opendatahub-operator-controller-manager-696d5956bc-lzfmt\" (UID: \"25b1a60c-85f3-4c74-b7ee-e3923e616719\") " pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-lzfmt" Jul 24 14:40:33.601260 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:33.601127 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/25b1a60c-85f3-4c74-b7ee-e3923e616719-webhook-cert\") pod \"opendatahub-operator-controller-manager-696d5956bc-lzfmt\" (UID: \"25b1a60c-85f3-4c74-b7ee-e3923e616719\") " pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-lzfmt" Jul 24 14:40:33.601260 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:33.601249 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qffp2\" (UniqueName: \"kubernetes.io/projected/25b1a60c-85f3-4c74-b7ee-e3923e616719-kube-api-access-qffp2\") pod \"opendatahub-operator-controller-manager-696d5956bc-lzfmt\" (UID: \"25b1a60c-85f3-4c74-b7ee-e3923e616719\") " pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-lzfmt" Jul 24 14:40:33.601386 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:33.601361 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25b1a60c-85f3-4c74-b7ee-e3923e616719-tmp\") pod \"opendatahub-operator-controller-manager-696d5956bc-lzfmt\" (UID: \"25b1a60c-85f3-4c74-b7ee-e3923e616719\") " pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-lzfmt" Jul 24 14:40:33.601450 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:33.601407 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/25b1a60c-85f3-4c74-b7ee-e3923e616719-manifests\") pod \"opendatahub-operator-controller-manager-696d5956bc-lzfmt\" (UID: \"25b1a60c-85f3-4c74-b7ee-e3923e616719\") " pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-lzfmt" Jul 24 14:40:33.702049 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:33.702016 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/25b1a60c-85f3-4c74-b7ee-e3923e616719-manifests\") pod \"opendatahub-operator-controller-manager-696d5956bc-lzfmt\" (UID: \"25b1a60c-85f3-4c74-b7ee-e3923e616719\") " pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-lzfmt" Jul 24 14:40:33.702229 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:33.702072 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/25b1a60c-85f3-4c74-b7ee-e3923e616719-apiservice-cert\") pod \"opendatahub-operator-controller-manager-696d5956bc-lzfmt\" (UID: \"25b1a60c-85f3-4c74-b7ee-e3923e616719\") " pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-lzfmt" Jul 24 14:40:33.702229 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:33.702206 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/25b1a60c-85f3-4c74-b7ee-e3923e616719-webhook-cert\") pod \"opendatahub-operator-controller-manager-696d5956bc-lzfmt\" (UID: \"25b1a60c-85f3-4c74-b7ee-e3923e616719\") " pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-lzfmt" Jul 24 14:40:33.702358 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:33.702286 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qffp2\" (UniqueName: \"kubernetes.io/projected/25b1a60c-85f3-4c74-b7ee-e3923e616719-kube-api-access-qffp2\") pod \"opendatahub-operator-controller-manager-696d5956bc-lzfmt\" (UID: \"25b1a60c-85f3-4c74-b7ee-e3923e616719\") " pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-lzfmt" Jul 24 14:40:33.702414 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:33.702378 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25b1a60c-85f3-4c74-b7ee-e3923e616719-tmp\") pod \"opendatahub-operator-controller-manager-696d5956bc-lzfmt\" (UID: \"25b1a60c-85f3-4c74-b7ee-e3923e616719\") " pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-lzfmt" Jul 24 14:40:33.702499 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:33.702471 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/25b1a60c-85f3-4c74-b7ee-e3923e616719-manifests\") pod \"opendatahub-operator-controller-manager-696d5956bc-lzfmt\" (UID: \"25b1a60c-85f3-4c74-b7ee-e3923e616719\") " pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-lzfmt" Jul 24 14:40:33.704383 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:33.704359 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25b1a60c-85f3-4c74-b7ee-e3923e616719-tmp\") pod \"opendatahub-operator-controller-manager-696d5956bc-lzfmt\" (UID: \"25b1a60c-85f3-4c74-b7ee-e3923e616719\") " pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-lzfmt" Jul 24 14:40:33.704632 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:33.704617 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/25b1a60c-85f3-4c74-b7ee-e3923e616719-apiservice-cert\") pod \"opendatahub-operator-controller-manager-696d5956bc-lzfmt\" (UID: \"25b1a60c-85f3-4c74-b7ee-e3923e616719\") " pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-lzfmt" Jul 24 14:40:33.704632 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:33.704624 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/25b1a60c-85f3-4c74-b7ee-e3923e616719-webhook-cert\") pod \"opendatahub-operator-controller-manager-696d5956bc-lzfmt\" (UID: \"25b1a60c-85f3-4c74-b7ee-e3923e616719\") " pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-lzfmt" Jul 24 14:40:33.718673 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:33.718649 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qffp2\" (UniqueName: \"kubernetes.io/projected/25b1a60c-85f3-4c74-b7ee-e3923e616719-kube-api-access-qffp2\") pod \"opendatahub-operator-controller-manager-696d5956bc-lzfmt\" (UID: \"25b1a60c-85f3-4c74-b7ee-e3923e616719\") " pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-lzfmt" Jul 24 14:40:33.834654 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:33.834632 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-lzfmt" Jul 24 14:40:33.972107 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:33.972086 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-696d5956bc-lzfmt"] Jul 24 14:40:33.974135 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:40:33.974106 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25b1a60c_85f3_4c74_b7ee_e3923e616719.slice/crio-f19e74f482b283e1948d2d158dab673bd5bea00184b8e951dd0467e0a2e10fd0 WatchSource:0}: Error finding container f19e74f482b283e1948d2d158dab673bd5bea00184b8e951dd0467e0a2e10fd0: Status 404 returned error can't find the container with id f19e74f482b283e1948d2d158dab673bd5bea00184b8e951dd0467e0a2e10fd0 Jul 24 14:40:34.575374 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:34.575332 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-lzfmt" event={"ID":"25b1a60c-85f3-4c74-b7ee-e3923e616719","Type":"ContainerStarted","Data":"f19e74f482b283e1948d2d158dab673bd5bea00184b8e951dd0467e0a2e10fd0"} Jul 24 14:40:37.592985 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:37.592946 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-lzfmt" event={"ID":"25b1a60c-85f3-4c74-b7ee-e3923e616719","Type":"ContainerStarted","Data":"284a97a4c0c3db9764f2bb30946849cd28c1588e3759a44c1efd8b125c2b9819"} Jul 24 14:40:38.599034 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:38.598998 2581 generic.go:356] "Generic (PLEG): container finished" podID="25b1a60c-85f3-4c74-b7ee-e3923e616719" containerID="284a97a4c0c3db9764f2bb30946849cd28c1588e3759a44c1efd8b125c2b9819" exitCode=0 Jul 24 14:40:38.599450 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:38.599091 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-lzfmt" event={"ID":"25b1a60c-85f3-4c74-b7ee-e3923e616719","Type":"ContainerDied","Data":"284a97a4c0c3db9764f2bb30946849cd28c1588e3759a44c1efd8b125c2b9819"} Jul 24 14:40:39.605651 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:39.605612 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-lzfmt" event={"ID":"25b1a60c-85f3-4c74-b7ee-e3923e616719","Type":"ContainerStarted","Data":"ff75330cc6a848a5658ecad4f7cdffbdc5353f200a6e38d3d39c544f5b60b08b"} Jul 24 14:40:39.605992 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:39.605694 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-lzfmt" Jul 24 14:40:39.635801 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:39.635755 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-lzfmt" podStartSLOduration=2.4547750329999998 podStartE2EDuration="6.63573918s" totalImagesPullingTime="3.15626169s" totalInitContainerRuntime="1.024702457s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:40:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:40:39.634251673 +0000 UTC m=+380.171507628" watchObservedRunningTime="2026-07-24 14:40:39.63573918 +0000 UTC m=+380.172995132" Jul 24 14:40:44.578126 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:44.578095 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-f8c8cf8c7-r6t8r" Jul 24 14:40:50.612527 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:40:50.612499 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-696d5956bc-lzfmt" Jul 24 14:41:07.115028 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.114997 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv"] Jul 24 14:41:07.195662 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.195638 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv"] Jul 24 14:41:07.195808 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.195727 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" Jul 24 14:41:07.199377 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.199357 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-rs4mn\"" Jul 24 14:41:07.200301 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.200280 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 24 14:41:07.260682 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.260658 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c9ec2f3-2d02-4d7c-842a-653209051c94-istio-data\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv\" (UID: \"3c9ec2f3-2d02-4d7c-842a-653209051c94\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" Jul 24 14:41:07.260772 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.260691 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c9ec2f3-2d02-4d7c-842a-653209051c94-istio-token\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv\" (UID: \"3c9ec2f3-2d02-4d7c-842a-653209051c94\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" Jul 24 14:41:07.260772 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.260728 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c9ec2f3-2d02-4d7c-842a-653209051c94-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv\" (UID: \"3c9ec2f3-2d02-4d7c-842a-653209051c94\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" Jul 24 14:41:07.260846 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.260780 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c9ec2f3-2d02-4d7c-842a-653209051c94-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv\" (UID: \"3c9ec2f3-2d02-4d7c-842a-653209051c94\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" Jul 24 14:41:07.260846 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.260830 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c9ec2f3-2d02-4d7c-842a-653209051c94-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv\" (UID: \"3c9ec2f3-2d02-4d7c-842a-653209051c94\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" Jul 24 14:41:07.260908 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.260846 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c9ec2f3-2d02-4d7c-842a-653209051c94-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv\" (UID: \"3c9ec2f3-2d02-4d7c-842a-653209051c94\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" Jul 24 14:41:07.260908 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.260865 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c9ec2f3-2d02-4d7c-842a-653209051c94-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv\" (UID: \"3c9ec2f3-2d02-4d7c-842a-653209051c94\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" Jul 24 14:41:07.260908 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.260881 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c9ec2f3-2d02-4d7c-842a-653209051c94-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv\" (UID: \"3c9ec2f3-2d02-4d7c-842a-653209051c94\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" Jul 24 14:41:07.261009 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.260911 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtlsh\" (UniqueName: \"kubernetes.io/projected/3c9ec2f3-2d02-4d7c-842a-653209051c94-kube-api-access-mtlsh\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv\" (UID: \"3c9ec2f3-2d02-4d7c-842a-653209051c94\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" Jul 24 14:41:07.361651 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.361632 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c9ec2f3-2d02-4d7c-842a-653209051c94-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv\" (UID: \"3c9ec2f3-2d02-4d7c-842a-653209051c94\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" Jul 24 14:41:07.361765 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.361658 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c9ec2f3-2d02-4d7c-842a-653209051c94-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv\" (UID: \"3c9ec2f3-2d02-4d7c-842a-653209051c94\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" Jul 24 14:41:07.361765 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.361684 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c9ec2f3-2d02-4d7c-842a-653209051c94-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv\" (UID: \"3c9ec2f3-2d02-4d7c-842a-653209051c94\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" Jul 24 14:41:07.361765 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.361700 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c9ec2f3-2d02-4d7c-842a-653209051c94-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv\" (UID: \"3c9ec2f3-2d02-4d7c-842a-653209051c94\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" Jul 24 14:41:07.361765 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.361717 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c9ec2f3-2d02-4d7c-842a-653209051c94-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv\" (UID: \"3c9ec2f3-2d02-4d7c-842a-653209051c94\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" Jul 24 14:41:07.361976 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.361765 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c9ec2f3-2d02-4d7c-842a-653209051c94-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv\" (UID: \"3c9ec2f3-2d02-4d7c-842a-653209051c94\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" Jul 24 14:41:07.361976 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.361827 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtlsh\" (UniqueName: \"kubernetes.io/projected/3c9ec2f3-2d02-4d7c-842a-653209051c94-kube-api-access-mtlsh\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv\" (UID: \"3c9ec2f3-2d02-4d7c-842a-653209051c94\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" Jul 24 14:41:07.361976 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.361880 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c9ec2f3-2d02-4d7c-842a-653209051c94-istio-data\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv\" (UID: \"3c9ec2f3-2d02-4d7c-842a-653209051c94\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" Jul 24 14:41:07.361976 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.361919 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c9ec2f3-2d02-4d7c-842a-653209051c94-istio-token\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv\" (UID: \"3c9ec2f3-2d02-4d7c-842a-653209051c94\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" Jul 24 14:41:07.362199 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.362081 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c9ec2f3-2d02-4d7c-842a-653209051c94-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv\" (UID: \"3c9ec2f3-2d02-4d7c-842a-653209051c94\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" Jul 24 14:41:07.362199 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.362097 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c9ec2f3-2d02-4d7c-842a-653209051c94-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv\" (UID: \"3c9ec2f3-2d02-4d7c-842a-653209051c94\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" Jul 24 14:41:07.362199 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.362191 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c9ec2f3-2d02-4d7c-842a-653209051c94-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv\" (UID: \"3c9ec2f3-2d02-4d7c-842a-653209051c94\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" Jul 24 14:41:07.362421 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.362404 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c9ec2f3-2d02-4d7c-842a-653209051c94-istio-data\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv\" (UID: \"3c9ec2f3-2d02-4d7c-842a-653209051c94\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" Jul 24 14:41:07.362525 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.362508 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c9ec2f3-2d02-4d7c-842a-653209051c94-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv\" (UID: \"3c9ec2f3-2d02-4d7c-842a-653209051c94\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" Jul 24 14:41:07.364072 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.364055 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c9ec2f3-2d02-4d7c-842a-653209051c94-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv\" (UID: \"3c9ec2f3-2d02-4d7c-842a-653209051c94\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" Jul 24 14:41:07.364141 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.364119 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c9ec2f3-2d02-4d7c-842a-653209051c94-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv\" (UID: \"3c9ec2f3-2d02-4d7c-842a-653209051c94\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" Jul 24 14:41:07.380475 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.380427 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c9ec2f3-2d02-4d7c-842a-653209051c94-istio-token\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv\" (UID: \"3c9ec2f3-2d02-4d7c-842a-653209051c94\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" Jul 24 14:41:07.380694 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.380678 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtlsh\" (UniqueName: \"kubernetes.io/projected/3c9ec2f3-2d02-4d7c-842a-653209051c94-kube-api-access-mtlsh\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv\" (UID: \"3c9ec2f3-2d02-4d7c-842a-653209051c94\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" Jul 24 14:41:07.505068 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.505030 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" Jul 24 14:41:07.538616 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.538591 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-75lrr"] Jul 24 14:41:07.540784 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.540768 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-75lrr" Jul 24 14:41:07.543638 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.543616 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 24 14:41:07.543638 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.543616 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 24 14:41:07.543878 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.543866 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 24 14:41:07.543929 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.543908 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-zstr9\"" Jul 24 14:41:07.555839 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.555816 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-75lrr"] Jul 24 14:41:07.653578 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.653556 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv"] Jul 24 14:41:07.655042 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:41:07.655015 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c9ec2f3_2d02_4d7c_842a_653209051c94.slice/crio-6a6d3466c3ba32d07908aee89e12711e54fdf7f5eae825fcc0a9072f78243ff1 WatchSource:0}: Error finding container 6a6d3466c3ba32d07908aee89e12711e54fdf7f5eae825fcc0a9072f78243ff1: Status 404 returned error can't find the container with id 6a6d3466c3ba32d07908aee89e12711e54fdf7f5eae825fcc0a9072f78243ff1 Jul 24 14:41:07.666268 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.666242 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgj8d\" (UniqueName: \"kubernetes.io/projected/aa1799bf-b00d-4024-9b3f-e58330985fc3-kube-api-access-mgj8d\") pod \"istiod-openshift-gateway-5677ccb49b-75lrr\" (UID: \"aa1799bf-b00d-4024-9b3f-e58330985fc3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-75lrr" Jul 24 14:41:07.666348 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.666280 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aa1799bf-b00d-4024-9b3f-e58330985fc3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-75lrr\" (UID: \"aa1799bf-b00d-4024-9b3f-e58330985fc3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-75lrr" Jul 24 14:41:07.666348 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.666301 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa1799bf-b00d-4024-9b3f-e58330985fc3-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-75lrr\" (UID: \"aa1799bf-b00d-4024-9b3f-e58330985fc3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-75lrr" Jul 24 14:41:07.666413 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.666365 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aa1799bf-b00d-4024-9b3f-e58330985fc3-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-75lrr\" (UID: \"aa1799bf-b00d-4024-9b3f-e58330985fc3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-75lrr" Jul 24 14:41:07.666413 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.666400 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aa1799bf-b00d-4024-9b3f-e58330985fc3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-75lrr\" (UID: \"aa1799bf-b00d-4024-9b3f-e58330985fc3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-75lrr" Jul 24 14:41:07.666474 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.666425 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aa1799bf-b00d-4024-9b3f-e58330985fc3-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-75lrr\" (UID: \"aa1799bf-b00d-4024-9b3f-e58330985fc3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-75lrr" Jul 24 14:41:07.666524 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.666507 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa1799bf-b00d-4024-9b3f-e58330985fc3-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-75lrr\" (UID: \"aa1799bf-b00d-4024-9b3f-e58330985fc3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-75lrr" Jul 24 14:41:07.739869 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.739841 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" event={"ID":"3c9ec2f3-2d02-4d7c-842a-653209051c94","Type":"ContainerStarted","Data":"6a6d3466c3ba32d07908aee89e12711e54fdf7f5eae825fcc0a9072f78243ff1"} Jul 24 14:41:07.767402 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.767383 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aa1799bf-b00d-4024-9b3f-e58330985fc3-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-75lrr\" (UID: \"aa1799bf-b00d-4024-9b3f-e58330985fc3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-75lrr" Jul 24 14:41:07.767487 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.767414 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aa1799bf-b00d-4024-9b3f-e58330985fc3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-75lrr\" (UID: \"aa1799bf-b00d-4024-9b3f-e58330985fc3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-75lrr" Jul 24 14:41:07.767487 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.767438 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aa1799bf-b00d-4024-9b3f-e58330985fc3-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-75lrr\" (UID: \"aa1799bf-b00d-4024-9b3f-e58330985fc3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-75lrr" Jul 24 14:41:07.767487 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.767483 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa1799bf-b00d-4024-9b3f-e58330985fc3-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-75lrr\" (UID: \"aa1799bf-b00d-4024-9b3f-e58330985fc3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-75lrr" Jul 24 14:41:07.767601 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.767513 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgj8d\" (UniqueName: \"kubernetes.io/projected/aa1799bf-b00d-4024-9b3f-e58330985fc3-kube-api-access-mgj8d\") pod \"istiod-openshift-gateway-5677ccb49b-75lrr\" (UID: \"aa1799bf-b00d-4024-9b3f-e58330985fc3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-75lrr" Jul 24 14:41:07.767601 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.767545 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aa1799bf-b00d-4024-9b3f-e58330985fc3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-75lrr\" (UID: \"aa1799bf-b00d-4024-9b3f-e58330985fc3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-75lrr" Jul 24 14:41:07.767601 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.767576 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa1799bf-b00d-4024-9b3f-e58330985fc3-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-75lrr\" (UID: \"aa1799bf-b00d-4024-9b3f-e58330985fc3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-75lrr" Jul 24 14:41:07.768404 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.768375 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aa1799bf-b00d-4024-9b3f-e58330985fc3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-75lrr\" (UID: \"aa1799bf-b00d-4024-9b3f-e58330985fc3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-75lrr" Jul 24 14:41:07.769749 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.769723 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aa1799bf-b00d-4024-9b3f-e58330985fc3-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-75lrr\" (UID: \"aa1799bf-b00d-4024-9b3f-e58330985fc3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-75lrr" Jul 24 14:41:07.769846 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.769766 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa1799bf-b00d-4024-9b3f-e58330985fc3-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-75lrr\" (UID: \"aa1799bf-b00d-4024-9b3f-e58330985fc3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-75lrr" Jul 24 14:41:07.769846 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.769777 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aa1799bf-b00d-4024-9b3f-e58330985fc3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-75lrr\" (UID: \"aa1799bf-b00d-4024-9b3f-e58330985fc3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-75lrr" Jul 24 14:41:07.769966 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.769943 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aa1799bf-b00d-4024-9b3f-e58330985fc3-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-75lrr\" (UID: \"aa1799bf-b00d-4024-9b3f-e58330985fc3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-75lrr" Jul 24 14:41:07.776130 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.776108 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa1799bf-b00d-4024-9b3f-e58330985fc3-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-75lrr\" (UID: \"aa1799bf-b00d-4024-9b3f-e58330985fc3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-75lrr" Jul 24 14:41:07.776816 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.776800 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgj8d\" (UniqueName: \"kubernetes.io/projected/aa1799bf-b00d-4024-9b3f-e58330985fc3-kube-api-access-mgj8d\") pod \"istiod-openshift-gateway-5677ccb49b-75lrr\" (UID: \"aa1799bf-b00d-4024-9b3f-e58330985fc3\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-75lrr" Jul 24 14:41:07.850990 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:07.850973 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-75lrr" Jul 24 14:41:08.013840 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:41:08.013813 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa1799bf_b00d_4024_9b3f_e58330985fc3.slice/crio-537369cdedc36ae7d8f23e7696550beb5855a21a391e1f2d43f76d32239ce3ff WatchSource:0}: Error finding container 537369cdedc36ae7d8f23e7696550beb5855a21a391e1f2d43f76d32239ce3ff: Status 404 returned error can't find the container with id 537369cdedc36ae7d8f23e7696550beb5855a21a391e1f2d43f76d32239ce3ff Jul 24 14:41:08.014751 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:08.014728 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-75lrr"] Jul 24 14:41:08.745907 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:08.745863 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-75lrr" event={"ID":"aa1799bf-b00d-4024-9b3f-e58330985fc3","Type":"ContainerStarted","Data":"537369cdedc36ae7d8f23e7696550beb5855a21a391e1f2d43f76d32239ce3ff"} Jul 24 14:41:10.186959 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:10.186923 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 24 14:41:10.187354 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:10.187005 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 24 14:41:10.187354 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:10.187053 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 24 14:41:10.762510 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:10.762481 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" event={"ID":"3c9ec2f3-2d02-4d7c-842a-653209051c94","Type":"ContainerStarted","Data":"631829ba0319829557747a487c5cfca019d22a8305e648dcc6b02498b01993e5"} Jul 24 14:41:10.789634 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:10.789578 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" podStartSLOduration=1.25982993 podStartE2EDuration="3.78955878s" totalImagesPullingTime="2.52972885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:41:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:41:10.789374629 +0000 UTC m=+411.326630584" watchObservedRunningTime="2026-07-24 14:41:10.78955878 +0000 UTC m=+411.326814734" Jul 24 14:41:11.505515 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:11.505482 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" Jul 24 14:41:11.506823 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:11.506797 2581 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jul 24 14:41:11.506930 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:11.506858 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" podUID="3c9ec2f3-2d02-4d7c-842a-653209051c94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jul 24 14:41:11.914599 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:11.914568 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv"] Jul 24 14:41:12.505530 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:12.505490 2581 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jul 24 14:41:12.506000 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:12.505596 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" podUID="3c9ec2f3-2d02-4d7c-842a-653209051c94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jul 24 14:41:13.505359 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:13.505322 2581 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jul 24 14:41:13.505527 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:13.505385 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" podUID="3c9ec2f3-2d02-4d7c-842a-653209051c94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jul 24 14:41:13.776203 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:13.776177 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" podUID="3c9ec2f3-2d02-4d7c-842a-653209051c94" containerName="istio-proxy" containerID="cri-o://631829ba0319829557747a487c5cfca019d22a8305e648dcc6b02498b01993e5" gracePeriod=30 Jul 24 14:41:15.686330 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:15.686298 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 24 14:41:15.686598 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:15.686364 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 24 14:41:15.788028 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:15.787999 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-75lrr" event={"ID":"aa1799bf-b00d-4024-9b3f-e58330985fc3","Type":"ContainerStarted","Data":"346d407d33a9d3dca04ffa72013b9d31c180f20f6af8d1e1f0ba7c1fe97e5b55"} Jul 24 14:41:15.788174 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:15.788059 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-75lrr" Jul 24 14:41:15.814222 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:15.814177 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-75lrr" podStartSLOduration=1.144342772 podStartE2EDuration="8.814137275s" totalImagesPullingTime="7.669794503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:41:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:41:15.811567501 +0000 UTC m=+416.348823490" watchObservedRunningTime="2026-07-24 14:41:15.814137275 +0000 UTC m=+416.351393227" Jul 24 14:41:16.794234 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:16.794203 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-75lrr" Jul 24 14:41:19.014936 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.014913 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" Jul 24 14:41:19.170779 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.170703 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c9ec2f3-2d02-4d7c-842a-653209051c94-istio-data\") pod \"3c9ec2f3-2d02-4d7c-842a-653209051c94\" (UID: \"3c9ec2f3-2d02-4d7c-842a-653209051c94\") " Jul 24 14:41:19.170779 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.170747 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c9ec2f3-2d02-4d7c-842a-653209051c94-credential-socket\") pod \"3c9ec2f3-2d02-4d7c-842a-653209051c94\" (UID: \"3c9ec2f3-2d02-4d7c-842a-653209051c94\") " Jul 24 14:41:19.170944 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.170780 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtlsh\" (UniqueName: \"kubernetes.io/projected/3c9ec2f3-2d02-4d7c-842a-653209051c94-kube-api-access-mtlsh\") pod \"3c9ec2f3-2d02-4d7c-842a-653209051c94\" (UID: \"3c9ec2f3-2d02-4d7c-842a-653209051c94\") " Jul 24 14:41:19.170944 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.170822 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c9ec2f3-2d02-4d7c-842a-653209051c94-istiod-ca-cert\") pod \"3c9ec2f3-2d02-4d7c-842a-653209051c94\" (UID: \"3c9ec2f3-2d02-4d7c-842a-653209051c94\") " Jul 24 14:41:19.170944 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.170867 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c9ec2f3-2d02-4d7c-842a-653209051c94-workload-certs\") pod \"3c9ec2f3-2d02-4d7c-842a-653209051c94\" (UID: \"3c9ec2f3-2d02-4d7c-842a-653209051c94\") " Jul 24 14:41:19.170944 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.170893 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c9ec2f3-2d02-4d7c-842a-653209051c94-istio-podinfo\") pod \"3c9ec2f3-2d02-4d7c-842a-653209051c94\" (UID: \"3c9ec2f3-2d02-4d7c-842a-653209051c94\") " Jul 24 14:41:19.171132 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.170961 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c9ec2f3-2d02-4d7c-842a-653209051c94-istio-token\") pod \"3c9ec2f3-2d02-4d7c-842a-653209051c94\" (UID: \"3c9ec2f3-2d02-4d7c-842a-653209051c94\") " Jul 24 14:41:19.171132 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.170987 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c9ec2f3-2d02-4d7c-842a-653209051c94-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3c9ec2f3-2d02-4d7c-842a-653209051c94" (UID: "3c9ec2f3-2d02-4d7c-842a-653209051c94"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:41:19.171132 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.170995 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c9ec2f3-2d02-4d7c-842a-653209051c94-istio-envoy\") pod \"3c9ec2f3-2d02-4d7c-842a-653209051c94\" (UID: \"3c9ec2f3-2d02-4d7c-842a-653209051c94\") " Jul 24 14:41:19.171132 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.171023 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c9ec2f3-2d02-4d7c-842a-653209051c94-istio-data" (OuterVolumeSpecName: "istio-data") pod "3c9ec2f3-2d02-4d7c-842a-653209051c94" (UID: "3c9ec2f3-2d02-4d7c-842a-653209051c94"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:41:19.171132 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.171049 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c9ec2f3-2d02-4d7c-842a-653209051c94-workload-socket\") pod \"3c9ec2f3-2d02-4d7c-842a-653209051c94\" (UID: \"3c9ec2f3-2d02-4d7c-842a-653209051c94\") " Jul 24 14:41:19.171132 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.171090 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c9ec2f3-2d02-4d7c-842a-653209051c94-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3c9ec2f3-2d02-4d7c-842a-653209051c94" (UID: "3c9ec2f3-2d02-4d7c-842a-653209051c94"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:41:19.171448 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.171223 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c9ec2f3-2d02-4d7c-842a-653209051c94-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3c9ec2f3-2d02-4d7c-842a-653209051c94" (UID: "3c9ec2f3-2d02-4d7c-842a-653209051c94"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:41:19.171448 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.171355 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c9ec2f3-2d02-4d7c-842a-653209051c94-istio-data\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:41:19.171448 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.171374 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c9ec2f3-2d02-4d7c-842a-653209051c94-credential-socket\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:41:19.171448 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.171387 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c9ec2f3-2d02-4d7c-842a-653209051c94-istiod-ca-cert\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:41:19.171448 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.171401 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c9ec2f3-2d02-4d7c-842a-653209051c94-workload-certs\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:41:19.171448 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.171352 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c9ec2f3-2d02-4d7c-842a-653209051c94-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3c9ec2f3-2d02-4d7c-842a-653209051c94" (UID: "3c9ec2f3-2d02-4d7c-842a-653209051c94"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:41:19.173138 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.173108 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c9ec2f3-2d02-4d7c-842a-653209051c94-istio-token" (OuterVolumeSpecName: "istio-token") pod "3c9ec2f3-2d02-4d7c-842a-653209051c94" (UID: "3c9ec2f3-2d02-4d7c-842a-653209051c94"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:41:19.173248 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.173147 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c9ec2f3-2d02-4d7c-842a-653209051c94-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3c9ec2f3-2d02-4d7c-842a-653209051c94" (UID: "3c9ec2f3-2d02-4d7c-842a-653209051c94"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:41:19.173248 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.173194 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c9ec2f3-2d02-4d7c-842a-653209051c94-kube-api-access-mtlsh" (OuterVolumeSpecName: "kube-api-access-mtlsh") pod "3c9ec2f3-2d02-4d7c-842a-653209051c94" (UID: "3c9ec2f3-2d02-4d7c-842a-653209051c94"). InnerVolumeSpecName "kube-api-access-mtlsh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:41:19.173331 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.173253 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3c9ec2f3-2d02-4d7c-842a-653209051c94-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3c9ec2f3-2d02-4d7c-842a-653209051c94" (UID: "3c9ec2f3-2d02-4d7c-842a-653209051c94"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 14:41:19.272578 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.272551 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c9ec2f3-2d02-4d7c-842a-653209051c94-istio-envoy\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:41:19.272578 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.272576 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c9ec2f3-2d02-4d7c-842a-653209051c94-workload-socket\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:41:19.272578 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.272585 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtlsh\" (UniqueName: \"kubernetes.io/projected/3c9ec2f3-2d02-4d7c-842a-653209051c94-kube-api-access-mtlsh\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:41:19.272782 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.272594 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c9ec2f3-2d02-4d7c-842a-653209051c94-istio-podinfo\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:41:19.272782 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.272603 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c9ec2f3-2d02-4d7c-842a-653209051c94-istio-token\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:41:19.808099 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.808069 2581 generic.go:356] "Generic (PLEG): container finished" podID="3c9ec2f3-2d02-4d7c-842a-653209051c94" containerID="631829ba0319829557747a487c5cfca019d22a8305e648dcc6b02498b01993e5" exitCode=0 Jul 24 14:41:19.808274 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.808111 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" Jul 24 14:41:19.808274 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.808134 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" event={"ID":"3c9ec2f3-2d02-4d7c-842a-653209051c94","Type":"ContainerDied","Data":"631829ba0319829557747a487c5cfca019d22a8305e648dcc6b02498b01993e5"} Jul 24 14:41:19.808274 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.808200 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv" event={"ID":"3c9ec2f3-2d02-4d7c-842a-653209051c94","Type":"ContainerDied","Data":"6a6d3466c3ba32d07908aee89e12711e54fdf7f5eae825fcc0a9072f78243ff1"} Jul 24 14:41:19.808274 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.808225 2581 scope.go:117] "RemoveContainer" containerID="631829ba0319829557747a487c5cfca019d22a8305e648dcc6b02498b01993e5" Jul 24 14:41:19.817189 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.817175 2581 scope.go:117] "RemoveContainer" containerID="631829ba0319829557747a487c5cfca019d22a8305e648dcc6b02498b01993e5" Jul 24 14:41:19.817449 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:41:19.817431 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"631829ba0319829557747a487c5cfca019d22a8305e648dcc6b02498b01993e5\": container with ID starting with 631829ba0319829557747a487c5cfca019d22a8305e648dcc6b02498b01993e5 not found: ID does not exist" containerID="631829ba0319829557747a487c5cfca019d22a8305e648dcc6b02498b01993e5" Jul 24 14:41:19.817493 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.817459 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"631829ba0319829557747a487c5cfca019d22a8305e648dcc6b02498b01993e5"} err="failed to get container status \"631829ba0319829557747a487c5cfca019d22a8305e648dcc6b02498b01993e5\": rpc error: code = NotFound desc = could not find container \"631829ba0319829557747a487c5cfca019d22a8305e648dcc6b02498b01993e5\": container with ID starting with 631829ba0319829557747a487c5cfca019d22a8305e648dcc6b02498b01993e5 not found: ID does not exist" Jul 24 14:41:19.839029 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.839003 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv"] Jul 24 14:41:19.844871 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:19.844854 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-rtlhv"] Jul 24 14:41:20.112409 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:41:20.112351 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c9ec2f3-2d02-4d7c-842a-653209051c94" path="/var/lib/kubelet/pods/3c9ec2f3-2d02-4d7c-842a-653209051c94/volumes" Jul 24 14:42:09.856244 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:09.856205 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735rkwz"] Jul 24 14:42:09.856722 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:09.856584 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c9ec2f3-2d02-4d7c-842a-653209051c94" containerName="istio-proxy" Jul 24 14:42:09.856722 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:09.856595 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c9ec2f3-2d02-4d7c-842a-653209051c94" containerName="istio-proxy" Jul 24 14:42:09.856722 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:09.856676 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c9ec2f3-2d02-4d7c-842a-653209051c94" containerName="istio-proxy" Jul 24 14:42:09.867680 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:09.867658 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735rkwz" Jul 24 14:42:09.870966 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:09.870948 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 24 14:42:09.871046 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:09.870966 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-djr82\"" Jul 24 14:42:09.871916 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:09.871900 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 24 14:42:09.878244 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:09.878217 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735rkwz"] Jul 24 14:42:09.940353 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:09.940329 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cfc0ce19-6c06-4691-b4df-2e4096034d18-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735rkwz\" (UID: \"cfc0ce19-6c06-4691-b4df-2e4096034d18\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735rkwz" Jul 24 14:42:09.940462 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:09.940372 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqvdr\" (UniqueName: \"kubernetes.io/projected/cfc0ce19-6c06-4691-b4df-2e4096034d18-kube-api-access-zqvdr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735rkwz\" (UID: \"cfc0ce19-6c06-4691-b4df-2e4096034d18\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735rkwz" Jul 24 14:42:09.940462 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:09.940398 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cfc0ce19-6c06-4691-b4df-2e4096034d18-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735rkwz\" (UID: \"cfc0ce19-6c06-4691-b4df-2e4096034d18\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735rkwz" Jul 24 14:42:10.041489 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:10.041469 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cfc0ce19-6c06-4691-b4df-2e4096034d18-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735rkwz\" (UID: \"cfc0ce19-6c06-4691-b4df-2e4096034d18\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735rkwz" Jul 24 14:42:10.041606 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:10.041502 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqvdr\" (UniqueName: \"kubernetes.io/projected/cfc0ce19-6c06-4691-b4df-2e4096034d18-kube-api-access-zqvdr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735rkwz\" (UID: \"cfc0ce19-6c06-4691-b4df-2e4096034d18\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735rkwz" Jul 24 14:42:10.041606 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:10.041523 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cfc0ce19-6c06-4691-b4df-2e4096034d18-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735rkwz\" (UID: \"cfc0ce19-6c06-4691-b4df-2e4096034d18\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735rkwz" Jul 24 14:42:10.041922 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:10.041904 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cfc0ce19-6c06-4691-b4df-2e4096034d18-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735rkwz\" (UID: \"cfc0ce19-6c06-4691-b4df-2e4096034d18\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735rkwz" Jul 24 14:42:10.041922 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:10.041922 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cfc0ce19-6c06-4691-b4df-2e4096034d18-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735rkwz\" (UID: \"cfc0ce19-6c06-4691-b4df-2e4096034d18\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735rkwz" Jul 24 14:42:10.050958 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:10.050933 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqvdr\" (UniqueName: \"kubernetes.io/projected/cfc0ce19-6c06-4691-b4df-2e4096034d18-kube-api-access-zqvdr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735rkwz\" (UID: \"cfc0ce19-6c06-4691-b4df-2e4096034d18\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735rkwz" Jul 24 14:42:10.178925 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:10.178873 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735rkwz" Jul 24 14:42:10.309416 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:10.309392 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735rkwz"] Jul 24 14:42:10.312013 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:42:10.311983 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfc0ce19_6c06_4691_b4df_2e4096034d18.slice/crio-bdd1d853ec2b7105ed50bfe72c4c6a7670b6225b052e6faea43dcbd9135cfdfe WatchSource:0}: Error finding container bdd1d853ec2b7105ed50bfe72c4c6a7670b6225b052e6faea43dcbd9135cfdfe: Status 404 returned error can't find the container with id bdd1d853ec2b7105ed50bfe72c4c6a7670b6225b052e6faea43dcbd9135cfdfe Jul 24 14:42:10.480568 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:10.480518 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5hfs"] Jul 24 14:42:10.483757 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:10.483741 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5hfs" Jul 24 14:42:10.498582 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:10.498560 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5hfs"] Jul 24 14:42:10.546386 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:10.546365 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c28712a-9b7e-4fb1-88dc-4d2514a57254-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5hfs\" (UID: \"0c28712a-9b7e-4fb1-88dc-4d2514a57254\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5hfs" Jul 24 14:42:10.546480 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:10.546405 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c28712a-9b7e-4fb1-88dc-4d2514a57254-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5hfs\" (UID: \"0c28712a-9b7e-4fb1-88dc-4d2514a57254\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5hfs" Jul 24 14:42:10.546480 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:10.546430 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6fsz\" (UniqueName: \"kubernetes.io/projected/0c28712a-9b7e-4fb1-88dc-4d2514a57254-kube-api-access-c6fsz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5hfs\" (UID: \"0c28712a-9b7e-4fb1-88dc-4d2514a57254\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5hfs" Jul 24 14:42:10.647602 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:10.647571 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c28712a-9b7e-4fb1-88dc-4d2514a57254-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5hfs\" (UID: \"0c28712a-9b7e-4fb1-88dc-4d2514a57254\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5hfs" Jul 24 14:42:10.647704 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:10.647618 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c28712a-9b7e-4fb1-88dc-4d2514a57254-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5hfs\" (UID: \"0c28712a-9b7e-4fb1-88dc-4d2514a57254\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5hfs" Jul 24 14:42:10.647704 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:10.647643 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6fsz\" (UniqueName: \"kubernetes.io/projected/0c28712a-9b7e-4fb1-88dc-4d2514a57254-kube-api-access-c6fsz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5hfs\" (UID: \"0c28712a-9b7e-4fb1-88dc-4d2514a57254\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5hfs" Jul 24 14:42:10.647900 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:10.647881 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c28712a-9b7e-4fb1-88dc-4d2514a57254-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5hfs\" (UID: \"0c28712a-9b7e-4fb1-88dc-4d2514a57254\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5hfs" Jul 24 14:42:10.647962 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:10.647911 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c28712a-9b7e-4fb1-88dc-4d2514a57254-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5hfs\" (UID: \"0c28712a-9b7e-4fb1-88dc-4d2514a57254\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5hfs" Jul 24 14:42:10.656462 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:10.656443 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6fsz\" (UniqueName: \"kubernetes.io/projected/0c28712a-9b7e-4fb1-88dc-4d2514a57254-kube-api-access-c6fsz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5hfs\" (UID: \"0c28712a-9b7e-4fb1-88dc-4d2514a57254\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5hfs" Jul 24 14:42:10.792238 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:10.792220 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5hfs" Jul 24 14:42:10.853100 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:10.853066 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmpdm"] Jul 24 14:42:10.856786 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:10.856767 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmpdm" Jul 24 14:42:10.873765 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:10.873743 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmpdm"] Jul 24 14:42:10.922985 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:10.922967 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5hfs"] Jul 24 14:42:10.924490 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:42:10.924466 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c28712a_9b7e_4fb1_88dc_4d2514a57254.slice/crio-957b3a5e0fdef06f471ed9c19d9efe7bc01caa3472506f9d0a3184b3a109bf63 WatchSource:0}: Error finding container 957b3a5e0fdef06f471ed9c19d9efe7bc01caa3472506f9d0a3184b3a109bf63: Status 404 returned error can't find the container with id 957b3a5e0fdef06f471ed9c19d9efe7bc01caa3472506f9d0a3184b3a109bf63 Jul 24 14:42:10.949662 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:10.949640 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7147f649-e4bb-4a00-a2e6-e16a639210b2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmpdm\" (UID: \"7147f649-e4bb-4a00-a2e6-e16a639210b2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmpdm" Jul 24 14:42:10.949744 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:10.949688 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7147f649-e4bb-4a00-a2e6-e16a639210b2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmpdm\" (UID: \"7147f649-e4bb-4a00-a2e6-e16a639210b2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmpdm" Jul 24 14:42:10.949744 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:10.949706 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb45z\" (UniqueName: \"kubernetes.io/projected/7147f649-e4bb-4a00-a2e6-e16a639210b2-kube-api-access-qb45z\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmpdm\" (UID: \"7147f649-e4bb-4a00-a2e6-e16a639210b2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmpdm" Jul 24 14:42:11.051115 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:11.051050 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7147f649-e4bb-4a00-a2e6-e16a639210b2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmpdm\" (UID: \"7147f649-e4bb-4a00-a2e6-e16a639210b2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmpdm" Jul 24 14:42:11.051331 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:11.051138 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7147f649-e4bb-4a00-a2e6-e16a639210b2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmpdm\" (UID: \"7147f649-e4bb-4a00-a2e6-e16a639210b2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmpdm" Jul 24 14:42:11.051331 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:11.051197 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb45z\" (UniqueName: \"kubernetes.io/projected/7147f649-e4bb-4a00-a2e6-e16a639210b2-kube-api-access-qb45z\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmpdm\" (UID: \"7147f649-e4bb-4a00-a2e6-e16a639210b2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmpdm" Jul 24 14:42:11.051489 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:11.051470 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7147f649-e4bb-4a00-a2e6-e16a639210b2-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmpdm\" (UID: \"7147f649-e4bb-4a00-a2e6-e16a639210b2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmpdm" Jul 24 14:42:11.051549 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:11.051470 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7147f649-e4bb-4a00-a2e6-e16a639210b2-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmpdm\" (UID: \"7147f649-e4bb-4a00-a2e6-e16a639210b2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmpdm" Jul 24 14:42:11.056186 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:11.056163 2581 generic.go:356] "Generic (PLEG): container finished" podID="cfc0ce19-6c06-4691-b4df-2e4096034d18" containerID="c7a8082501de1c22b5d0e48374e4148dd8256808cecfe8bdf506a4519bda7d46" exitCode=0 Jul 24 14:42:11.056266 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:11.056246 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735rkwz" event={"ID":"cfc0ce19-6c06-4691-b4df-2e4096034d18","Type":"ContainerDied","Data":"c7a8082501de1c22b5d0e48374e4148dd8256808cecfe8bdf506a4519bda7d46"} Jul 24 14:42:11.056306 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:11.056294 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735rkwz" event={"ID":"cfc0ce19-6c06-4691-b4df-2e4096034d18","Type":"ContainerStarted","Data":"bdd1d853ec2b7105ed50bfe72c4c6a7670b6225b052e6faea43dcbd9135cfdfe"} Jul 24 14:42:11.057792 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:11.057774 2581 generic.go:356] "Generic (PLEG): container finished" podID="0c28712a-9b7e-4fb1-88dc-4d2514a57254" containerID="ce55d7352355e40f055a3f16eaa78a10083d6422e7a0b0734d5b9a3230b8c3b6" exitCode=0 Jul 24 14:42:11.057888 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:11.057811 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5hfs" event={"ID":"0c28712a-9b7e-4fb1-88dc-4d2514a57254","Type":"ContainerDied","Data":"ce55d7352355e40f055a3f16eaa78a10083d6422e7a0b0734d5b9a3230b8c3b6"} Jul 24 14:42:11.057888 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:11.057838 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5hfs" event={"ID":"0c28712a-9b7e-4fb1-88dc-4d2514a57254","Type":"ContainerStarted","Data":"957b3a5e0fdef06f471ed9c19d9efe7bc01caa3472506f9d0a3184b3a109bf63"} Jul 24 14:42:11.060024 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:11.060005 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb45z\" (UniqueName: \"kubernetes.io/projected/7147f649-e4bb-4a00-a2e6-e16a639210b2-kube-api-access-qb45z\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmpdm\" (UID: \"7147f649-e4bb-4a00-a2e6-e16a639210b2\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmpdm" Jul 24 14:42:11.165549 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:11.165531 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmpdm" Jul 24 14:42:11.251836 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:11.251803 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17h4xt"] Jul 24 14:42:11.257123 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:11.257100 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17h4xt" Jul 24 14:42:11.268061 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:11.268040 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17h4xt"] Jul 24 14:42:11.297512 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:11.297493 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmpdm"] Jul 24 14:42:11.299405 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:42:11.299382 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7147f649_e4bb_4a00_a2e6_e16a639210b2.slice/crio-48d873934871d7fa0498e91b18723eb379ddadd5385738c69082faea8d874093 WatchSource:0}: Error finding container 48d873934871d7fa0498e91b18723eb379ddadd5385738c69082faea8d874093: Status 404 returned error can't find the container with id 48d873934871d7fa0498e91b18723eb379ddadd5385738c69082faea8d874093 Jul 24 14:42:11.352782 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:11.352762 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74684c06-2406-4a20-a37d-c3ba19c31f53-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17h4xt\" (UID: \"74684c06-2406-4a20-a37d-c3ba19c31f53\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17h4xt" Jul 24 14:42:11.352884 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:11.352793 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74684c06-2406-4a20-a37d-c3ba19c31f53-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17h4xt\" (UID: \"74684c06-2406-4a20-a37d-c3ba19c31f53\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17h4xt" Jul 24 14:42:11.352884 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:11.352868 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x45jf\" (UniqueName: \"kubernetes.io/projected/74684c06-2406-4a20-a37d-c3ba19c31f53-kube-api-access-x45jf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17h4xt\" (UID: \"74684c06-2406-4a20-a37d-c3ba19c31f53\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17h4xt" Jul 24 14:42:11.454081 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:11.454055 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x45jf\" (UniqueName: \"kubernetes.io/projected/74684c06-2406-4a20-a37d-c3ba19c31f53-kube-api-access-x45jf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17h4xt\" (UID: \"74684c06-2406-4a20-a37d-c3ba19c31f53\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17h4xt" Jul 24 14:42:11.454228 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:11.454212 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74684c06-2406-4a20-a37d-c3ba19c31f53-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17h4xt\" (UID: \"74684c06-2406-4a20-a37d-c3ba19c31f53\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17h4xt" Jul 24 14:42:11.454288 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:11.454251 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74684c06-2406-4a20-a37d-c3ba19c31f53-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17h4xt\" (UID: \"74684c06-2406-4a20-a37d-c3ba19c31f53\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17h4xt" Jul 24 14:42:11.454587 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:11.454566 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74684c06-2406-4a20-a37d-c3ba19c31f53-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17h4xt\" (UID: \"74684c06-2406-4a20-a37d-c3ba19c31f53\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17h4xt" Jul 24 14:42:11.454587 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:11.454580 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74684c06-2406-4a20-a37d-c3ba19c31f53-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17h4xt\" (UID: \"74684c06-2406-4a20-a37d-c3ba19c31f53\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17h4xt" Jul 24 14:42:11.462661 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:11.462643 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x45jf\" (UniqueName: \"kubernetes.io/projected/74684c06-2406-4a20-a37d-c3ba19c31f53-kube-api-access-x45jf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17h4xt\" (UID: \"74684c06-2406-4a20-a37d-c3ba19c31f53\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17h4xt" Jul 24 14:42:11.568714 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:11.568652 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17h4xt" Jul 24 14:42:11.746727 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:11.746706 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17h4xt"] Jul 24 14:42:11.795881 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:42:11.795852 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74684c06_2406_4a20_a37d_c3ba19c31f53.slice/crio-093afb3b40acbf5ab42df94e7c90e7bfb1f206416f209602ab98629e3f4daa4a WatchSource:0}: Error finding container 093afb3b40acbf5ab42df94e7c90e7bfb1f206416f209602ab98629e3f4daa4a: Status 404 returned error can't find the container with id 093afb3b40acbf5ab42df94e7c90e7bfb1f206416f209602ab98629e3f4daa4a Jul 24 14:42:12.064205 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:12.064173 2581 generic.go:356] "Generic (PLEG): container finished" podID="0c28712a-9b7e-4fb1-88dc-4d2514a57254" containerID="4fbfaed49457fac504817e2b195979d64d5bc2fcfa42dd3f402b1675f2ea6c74" exitCode=0 Jul 24 14:42:12.064599 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:12.064258 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5hfs" event={"ID":"0c28712a-9b7e-4fb1-88dc-4d2514a57254","Type":"ContainerDied","Data":"4fbfaed49457fac504817e2b195979d64d5bc2fcfa42dd3f402b1675f2ea6c74"} Jul 24 14:42:12.065785 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:12.065767 2581 generic.go:356] "Generic (PLEG): container finished" podID="7147f649-e4bb-4a00-a2e6-e16a639210b2" containerID="061aaa0b29b4d2ccc38c38db6f22015a22c2c76ab064a05a102e53bc049bc239" exitCode=0 Jul 24 14:42:12.065879 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:12.065857 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmpdm" event={"ID":"7147f649-e4bb-4a00-a2e6-e16a639210b2","Type":"ContainerDied","Data":"061aaa0b29b4d2ccc38c38db6f22015a22c2c76ab064a05a102e53bc049bc239"} Jul 24 14:42:12.065946 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:12.065901 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmpdm" event={"ID":"7147f649-e4bb-4a00-a2e6-e16a639210b2","Type":"ContainerStarted","Data":"48d873934871d7fa0498e91b18723eb379ddadd5385738c69082faea8d874093"} Jul 24 14:42:12.067874 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:12.067854 2581 generic.go:356] "Generic (PLEG): container finished" podID="cfc0ce19-6c06-4691-b4df-2e4096034d18" containerID="48c5b616c28c6d06520a264385a351ec944aae8491d4e8f30b3e00dd3463c722" exitCode=0 Jul 24 14:42:12.067991 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:12.067935 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735rkwz" event={"ID":"cfc0ce19-6c06-4691-b4df-2e4096034d18","Type":"ContainerDied","Data":"48c5b616c28c6d06520a264385a351ec944aae8491d4e8f30b3e00dd3463c722"} Jul 24 14:42:12.069674 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:12.069645 2581 generic.go:356] "Generic (PLEG): container finished" podID="74684c06-2406-4a20-a37d-c3ba19c31f53" containerID="bf49c22d70e447d1477108bd798a0111a299a524cf04d84afbafba1b1edc1ad5" exitCode=0 Jul 24 14:42:12.069755 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:12.069684 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17h4xt" event={"ID":"74684c06-2406-4a20-a37d-c3ba19c31f53","Type":"ContainerDied","Data":"bf49c22d70e447d1477108bd798a0111a299a524cf04d84afbafba1b1edc1ad5"} Jul 24 14:42:12.069755 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:12.069717 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17h4xt" event={"ID":"74684c06-2406-4a20-a37d-c3ba19c31f53","Type":"ContainerStarted","Data":"093afb3b40acbf5ab42df94e7c90e7bfb1f206416f209602ab98629e3f4daa4a"} Jul 24 14:42:13.076225 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:13.076196 2581 generic.go:356] "Generic (PLEG): container finished" podID="cfc0ce19-6c06-4691-b4df-2e4096034d18" containerID="67bf6d9a33268c4098228c328de151963aa7c2f09a2e03d88612915ff0273b58" exitCode=0 Jul 24 14:42:13.076623 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:13.076267 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735rkwz" event={"ID":"cfc0ce19-6c06-4691-b4df-2e4096034d18","Type":"ContainerDied","Data":"67bf6d9a33268c4098228c328de151963aa7c2f09a2e03d88612915ff0273b58"} Jul 24 14:42:13.078025 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:13.078005 2581 generic.go:356] "Generic (PLEG): container finished" podID="74684c06-2406-4a20-a37d-c3ba19c31f53" containerID="6300509d54cd39bc0e4827e7e579b510062d5b1b8973fe950385171ea30f1637" exitCode=0 Jul 24 14:42:13.078123 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:13.078085 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17h4xt" event={"ID":"74684c06-2406-4a20-a37d-c3ba19c31f53","Type":"ContainerDied","Data":"6300509d54cd39bc0e4827e7e579b510062d5b1b8973fe950385171ea30f1637"} Jul 24 14:42:13.080239 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:13.080222 2581 generic.go:356] "Generic (PLEG): container finished" podID="0c28712a-9b7e-4fb1-88dc-4d2514a57254" containerID="1ed73ebda791bef56c6ff4aecc7a2adbf24ef6e8e18ebf5b0b02c5f614901381" exitCode=0 Jul 24 14:42:13.080333 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:13.080284 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5hfs" event={"ID":"0c28712a-9b7e-4fb1-88dc-4d2514a57254","Type":"ContainerDied","Data":"1ed73ebda791bef56c6ff4aecc7a2adbf24ef6e8e18ebf5b0b02c5f614901381"} Jul 24 14:42:13.081918 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:13.081901 2581 generic.go:356] "Generic (PLEG): container finished" podID="7147f649-e4bb-4a00-a2e6-e16a639210b2" containerID="06bda78f6bee8e44cae8baa8dfe537ecb98450ad3a05bd12177bcc4f41594142" exitCode=0 Jul 24 14:42:13.081995 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:13.081947 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmpdm" event={"ID":"7147f649-e4bb-4a00-a2e6-e16a639210b2","Type":"ContainerDied","Data":"06bda78f6bee8e44cae8baa8dfe537ecb98450ad3a05bd12177bcc4f41594142"} Jul 24 14:42:14.088484 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:14.088453 2581 generic.go:356] "Generic (PLEG): container finished" podID="7147f649-e4bb-4a00-a2e6-e16a639210b2" containerID="3433a6e05f2e8bf89e2cb2be5d00a23fefbea3e0849f2a5562babd953a153f3c" exitCode=0 Jul 24 14:42:14.088852 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:14.088531 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmpdm" event={"ID":"7147f649-e4bb-4a00-a2e6-e16a639210b2","Type":"ContainerDied","Data":"3433a6e05f2e8bf89e2cb2be5d00a23fefbea3e0849f2a5562babd953a153f3c"} Jul 24 14:42:14.090487 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:14.090464 2581 generic.go:356] "Generic (PLEG): container finished" podID="74684c06-2406-4a20-a37d-c3ba19c31f53" containerID="4626462dfbf0c8f2ad5cfb57254e4f9c72c26d79d0d69558a5c8ba10e43cc7ac" exitCode=0 Jul 24 14:42:14.090617 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:14.090549 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17h4xt" event={"ID":"74684c06-2406-4a20-a37d-c3ba19c31f53","Type":"ContainerDied","Data":"4626462dfbf0c8f2ad5cfb57254e4f9c72c26d79d0d69558a5c8ba10e43cc7ac"} Jul 24 14:42:14.222702 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:14.222674 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5hfs" Jul 24 14:42:14.254115 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:14.254094 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735rkwz" Jul 24 14:42:14.278695 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:14.278667 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6fsz\" (UniqueName: \"kubernetes.io/projected/0c28712a-9b7e-4fb1-88dc-4d2514a57254-kube-api-access-c6fsz\") pod \"0c28712a-9b7e-4fb1-88dc-4d2514a57254\" (UID: \"0c28712a-9b7e-4fb1-88dc-4d2514a57254\") " Jul 24 14:42:14.278816 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:14.278779 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c28712a-9b7e-4fb1-88dc-4d2514a57254-bundle\") pod \"0c28712a-9b7e-4fb1-88dc-4d2514a57254\" (UID: \"0c28712a-9b7e-4fb1-88dc-4d2514a57254\") " Jul 24 14:42:14.278870 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:14.278813 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c28712a-9b7e-4fb1-88dc-4d2514a57254-util\") pod \"0c28712a-9b7e-4fb1-88dc-4d2514a57254\" (UID: \"0c28712a-9b7e-4fb1-88dc-4d2514a57254\") " Jul 24 14:42:14.279269 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:14.279237 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c28712a-9b7e-4fb1-88dc-4d2514a57254-bundle" (OuterVolumeSpecName: "bundle") pod "0c28712a-9b7e-4fb1-88dc-4d2514a57254" (UID: "0c28712a-9b7e-4fb1-88dc-4d2514a57254"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:42:14.280786 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:14.280766 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c28712a-9b7e-4fb1-88dc-4d2514a57254-kube-api-access-c6fsz" (OuterVolumeSpecName: "kube-api-access-c6fsz") pod "0c28712a-9b7e-4fb1-88dc-4d2514a57254" (UID: "0c28712a-9b7e-4fb1-88dc-4d2514a57254"). InnerVolumeSpecName "kube-api-access-c6fsz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:42:14.288017 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:14.287975 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c28712a-9b7e-4fb1-88dc-4d2514a57254-util" (OuterVolumeSpecName: "util") pod "0c28712a-9b7e-4fb1-88dc-4d2514a57254" (UID: "0c28712a-9b7e-4fb1-88dc-4d2514a57254"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:42:14.379290 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:14.379229 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cfc0ce19-6c06-4691-b4df-2e4096034d18-bundle\") pod \"cfc0ce19-6c06-4691-b4df-2e4096034d18\" (UID: \"cfc0ce19-6c06-4691-b4df-2e4096034d18\") " Jul 24 14:42:14.379290 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:14.379287 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqvdr\" (UniqueName: \"kubernetes.io/projected/cfc0ce19-6c06-4691-b4df-2e4096034d18-kube-api-access-zqvdr\") pod \"cfc0ce19-6c06-4691-b4df-2e4096034d18\" (UID: \"cfc0ce19-6c06-4691-b4df-2e4096034d18\") " Jul 24 14:42:14.379464 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:14.379323 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cfc0ce19-6c06-4691-b4df-2e4096034d18-util\") pod \"cfc0ce19-6c06-4691-b4df-2e4096034d18\" (UID: \"cfc0ce19-6c06-4691-b4df-2e4096034d18\") " Jul 24 14:42:14.379590 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:14.379574 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6fsz\" (UniqueName: \"kubernetes.io/projected/0c28712a-9b7e-4fb1-88dc-4d2514a57254-kube-api-access-c6fsz\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:42:14.379644 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:14.379595 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c28712a-9b7e-4fb1-88dc-4d2514a57254-bundle\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:42:14.379644 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:14.379608 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c28712a-9b7e-4fb1-88dc-4d2514a57254-util\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:42:14.379755 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:14.379734 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfc0ce19-6c06-4691-b4df-2e4096034d18-bundle" (OuterVolumeSpecName: "bundle") pod "cfc0ce19-6c06-4691-b4df-2e4096034d18" (UID: "cfc0ce19-6c06-4691-b4df-2e4096034d18"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:42:14.381358 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:14.381340 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfc0ce19-6c06-4691-b4df-2e4096034d18-kube-api-access-zqvdr" (OuterVolumeSpecName: "kube-api-access-zqvdr") pod "cfc0ce19-6c06-4691-b4df-2e4096034d18" (UID: "cfc0ce19-6c06-4691-b4df-2e4096034d18"). InnerVolumeSpecName "kube-api-access-zqvdr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:42:14.384836 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:14.384817 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfc0ce19-6c06-4691-b4df-2e4096034d18-util" (OuterVolumeSpecName: "util") pod "cfc0ce19-6c06-4691-b4df-2e4096034d18" (UID: "cfc0ce19-6c06-4691-b4df-2e4096034d18"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:42:14.480237 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:14.480202 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cfc0ce19-6c06-4691-b4df-2e4096034d18-bundle\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:42:14.480237 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:14.480235 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqvdr\" (UniqueName: \"kubernetes.io/projected/cfc0ce19-6c06-4691-b4df-2e4096034d18-kube-api-access-zqvdr\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:42:14.480366 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:14.480250 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cfc0ce19-6c06-4691-b4df-2e4096034d18-util\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:42:15.097631 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:15.097600 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735rkwz" Jul 24 14:42:15.097631 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:15.097626 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735rkwz" event={"ID":"cfc0ce19-6c06-4691-b4df-2e4096034d18","Type":"ContainerDied","Data":"bdd1d853ec2b7105ed50bfe72c4c6a7670b6225b052e6faea43dcbd9135cfdfe"} Jul 24 14:42:15.098134 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:15.097702 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bdd1d853ec2b7105ed50bfe72c4c6a7670b6225b052e6faea43dcbd9135cfdfe" Jul 24 14:42:15.099605 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:15.099577 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5hfs" Jul 24 14:42:15.099605 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:15.099597 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5hfs" event={"ID":"0c28712a-9b7e-4fb1-88dc-4d2514a57254","Type":"ContainerDied","Data":"957b3a5e0fdef06f471ed9c19d9efe7bc01caa3472506f9d0a3184b3a109bf63"} Jul 24 14:42:15.099760 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:15.099634 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="957b3a5e0fdef06f471ed9c19d9efe7bc01caa3472506f9d0a3184b3a109bf63" Jul 24 14:42:15.225190 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:15.225169 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmpdm" Jul 24 14:42:15.256479 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:15.256460 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17h4xt" Jul 24 14:42:15.287016 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:15.286995 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7147f649-e4bb-4a00-a2e6-e16a639210b2-util\") pod \"7147f649-e4bb-4a00-a2e6-e16a639210b2\" (UID: \"7147f649-e4bb-4a00-a2e6-e16a639210b2\") " Jul 24 14:42:15.287206 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:15.287042 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7147f649-e4bb-4a00-a2e6-e16a639210b2-bundle\") pod \"7147f649-e4bb-4a00-a2e6-e16a639210b2\" (UID: \"7147f649-e4bb-4a00-a2e6-e16a639210b2\") " Jul 24 14:42:15.287206 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:15.287123 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qb45z\" (UniqueName: \"kubernetes.io/projected/7147f649-e4bb-4a00-a2e6-e16a639210b2-kube-api-access-qb45z\") pod \"7147f649-e4bb-4a00-a2e6-e16a639210b2\" (UID: \"7147f649-e4bb-4a00-a2e6-e16a639210b2\") " Jul 24 14:42:15.287531 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:15.287502 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7147f649-e4bb-4a00-a2e6-e16a639210b2-bundle" (OuterVolumeSpecName: "bundle") pod "7147f649-e4bb-4a00-a2e6-e16a639210b2" (UID: "7147f649-e4bb-4a00-a2e6-e16a639210b2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:42:15.289079 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:15.289057 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7147f649-e4bb-4a00-a2e6-e16a639210b2-kube-api-access-qb45z" (OuterVolumeSpecName: "kube-api-access-qb45z") pod "7147f649-e4bb-4a00-a2e6-e16a639210b2" (UID: "7147f649-e4bb-4a00-a2e6-e16a639210b2"). InnerVolumeSpecName "kube-api-access-qb45z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:42:15.292480 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:15.292460 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7147f649-e4bb-4a00-a2e6-e16a639210b2-util" (OuterVolumeSpecName: "util") pod "7147f649-e4bb-4a00-a2e6-e16a639210b2" (UID: "7147f649-e4bb-4a00-a2e6-e16a639210b2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:42:15.388536 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:15.388479 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74684c06-2406-4a20-a37d-c3ba19c31f53-util\") pod \"74684c06-2406-4a20-a37d-c3ba19c31f53\" (UID: \"74684c06-2406-4a20-a37d-c3ba19c31f53\") " Jul 24 14:42:15.388612 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:15.388548 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x45jf\" (UniqueName: \"kubernetes.io/projected/74684c06-2406-4a20-a37d-c3ba19c31f53-kube-api-access-x45jf\") pod \"74684c06-2406-4a20-a37d-c3ba19c31f53\" (UID: \"74684c06-2406-4a20-a37d-c3ba19c31f53\") " Jul 24 14:42:15.388655 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:15.388618 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74684c06-2406-4a20-a37d-c3ba19c31f53-bundle\") pod \"74684c06-2406-4a20-a37d-c3ba19c31f53\" (UID: \"74684c06-2406-4a20-a37d-c3ba19c31f53\") " Jul 24 14:42:15.388840 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:15.388823 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qb45z\" (UniqueName: \"kubernetes.io/projected/7147f649-e4bb-4a00-a2e6-e16a639210b2-kube-api-access-qb45z\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:42:15.388884 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:15.388844 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7147f649-e4bb-4a00-a2e6-e16a639210b2-util\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:42:15.388884 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:15.388859 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7147f649-e4bb-4a00-a2e6-e16a639210b2-bundle\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:42:15.389089 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:15.389060 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74684c06-2406-4a20-a37d-c3ba19c31f53-bundle" (OuterVolumeSpecName: "bundle") pod "74684c06-2406-4a20-a37d-c3ba19c31f53" (UID: "74684c06-2406-4a20-a37d-c3ba19c31f53"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:42:15.390619 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:15.390595 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74684c06-2406-4a20-a37d-c3ba19c31f53-kube-api-access-x45jf" (OuterVolumeSpecName: "kube-api-access-x45jf") pod "74684c06-2406-4a20-a37d-c3ba19c31f53" (UID: "74684c06-2406-4a20-a37d-c3ba19c31f53"). InnerVolumeSpecName "kube-api-access-x45jf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:42:15.394038 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:15.394008 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74684c06-2406-4a20-a37d-c3ba19c31f53-util" (OuterVolumeSpecName: "util") pod "74684c06-2406-4a20-a37d-c3ba19c31f53" (UID: "74684c06-2406-4a20-a37d-c3ba19c31f53"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 14:42:15.489912 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:15.489885 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74684c06-2406-4a20-a37d-c3ba19c31f53-util\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:42:15.489912 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:15.489903 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x45jf\" (UniqueName: \"kubernetes.io/projected/74684c06-2406-4a20-a37d-c3ba19c31f53-kube-api-access-x45jf\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:42:15.489912 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:15.489914 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74684c06-2406-4a20-a37d-c3ba19c31f53-bundle\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:42:16.105873 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:16.105844 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmpdm" Jul 24 14:42:16.106333 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:16.105876 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmpdm" event={"ID":"7147f649-e4bb-4a00-a2e6-e16a639210b2","Type":"ContainerDied","Data":"48d873934871d7fa0498e91b18723eb379ddadd5385738c69082faea8d874093"} Jul 24 14:42:16.106333 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:16.105924 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="48d873934871d7fa0498e91b18723eb379ddadd5385738c69082faea8d874093" Jul 24 14:42:16.108019 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:16.107998 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17h4xt" Jul 24 14:42:16.112916 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:16.112886 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17h4xt" event={"ID":"74684c06-2406-4a20-a37d-c3ba19c31f53","Type":"ContainerDied","Data":"093afb3b40acbf5ab42df94e7c90e7bfb1f206416f209602ab98629e3f4daa4a"} Jul 24 14:42:16.113033 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:42:16.112932 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="093afb3b40acbf5ab42df94e7c90e7bfb1f206416f209602ab98629e3f4daa4a" Jul 24 14:43:30.356233 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.354637 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:43:30.356233 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.355354 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74684c06-2406-4a20-a37d-c3ba19c31f53" containerName="extract" Jul 24 14:43:30.356233 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.355373 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="74684c06-2406-4a20-a37d-c3ba19c31f53" containerName="extract" Jul 24 14:43:30.356233 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.355397 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74684c06-2406-4a20-a37d-c3ba19c31f53" containerName="util" Jul 24 14:43:30.356233 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.355407 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="74684c06-2406-4a20-a37d-c3ba19c31f53" containerName="util" Jul 24 14:43:30.356233 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.355417 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfc0ce19-6c06-4691-b4df-2e4096034d18" containerName="pull" Jul 24 14:43:30.356233 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.355427 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfc0ce19-6c06-4691-b4df-2e4096034d18" containerName="pull" Jul 24 14:43:30.356233 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.355441 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74684c06-2406-4a20-a37d-c3ba19c31f53" containerName="pull" Jul 24 14:43:30.356233 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.355455 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="74684c06-2406-4a20-a37d-c3ba19c31f53" containerName="pull" Jul 24 14:43:30.356233 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.355466 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c28712a-9b7e-4fb1-88dc-4d2514a57254" containerName="extract" Jul 24 14:43:30.356233 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.355474 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c28712a-9b7e-4fb1-88dc-4d2514a57254" containerName="extract" Jul 24 14:43:30.356233 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.355495 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfc0ce19-6c06-4691-b4df-2e4096034d18" containerName="util" Jul 24 14:43:30.356233 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.355504 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfc0ce19-6c06-4691-b4df-2e4096034d18" containerName="util" Jul 24 14:43:30.356233 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.355529 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7147f649-e4bb-4a00-a2e6-e16a639210b2" containerName="extract" Jul 24 14:43:30.356233 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.355537 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7147f649-e4bb-4a00-a2e6-e16a639210b2" containerName="extract" Jul 24 14:43:30.356233 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.355549 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c28712a-9b7e-4fb1-88dc-4d2514a57254" containerName="util" Jul 24 14:43:30.356233 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.355562 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c28712a-9b7e-4fb1-88dc-4d2514a57254" containerName="util" Jul 24 14:43:30.356233 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.355573 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c28712a-9b7e-4fb1-88dc-4d2514a57254" containerName="pull" Jul 24 14:43:30.356233 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.355582 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c28712a-9b7e-4fb1-88dc-4d2514a57254" containerName="pull" Jul 24 14:43:30.356233 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.355597 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7147f649-e4bb-4a00-a2e6-e16a639210b2" containerName="pull" Jul 24 14:43:30.356233 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.355605 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7147f649-e4bb-4a00-a2e6-e16a639210b2" containerName="pull" Jul 24 14:43:30.356233 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.355626 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7147f649-e4bb-4a00-a2e6-e16a639210b2" containerName="util" Jul 24 14:43:30.356233 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.355635 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7147f649-e4bb-4a00-a2e6-e16a639210b2" containerName="util" Jul 24 14:43:30.356233 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.355644 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfc0ce19-6c06-4691-b4df-2e4096034d18" containerName="extract" Jul 24 14:43:30.356233 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.355654 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfc0ce19-6c06-4691-b4df-2e4096034d18" containerName="extract" Jul 24 14:43:30.356233 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.355866 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c28712a-9b7e-4fb1-88dc-4d2514a57254" containerName="extract" Jul 24 14:43:30.356233 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.355892 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7147f649-e4bb-4a00-a2e6-e16a639210b2" containerName="extract" Jul 24 14:43:30.356233 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.355904 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfc0ce19-6c06-4691-b4df-2e4096034d18" containerName="extract" Jul 24 14:43:30.356233 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.355914 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="74684c06-2406-4a20-a37d-c3ba19c31f53" containerName="extract" Jul 24 14:43:30.359644 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.359626 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-f599l" Jul 24 14:43:30.365341 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.365321 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-djr82\"" Jul 24 14:43:30.365450 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.365392 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 24 14:43:30.366544 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.366526 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 24 14:43:30.366639 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.366526 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 24 14:43:30.372861 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.372841 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:43:30.417423 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.417391 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:43:30.465999 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.465974 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/60a68218-50bc-42c7-80cf-b2181a743aa0-config-file\") pod \"limitador-limitador-54d6d988d5-f599l\" (UID: \"60a68218-50bc-42c7-80cf-b2181a743aa0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-f599l" Jul 24 14:43:30.466121 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.466006 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcvtx\" (UniqueName: \"kubernetes.io/projected/60a68218-50bc-42c7-80cf-b2181a743aa0-kube-api-access-xcvtx\") pod \"limitador-limitador-54d6d988d5-f599l\" (UID: \"60a68218-50bc-42c7-80cf-b2181a743aa0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-f599l" Jul 24 14:43:30.567299 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.567272 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/60a68218-50bc-42c7-80cf-b2181a743aa0-config-file\") pod \"limitador-limitador-54d6d988d5-f599l\" (UID: \"60a68218-50bc-42c7-80cf-b2181a743aa0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-f599l" Jul 24 14:43:30.567439 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.567312 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcvtx\" (UniqueName: \"kubernetes.io/projected/60a68218-50bc-42c7-80cf-b2181a743aa0-kube-api-access-xcvtx\") pod \"limitador-limitador-54d6d988d5-f599l\" (UID: \"60a68218-50bc-42c7-80cf-b2181a743aa0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-f599l" Jul 24 14:43:30.567852 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.567832 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/60a68218-50bc-42c7-80cf-b2181a743aa0-config-file\") pod \"limitador-limitador-54d6d988d5-f599l\" (UID: \"60a68218-50bc-42c7-80cf-b2181a743aa0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-f599l" Jul 24 14:43:30.576290 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.576272 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcvtx\" (UniqueName: \"kubernetes.io/projected/60a68218-50bc-42c7-80cf-b2181a743aa0-kube-api-access-xcvtx\") pod \"limitador-limitador-54d6d988d5-f599l\" (UID: \"60a68218-50bc-42c7-80cf-b2181a743aa0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-f599l" Jul 24 14:43:30.669556 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.669494 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-f599l" Jul 24 14:43:30.797834 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:30.797812 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:43:30.800090 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:43:30.800063 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60a68218_50bc_42c7_80cf_b2181a743aa0.slice/crio-5178ff316b11f4f618281be2a9e3a5821dff0137badfe464efc2f8ba9011b168 WatchSource:0}: Error finding container 5178ff316b11f4f618281be2a9e3a5821dff0137badfe464efc2f8ba9011b168: Status 404 returned error can't find the container with id 5178ff316b11f4f618281be2a9e3a5821dff0137badfe464efc2f8ba9011b168 Jul 24 14:43:31.468599 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:31.468569 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-f599l" event={"ID":"60a68218-50bc-42c7-80cf-b2181a743aa0","Type":"ContainerStarted","Data":"5178ff316b11f4f618281be2a9e3a5821dff0137badfe464efc2f8ba9011b168"} Jul 24 14:43:33.480978 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:33.480891 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-f599l" event={"ID":"60a68218-50bc-42c7-80cf-b2181a743aa0","Type":"ContainerStarted","Data":"364b5daee3eba75e34cae697acd482a259a4189ecc5e73d9d94c29162e9faef6"} Jul 24 14:43:33.480978 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:33.480948 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-f599l" Jul 24 14:43:33.502096 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:33.502053 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-f599l" podStartSLOduration=1.143112114 podStartE2EDuration="3.502039337s" totalImagesPullingTime="2.358927223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:43:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:43:33.499879413 +0000 UTC m=+554.037135365" watchObservedRunningTime="2026-07-24 14:43:33.502039337 +0000 UTC m=+554.039295305" Jul 24 14:43:44.486823 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:43:44.486795 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-f599l" Jul 24 14:44:45.239080 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:44:45.239009 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:45:10.698586 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:10.698551 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:45:17.801864 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:17.801834 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:45:20.995190 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:20.995135 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:45:30.089313 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:30.089284 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6"] Jul 24 14:45:30.095148 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:30.095120 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6" Jul 24 14:45:30.098410 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:30.098387 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kg9tm\"" Jul 24 14:45:30.099658 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:30.099636 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 24 14:45:30.099896 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:30.099676 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 24 14:45:30.099896 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:30.099752 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 24 14:45:30.102795 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:30.102773 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6"] Jul 24 14:45:30.280780 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:30.280748 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1725524-e5f4-4e33-85d0-1d15c2630da6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6\" (UID: \"b1725524-e5f4-4e33-85d0-1d15c2630da6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6" Jul 24 14:45:30.280990 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:30.280926 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1725524-e5f4-4e33-85d0-1d15c2630da6-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6\" (UID: \"b1725524-e5f4-4e33-85d0-1d15c2630da6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6" Jul 24 14:45:30.280990 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:30.280986 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1725524-e5f4-4e33-85d0-1d15c2630da6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6\" (UID: \"b1725524-e5f4-4e33-85d0-1d15c2630da6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6" Jul 24 14:45:30.281266 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:30.281245 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1725524-e5f4-4e33-85d0-1d15c2630da6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6\" (UID: \"b1725524-e5f4-4e33-85d0-1d15c2630da6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6" Jul 24 14:45:30.281319 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:30.281285 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlww8\" (UniqueName: \"kubernetes.io/projected/b1725524-e5f4-4e33-85d0-1d15c2630da6-kube-api-access-zlww8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6\" (UID: \"b1725524-e5f4-4e33-85d0-1d15c2630da6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6" Jul 24 14:45:30.281319 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:30.281312 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1725524-e5f4-4e33-85d0-1d15c2630da6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6\" (UID: \"b1725524-e5f4-4e33-85d0-1d15c2630da6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6" Jul 24 14:45:30.381810 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:30.381714 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1725524-e5f4-4e33-85d0-1d15c2630da6-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6\" (UID: \"b1725524-e5f4-4e33-85d0-1d15c2630da6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6" Jul 24 14:45:30.381810 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:30.381759 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1725524-e5f4-4e33-85d0-1d15c2630da6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6\" (UID: \"b1725524-e5f4-4e33-85d0-1d15c2630da6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6" Jul 24 14:45:30.381810 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:30.381797 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1725524-e5f4-4e33-85d0-1d15c2630da6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6\" (UID: \"b1725524-e5f4-4e33-85d0-1d15c2630da6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6" Jul 24 14:45:30.382090 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:30.381829 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlww8\" (UniqueName: \"kubernetes.io/projected/b1725524-e5f4-4e33-85d0-1d15c2630da6-kube-api-access-zlww8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6\" (UID: \"b1725524-e5f4-4e33-85d0-1d15c2630da6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6" Jul 24 14:45:30.382090 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:30.381856 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1725524-e5f4-4e33-85d0-1d15c2630da6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6\" (UID: \"b1725524-e5f4-4e33-85d0-1d15c2630da6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6" Jul 24 14:45:30.382090 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:30.381883 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1725524-e5f4-4e33-85d0-1d15c2630da6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6\" (UID: \"b1725524-e5f4-4e33-85d0-1d15c2630da6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6" Jul 24 14:45:30.382285 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:30.382196 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1725524-e5f4-4e33-85d0-1d15c2630da6-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6\" (UID: \"b1725524-e5f4-4e33-85d0-1d15c2630da6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6" Jul 24 14:45:30.382285 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:30.382221 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1725524-e5f4-4e33-85d0-1d15c2630da6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6\" (UID: \"b1725524-e5f4-4e33-85d0-1d15c2630da6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6" Jul 24 14:45:30.382285 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:30.382258 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1725524-e5f4-4e33-85d0-1d15c2630da6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6\" (UID: \"b1725524-e5f4-4e33-85d0-1d15c2630da6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6" Jul 24 14:45:30.384176 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:30.384141 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1725524-e5f4-4e33-85d0-1d15c2630da6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6\" (UID: \"b1725524-e5f4-4e33-85d0-1d15c2630da6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6" Jul 24 14:45:30.384455 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:30.384437 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1725524-e5f4-4e33-85d0-1d15c2630da6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6\" (UID: \"b1725524-e5f4-4e33-85d0-1d15c2630da6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6" Jul 24 14:45:30.391257 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:30.391239 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlww8\" (UniqueName: \"kubernetes.io/projected/b1725524-e5f4-4e33-85d0-1d15c2630da6-kube-api-access-zlww8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6\" (UID: \"b1725524-e5f4-4e33-85d0-1d15c2630da6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6" Jul 24 14:45:30.408670 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:30.408646 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6" Jul 24 14:45:30.542314 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:30.542291 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6"] Jul 24 14:45:30.544137 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:45:30.544111 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1725524_e5f4_4e33_85d0_1d15c2630da6.slice/crio-d5543a9762288d2cb8e3aa88b9cf6e1aedf12b9a00f34bec6a81bc64bf3060df WatchSource:0}: Error finding container d5543a9762288d2cb8e3aa88b9cf6e1aedf12b9a00f34bec6a81bc64bf3060df: Status 404 returned error can't find the container with id d5543a9762288d2cb8e3aa88b9cf6e1aedf12b9a00f34bec6a81bc64bf3060df Jul 24 14:45:30.545542 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:30.545524 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 14:45:31.082979 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:31.082942 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6" event={"ID":"b1725524-e5f4-4e33-85d0-1d15c2630da6","Type":"ContainerStarted","Data":"d5543a9762288d2cb8e3aa88b9cf6e1aedf12b9a00f34bec6a81bc64bf3060df"} Jul 24 14:45:31.688019 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:31.687985 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:45:32.089968 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:32.089934 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6" event={"ID":"b1725524-e5f4-4e33-85d0-1d15c2630da6","Type":"ContainerStarted","Data":"2a53e3e338e4e9f061c20479915aa48030205461a40f0c7cff74ed6d0aa96a13"} Jul 24 14:45:32.112676 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:32.112633 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6" podStartSLOduration=0.948824625 podStartE2EDuration="2.112617511s" totalImagesPullingTime="1.163792886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:45:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:45:32.111627356 +0000 UTC m=+672.648883309" watchObservedRunningTime="2026-07-24 14:45:32.112617511 +0000 UTC m=+672.649873465" Jul 24 14:45:40.409284 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:40.409249 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6" Jul 24 14:45:40.409665 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:40.409304 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6" Jul 24 14:45:40.421537 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:40.421516 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6" Jul 24 14:45:40.998612 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:40.998581 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:45:41.144238 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:41.144210 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6" Jul 24 14:45:53.905121 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:45:53.905086 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:47:03.612116 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:47:03.612087 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:47:12.597505 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:47:12.597472 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:47:23.196342 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:47:23.196301 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:49:04.091787 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:49:04.091756 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:49:14.199297 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:49:14.199200 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:49:47.393529 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:49:47.393488 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:49:56.884050 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:49:56.884011 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:50:06.988319 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:50:06.988283 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:50:17.096406 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:50:17.096371 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:50:27.700525 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:50:27.700494 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:50:36.301105 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:50:36.301070 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:50:47.992654 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:50:47.992565 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:50:55.100736 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:50:55.100701 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:51:02.292580 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:51:02.292548 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:51:11.293205 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:51:11.293171 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:51:23.403345 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:51:23.403313 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:51:35.895219 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:51:35.895188 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:51:59.699961 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:51:59.699924 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:52:09.700207 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:52:09.700166 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:52:15.895877 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:52:15.895807 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:52:25.794489 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:52:25.794460 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:52:37.292980 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:52:37.292947 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:52:45.909672 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:52:45.909640 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:52:52.952952 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:52:52.952919 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-89bf45b89-tm598"] Jul 24 14:52:52.956260 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:52:52.956240 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-89bf45b89-tm598" Jul 24 14:52:52.980973 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:52:52.980950 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-89bf45b89-tm598"] Jul 24 14:52:53.038066 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:52:53.038040 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/529a8628-7402-461d-8e82-89ce4dcd47ee-console-config\") pod \"console-89bf45b89-tm598\" (UID: \"529a8628-7402-461d-8e82-89ce4dcd47ee\") " pod="openshift-console/console-89bf45b89-tm598" Jul 24 14:52:53.038066 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:52:53.038067 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxf65\" (UniqueName: \"kubernetes.io/projected/529a8628-7402-461d-8e82-89ce4dcd47ee-kube-api-access-kxf65\") pod \"console-89bf45b89-tm598\" (UID: \"529a8628-7402-461d-8e82-89ce4dcd47ee\") " pod="openshift-console/console-89bf45b89-tm598" Jul 24 14:52:53.038228 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:52:53.038100 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/529a8628-7402-461d-8e82-89ce4dcd47ee-service-ca\") pod \"console-89bf45b89-tm598\" (UID: \"529a8628-7402-461d-8e82-89ce4dcd47ee\") " pod="openshift-console/console-89bf45b89-tm598" Jul 24 14:52:53.038228 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:52:53.038147 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/529a8628-7402-461d-8e82-89ce4dcd47ee-trusted-ca-bundle\") pod \"console-89bf45b89-tm598\" (UID: \"529a8628-7402-461d-8e82-89ce4dcd47ee\") " pod="openshift-console/console-89bf45b89-tm598" Jul 24 14:52:53.038228 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:52:53.038231 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/529a8628-7402-461d-8e82-89ce4dcd47ee-oauth-serving-cert\") pod \"console-89bf45b89-tm598\" (UID: \"529a8628-7402-461d-8e82-89ce4dcd47ee\") " pod="openshift-console/console-89bf45b89-tm598" Jul 24 14:52:53.038337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:52:53.038252 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/529a8628-7402-461d-8e82-89ce4dcd47ee-console-serving-cert\") pod \"console-89bf45b89-tm598\" (UID: \"529a8628-7402-461d-8e82-89ce4dcd47ee\") " pod="openshift-console/console-89bf45b89-tm598" Jul 24 14:52:53.038337 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:52:53.038272 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/529a8628-7402-461d-8e82-89ce4dcd47ee-console-oauth-config\") pod \"console-89bf45b89-tm598\" (UID: \"529a8628-7402-461d-8e82-89ce4dcd47ee\") " pod="openshift-console/console-89bf45b89-tm598" Jul 24 14:52:53.139268 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:52:53.139239 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/529a8628-7402-461d-8e82-89ce4dcd47ee-oauth-serving-cert\") pod \"console-89bf45b89-tm598\" (UID: \"529a8628-7402-461d-8e82-89ce4dcd47ee\") " pod="openshift-console/console-89bf45b89-tm598" Jul 24 14:52:53.139359 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:52:53.139276 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/529a8628-7402-461d-8e82-89ce4dcd47ee-console-serving-cert\") pod \"console-89bf45b89-tm598\" (UID: \"529a8628-7402-461d-8e82-89ce4dcd47ee\") " pod="openshift-console/console-89bf45b89-tm598" Jul 24 14:52:53.139359 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:52:53.139347 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/529a8628-7402-461d-8e82-89ce4dcd47ee-console-oauth-config\") pod \"console-89bf45b89-tm598\" (UID: \"529a8628-7402-461d-8e82-89ce4dcd47ee\") " pod="openshift-console/console-89bf45b89-tm598" Jul 24 14:52:53.139442 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:52:53.139407 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/529a8628-7402-461d-8e82-89ce4dcd47ee-console-config\") pod \"console-89bf45b89-tm598\" (UID: \"529a8628-7402-461d-8e82-89ce4dcd47ee\") " pod="openshift-console/console-89bf45b89-tm598" Jul 24 14:52:53.139442 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:52:53.139427 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxf65\" (UniqueName: \"kubernetes.io/projected/529a8628-7402-461d-8e82-89ce4dcd47ee-kube-api-access-kxf65\") pod \"console-89bf45b89-tm598\" (UID: \"529a8628-7402-461d-8e82-89ce4dcd47ee\") " pod="openshift-console/console-89bf45b89-tm598" Jul 24 14:52:53.139541 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:52:53.139474 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/529a8628-7402-461d-8e82-89ce4dcd47ee-service-ca\") pod \"console-89bf45b89-tm598\" (UID: \"529a8628-7402-461d-8e82-89ce4dcd47ee\") " pod="openshift-console/console-89bf45b89-tm598" Jul 24 14:52:53.139541 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:52:53.139510 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/529a8628-7402-461d-8e82-89ce4dcd47ee-trusted-ca-bundle\") pod \"console-89bf45b89-tm598\" (UID: \"529a8628-7402-461d-8e82-89ce4dcd47ee\") " pod="openshift-console/console-89bf45b89-tm598" Jul 24 14:52:53.140327 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:52:53.140304 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/529a8628-7402-461d-8e82-89ce4dcd47ee-oauth-serving-cert\") pod \"console-89bf45b89-tm598\" (UID: \"529a8628-7402-461d-8e82-89ce4dcd47ee\") " pod="openshift-console/console-89bf45b89-tm598" Jul 24 14:52:53.140428 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:52:53.140407 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/529a8628-7402-461d-8e82-89ce4dcd47ee-service-ca\") pod \"console-89bf45b89-tm598\" (UID: \"529a8628-7402-461d-8e82-89ce4dcd47ee\") " pod="openshift-console/console-89bf45b89-tm598" Jul 24 14:52:53.140472 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:52:53.140447 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/529a8628-7402-461d-8e82-89ce4dcd47ee-console-config\") pod \"console-89bf45b89-tm598\" (UID: \"529a8628-7402-461d-8e82-89ce4dcd47ee\") " pod="openshift-console/console-89bf45b89-tm598" Jul 24 14:52:53.140622 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:52:53.140599 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/529a8628-7402-461d-8e82-89ce4dcd47ee-trusted-ca-bundle\") pod \"console-89bf45b89-tm598\" (UID: \"529a8628-7402-461d-8e82-89ce4dcd47ee\") " pod="openshift-console/console-89bf45b89-tm598" Jul 24 14:52:53.141820 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:52:53.141795 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/529a8628-7402-461d-8e82-89ce4dcd47ee-console-oauth-config\") pod \"console-89bf45b89-tm598\" (UID: \"529a8628-7402-461d-8e82-89ce4dcd47ee\") " pod="openshift-console/console-89bf45b89-tm598" Jul 24 14:52:53.142042 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:52:53.142021 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/529a8628-7402-461d-8e82-89ce4dcd47ee-console-serving-cert\") pod \"console-89bf45b89-tm598\" (UID: \"529a8628-7402-461d-8e82-89ce4dcd47ee\") " pod="openshift-console/console-89bf45b89-tm598" Jul 24 14:52:53.148099 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:52:53.148077 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxf65\" (UniqueName: \"kubernetes.io/projected/529a8628-7402-461d-8e82-89ce4dcd47ee-kube-api-access-kxf65\") pod \"console-89bf45b89-tm598\" (UID: \"529a8628-7402-461d-8e82-89ce4dcd47ee\") " pod="openshift-console/console-89bf45b89-tm598" Jul 24 14:52:53.264903 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:52:53.264846 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-89bf45b89-tm598" Jul 24 14:52:53.399568 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:52:53.399545 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-89bf45b89-tm598"] Jul 24 14:52:53.401231 ip-10-0-131-12 kubenswrapper[2581]: W0724 14:52:53.401193 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod529a8628_7402_461d_8e82_89ce4dcd47ee.slice/crio-10d432756a3886289e4df60118cbb2e88871c5e812163ad8789b7770df6868e0 WatchSource:0}: Error finding container 10d432756a3886289e4df60118cbb2e88871c5e812163ad8789b7770df6868e0: Status 404 returned error can't find the container with id 10d432756a3886289e4df60118cbb2e88871c5e812163ad8789b7770df6868e0 Jul 24 14:52:54.278562 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:52:54.278528 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-89bf45b89-tm598" event={"ID":"529a8628-7402-461d-8e82-89ce4dcd47ee","Type":"ContainerStarted","Data":"e50db4891c77d34d69ebae1a85018a5025152de5389d83e6169ed13017b978f2"} Jul 24 14:52:54.278921 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:52:54.278575 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-89bf45b89-tm598" event={"ID":"529a8628-7402-461d-8e82-89ce4dcd47ee","Type":"ContainerStarted","Data":"10d432756a3886289e4df60118cbb2e88871c5e812163ad8789b7770df6868e0"} Jul 24 14:52:54.301940 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:52:54.301894 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-89bf45b89-tm598" podStartSLOduration=2.301880354 podStartE2EDuration="2.301880354s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:52:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:52:54.300249913 +0000 UTC m=+1114.837505870" watchObservedRunningTime="2026-07-24 14:52:54.301880354 +0000 UTC m=+1114.839136305" Jul 24 14:52:54.791515 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:52:54.791478 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:53:03.266018 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:03.265939 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-89bf45b89-tm598" Jul 24 14:53:03.266018 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:03.265988 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-89bf45b89-tm598" Jul 24 14:53:03.270692 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:03.270668 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-89bf45b89-tm598" Jul 24 14:53:03.326691 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:03.326670 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-89bf45b89-tm598" Jul 24 14:53:03.377968 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:03.377941 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d98d99dd4-ndbmd"] Jul 24 14:53:04.095026 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:04.094991 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:53:28.399435 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:28.399374 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d98d99dd4-ndbmd" podUID="bb656059-871b-46f1-9101-71c446dd772f" containerName="console" containerID="cri-o://e2de4db949f945f946c1ad0bcfe0f0dd79670e57dc7ff67324a619308df837d6" gracePeriod=15 Jul 24 14:53:28.652086 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:28.652033 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d98d99dd4-ndbmd" Jul 24 14:53:28.823809 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:28.823780 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb656059-871b-46f1-9101-71c446dd772f-console-config\") pod \"bb656059-871b-46f1-9101-71c446dd772f\" (UID: \"bb656059-871b-46f1-9101-71c446dd772f\") " Jul 24 14:53:28.823974 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:28.823819 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb656059-871b-46f1-9101-71c446dd772f-console-serving-cert\") pod \"bb656059-871b-46f1-9101-71c446dd772f\" (UID: \"bb656059-871b-46f1-9101-71c446dd772f\") " Jul 24 14:53:28.823974 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:28.823860 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb656059-871b-46f1-9101-71c446dd772f-service-ca\") pod \"bb656059-871b-46f1-9101-71c446dd772f\" (UID: \"bb656059-871b-46f1-9101-71c446dd772f\") " Jul 24 14:53:28.823974 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:28.823886 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb656059-871b-46f1-9101-71c446dd772f-trusted-ca-bundle\") pod \"bb656059-871b-46f1-9101-71c446dd772f\" (UID: \"bb656059-871b-46f1-9101-71c446dd772f\") " Jul 24 14:53:28.823974 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:28.823908 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb656059-871b-46f1-9101-71c446dd772f-oauth-serving-cert\") pod \"bb656059-871b-46f1-9101-71c446dd772f\" (UID: \"bb656059-871b-46f1-9101-71c446dd772f\") " Jul 24 14:53:28.823974 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:28.823950 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb656059-871b-46f1-9101-71c446dd772f-console-oauth-config\") pod \"bb656059-871b-46f1-9101-71c446dd772f\" (UID: \"bb656059-871b-46f1-9101-71c446dd772f\") " Jul 24 14:53:28.824246 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:28.823976 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plz8t\" (UniqueName: \"kubernetes.io/projected/bb656059-871b-46f1-9101-71c446dd772f-kube-api-access-plz8t\") pod \"bb656059-871b-46f1-9101-71c446dd772f\" (UID: \"bb656059-871b-46f1-9101-71c446dd772f\") " Jul 24 14:53:28.824246 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:28.824130 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb656059-871b-46f1-9101-71c446dd772f-console-config" (OuterVolumeSpecName: "console-config") pod "bb656059-871b-46f1-9101-71c446dd772f" (UID: "bb656059-871b-46f1-9101-71c446dd772f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:53:28.824326 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:28.824312 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb656059-871b-46f1-9101-71c446dd772f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bb656059-871b-46f1-9101-71c446dd772f" (UID: "bb656059-871b-46f1-9101-71c446dd772f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:53:28.824367 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:28.824323 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb656059-871b-46f1-9101-71c446dd772f-console-config\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:53:28.824367 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:28.824324 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb656059-871b-46f1-9101-71c446dd772f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bb656059-871b-46f1-9101-71c446dd772f" (UID: "bb656059-871b-46f1-9101-71c446dd772f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:53:28.824579 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:28.824556 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb656059-871b-46f1-9101-71c446dd772f-service-ca" (OuterVolumeSpecName: "service-ca") pod "bb656059-871b-46f1-9101-71c446dd772f" (UID: "bb656059-871b-46f1-9101-71c446dd772f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 14:53:28.826177 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:28.826131 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb656059-871b-46f1-9101-71c446dd772f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bb656059-871b-46f1-9101-71c446dd772f" (UID: "bb656059-871b-46f1-9101-71c446dd772f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:53:28.826271 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:28.826181 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb656059-871b-46f1-9101-71c446dd772f-kube-api-access-plz8t" (OuterVolumeSpecName: "kube-api-access-plz8t") pod "bb656059-871b-46f1-9101-71c446dd772f" (UID: "bb656059-871b-46f1-9101-71c446dd772f"). InnerVolumeSpecName "kube-api-access-plz8t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 14:53:28.826271 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:28.826227 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb656059-871b-46f1-9101-71c446dd772f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bb656059-871b-46f1-9101-71c446dd772f" (UID: "bb656059-871b-46f1-9101-71c446dd772f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 14:53:28.924766 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:28.924705 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb656059-871b-46f1-9101-71c446dd772f-service-ca\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:53:28.924766 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:28.924725 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb656059-871b-46f1-9101-71c446dd772f-trusted-ca-bundle\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:53:28.924766 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:28.924735 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb656059-871b-46f1-9101-71c446dd772f-oauth-serving-cert\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:53:28.924766 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:28.924744 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb656059-871b-46f1-9101-71c446dd772f-console-oauth-config\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:53:28.924766 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:28.924753 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plz8t\" (UniqueName: \"kubernetes.io/projected/bb656059-871b-46f1-9101-71c446dd772f-kube-api-access-plz8t\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:53:28.924766 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:28.924762 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb656059-871b-46f1-9101-71c446dd772f-console-serving-cert\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 14:53:29.449809 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:29.449773 2581 generic.go:356] "Generic (PLEG): container finished" podID="bb656059-871b-46f1-9101-71c446dd772f" containerID="e2de4db949f945f946c1ad0bcfe0f0dd79670e57dc7ff67324a619308df837d6" exitCode=0 Jul 24 14:53:29.450273 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:29.449819 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d98d99dd4-ndbmd" Jul 24 14:53:29.450273 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:29.449857 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d98d99dd4-ndbmd" event={"ID":"bb656059-871b-46f1-9101-71c446dd772f","Type":"ContainerDied","Data":"e2de4db949f945f946c1ad0bcfe0f0dd79670e57dc7ff67324a619308df837d6"} Jul 24 14:53:29.450273 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:29.449911 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d98d99dd4-ndbmd" event={"ID":"bb656059-871b-46f1-9101-71c446dd772f","Type":"ContainerDied","Data":"1c8cb73f7b5e0264fe7de32d8cb96d8536349231b9d7ae18982a34b9e9b85e59"} Jul 24 14:53:29.450273 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:29.449935 2581 scope.go:117] "RemoveContainer" containerID="e2de4db949f945f946c1ad0bcfe0f0dd79670e57dc7ff67324a619308df837d6" Jul 24 14:53:29.459868 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:29.459853 2581 scope.go:117] "RemoveContainer" containerID="e2de4db949f945f946c1ad0bcfe0f0dd79670e57dc7ff67324a619308df837d6" Jul 24 14:53:29.460123 ip-10-0-131-12 kubenswrapper[2581]: E0724 14:53:29.460103 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2de4db949f945f946c1ad0bcfe0f0dd79670e57dc7ff67324a619308df837d6\": container with ID starting with e2de4db949f945f946c1ad0bcfe0f0dd79670e57dc7ff67324a619308df837d6 not found: ID does not exist" containerID="e2de4db949f945f946c1ad0bcfe0f0dd79670e57dc7ff67324a619308df837d6" Jul 24 14:53:29.460209 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:29.460135 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2de4db949f945f946c1ad0bcfe0f0dd79670e57dc7ff67324a619308df837d6"} err="failed to get container status \"e2de4db949f945f946c1ad0bcfe0f0dd79670e57dc7ff67324a619308df837d6\": rpc error: code = NotFound desc = could not find container \"e2de4db949f945f946c1ad0bcfe0f0dd79670e57dc7ff67324a619308df837d6\": container with ID starting with e2de4db949f945f946c1ad0bcfe0f0dd79670e57dc7ff67324a619308df837d6 not found: ID does not exist" Jul 24 14:53:29.473195 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:29.473173 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d98d99dd4-ndbmd"] Jul 24 14:53:29.476739 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:29.476718 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d98d99dd4-ndbmd"] Jul 24 14:53:30.112907 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:53:30.112879 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb656059-871b-46f1-9101-71c446dd772f" path="/var/lib/kubelet/pods/bb656059-871b-46f1-9101-71c446dd772f/volumes" Jul 24 14:54:51.724611 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:54:51.724578 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:55:00.191028 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:55:00.190995 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:55:12.747043 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:55:12.746969 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:55:26.808611 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:55:26.808576 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:55:35.894222 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:55:35.894181 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:55:46.594669 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:55:46.594632 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:55:55.899994 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:55:55.899957 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:56:05.896763 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:56:05.896726 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:56:16.794544 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:56:16.794507 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:56:27.051300 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:56:27.051260 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:56:37.292330 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:56:37.292293 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:56:59.413240 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:56:59.413142 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:57:08.803958 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:57:08.803921 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:57:21.797220 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:57:21.797177 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:57:47.701625 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:57:47.701587 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:58:00.923236 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:58:00.923204 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:58:09.998065 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:58:09.998031 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:58:20.004327 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:58:19.998717 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:58:31.387438 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:58:31.387399 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:58:40.694887 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:58:40.694852 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:58:50.593026 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:58:50.592987 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:58:59.695539 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:58:59.695499 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:59:08.794240 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:59:08.794207 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:59:21.603709 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:59:21.603674 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:59:31.591887 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:59:31.591857 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:59:42.705550 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:59:42.705472 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 14:59:51.599033 ip-10-0-131-12 kubenswrapper[2581]: I0724 14:59:51.599001 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 15:00:00.151491 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:00:00.151456 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748420-zl54h"] Jul 24 15:00:00.153735 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:00:00.151795 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb656059-871b-46f1-9101-71c446dd772f" containerName="console" Jul 24 15:00:00.153735 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:00:00.151806 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb656059-871b-46f1-9101-71c446dd772f" containerName="console" Jul 24 15:00:00.153735 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:00:00.151867 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb656059-871b-46f1-9101-71c446dd772f" containerName="console" Jul 24 15:00:00.154678 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:00:00.154663 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748420-zl54h" Jul 24 15:00:00.157376 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:00:00.157350 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-g4jrf\"" Jul 24 15:00:00.163748 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:00:00.163733 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748420-zl54h" Jul 24 15:00:00.175273 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:00:00.175251 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748420-zl54h"] Jul 24 15:00:00.295945 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:00:00.295919 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748420-zl54h"] Jul 24 15:00:00.297687 ip-10-0-131-12 kubenswrapper[2581]: W0724 15:00:00.297662 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod552be55e_a7fe_449f_9724_2d819f8b9378.slice/crio-aa1a65999415254b3e0089ad9e988def5c609655627db9b4207cc1e08363bcd2 WatchSource:0}: Error finding container aa1a65999415254b3e0089ad9e988def5c609655627db9b4207cc1e08363bcd2: Status 404 returned error can't find the container with id aa1a65999415254b3e0089ad9e988def5c609655627db9b4207cc1e08363bcd2 Jul 24 15:00:00.299427 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:00:00.299410 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 15:00:00.399184 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:00:00.399147 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748420-zl54h" event={"ID":"552be55e-a7fe-449f-9724-2d819f8b9378","Type":"ContainerStarted","Data":"aa1a65999415254b3e0089ad9e988def5c609655627db9b4207cc1e08363bcd2"} Jul 24 15:00:00.503866 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:00:00.503802 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 15:00:03.419144 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:00:03.419106 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748420-zl54h" event={"ID":"552be55e-a7fe-449f-9724-2d819f8b9378","Type":"ContainerStarted","Data":"e029e81912775a037ef8f2d82d37d69264a7b8ef51fca2edfc85558dd5f51fb8"} Jul 24 15:00:03.438344 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:00:03.438289 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748420-zl54h" podStartSLOduration=1.145437769 podStartE2EDuration="3.438272148s" totalImagesPullingTime="2.292834379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:00:03.436819465 +0000 UTC m=+1543.974075417" watchObservedRunningTime="2026-07-24 15:00:03.438272148 +0000 UTC m=+1543.975528100" Jul 24 15:00:04.425950 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:00:04.425921 2581 generic.go:356] "Generic (PLEG): container finished" podID="552be55e-a7fe-449f-9724-2d819f8b9378" containerID="e029e81912775a037ef8f2d82d37d69264a7b8ef51fca2edfc85558dd5f51fb8" exitCode=0 Jul 24 15:00:04.426408 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:00:04.426019 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748420-zl54h" event={"ID":"552be55e-a7fe-449f-9724-2d819f8b9378","Type":"ContainerDied","Data":"e029e81912775a037ef8f2d82d37d69264a7b8ef51fca2edfc85558dd5f51fb8"} Jul 24 15:00:05.561034 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:00:05.561011 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748420-zl54h" Jul 24 15:00:06.437397 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:00:06.437311 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748420-zl54h" event={"ID":"552be55e-a7fe-449f-9724-2d819f8b9378","Type":"ContainerDied","Data":"aa1a65999415254b3e0089ad9e988def5c609655627db9b4207cc1e08363bcd2"} Jul 24 15:00:06.437397 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:00:06.437330 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748420-zl54h" Jul 24 15:00:06.437397 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:00:06.437363 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa1a65999415254b3e0089ad9e988def5c609655627db9b4207cc1e08363bcd2" Jul 24 15:00:12.487910 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:00:12.487877 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 15:00:26.696805 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:00:26.696776 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 15:00:39.496822 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:00:39.496791 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 15:00:51.829919 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:00:51.829885 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 15:01:01.517185 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:01:01.517135 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 15:01:14.101677 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:01:14.101589 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 15:01:22.698218 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:01:22.698175 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 15:01:40.700170 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:01:40.700128 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 15:01:58.376526 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:01:58.376494 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ee2b828d-f6qf2"] Jul 24 15:01:58.376996 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:01:58.376832 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="552be55e-a7fe-449f-9724-2d819f8b9378" containerName="cleanup" Jul 24 15:01:58.376996 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:01:58.376842 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="552be55e-a7fe-449f-9724-2d819f8b9378" containerName="cleanup" Jul 24 15:01:58.376996 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:01:58.376905 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="552be55e-a7fe-449f-9724-2d819f8b9378" containerName="cleanup" Jul 24 15:01:58.379761 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:01:58.379747 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ee2b828d-f6qf2" Jul 24 15:01:58.385552 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:01:58.385513 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 24 15:01:58.386734 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:01:58.386711 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-g4jrf\"" Jul 24 15:01:58.388904 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:01:58.388885 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7958d6c7-ccf1-443f-b9f5-e34705f0a90c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ee2b828d-f6qf2\" (UID: \"7958d6c7-ccf1-443f-b9f5-e34705f0a90c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ee2b828d-f6qf2" Jul 24 15:01:58.398516 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:01:58.398492 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ee2b828d-f6qf2"] Jul 24 15:01:58.490075 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:01:58.490053 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7958d6c7-ccf1-443f-b9f5-e34705f0a90c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ee2b828d-f6qf2\" (UID: \"7958d6c7-ccf1-443f-b9f5-e34705f0a90c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ee2b828d-f6qf2" Jul 24 15:01:58.490616 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:01:58.490599 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7958d6c7-ccf1-443f-b9f5-e34705f0a90c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ee2b828d-f6qf2\" (UID: \"7958d6c7-ccf1-443f-b9f5-e34705f0a90c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ee2b828d-f6qf2" Jul 24 15:01:58.689564 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:01:58.689503 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ee2b828d-f6qf2" Jul 24 15:01:58.818965 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:01:58.818945 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ee2b828d-f6qf2"] Jul 24 15:01:58.820833 ip-10-0-131-12 kubenswrapper[2581]: W0724 15:01:58.820808 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7958d6c7_ccf1_443f_b9f5_e34705f0a90c.slice/crio-e00e052dece8b77085201a0ccc08c94d53e4799560cc7a340e24588232809828 WatchSource:0}: Error finding container e00e052dece8b77085201a0ccc08c94d53e4799560cc7a340e24588232809828: Status 404 returned error can't find the container with id e00e052dece8b77085201a0ccc08c94d53e4799560cc7a340e24588232809828 Jul 24 15:01:59.009566 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:01:59.009506 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ee2b828d-f6qf2" event={"ID":"7958d6c7-ccf1-443f-b9f5-e34705f0a90c","Type":"ContainerStarted","Data":"e00e052dece8b77085201a0ccc08c94d53e4799560cc7a340e24588232809828"} Jul 24 15:02:00.018089 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:00.018054 2581 generic.go:356] "Generic (PLEG): container finished" podID="7958d6c7-ccf1-443f-b9f5-e34705f0a90c" containerID="a35271d9106ed861975a31fcce2a656a1a5d0241c6550517c87254828f290261" exitCode=0 Jul 24 15:02:00.018519 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:00.018146 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ee2b828d-f6qf2" event={"ID":"7958d6c7-ccf1-443f-b9f5-e34705f0a90c","Type":"ContainerDied","Data":"a35271d9106ed861975a31fcce2a656a1a5d0241c6550517c87254828f290261"} Jul 24 15:02:01.148126 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:01.148101 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ee2b828d-f6qf2" Jul 24 15:02:01.212912 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:01.212885 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7958d6c7-ccf1-443f-b9f5-e34705f0a90c-maas-api-service-ca\") pod \"7958d6c7-ccf1-443f-b9f5-e34705f0a90c\" (UID: \"7958d6c7-ccf1-443f-b9f5-e34705f0a90c\") " Jul 24 15:02:01.213272 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:01.213253 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7958d6c7-ccf1-443f-b9f5-e34705f0a90c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7958d6c7-ccf1-443f-b9f5-e34705f0a90c" (UID: "7958d6c7-ccf1-443f-b9f5-e34705f0a90c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:02:01.313492 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:01.313469 2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7958d6c7-ccf1-443f-b9f5-e34705f0a90c-maas-api-service-ca\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 15:02:02.031522 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:02.031494 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ee2b828d-f6qf2" Jul 24 15:02:02.031694 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:02.031533 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ee2b828d-f6qf2" event={"ID":"7958d6c7-ccf1-443f-b9f5-e34705f0a90c","Type":"ContainerDied","Data":"e00e052dece8b77085201a0ccc08c94d53e4799560cc7a340e24588232809828"} Jul 24 15:02:02.031694 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:02.031584 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e00e052dece8b77085201a0ccc08c94d53e4799560cc7a340e24588232809828" Jul 24 15:02:11.896445 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:11.896400 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 15:02:13.535072 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:13.535036 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ee2b828d-f6qf2"] Jul 24 15:02:13.545493 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:13.545467 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ee2b828d-f6qf2"] Jul 24 15:02:14.111512 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:14.111475 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7958d6c7-ccf1-443f-b9f5-e34705f0a90c" path="/var/lib/kubelet/pods/7958d6c7-ccf1-443f-b9f5-e34705f0a90c/volumes" Jul 24 15:02:14.988956 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:14.988915 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6"] Jul 24 15:02:14.989447 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:14.989290 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7958d6c7-ccf1-443f-b9f5-e34705f0a90c" containerName="revoke-keys" Jul 24 15:02:14.989447 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:14.989302 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7958d6c7-ccf1-443f-b9f5-e34705f0a90c" containerName="revoke-keys" Jul 24 15:02:14.989447 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:14.989356 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7958d6c7-ccf1-443f-b9f5-e34705f0a90c" containerName="revoke-keys" Jul 24 15:02:14.992621 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:14.992603 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:14.996213 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:14.996197 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-47d0d404-gw-openshift-default-dockercfg-pxjs4\"" Jul 24 15:02:15.016218 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:15.016195 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6"] Jul 24 15:02:15.121552 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:15.121524 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee97830f-749b-4201-82a7-ff5fac07ec5f-istio-token\") pod \"e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6\" (UID: \"ee97830f-749b-4201-82a7-ff5fac07ec5f\") " pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:15.121729 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:15.121558 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee97830f-749b-4201-82a7-ff5fac07ec5f-istio-podinfo\") pod \"e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6\" (UID: \"ee97830f-749b-4201-82a7-ff5fac07ec5f\") " pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:15.121729 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:15.121581 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee97830f-749b-4201-82a7-ff5fac07ec5f-workload-socket\") pod \"e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6\" (UID: \"ee97830f-749b-4201-82a7-ff5fac07ec5f\") " pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:15.121729 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:15.121599 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee97830f-749b-4201-82a7-ff5fac07ec5f-istio-envoy\") pod \"e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6\" (UID: \"ee97830f-749b-4201-82a7-ff5fac07ec5f\") " pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:15.121729 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:15.121680 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7lt8\" (UniqueName: \"kubernetes.io/projected/ee97830f-749b-4201-82a7-ff5fac07ec5f-kube-api-access-v7lt8\") pod \"e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6\" (UID: \"ee97830f-749b-4201-82a7-ff5fac07ec5f\") " pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:15.121729 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:15.121718 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee97830f-749b-4201-82a7-ff5fac07ec5f-credential-socket\") pod \"e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6\" (UID: \"ee97830f-749b-4201-82a7-ff5fac07ec5f\") " pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:15.121921 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:15.121764 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee97830f-749b-4201-82a7-ff5fac07ec5f-istio-data\") pod \"e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6\" (UID: \"ee97830f-749b-4201-82a7-ff5fac07ec5f\") " pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:15.121921 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:15.121787 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee97830f-749b-4201-82a7-ff5fac07ec5f-istiod-ca-cert\") pod \"e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6\" (UID: \"ee97830f-749b-4201-82a7-ff5fac07ec5f\") " pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:15.121921 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:15.121853 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee97830f-749b-4201-82a7-ff5fac07ec5f-workload-certs\") pod \"e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6\" (UID: \"ee97830f-749b-4201-82a7-ff5fac07ec5f\") " pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:15.223191 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:15.223145 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee97830f-749b-4201-82a7-ff5fac07ec5f-istio-podinfo\") pod \"e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6\" (UID: \"ee97830f-749b-4201-82a7-ff5fac07ec5f\") " pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:15.223311 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:15.223199 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee97830f-749b-4201-82a7-ff5fac07ec5f-workload-socket\") pod \"e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6\" (UID: \"ee97830f-749b-4201-82a7-ff5fac07ec5f\") " pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:15.223311 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:15.223231 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee97830f-749b-4201-82a7-ff5fac07ec5f-istio-envoy\") pod \"e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6\" (UID: \"ee97830f-749b-4201-82a7-ff5fac07ec5f\") " pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:15.223311 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:15.223267 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7lt8\" (UniqueName: \"kubernetes.io/projected/ee97830f-749b-4201-82a7-ff5fac07ec5f-kube-api-access-v7lt8\") pod \"e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6\" (UID: \"ee97830f-749b-4201-82a7-ff5fac07ec5f\") " pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:15.223311 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:15.223296 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee97830f-749b-4201-82a7-ff5fac07ec5f-credential-socket\") pod \"e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6\" (UID: \"ee97830f-749b-4201-82a7-ff5fac07ec5f\") " pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:15.223480 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:15.223321 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee97830f-749b-4201-82a7-ff5fac07ec5f-istio-data\") pod \"e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6\" (UID: \"ee97830f-749b-4201-82a7-ff5fac07ec5f\") " pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:15.223540 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:15.223467 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee97830f-749b-4201-82a7-ff5fac07ec5f-istiod-ca-cert\") pod \"e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6\" (UID: \"ee97830f-749b-4201-82a7-ff5fac07ec5f\") " pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:15.223592 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:15.223567 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee97830f-749b-4201-82a7-ff5fac07ec5f-workload-certs\") pod \"e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6\" (UID: \"ee97830f-749b-4201-82a7-ff5fac07ec5f\") " pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:15.223645 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:15.223629 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee97830f-749b-4201-82a7-ff5fac07ec5f-istio-token\") pod \"e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6\" (UID: \"ee97830f-749b-4201-82a7-ff5fac07ec5f\") " pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:15.223701 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:15.223651 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee97830f-749b-4201-82a7-ff5fac07ec5f-workload-socket\") pod \"e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6\" (UID: \"ee97830f-749b-4201-82a7-ff5fac07ec5f\") " pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:15.223758 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:15.223720 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee97830f-749b-4201-82a7-ff5fac07ec5f-credential-socket\") pod \"e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6\" (UID: \"ee97830f-749b-4201-82a7-ff5fac07ec5f\") " pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:15.223813 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:15.223770 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee97830f-749b-4201-82a7-ff5fac07ec5f-istio-data\") pod \"e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6\" (UID: \"ee97830f-749b-4201-82a7-ff5fac07ec5f\") " pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:15.223946 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:15.223919 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee97830f-749b-4201-82a7-ff5fac07ec5f-workload-certs\") pod \"e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6\" (UID: \"ee97830f-749b-4201-82a7-ff5fac07ec5f\") " pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:15.224620 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:15.224139 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee97830f-749b-4201-82a7-ff5fac07ec5f-istiod-ca-cert\") pod \"e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6\" (UID: \"ee97830f-749b-4201-82a7-ff5fac07ec5f\") " pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:15.225973 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:15.225949 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee97830f-749b-4201-82a7-ff5fac07ec5f-istio-envoy\") pod \"e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6\" (UID: \"ee97830f-749b-4201-82a7-ff5fac07ec5f\") " pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:15.226227 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:15.226193 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee97830f-749b-4201-82a7-ff5fac07ec5f-istio-podinfo\") pod \"e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6\" (UID: \"ee97830f-749b-4201-82a7-ff5fac07ec5f\") " pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:15.237761 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:15.237737 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7lt8\" (UniqueName: \"kubernetes.io/projected/ee97830f-749b-4201-82a7-ff5fac07ec5f-kube-api-access-v7lt8\") pod \"e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6\" (UID: \"ee97830f-749b-4201-82a7-ff5fac07ec5f\") " pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:15.238206 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:15.238188 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee97830f-749b-4201-82a7-ff5fac07ec5f-istio-token\") pod \"e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6\" (UID: \"ee97830f-749b-4201-82a7-ff5fac07ec5f\") " pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:15.302561 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:15.302538 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:15.446065 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:15.446038 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6"] Jul 24 15:02:15.447182 ip-10-0-131-12 kubenswrapper[2581]: W0724 15:02:15.447135 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee97830f_749b_4201_82a7_ff5fac07ec5f.slice/crio-9c2acbb1e4a803d3bfa395fdb860befb7c5cfc5d915d842fee843b294b2210c5 WatchSource:0}: Error finding container 9c2acbb1e4a803d3bfa395fdb860befb7c5cfc5d915d842fee843b294b2210c5: Status 404 returned error can't find the container with id 9c2acbb1e4a803d3bfa395fdb860befb7c5cfc5d915d842fee843b294b2210c5 Jul 24 15:02:15.449289 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:15.449261 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 24 15:02:15.449349 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:15.449326 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 24 15:02:15.449387 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:15.449356 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 24 15:02:16.106198 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:16.106140 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" event={"ID":"ee97830f-749b-4201-82a7-ff5fac07ec5f","Type":"ContainerStarted","Data":"cc3caf89bebb5d15ff74d7e1fb39f713b28c22cde7d33542a9747dcfdae0cf41"} Jul 24 15:02:16.106680 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:16.106219 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" event={"ID":"ee97830f-749b-4201-82a7-ff5fac07ec5f","Type":"ContainerStarted","Data":"9c2acbb1e4a803d3bfa395fdb860befb7c5cfc5d915d842fee843b294b2210c5"} Jul 24 15:02:16.137255 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:16.137203 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" podStartSLOduration=2.137188529 podStartE2EDuration="2.137188529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:02:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:02:16.134464086 +0000 UTC m=+1676.671720040" watchObservedRunningTime="2026-07-24 15:02:16.137188529 +0000 UTC m=+1676.674444459" Jul 24 15:02:16.302858 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:16.302832 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:16.307508 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:16.307487 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:17.111588 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:17.111547 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:17.112526 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:17.112504 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:24.908646 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:24.908608 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 15:02:32.739634 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:32.739583 2581 patch_prober.go:28] interesting pod/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": read tcp 10.133.0.2:54310->10.133.0.41:15021: read: connection reset by peer" start-of-body= Jul 24 15:02:32.740042 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:32.739672 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" podUID="ee97830f-749b-4201-82a7-ff5fac07ec5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": read tcp 10.133.0.2:54310->10.133.0.41:15021: read: connection reset by peer" Jul 24 15:02:33.201707 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:33.201676 2581 generic.go:356] "Generic (PLEG): container finished" podID="ee97830f-749b-4201-82a7-ff5fac07ec5f" containerID="cc3caf89bebb5d15ff74d7e1fb39f713b28c22cde7d33542a9747dcfdae0cf41" exitCode=0 Jul 24 15:02:33.201868 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:33.201751 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" event={"ID":"ee97830f-749b-4201-82a7-ff5fac07ec5f","Type":"ContainerDied","Data":"cc3caf89bebb5d15ff74d7e1fb39f713b28c22cde7d33542a9747dcfdae0cf41"} Jul 24 15:02:33.202106 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:33.202093 2581 scope.go:117] "RemoveContainer" containerID="cc3caf89bebb5d15ff74d7e1fb39f713b28c22cde7d33542a9747dcfdae0cf41" Jul 24 15:02:33.203067 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:33.203045 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 24 15:02:33.203120 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:33.203108 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 24 15:02:33.203174 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:33.203137 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 24 15:02:34.208766 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:34.208732 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" event={"ID":"ee97830f-749b-4201-82a7-ff5fac07ec5f","Type":"ContainerStarted","Data":"5ab972ac250af0d19b838c4eee49a904198fb957a929c0d8a694723dab90206c"} Jul 24 15:02:34.303362 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:34.303332 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:34.303559 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:34.303537 2581 patch_prober.go:28] interesting pod/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 24 15:02:34.303604 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:34.303581 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" podUID="ee97830f-749b-4201-82a7-ff5fac07ec5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 24 15:02:35.303596 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:35.303565 2581 patch_prober.go:28] interesting pod/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 24 15:02:35.303998 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:35.303618 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" podUID="ee97830f-749b-4201-82a7-ff5fac07ec5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 24 15:02:36.303734 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:36.303701 2581 patch_prober.go:28] interesting pod/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 24 15:02:36.304129 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:36.303755 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" podUID="ee97830f-749b-4201-82a7-ff5fac07ec5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 24 15:02:37.302848 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:37.302813 2581 patch_prober.go:28] interesting pod/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 24 15:02:37.303021 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:37.302867 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" podUID="ee97830f-749b-4201-82a7-ff5fac07ec5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 24 15:02:38.306967 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:38.306939 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:38.307406 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:38.307265 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:38.307996 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:38.307981 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:02:42.796175 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:42.796075 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-47d0d404-6xd5k"] Jul 24 15:02:42.799196 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:42.799178 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-47d0d404-6xd5k" Jul 24 15:02:42.802901 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:42.802882 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 24 15:02:42.803799 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:42.803781 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-g4jrf\"" Jul 24 15:02:42.812011 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:42.811989 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-47d0d404-6xd5k"] Jul 24 15:02:42.963319 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:42.963288 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab6744c1-31f7-4eec-a52d-ea3f7ce821ad-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-47d0d404-6xd5k\" (UID: \"ab6744c1-31f7-4eec-a52d-ea3f7ce821ad\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-47d0d404-6xd5k" Jul 24 15:02:43.064048 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:43.063983 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab6744c1-31f7-4eec-a52d-ea3f7ce821ad-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-47d0d404-6xd5k\" (UID: \"ab6744c1-31f7-4eec-a52d-ea3f7ce821ad\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-47d0d404-6xd5k" Jul 24 15:02:43.064582 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:43.064562 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab6744c1-31f7-4eec-a52d-ea3f7ce821ad-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-47d0d404-6xd5k\" (UID: \"ab6744c1-31f7-4eec-a52d-ea3f7ce821ad\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-47d0d404-6xd5k" Jul 24 15:02:43.109532 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:43.109509 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-47d0d404-6xd5k" Jul 24 15:02:43.244144 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:43.244120 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-47d0d404-6xd5k"] Jul 24 15:02:43.245374 ip-10-0-131-12 kubenswrapper[2581]: W0724 15:02:43.245349 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab6744c1_31f7_4eec_a52d_ea3f7ce821ad.slice/crio-eac13e330a63bc3654f0baf7a8f24cd6dec77b8fd210600ec1f3ddb9a66b58ac WatchSource:0}: Error finding container eac13e330a63bc3654f0baf7a8f24cd6dec77b8fd210600ec1f3ddb9a66b58ac: Status 404 returned error can't find the container with id eac13e330a63bc3654f0baf7a8f24cd6dec77b8fd210600ec1f3ddb9a66b58ac Jul 24 15:02:43.258705 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:43.258682 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-47d0d404-6xd5k" event={"ID":"ab6744c1-31f7-4eec-a52d-ea3f7ce821ad","Type":"ContainerStarted","Data":"eac13e330a63bc3654f0baf7a8f24cd6dec77b8fd210600ec1f3ddb9a66b58ac"} Jul 24 15:02:44.264945 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:44.264867 2581 generic.go:356] "Generic (PLEG): container finished" podID="ab6744c1-31f7-4eec-a52d-ea3f7ce821ad" containerID="2551a2ce4a4ad9286ea5b27366f9e55833727d9c66d472e24ca53ea15dda99df" exitCode=0 Jul 24 15:02:44.265350 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:44.264952 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-47d0d404-6xd5k" event={"ID":"ab6744c1-31f7-4eec-a52d-ea3f7ce821ad","Type":"ContainerDied","Data":"2551a2ce4a4ad9286ea5b27366f9e55833727d9c66d472e24ca53ea15dda99df"} Jul 24 15:02:45.397496 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:45.397471 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-47d0d404-6xd5k" Jul 24 15:02:45.585333 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:45.585308 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab6744c1-31f7-4eec-a52d-ea3f7ce821ad-maas-api-service-ca\") pod \"ab6744c1-31f7-4eec-a52d-ea3f7ce821ad\" (UID: \"ab6744c1-31f7-4eec-a52d-ea3f7ce821ad\") " Jul 24 15:02:45.585654 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:45.585639 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab6744c1-31f7-4eec-a52d-ea3f7ce821ad-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ab6744c1-31f7-4eec-a52d-ea3f7ce821ad" (UID: "ab6744c1-31f7-4eec-a52d-ea3f7ce821ad"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:02:45.686553 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:45.686531 2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab6744c1-31f7-4eec-a52d-ea3f7ce821ad-maas-api-service-ca\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 15:02:46.276720 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:46.276689 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-47d0d404-6xd5k" event={"ID":"ab6744c1-31f7-4eec-a52d-ea3f7ce821ad","Type":"ContainerDied","Data":"eac13e330a63bc3654f0baf7a8f24cd6dec77b8fd210600ec1f3ddb9a66b58ac"} Jul 24 15:02:46.276720 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:46.276714 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-47d0d404-6xd5k" Jul 24 15:02:46.276900 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:46.276734 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eac13e330a63bc3654f0baf7a8f24cd6dec77b8fd210600ec1f3ddb9a66b58ac" Jul 24 15:02:56.274035 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:56.273992 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 15:02:58.031474 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:58.031426 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-47d0d404-6xd5k"] Jul 24 15:02:58.038847 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:58.038809 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-47d0d404-6xd5k"] Jul 24 15:02:58.113009 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:58.112962 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab6744c1-31f7-4eec-a52d-ea3f7ce821ad" path="/var/lib/kubelet/pods/ab6744c1-31f7-4eec-a52d-ea3f7ce821ad/volumes" Jul 24 15:02:58.200403 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:58.200374 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6"] Jul 24 15:02:58.200635 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:02:58.200588 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" podUID="ee97830f-749b-4201-82a7-ff5fac07ec5f" containerName="istio-proxy" containerID="cri-o://5ab972ac250af0d19b838c4eee49a904198fb957a929c0d8a694723dab90206c" gracePeriod=30 Jul 24 15:03:03.365604 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:03.365574 2581 generic.go:356] "Generic (PLEG): container finished" podID="ee97830f-749b-4201-82a7-ff5fac07ec5f" containerID="5ab972ac250af0d19b838c4eee49a904198fb957a929c0d8a694723dab90206c" exitCode=0 Jul 24 15:03:03.366022 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:03.365614 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" event={"ID":"ee97830f-749b-4201-82a7-ff5fac07ec5f","Type":"ContainerDied","Data":"5ab972ac250af0d19b838c4eee49a904198fb957a929c0d8a694723dab90206c"} Jul 24 15:03:03.366022 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:03.365674 2581 scope.go:117] "RemoveContainer" containerID="cc3caf89bebb5d15ff74d7e1fb39f713b28c22cde7d33542a9747dcfdae0cf41" Jul 24 15:03:03.456064 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:03.456039 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:03:03.537619 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:03.537595 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7lt8\" (UniqueName: \"kubernetes.io/projected/ee97830f-749b-4201-82a7-ff5fac07ec5f-kube-api-access-v7lt8\") pod \"ee97830f-749b-4201-82a7-ff5fac07ec5f\" (UID: \"ee97830f-749b-4201-82a7-ff5fac07ec5f\") " Jul 24 15:03:03.537751 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:03.537626 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee97830f-749b-4201-82a7-ff5fac07ec5f-workload-certs\") pod \"ee97830f-749b-4201-82a7-ff5fac07ec5f\" (UID: \"ee97830f-749b-4201-82a7-ff5fac07ec5f\") " Jul 24 15:03:03.537751 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:03.537651 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee97830f-749b-4201-82a7-ff5fac07ec5f-istio-podinfo\") pod \"ee97830f-749b-4201-82a7-ff5fac07ec5f\" (UID: \"ee97830f-749b-4201-82a7-ff5fac07ec5f\") " Jul 24 15:03:03.537751 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:03.537667 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee97830f-749b-4201-82a7-ff5fac07ec5f-istio-data\") pod \"ee97830f-749b-4201-82a7-ff5fac07ec5f\" (UID: \"ee97830f-749b-4201-82a7-ff5fac07ec5f\") " Jul 24 15:03:03.537924 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:03.537744 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee97830f-749b-4201-82a7-ff5fac07ec5f-istiod-ca-cert\") pod \"ee97830f-749b-4201-82a7-ff5fac07ec5f\" (UID: \"ee97830f-749b-4201-82a7-ff5fac07ec5f\") " Jul 24 15:03:03.537924 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:03.537817 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee97830f-749b-4201-82a7-ff5fac07ec5f-istio-token\") pod \"ee97830f-749b-4201-82a7-ff5fac07ec5f\" (UID: \"ee97830f-749b-4201-82a7-ff5fac07ec5f\") " Jul 24 15:03:03.537924 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:03.537871 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee97830f-749b-4201-82a7-ff5fac07ec5f-istio-envoy\") pod \"ee97830f-749b-4201-82a7-ff5fac07ec5f\" (UID: \"ee97830f-749b-4201-82a7-ff5fac07ec5f\") " Jul 24 15:03:03.537924 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:03.537902 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee97830f-749b-4201-82a7-ff5fac07ec5f-workload-socket\") pod \"ee97830f-749b-4201-82a7-ff5fac07ec5f\" (UID: \"ee97830f-749b-4201-82a7-ff5fac07ec5f\") " Jul 24 15:03:03.538115 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:03.537928 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee97830f-749b-4201-82a7-ff5fac07ec5f-credential-socket\") pod \"ee97830f-749b-4201-82a7-ff5fac07ec5f\" (UID: \"ee97830f-749b-4201-82a7-ff5fac07ec5f\") " Jul 24 15:03:03.538115 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:03.538085 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee97830f-749b-4201-82a7-ff5fac07ec5f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ee97830f-749b-4201-82a7-ff5fac07ec5f" (UID: "ee97830f-749b-4201-82a7-ff5fac07ec5f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:03:03.538284 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:03.538210 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee97830f-749b-4201-82a7-ff5fac07ec5f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ee97830f-749b-4201-82a7-ff5fac07ec5f" (UID: "ee97830f-749b-4201-82a7-ff5fac07ec5f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:03:03.538341 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:03.538288 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee97830f-749b-4201-82a7-ff5fac07ec5f-istiod-ca-cert\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 15:03:03.538404 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:03.538332 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee97830f-749b-4201-82a7-ff5fac07ec5f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ee97830f-749b-4201-82a7-ff5fac07ec5f" (UID: "ee97830f-749b-4201-82a7-ff5fac07ec5f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:03:03.538492 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:03.538469 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee97830f-749b-4201-82a7-ff5fac07ec5f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ee97830f-749b-4201-82a7-ff5fac07ec5f" (UID: "ee97830f-749b-4201-82a7-ff5fac07ec5f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:03:03.538638 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:03.538594 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee97830f-749b-4201-82a7-ff5fac07ec5f-istio-data" (OuterVolumeSpecName: "istio-data") pod "ee97830f-749b-4201-82a7-ff5fac07ec5f" (UID: "ee97830f-749b-4201-82a7-ff5fac07ec5f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:03:03.540071 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:03.539983 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ee97830f-749b-4201-82a7-ff5fac07ec5f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ee97830f-749b-4201-82a7-ff5fac07ec5f" (UID: "ee97830f-749b-4201-82a7-ff5fac07ec5f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 15:03:03.540369 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:03.540346 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee97830f-749b-4201-82a7-ff5fac07ec5f-kube-api-access-v7lt8" (OuterVolumeSpecName: "kube-api-access-v7lt8") pod "ee97830f-749b-4201-82a7-ff5fac07ec5f" (UID: "ee97830f-749b-4201-82a7-ff5fac07ec5f"). InnerVolumeSpecName "kube-api-access-v7lt8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:03:03.540557 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:03.540525 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee97830f-749b-4201-82a7-ff5fac07ec5f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ee97830f-749b-4201-82a7-ff5fac07ec5f" (UID: "ee97830f-749b-4201-82a7-ff5fac07ec5f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:03:03.540641 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:03.540552 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee97830f-749b-4201-82a7-ff5fac07ec5f-istio-token" (OuterVolumeSpecName: "istio-token") pod "ee97830f-749b-4201-82a7-ff5fac07ec5f" (UID: "ee97830f-749b-4201-82a7-ff5fac07ec5f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:03:03.639576 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:03.639548 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee97830f-749b-4201-82a7-ff5fac07ec5f-istio-token\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 15:03:03.639576 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:03.639573 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee97830f-749b-4201-82a7-ff5fac07ec5f-istio-envoy\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 15:03:03.639749 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:03.639586 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee97830f-749b-4201-82a7-ff5fac07ec5f-workload-socket\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 15:03:03.639749 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:03.639597 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee97830f-749b-4201-82a7-ff5fac07ec5f-credential-socket\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 15:03:03.639749 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:03.639610 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7lt8\" (UniqueName: \"kubernetes.io/projected/ee97830f-749b-4201-82a7-ff5fac07ec5f-kube-api-access-v7lt8\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 15:03:03.639749 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:03.639621 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee97830f-749b-4201-82a7-ff5fac07ec5f-workload-certs\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 15:03:03.639749 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:03.639633 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee97830f-749b-4201-82a7-ff5fac07ec5f-istio-podinfo\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 15:03:03.639749 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:03.639643 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee97830f-749b-4201-82a7-ff5fac07ec5f-istio-data\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 15:03:04.371506 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:04.371434 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" Jul 24 15:03:04.371903 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:04.371432 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6" event={"ID":"ee97830f-749b-4201-82a7-ff5fac07ec5f","Type":"ContainerDied","Data":"9c2acbb1e4a803d3bfa395fdb860befb7c5cfc5d915d842fee843b294b2210c5"} Jul 24 15:03:04.371903 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:04.371566 2581 scope.go:117] "RemoveContainer" containerID="5ab972ac250af0d19b838c4eee49a904198fb957a929c0d8a694723dab90206c" Jul 24 15:03:04.406941 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:04.406917 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6"] Jul 24 15:03:04.414825 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:04.414793 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-47d0d404-gw-openshift-default-84f5f89bdd-l5mz6"] Jul 24 15:03:06.113350 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:06.113309 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee97830f-749b-4201-82a7-ff5fac07ec5f" path="/var/lib/kubelet/pods/ee97830f-749b-4201-82a7-ff5fac07ec5f/volumes" Jul 24 15:03:10.158304 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:10.158270 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 15:03:28.169129 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:28.169096 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a1550b4d-djhjx"] Jul 24 15:03:28.169545 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:28.169465 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab6744c1-31f7-4eec-a52d-ea3f7ce821ad" containerName="revoke-keys" Jul 24 15:03:28.169545 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:28.169476 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab6744c1-31f7-4eec-a52d-ea3f7ce821ad" containerName="revoke-keys" Jul 24 15:03:28.169545 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:28.169485 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee97830f-749b-4201-82a7-ff5fac07ec5f" containerName="istio-proxy" Jul 24 15:03:28.169545 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:28.169490 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee97830f-749b-4201-82a7-ff5fac07ec5f" containerName="istio-proxy" Jul 24 15:03:28.169680 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:28.169558 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab6744c1-31f7-4eec-a52d-ea3f7ce821ad" containerName="revoke-keys" Jul 24 15:03:28.169680 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:28.169566 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee97830f-749b-4201-82a7-ff5fac07ec5f" containerName="istio-proxy" Jul 24 15:03:28.169680 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:28.169573 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee97830f-749b-4201-82a7-ff5fac07ec5f" containerName="istio-proxy" Jul 24 15:03:28.172478 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:28.172461 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a1550b4d-djhjx" Jul 24 15:03:28.175671 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:28.175652 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 24 15:03:28.180402 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:28.180385 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-g4jrf\"" Jul 24 15:03:28.187302 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:28.187279 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a1550b4d-djhjx"] Jul 24 15:03:28.341329 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:28.341297 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7e599cc-172b-42b6-80bd-45e07010b222-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a1550b4d-djhjx\" (UID: \"a7e599cc-172b-42b6-80bd-45e07010b222\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a1550b4d-djhjx" Jul 24 15:03:28.442691 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:28.442582 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7e599cc-172b-42b6-80bd-45e07010b222-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a1550b4d-djhjx\" (UID: \"a7e599cc-172b-42b6-80bd-45e07010b222\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a1550b4d-djhjx" Jul 24 15:03:28.443253 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:28.443234 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7e599cc-172b-42b6-80bd-45e07010b222-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a1550b4d-djhjx\" (UID: \"a7e599cc-172b-42b6-80bd-45e07010b222\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a1550b4d-djhjx" Jul 24 15:03:28.482589 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:28.482568 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a1550b4d-djhjx" Jul 24 15:03:28.645832 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:28.645805 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a1550b4d-djhjx"] Jul 24 15:03:28.646537 ip-10-0-131-12 kubenswrapper[2581]: W0724 15:03:28.646509 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7e599cc_172b_42b6_80bd_45e07010b222.slice/crio-6fc30baad1ac11bcc6ed8c2332f0c530d7f0d96b19b18f4c1a6b2aa4a2be8b3a WatchSource:0}: Error finding container 6fc30baad1ac11bcc6ed8c2332f0c530d7f0d96b19b18f4c1a6b2aa4a2be8b3a: Status 404 returned error can't find the container with id 6fc30baad1ac11bcc6ed8c2332f0c530d7f0d96b19b18f4c1a6b2aa4a2be8b3a Jul 24 15:03:29.500893 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:29.500863 2581 generic.go:356] "Generic (PLEG): container finished" podID="a7e599cc-172b-42b6-80bd-45e07010b222" containerID="ce38f207a5484c685a9963c8c7902194f228f9d045966e2de12a542bc4866318" exitCode=0 Jul 24 15:03:29.501286 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:29.500936 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a1550b4d-djhjx" event={"ID":"a7e599cc-172b-42b6-80bd-45e07010b222","Type":"ContainerDied","Data":"ce38f207a5484c685a9963c8c7902194f228f9d045966e2de12a542bc4866318"} Jul 24 15:03:29.501286 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:29.500985 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a1550b4d-djhjx" event={"ID":"a7e599cc-172b-42b6-80bd-45e07010b222","Type":"ContainerStarted","Data":"6fc30baad1ac11bcc6ed8c2332f0c530d7f0d96b19b18f4c1a6b2aa4a2be8b3a"} Jul 24 15:03:30.635620 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:30.635595 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a1550b4d-djhjx" Jul 24 15:03:30.762582 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:30.762510 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7e599cc-172b-42b6-80bd-45e07010b222-maas-api-service-ca\") pod \"a7e599cc-172b-42b6-80bd-45e07010b222\" (UID: \"a7e599cc-172b-42b6-80bd-45e07010b222\") " Jul 24 15:03:30.762841 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:30.762820 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7e599cc-172b-42b6-80bd-45e07010b222-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a7e599cc-172b-42b6-80bd-45e07010b222" (UID: "a7e599cc-172b-42b6-80bd-45e07010b222"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:03:30.863764 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:30.863740 2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7e599cc-172b-42b6-80bd-45e07010b222-maas-api-service-ca\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 15:03:31.512959 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:31.512931 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a1550b4d-djhjx" Jul 24 15:03:31.513122 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:31.512931 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a1550b4d-djhjx" event={"ID":"a7e599cc-172b-42b6-80bd-45e07010b222","Type":"ContainerDied","Data":"6fc30baad1ac11bcc6ed8c2332f0c530d7f0d96b19b18f4c1a6b2aa4a2be8b3a"} Jul 24 15:03:31.513122 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:31.513050 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6fc30baad1ac11bcc6ed8c2332f0c530d7f0d96b19b18f4c1a6b2aa4a2be8b3a" Jul 24 15:03:41.411824 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:41.411791 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 15:03:43.254732 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:43.254698 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a1550b4d-djhjx"] Jul 24 15:03:43.257135 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:43.257107 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a1550b4d-djhjx"] Jul 24 15:03:44.112599 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:44.112565 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7e599cc-172b-42b6-80bd-45e07010b222" path="/var/lib/kubelet/pods/a7e599cc-172b-42b6-80bd-45e07010b222/volumes" Jul 24 15:03:45.281769 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.281739 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7"] Jul 24 15:03:45.282144 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.282072 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7e599cc-172b-42b6-80bd-45e07010b222" containerName="revoke-keys" Jul 24 15:03:45.282144 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.282083 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7e599cc-172b-42b6-80bd-45e07010b222" containerName="revoke-keys" Jul 24 15:03:45.282144 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.282104 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee97830f-749b-4201-82a7-ff5fac07ec5f" containerName="istio-proxy" Jul 24 15:03:45.282144 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.282113 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee97830f-749b-4201-82a7-ff5fac07ec5f" containerName="istio-proxy" Jul 24 15:03:45.282491 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.282214 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7e599cc-172b-42b6-80bd-45e07010b222" containerName="revoke-keys" Jul 24 15:03:45.285471 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.285451 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:03:45.289349 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.289330 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-84b622a4-openshift-default-dockercfg-9tzf7\"" Jul 24 15:03:45.298645 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.298627 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7"] Jul 24 15:03:45.378349 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.378316 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66e37b1d-5eee-4a52-910f-30b35f443151-workload-certs\") pod \"e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7\" (UID: \"66e37b1d-5eee-4a52-910f-30b35f443151\") " pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:03:45.378505 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.378362 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66e37b1d-5eee-4a52-910f-30b35f443151-istio-data\") pod \"e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7\" (UID: \"66e37b1d-5eee-4a52-910f-30b35f443151\") " pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:03:45.378505 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.378390 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66e37b1d-5eee-4a52-910f-30b35f443151-credential-socket\") pod \"e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7\" (UID: \"66e37b1d-5eee-4a52-910f-30b35f443151\") " pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:03:45.378505 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.378427 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66e37b1d-5eee-4a52-910f-30b35f443151-workload-socket\") pod \"e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7\" (UID: \"66e37b1d-5eee-4a52-910f-30b35f443151\") " pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:03:45.378505 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.378463 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66e37b1d-5eee-4a52-910f-30b35f443151-istio-token\") pod \"e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7\" (UID: \"66e37b1d-5eee-4a52-910f-30b35f443151\") " pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:03:45.378505 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.378489 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66e37b1d-5eee-4a52-910f-30b35f443151-istio-podinfo\") pod \"e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7\" (UID: \"66e37b1d-5eee-4a52-910f-30b35f443151\") " pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:03:45.378505 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.378506 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66e37b1d-5eee-4a52-910f-30b35f443151-istio-envoy\") pod \"e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7\" (UID: \"66e37b1d-5eee-4a52-910f-30b35f443151\") " pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:03:45.378737 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.378577 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66e37b1d-5eee-4a52-910f-30b35f443151-istiod-ca-cert\") pod \"e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7\" (UID: \"66e37b1d-5eee-4a52-910f-30b35f443151\") " pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:03:45.378737 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.378618 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmts7\" (UniqueName: \"kubernetes.io/projected/66e37b1d-5eee-4a52-910f-30b35f443151-kube-api-access-dmts7\") pod \"e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7\" (UID: \"66e37b1d-5eee-4a52-910f-30b35f443151\") " pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:03:45.479515 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.479486 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmts7\" (UniqueName: \"kubernetes.io/projected/66e37b1d-5eee-4a52-910f-30b35f443151-kube-api-access-dmts7\") pod \"e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7\" (UID: \"66e37b1d-5eee-4a52-910f-30b35f443151\") " pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:03:45.479670 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.479553 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66e37b1d-5eee-4a52-910f-30b35f443151-workload-certs\") pod \"e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7\" (UID: \"66e37b1d-5eee-4a52-910f-30b35f443151\") " pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:03:45.479670 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.479580 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66e37b1d-5eee-4a52-910f-30b35f443151-istio-data\") pod \"e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7\" (UID: \"66e37b1d-5eee-4a52-910f-30b35f443151\") " pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:03:45.479670 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.479604 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66e37b1d-5eee-4a52-910f-30b35f443151-credential-socket\") pod \"e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7\" (UID: \"66e37b1d-5eee-4a52-910f-30b35f443151\") " pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:03:45.479670 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.479626 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66e37b1d-5eee-4a52-910f-30b35f443151-workload-socket\") pod \"e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7\" (UID: \"66e37b1d-5eee-4a52-910f-30b35f443151\") " pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:03:45.479670 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.479651 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66e37b1d-5eee-4a52-910f-30b35f443151-istio-token\") pod \"e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7\" (UID: \"66e37b1d-5eee-4a52-910f-30b35f443151\") " pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:03:45.479916 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.479687 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66e37b1d-5eee-4a52-910f-30b35f443151-istio-podinfo\") pod \"e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7\" (UID: \"66e37b1d-5eee-4a52-910f-30b35f443151\") " pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:03:45.479916 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.479709 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66e37b1d-5eee-4a52-910f-30b35f443151-istio-envoy\") pod \"e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7\" (UID: \"66e37b1d-5eee-4a52-910f-30b35f443151\") " pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:03:45.479916 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.479754 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66e37b1d-5eee-4a52-910f-30b35f443151-istiod-ca-cert\") pod \"e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7\" (UID: \"66e37b1d-5eee-4a52-910f-30b35f443151\") " pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:03:45.480078 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.480033 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66e37b1d-5eee-4a52-910f-30b35f443151-workload-socket\") pod \"e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7\" (UID: \"66e37b1d-5eee-4a52-910f-30b35f443151\") " pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:03:45.480144 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.480084 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66e37b1d-5eee-4a52-910f-30b35f443151-credential-socket\") pod \"e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7\" (UID: \"66e37b1d-5eee-4a52-910f-30b35f443151\") " pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:03:45.480418 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.480395 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66e37b1d-5eee-4a52-910f-30b35f443151-workload-certs\") pod \"e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7\" (UID: \"66e37b1d-5eee-4a52-910f-30b35f443151\") " pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:03:45.480619 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.480433 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66e37b1d-5eee-4a52-910f-30b35f443151-istio-data\") pod \"e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7\" (UID: \"66e37b1d-5eee-4a52-910f-30b35f443151\") " pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:03:45.480619 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.480610 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66e37b1d-5eee-4a52-910f-30b35f443151-istiod-ca-cert\") pod \"e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7\" (UID: \"66e37b1d-5eee-4a52-910f-30b35f443151\") " pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:03:45.482312 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.482292 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66e37b1d-5eee-4a52-910f-30b35f443151-istio-envoy\") pod \"e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7\" (UID: \"66e37b1d-5eee-4a52-910f-30b35f443151\") " pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:03:45.482457 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.482439 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66e37b1d-5eee-4a52-910f-30b35f443151-istio-podinfo\") pod \"e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7\" (UID: \"66e37b1d-5eee-4a52-910f-30b35f443151\") " pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:03:45.488175 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.488138 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmts7\" (UniqueName: \"kubernetes.io/projected/66e37b1d-5eee-4a52-910f-30b35f443151-kube-api-access-dmts7\") pod \"e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7\" (UID: \"66e37b1d-5eee-4a52-910f-30b35f443151\") " pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:03:45.488356 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.488337 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66e37b1d-5eee-4a52-910f-30b35f443151-istio-token\") pod \"e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7\" (UID: \"66e37b1d-5eee-4a52-910f-30b35f443151\") " pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:03:45.595257 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.595197 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:03:45.730201 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.730178 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7"] Jul 24 15:03:45.731804 ip-10-0-131-12 kubenswrapper[2581]: W0724 15:03:45.731776 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66e37b1d_5eee_4a52_910f_30b35f443151.slice/crio-c5469ab13ac550e015e2325ffb3a764b768c89435ae11e71e2c3cdd5ced9c6d1 WatchSource:0}: Error finding container c5469ab13ac550e015e2325ffb3a764b768c89435ae11e71e2c3cdd5ced9c6d1: Status 404 returned error can't find the container with id c5469ab13ac550e015e2325ffb3a764b768c89435ae11e71e2c3cdd5ced9c6d1 Jul 24 15:03:45.733819 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.733788 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 24 15:03:45.733920 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.733852 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 24 15:03:45.733920 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:45.733878 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 24 15:03:46.591826 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:46.591798 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" event={"ID":"66e37b1d-5eee-4a52-910f-30b35f443151","Type":"ContainerStarted","Data":"f99ae1914e3d80dc6b44fe40e7b3b9cec25ccbf0133f86045598d35705976006"} Jul 24 15:03:46.592212 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:46.591849 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" event={"ID":"66e37b1d-5eee-4a52-910f-30b35f443151","Type":"ContainerStarted","Data":"c5469ab13ac550e015e2325ffb3a764b768c89435ae11e71e2c3cdd5ced9c6d1"} Jul 24 15:03:46.595317 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:46.595302 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:03:46.599807 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:46.599786 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:03:46.616655 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:46.616612 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" podStartSLOduration=1.61659992 podStartE2EDuration="1.61659992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:03:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:03:46.613805894 +0000 UTC m=+1767.151061845" watchObservedRunningTime="2026-07-24 15:03:46.61659992 +0000 UTC m=+1767.153855872" Jul 24 15:03:47.600714 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:47.600687 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:03:47.601480 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:47.601460 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:03:54.996550 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:03:54.996518 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 15:04:02.618398 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:02.617943 2581 patch_prober.go:28] interesting pod/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": read tcp 10.133.0.2:43174->10.133.0.44:15021: read: connection reset by peer" start-of-body= Jul 24 15:04:02.618398 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:02.618028 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" podUID="66e37b1d-5eee-4a52-910f-30b35f443151" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": read tcp 10.133.0.2:43174->10.133.0.44:15021: read: connection reset by peer" Jul 24 15:04:02.686040 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:02.686017 2581 generic.go:356] "Generic (PLEG): container finished" podID="66e37b1d-5eee-4a52-910f-30b35f443151" containerID="f99ae1914e3d80dc6b44fe40e7b3b9cec25ccbf0133f86045598d35705976006" exitCode=0 Jul 24 15:04:02.686143 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:02.686089 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" event={"ID":"66e37b1d-5eee-4a52-910f-30b35f443151","Type":"ContainerDied","Data":"f99ae1914e3d80dc6b44fe40e7b3b9cec25ccbf0133f86045598d35705976006"} Jul 24 15:04:02.686482 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:02.686466 2581 scope.go:117] "RemoveContainer" containerID="f99ae1914e3d80dc6b44fe40e7b3b9cec25ccbf0133f86045598d35705976006" Jul 24 15:04:02.687527 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:02.687498 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 24 15:04:02.687593 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:02.687579 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 24 15:04:02.687631 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:02.687615 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 24 15:04:03.693692 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:03.693657 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" event={"ID":"66e37b1d-5eee-4a52-910f-30b35f443151","Type":"ContainerStarted","Data":"16dc702a45b37f228b2abfa8d2091913dacbf2f1f7a893a716a8e8506d36b7f3"} Jul 24 15:04:04.595675 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:04.595640 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:04:04.595855 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:04.595778 2581 patch_prober.go:28] interesting pod/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Jul 24 15:04:04.595855 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:04.595837 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" podUID="66e37b1d-5eee-4a52-910f-30b35f443151" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Jul 24 15:04:05.596009 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:05.595978 2581 patch_prober.go:28] interesting pod/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Jul 24 15:04:05.596418 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:05.596040 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" podUID="66e37b1d-5eee-4a52-910f-30b35f443151" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Jul 24 15:04:06.596045 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:06.596010 2581 patch_prober.go:28] interesting pod/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Jul 24 15:04:06.596453 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:06.596067 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" podUID="66e37b1d-5eee-4a52-910f-30b35f443151" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Jul 24 15:04:07.599294 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:07.599266 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:04:07.599667 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:07.599505 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:04:07.600091 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:07.600074 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:04:12.892977 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:12.892899 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-84b622a4-mr8rs"] Jul 24 15:04:12.896619 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:12.896600 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-84b622a4-mr8rs" Jul 24 15:04:12.899198 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:12.899178 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 24 15:04:12.899312 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:12.899294 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-g4jrf\"" Jul 24 15:04:12.904721 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:12.904665 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-84b622a4-mr8rs"] Jul 24 15:04:13.007558 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:13.007535 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/972b737f-531c-4668-b5a8-c10302efac07-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-84b622a4-mr8rs\" (UID: \"972b737f-531c-4668-b5a8-c10302efac07\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-84b622a4-mr8rs" Jul 24 15:04:13.108473 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:13.108446 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/972b737f-531c-4668-b5a8-c10302efac07-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-84b622a4-mr8rs\" (UID: \"972b737f-531c-4668-b5a8-c10302efac07\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-84b622a4-mr8rs" Jul 24 15:04:13.109042 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:13.109024 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/972b737f-531c-4668-b5a8-c10302efac07-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-84b622a4-mr8rs\" (UID: \"972b737f-531c-4668-b5a8-c10302efac07\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-84b622a4-mr8rs" Jul 24 15:04:13.208611 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:13.208553 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-84b622a4-mr8rs" Jul 24 15:04:13.341969 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:13.341947 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-84b622a4-mr8rs"] Jul 24 15:04:13.343607 ip-10-0-131-12 kubenswrapper[2581]: W0724 15:04:13.343587 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod972b737f_531c_4668_b5a8_c10302efac07.slice/crio-a4ad9762e6a6a3e223935e4350bd21b5124c2182d5cb9afe816bcc0daaf5a95f WatchSource:0}: Error finding container a4ad9762e6a6a3e223935e4350bd21b5124c2182d5cb9afe816bcc0daaf5a95f: Status 404 returned error can't find the container with id a4ad9762e6a6a3e223935e4350bd21b5124c2182d5cb9afe816bcc0daaf5a95f Jul 24 15:04:13.748344 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:13.748311 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-84b622a4-mr8rs" event={"ID":"972b737f-531c-4668-b5a8-c10302efac07","Type":"ContainerStarted","Data":"7cf710425a9f2bd5d19552bc97549dba481869ec01c7cb5fc3a8bcb563e9642c"} Jul 24 15:04:13.748485 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:13.748364 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-84b622a4-mr8rs" event={"ID":"972b737f-531c-4668-b5a8-c10302efac07","Type":"ContainerStarted","Data":"a4ad9762e6a6a3e223935e4350bd21b5124c2182d5cb9afe816bcc0daaf5a95f"} Jul 24 15:04:13.766599 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:13.766558 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-84b622a4-mr8rs" podStartSLOduration=1.76654318 podStartE2EDuration="1.76654318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:04:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:04:13.764146213 +0000 UTC m=+1794.301402166" watchObservedRunningTime="2026-07-24 15:04:13.76654318 +0000 UTC m=+1794.303799109" Jul 24 15:04:14.755548 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:14.755510 2581 generic.go:356] "Generic (PLEG): container finished" podID="972b737f-531c-4668-b5a8-c10302efac07" containerID="7cf710425a9f2bd5d19552bc97549dba481869ec01c7cb5fc3a8bcb563e9642c" exitCode=0 Jul 24 15:04:14.755908 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:14.755553 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-84b622a4-mr8rs" event={"ID":"972b737f-531c-4668-b5a8-c10302efac07","Type":"ContainerDied","Data":"7cf710425a9f2bd5d19552bc97549dba481869ec01c7cb5fc3a8bcb563e9642c"} Jul 24 15:04:15.891033 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:15.891010 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-84b622a4-mr8rs" Jul 24 15:04:16.034720 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:16.034696 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/972b737f-531c-4668-b5a8-c10302efac07-maas-api-service-ca\") pod \"972b737f-531c-4668-b5a8-c10302efac07\" (UID: \"972b737f-531c-4668-b5a8-c10302efac07\") " Jul 24 15:04:16.035038 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:16.035015 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/972b737f-531c-4668-b5a8-c10302efac07-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "972b737f-531c-4668-b5a8-c10302efac07" (UID: "972b737f-531c-4668-b5a8-c10302efac07"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:04:16.135387 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:16.135364 2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/972b737f-531c-4668-b5a8-c10302efac07-maas-api-service-ca\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 15:04:16.767880 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:16.767855 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-84b622a4-mr8rs" Jul 24 15:04:16.768046 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:16.767900 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-84b622a4-mr8rs" event={"ID":"972b737f-531c-4668-b5a8-c10302efac07","Type":"ContainerDied","Data":"a4ad9762e6a6a3e223935e4350bd21b5124c2182d5cb9afe816bcc0daaf5a95f"} Jul 24 15:04:16.768046 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:16.767942 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4ad9762e6a6a3e223935e4350bd21b5124c2182d5cb9afe816bcc0daaf5a95f" Jul 24 15:04:26.392166 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:26.392112 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 15:04:28.058281 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:28.058241 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-84b622a4-mr8rs"] Jul 24 15:04:28.060279 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:28.060256 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-84b622a4-mr8rs"] Jul 24 15:04:28.112121 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:28.112078 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="972b737f-531c-4668-b5a8-c10302efac07" path="/var/lib/kubelet/pods/972b737f-531c-4668-b5a8-c10302efac07/volumes" Jul 24 15:04:28.202103 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:28.202074 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7"] Jul 24 15:04:28.202314 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:28.202292 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" podUID="66e37b1d-5eee-4a52-910f-30b35f443151" containerName="istio-proxy" containerID="cri-o://16dc702a45b37f228b2abfa8d2091913dacbf2f1f7a893a716a8e8506d36b7f3" gracePeriod=30 Jul 24 15:04:33.443900 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.443880 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:04:33.586800 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.586777 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66e37b1d-5eee-4a52-910f-30b35f443151-istio-data\") pod \"66e37b1d-5eee-4a52-910f-30b35f443151\" (UID: \"66e37b1d-5eee-4a52-910f-30b35f443151\") " Jul 24 15:04:33.586960 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.586806 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66e37b1d-5eee-4a52-910f-30b35f443151-credential-socket\") pod \"66e37b1d-5eee-4a52-910f-30b35f443151\" (UID: \"66e37b1d-5eee-4a52-910f-30b35f443151\") " Jul 24 15:04:33.586960 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.586832 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66e37b1d-5eee-4a52-910f-30b35f443151-workload-socket\") pod \"66e37b1d-5eee-4a52-910f-30b35f443151\" (UID: \"66e37b1d-5eee-4a52-910f-30b35f443151\") " Jul 24 15:04:33.586960 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.586861 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66e37b1d-5eee-4a52-910f-30b35f443151-workload-certs\") pod \"66e37b1d-5eee-4a52-910f-30b35f443151\" (UID: \"66e37b1d-5eee-4a52-910f-30b35f443151\") " Jul 24 15:04:33.586960 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.586887 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66e37b1d-5eee-4a52-910f-30b35f443151-istio-envoy\") pod \"66e37b1d-5eee-4a52-910f-30b35f443151\" (UID: \"66e37b1d-5eee-4a52-910f-30b35f443151\") " Jul 24 15:04:33.586960 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.586919 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66e37b1d-5eee-4a52-910f-30b35f443151-istio-token\") pod \"66e37b1d-5eee-4a52-910f-30b35f443151\" (UID: \"66e37b1d-5eee-4a52-910f-30b35f443151\") " Jul 24 15:04:33.586960 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.586945 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66e37b1d-5eee-4a52-910f-30b35f443151-istiod-ca-cert\") pod \"66e37b1d-5eee-4a52-910f-30b35f443151\" (UID: \"66e37b1d-5eee-4a52-910f-30b35f443151\") " Jul 24 15:04:33.587311 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.586969 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmts7\" (UniqueName: \"kubernetes.io/projected/66e37b1d-5eee-4a52-910f-30b35f443151-kube-api-access-dmts7\") pod \"66e37b1d-5eee-4a52-910f-30b35f443151\" (UID: \"66e37b1d-5eee-4a52-910f-30b35f443151\") " Jul 24 15:04:33.587311 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.587012 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66e37b1d-5eee-4a52-910f-30b35f443151-istio-podinfo\") pod \"66e37b1d-5eee-4a52-910f-30b35f443151\" (UID: \"66e37b1d-5eee-4a52-910f-30b35f443151\") " Jul 24 15:04:33.587311 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.587049 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66e37b1d-5eee-4a52-910f-30b35f443151-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "66e37b1d-5eee-4a52-910f-30b35f443151" (UID: "66e37b1d-5eee-4a52-910f-30b35f443151"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:04:33.587311 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.587130 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66e37b1d-5eee-4a52-910f-30b35f443151-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "66e37b1d-5eee-4a52-910f-30b35f443151" (UID: "66e37b1d-5eee-4a52-910f-30b35f443151"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:04:33.587311 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.587187 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66e37b1d-5eee-4a52-910f-30b35f443151-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "66e37b1d-5eee-4a52-910f-30b35f443151" (UID: "66e37b1d-5eee-4a52-910f-30b35f443151"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:04:33.587578 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.587337 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66e37b1d-5eee-4a52-910f-30b35f443151-credential-socket\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 15:04:33.587578 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.587356 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66e37b1d-5eee-4a52-910f-30b35f443151-workload-socket\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 15:04:33.587578 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.587370 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66e37b1d-5eee-4a52-910f-30b35f443151-workload-certs\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 15:04:33.587810 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.587605 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66e37b1d-5eee-4a52-910f-30b35f443151-istio-data" (OuterVolumeSpecName: "istio-data") pod "66e37b1d-5eee-4a52-910f-30b35f443151" (UID: "66e37b1d-5eee-4a52-910f-30b35f443151"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:04:33.587810 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.587704 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66e37b1d-5eee-4a52-910f-30b35f443151-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "66e37b1d-5eee-4a52-910f-30b35f443151" (UID: "66e37b1d-5eee-4a52-910f-30b35f443151"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:04:33.589179 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.589130 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/66e37b1d-5eee-4a52-910f-30b35f443151-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "66e37b1d-5eee-4a52-910f-30b35f443151" (UID: "66e37b1d-5eee-4a52-910f-30b35f443151"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 15:04:33.589366 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.589347 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66e37b1d-5eee-4a52-910f-30b35f443151-istio-token" (OuterVolumeSpecName: "istio-token") pod "66e37b1d-5eee-4a52-910f-30b35f443151" (UID: "66e37b1d-5eee-4a52-910f-30b35f443151"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:04:33.589547 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.589522 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66e37b1d-5eee-4a52-910f-30b35f443151-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "66e37b1d-5eee-4a52-910f-30b35f443151" (UID: "66e37b1d-5eee-4a52-910f-30b35f443151"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:04:33.589547 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.589536 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66e37b1d-5eee-4a52-910f-30b35f443151-kube-api-access-dmts7" (OuterVolumeSpecName: "kube-api-access-dmts7") pod "66e37b1d-5eee-4a52-910f-30b35f443151" (UID: "66e37b1d-5eee-4a52-910f-30b35f443151"). InnerVolumeSpecName "kube-api-access-dmts7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:04:33.688427 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.688403 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66e37b1d-5eee-4a52-910f-30b35f443151-istio-data\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 15:04:33.688427 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.688423 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66e37b1d-5eee-4a52-910f-30b35f443151-istio-envoy\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 15:04:33.688427 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.688431 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66e37b1d-5eee-4a52-910f-30b35f443151-istio-token\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 15:04:33.688598 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.688439 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66e37b1d-5eee-4a52-910f-30b35f443151-istiod-ca-cert\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 15:04:33.688598 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.688448 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmts7\" (UniqueName: \"kubernetes.io/projected/66e37b1d-5eee-4a52-910f-30b35f443151-kube-api-access-dmts7\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 15:04:33.688598 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.688457 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66e37b1d-5eee-4a52-910f-30b35f443151-istio-podinfo\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 15:04:33.858724 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.858644 2581 generic.go:356] "Generic (PLEG): container finished" podID="66e37b1d-5eee-4a52-910f-30b35f443151" containerID="16dc702a45b37f228b2abfa8d2091913dacbf2f1f7a893a716a8e8506d36b7f3" exitCode=0 Jul 24 15:04:33.858724 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.858682 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" event={"ID":"66e37b1d-5eee-4a52-910f-30b35f443151","Type":"ContainerDied","Data":"16dc702a45b37f228b2abfa8d2091913dacbf2f1f7a893a716a8e8506d36b7f3"} Jul 24 15:04:33.858724 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.858693 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" Jul 24 15:04:33.858724 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.858725 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7" event={"ID":"66e37b1d-5eee-4a52-910f-30b35f443151","Type":"ContainerDied","Data":"c5469ab13ac550e015e2325ffb3a764b768c89435ae11e71e2c3cdd5ced9c6d1"} Jul 24 15:04:33.858980 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.858745 2581 scope.go:117] "RemoveContainer" containerID="16dc702a45b37f228b2abfa8d2091913dacbf2f1f7a893a716a8e8506d36b7f3" Jul 24 15:04:33.868259 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.868237 2581 scope.go:117] "RemoveContainer" containerID="f99ae1914e3d80dc6b44fe40e7b3b9cec25ccbf0133f86045598d35705976006" Jul 24 15:04:33.878143 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.878108 2581 scope.go:117] "RemoveContainer" containerID="16dc702a45b37f228b2abfa8d2091913dacbf2f1f7a893a716a8e8506d36b7f3" Jul 24 15:04:33.878703 ip-10-0-131-12 kubenswrapper[2581]: E0724 15:04:33.878677 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16dc702a45b37f228b2abfa8d2091913dacbf2f1f7a893a716a8e8506d36b7f3\": container with ID starting with 16dc702a45b37f228b2abfa8d2091913dacbf2f1f7a893a716a8e8506d36b7f3 not found: ID does not exist" containerID="16dc702a45b37f228b2abfa8d2091913dacbf2f1f7a893a716a8e8506d36b7f3" Jul 24 15:04:33.878797 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.878711 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16dc702a45b37f228b2abfa8d2091913dacbf2f1f7a893a716a8e8506d36b7f3"} err="failed to get container status \"16dc702a45b37f228b2abfa8d2091913dacbf2f1f7a893a716a8e8506d36b7f3\": rpc error: code = NotFound desc = could not find container \"16dc702a45b37f228b2abfa8d2091913dacbf2f1f7a893a716a8e8506d36b7f3\": container with ID starting with 16dc702a45b37f228b2abfa8d2091913dacbf2f1f7a893a716a8e8506d36b7f3 not found: ID does not exist" Jul 24 15:04:33.878797 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.878733 2581 scope.go:117] "RemoveContainer" containerID="f99ae1914e3d80dc6b44fe40e7b3b9cec25ccbf0133f86045598d35705976006" Jul 24 15:04:33.879066 ip-10-0-131-12 kubenswrapper[2581]: E0724 15:04:33.879009 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f99ae1914e3d80dc6b44fe40e7b3b9cec25ccbf0133f86045598d35705976006\": container with ID starting with f99ae1914e3d80dc6b44fe40e7b3b9cec25ccbf0133f86045598d35705976006 not found: ID does not exist" containerID="f99ae1914e3d80dc6b44fe40e7b3b9cec25ccbf0133f86045598d35705976006" Jul 24 15:04:33.879146 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.879076 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f99ae1914e3d80dc6b44fe40e7b3b9cec25ccbf0133f86045598d35705976006"} err="failed to get container status \"f99ae1914e3d80dc6b44fe40e7b3b9cec25ccbf0133f86045598d35705976006\": rpc error: code = NotFound desc = could not find container \"f99ae1914e3d80dc6b44fe40e7b3b9cec25ccbf0133f86045598d35705976006\": container with ID starting with f99ae1914e3d80dc6b44fe40e7b3b9cec25ccbf0133f86045598d35705976006 not found: ID does not exist" Jul 24 15:04:33.881251 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.881232 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7"] Jul 24 15:04:33.886544 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:33.886525 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-84b622a4-openshift-default-7bd54bcdfb-rk5f7"] Jul 24 15:04:34.113904 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:04:34.113835 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66e37b1d-5eee-4a52-910f-30b35f443151" path="/var/lib/kubelet/pods/66e37b1d-5eee-4a52-910f-30b35f443151/volumes" Jul 24 15:05:54.817823 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:05:54.817747 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 15:06:04.301140 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:06:04.301105 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 15:06:16.205088 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:06:16.205057 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 15:08:20.079436 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:08:20.079407 2581 scope.go:117] "RemoveContainer" containerID="a35271d9106ed861975a31fcce2a656a1a5d0241c6550517c87254828f290261" Jul 24 15:08:21.104173 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:08:21.104118 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c811f4d5-bkxfx"] Jul 24 15:08:21.104729 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:08:21.104705 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="972b737f-531c-4668-b5a8-c10302efac07" containerName="revoke-keys" Jul 24 15:08:21.104820 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:08:21.104732 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="972b737f-531c-4668-b5a8-c10302efac07" containerName="revoke-keys" Jul 24 15:08:21.104820 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:08:21.104751 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66e37b1d-5eee-4a52-910f-30b35f443151" containerName="istio-proxy" Jul 24 15:08:21.104820 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:08:21.104760 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="66e37b1d-5eee-4a52-910f-30b35f443151" containerName="istio-proxy" Jul 24 15:08:21.104820 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:08:21.104792 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66e37b1d-5eee-4a52-910f-30b35f443151" containerName="istio-proxy" Jul 24 15:08:21.104820 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:08:21.104800 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="66e37b1d-5eee-4a52-910f-30b35f443151" containerName="istio-proxy" Jul 24 15:08:21.105054 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:08:21.104922 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="66e37b1d-5eee-4a52-910f-30b35f443151" containerName="istio-proxy" Jul 24 15:08:21.105054 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:08:21.104937 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="972b737f-531c-4668-b5a8-c10302efac07" containerName="revoke-keys" Jul 24 15:08:21.109592 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:08:21.109567 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c811f4d5-bkxfx" Jul 24 15:08:21.112367 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:08:21.112342 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 24 15:08:21.112483 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:08:21.112422 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-g4jrf\"" Jul 24 15:08:21.127527 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:08:21.127497 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c811f4d5-bkxfx"] Jul 24 15:08:21.138722 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:08:21.138697 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e99d6a82-f9c1-49d4-a18a-9b9aab83ce00-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c811f4d5-bkxfx\" (UID: \"e99d6a82-f9c1-49d4-a18a-9b9aab83ce00\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c811f4d5-bkxfx" Jul 24 15:08:21.239573 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:08:21.239548 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e99d6a82-f9c1-49d4-a18a-9b9aab83ce00-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c811f4d5-bkxfx\" (UID: \"e99d6a82-f9c1-49d4-a18a-9b9aab83ce00\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c811f4d5-bkxfx" Jul 24 15:08:21.240104 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:08:21.240085 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e99d6a82-f9c1-49d4-a18a-9b9aab83ce00-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c811f4d5-bkxfx\" (UID: \"e99d6a82-f9c1-49d4-a18a-9b9aab83ce00\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c811f4d5-bkxfx" Jul 24 15:08:21.420552 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:08:21.420478 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c811f4d5-bkxfx" Jul 24 15:08:21.548938 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:08:21.548916 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c811f4d5-bkxfx"] Jul 24 15:08:21.550545 ip-10-0-131-12 kubenswrapper[2581]: W0724 15:08:21.550518 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode99d6a82_f9c1_49d4_a18a_9b9aab83ce00.slice/crio-fe8754203daad4dc06cba08c68439a7cdaf7154610023c588a42b04a211df961 WatchSource:0}: Error finding container fe8754203daad4dc06cba08c68439a7cdaf7154610023c588a42b04a211df961: Status 404 returned error can't find the container with id fe8754203daad4dc06cba08c68439a7cdaf7154610023c588a42b04a211df961 Jul 24 15:08:22.049886 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:08:22.049842 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c811f4d5-bkxfx" event={"ID":"e99d6a82-f9c1-49d4-a18a-9b9aab83ce00","Type":"ContainerStarted","Data":"007cb18480c347f430ecccec2d65e8ee8c07da6335fa5895d8320970034dbaec"} Jul 24 15:08:22.050054 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:08:22.049905 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c811f4d5-bkxfx" event={"ID":"e99d6a82-f9c1-49d4-a18a-9b9aab83ce00","Type":"ContainerStarted","Data":"fe8754203daad4dc06cba08c68439a7cdaf7154610023c588a42b04a211df961"} Jul 24 15:08:22.069541 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:08:22.069492 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c811f4d5-bkxfx" podStartSLOduration=1.069478341 podStartE2EDuration="1.069478341s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:08:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:08:22.067622767 +0000 UTC m=+2042.604878722" watchObservedRunningTime="2026-07-24 15:08:22.069478341 +0000 UTC m=+2042.606734341" Jul 24 15:08:23.056445 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:08:23.056407 2581 generic.go:356] "Generic (PLEG): container finished" podID="e99d6a82-f9c1-49d4-a18a-9b9aab83ce00" containerID="007cb18480c347f430ecccec2d65e8ee8c07da6335fa5895d8320970034dbaec" exitCode=0 Jul 24 15:08:23.056814 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:08:23.056490 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c811f4d5-bkxfx" event={"ID":"e99d6a82-f9c1-49d4-a18a-9b9aab83ce00","Type":"ContainerDied","Data":"007cb18480c347f430ecccec2d65e8ee8c07da6335fa5895d8320970034dbaec"} Jul 24 15:08:24.190053 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:08:24.190027 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c811f4d5-bkxfx" Jul 24 15:08:24.260679 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:08:24.260653 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e99d6a82-f9c1-49d4-a18a-9b9aab83ce00-maas-api-service-ca\") pod \"e99d6a82-f9c1-49d4-a18a-9b9aab83ce00\" (UID: \"e99d6a82-f9c1-49d4-a18a-9b9aab83ce00\") " Jul 24 15:08:24.260983 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:08:24.260962 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e99d6a82-f9c1-49d4-a18a-9b9aab83ce00-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e99d6a82-f9c1-49d4-a18a-9b9aab83ce00" (UID: "e99d6a82-f9c1-49d4-a18a-9b9aab83ce00"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:08:24.361378 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:08:24.361321 2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e99d6a82-f9c1-49d4-a18a-9b9aab83ce00-maas-api-service-ca\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 15:08:25.067889 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:08:25.067855 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c811f4d5-bkxfx" event={"ID":"e99d6a82-f9c1-49d4-a18a-9b9aab83ce00","Type":"ContainerDied","Data":"fe8754203daad4dc06cba08c68439a7cdaf7154610023c588a42b04a211df961"} Jul 24 15:08:25.067889 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:08:25.067879 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c811f4d5-bkxfx" Jul 24 15:08:25.068103 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:08:25.067903 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fe8754203daad4dc06cba08c68439a7cdaf7154610023c588a42b04a211df961" Jul 24 15:08:34.613101 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:08:34.613066 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 15:08:36.227726 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:08:36.227696 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c811f4d5-bkxfx"] Jul 24 15:08:36.234184 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:08:36.234142 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c811f4d5-bkxfx"] Jul 24 15:08:38.112500 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:08:38.112467 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e99d6a82-f9c1-49d4-a18a-9b9aab83ce00" path="/var/lib/kubelet/pods/e99d6a82-f9c1-49d4-a18a-9b9aab83ce00/volumes" Jul 24 15:09:04.005540 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.005510 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m"] Jul 24 15:09:04.007900 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.005834 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e99d6a82-f9c1-49d4-a18a-9b9aab83ce00" containerName="revoke-keys" Jul 24 15:09:04.007900 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.005847 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e99d6a82-f9c1-49d4-a18a-9b9aab83ce00" containerName="revoke-keys" Jul 24 15:09:04.007900 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.005920 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="66e37b1d-5eee-4a52-910f-30b35f443151" containerName="istio-proxy" Jul 24 15:09:04.007900 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.005930 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e99d6a82-f9c1-49d4-a18a-9b9aab83ce00" containerName="revoke-keys" Jul 24 15:09:04.009037 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.009023 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:09:04.011660 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.011638 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-e61f3ca0-openshift-default-dockercfg-jjhjf\"" Jul 24 15:09:04.023202 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.023177 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m"] Jul 24 15:09:04.066553 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.066522 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-istio-token\") pod \"e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m\" (UID: \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\") " pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:09:04.066685 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.066559 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-workload-socket\") pod \"e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m\" (UID: \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\") " pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:09:04.066685 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.066583 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-credential-socket\") pod \"e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m\" (UID: \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\") " pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:09:04.066685 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.066606 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-workload-certs\") pod \"e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m\" (UID: \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\") " pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:09:04.066685 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.066631 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-istio-envoy\") pod \"e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m\" (UID: \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\") " pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:09:04.066685 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.066657 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-istio-podinfo\") pod \"e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m\" (UID: \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\") " pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:09:04.066964 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.066724 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-istio-data\") pod \"e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m\" (UID: \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\") " pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:09:04.066964 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.066761 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-istiod-ca-cert\") pod \"e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m\" (UID: \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\") " pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:09:04.066964 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.066787 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8hhm\" (UniqueName: \"kubernetes.io/projected/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-kube-api-access-z8hhm\") pod \"e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m\" (UID: \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\") " pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:09:04.167967 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.167933 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-istio-podinfo\") pod \"e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m\" (UID: \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\") " pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:09:04.168110 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.167973 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-istio-data\") pod \"e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m\" (UID: \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\") " pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:09:04.168110 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.167990 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-istiod-ca-cert\") pod \"e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m\" (UID: \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\") " pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:09:04.168110 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.168005 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8hhm\" (UniqueName: \"kubernetes.io/projected/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-kube-api-access-z8hhm\") pod \"e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m\" (UID: \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\") " pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:09:04.168110 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.168069 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-istio-token\") pod \"e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m\" (UID: \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\") " pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:09:04.168110 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.168087 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-workload-socket\") pod \"e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m\" (UID: \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\") " pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:09:04.168110 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.168102 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-credential-socket\") pod \"e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m\" (UID: \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\") " pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:09:04.168443 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.168117 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-workload-certs\") pod \"e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m\" (UID: \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\") " pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:09:04.168443 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.168134 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-istio-envoy\") pod \"e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m\" (UID: \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\") " pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:09:04.168443 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.168403 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-istio-data\") pod \"e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m\" (UID: \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\") " pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:09:04.168726 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.168695 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-workload-certs\") pod \"e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m\" (UID: \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\") " pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:09:04.168852 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.168789 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-workload-socket\") pod \"e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m\" (UID: \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\") " pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:09:04.168852 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.168810 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-credential-socket\") pod \"e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m\" (UID: \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\") " pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:09:04.169023 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.168981 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-istiod-ca-cert\") pod \"e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m\" (UID: \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\") " pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:09:04.170389 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.170371 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-istio-envoy\") pod \"e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m\" (UID: \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\") " pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:09:04.170581 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.170564 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-istio-podinfo\") pod \"e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m\" (UID: \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\") " pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:09:04.176763 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.176741 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-istio-token\") pod \"e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m\" (UID: \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\") " pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:09:04.176843 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.176769 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8hhm\" (UniqueName: \"kubernetes.io/projected/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-kube-api-access-z8hhm\") pod \"e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m\" (UID: \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\") " pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:09:04.319128 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.319104 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:09:04.463922 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.463897 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m"] Jul 24 15:09:04.465542 ip-10-0-131-12 kubenswrapper[2581]: W0724 15:09:04.465515 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8e718e1_a0b6_46ac_b52d_5d1f16b962b6.slice/crio-b067ac044f2c5cc11634ae5cba9596095bcb8f5f028165f7e1c0c36ecafbb609 WatchSource:0}: Error finding container b067ac044f2c5cc11634ae5cba9596095bcb8f5f028165f7e1c0c36ecafbb609: Status 404 returned error can't find the container with id b067ac044f2c5cc11634ae5cba9596095bcb8f5f028165f7e1c0c36ecafbb609 Jul 24 15:09:04.468057 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.468021 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 24 15:09:04.468203 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.468103 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 24 15:09:04.468203 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:04.468166 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 24 15:09:05.277541 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:05.277507 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" event={"ID":"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6","Type":"ContainerStarted","Data":"504ff5ac4a1cae41097549587f3c6ec56661bfbc024214111200f607d80c7e8c"} Jul 24 15:09:05.277906 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:05.277562 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" event={"ID":"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6","Type":"ContainerStarted","Data":"b067ac044f2c5cc11634ae5cba9596095bcb8f5f028165f7e1c0c36ecafbb609"} Jul 24 15:09:05.304101 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:05.304054 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" podStartSLOduration=2.304037652 podStartE2EDuration="2.304037652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:09:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:09:05.301864922 +0000 UTC m=+2085.839120879" watchObservedRunningTime="2026-07-24 15:09:05.304037652 +0000 UTC m=+2085.841293665" Jul 24 15:09:05.319304 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:05.319280 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:09:05.323820 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:05.323801 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:09:06.283409 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:06.283375 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:09:06.284411 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:06.284387 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:09:13.095940 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:13.095904 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 15:09:20.099313 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:20.099285 2581 scope.go:117] "RemoveContainer" containerID="2551a2ce4a4ad9286ea5b27366f9e55833727d9c66d472e24ca53ea15dda99df" Jul 24 15:09:21.284883 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:21.284847 2581 patch_prober.go:28] interesting pod/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 24 15:09:21.285266 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:21.284913 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" podUID="c8e718e1-a0b6-46ac-b52d-5d1f16b962b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 24 15:09:21.368196 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:21.368112 2581 generic.go:356] "Generic (PLEG): container finished" podID="c8e718e1-a0b6-46ac-b52d-5d1f16b962b6" containerID="504ff5ac4a1cae41097549587f3c6ec56661bfbc024214111200f607d80c7e8c" exitCode=0 Jul 24 15:09:21.368196 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:21.368186 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" event={"ID":"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6","Type":"ContainerDied","Data":"504ff5ac4a1cae41097549587f3c6ec56661bfbc024214111200f607d80c7e8c"} Jul 24 15:09:21.368549 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:21.368536 2581 scope.go:117] "RemoveContainer" containerID="504ff5ac4a1cae41097549587f3c6ec56661bfbc024214111200f607d80c7e8c" Jul 24 15:09:21.369552 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:21.369522 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 24 15:09:21.369634 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:21.369616 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 24 15:09:21.369673 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:21.369659 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 24 15:09:22.375168 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:22.375120 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" event={"ID":"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6","Type":"ContainerStarted","Data":"6d7ddc2a6bc1be36fe13b593253c0d4fff62d2ff990c565823987b1cbd8199d7"} Jul 24 15:09:23.319390 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:23.319355 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:09:23.319585 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:23.319539 2581 patch_prober.go:28] interesting pod/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 24 15:09:23.319661 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:23.319604 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" podUID="c8e718e1-a0b6-46ac-b52d-5d1f16b962b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 24 15:09:24.319804 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:24.319770 2581 patch_prober.go:28] interesting pod/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 24 15:09:24.320233 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:24.319821 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" podUID="c8e718e1-a0b6-46ac-b52d-5d1f16b962b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 24 15:09:25.319852 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:25.319822 2581 patch_prober.go:28] interesting pod/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 24 15:09:25.320258 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:25.319871 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" podUID="c8e718e1-a0b6-46ac-b52d-5d1f16b962b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 24 15:09:26.323605 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:26.323577 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:09:26.324116 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:26.323898 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:09:26.324485 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:09:26.324468 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:10:20.122135 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:10:20.122068 2581 scope.go:117] "RemoveContainer" containerID="7cf710425a9f2bd5d19552bc97549dba481869ec01c7cb5fc3a8bcb563e9642c" Jul 24 15:10:20.130545 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:10:20.130527 2581 scope.go:117] "RemoveContainer" containerID="ce38f207a5484c685a9963c8c7902194f228f9d045966e2de12a542bc4866318" Jul 24 15:11:15.286426 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:15.286394 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e61f3ca0-glppb"] Jul 24 15:11:15.289973 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:15.289951 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e61f3ca0-glppb" Jul 24 15:11:15.293300 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:15.293277 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 24 15:11:15.293404 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:15.293277 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-g4jrf\"" Jul 24 15:11:15.308218 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:15.308200 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e61f3ca0-glppb"] Jul 24 15:11:15.362114 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:15.362087 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d3b71c5-5b8d-44d9-9916-aa8b2bdb1f7b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e61f3ca0-glppb\" (UID: \"3d3b71c5-5b8d-44d9-9916-aa8b2bdb1f7b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e61f3ca0-glppb" Jul 24 15:11:15.463491 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:15.463452 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d3b71c5-5b8d-44d9-9916-aa8b2bdb1f7b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e61f3ca0-glppb\" (UID: \"3d3b71c5-5b8d-44d9-9916-aa8b2bdb1f7b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e61f3ca0-glppb" Jul 24 15:11:15.464036 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:15.464018 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d3b71c5-5b8d-44d9-9916-aa8b2bdb1f7b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e61f3ca0-glppb\" (UID: \"3d3b71c5-5b8d-44d9-9916-aa8b2bdb1f7b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e61f3ca0-glppb" Jul 24 15:11:15.600301 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:15.600228 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e61f3ca0-glppb" Jul 24 15:11:15.740381 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:15.740353 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e61f3ca0-glppb"] Jul 24 15:11:15.742017 ip-10-0-131-12 kubenswrapper[2581]: W0724 15:11:15.741990 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d3b71c5_5b8d_44d9_9916_aa8b2bdb1f7b.slice/crio-67c9f108c1c6fb8a2836f246c792bade19ae891fec40ddfad7e161f2943b247a WatchSource:0}: Error finding container 67c9f108c1c6fb8a2836f246c792bade19ae891fec40ddfad7e161f2943b247a: Status 404 returned error can't find the container with id 67c9f108c1c6fb8a2836f246c792bade19ae891fec40ddfad7e161f2943b247a Jul 24 15:11:15.958308 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:15.958281 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e61f3ca0-glppb" event={"ID":"3d3b71c5-5b8d-44d9-9916-aa8b2bdb1f7b","Type":"ContainerStarted","Data":"67c9f108c1c6fb8a2836f246c792bade19ae891fec40ddfad7e161f2943b247a"} Jul 24 15:11:16.965043 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:16.965007 2581 generic.go:356] "Generic (PLEG): container finished" podID="3d3b71c5-5b8d-44d9-9916-aa8b2bdb1f7b" containerID="ac4a9f23ac4a5572fb00b122764a37859ee65167e0265f81a4774b414b2c4d59" exitCode=0 Jul 24 15:11:16.965436 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:16.965092 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e61f3ca0-glppb" event={"ID":"3d3b71c5-5b8d-44d9-9916-aa8b2bdb1f7b","Type":"ContainerDied","Data":"ac4a9f23ac4a5572fb00b122764a37859ee65167e0265f81a4774b414b2c4d59"} Jul 24 15:11:18.096954 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:18.096928 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e61f3ca0-glppb" Jul 24 15:11:18.189181 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:18.189124 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d3b71c5-5b8d-44d9-9916-aa8b2bdb1f7b-maas-api-service-ca\") pod \"3d3b71c5-5b8d-44d9-9916-aa8b2bdb1f7b\" (UID: \"3d3b71c5-5b8d-44d9-9916-aa8b2bdb1f7b\") " Jul 24 15:11:18.189511 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:18.189485 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d3b71c5-5b8d-44d9-9916-aa8b2bdb1f7b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3d3b71c5-5b8d-44d9-9916-aa8b2bdb1f7b" (UID: "3d3b71c5-5b8d-44d9-9916-aa8b2bdb1f7b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:11:18.189626 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:18.189579 2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d3b71c5-5b8d-44d9-9916-aa8b2bdb1f7b-maas-api-service-ca\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 15:11:18.977348 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:18.977323 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e61f3ca0-glppb" Jul 24 15:11:18.977348 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:18.977340 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e61f3ca0-glppb" event={"ID":"3d3b71c5-5b8d-44d9-9916-aa8b2bdb1f7b","Type":"ContainerDied","Data":"67c9f108c1c6fb8a2836f246c792bade19ae891fec40ddfad7e161f2943b247a"} Jul 24 15:11:18.977624 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:18.977415 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="67c9f108c1c6fb8a2836f246c792bade19ae891fec40ddfad7e161f2943b247a" Jul 24 15:11:29.097367 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:29.097335 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 15:11:30.419529 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:30.419498 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e61f3ca0-glppb"] Jul 24 15:11:30.422792 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:30.422758 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e61f3ca0-glppb"] Jul 24 15:11:32.112171 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:32.112118 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d3b71c5-5b8d-44d9-9916-aa8b2bdb1f7b" path="/var/lib/kubelet/pods/3d3b71c5-5b8d-44d9-9916-aa8b2bdb1f7b/volumes" Jul 24 15:11:37.371927 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:37.371888 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m"] Jul 24 15:11:37.372410 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:37.372166 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" podUID="c8e718e1-a0b6-46ac-b52d-5d1f16b962b6" containerName="istio-proxy" containerID="cri-o://6d7ddc2a6bc1be36fe13b593253c0d4fff62d2ff990c565823987b1cbd8199d7" gracePeriod=30 Jul 24 15:11:41.326114 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:41.326029 2581 patch_prober.go:28] interesting pod/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 24 15:11:41.326114 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:41.326101 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" podUID="c8e718e1-a0b6-46ac-b52d-5d1f16b962b6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 24 15:11:41.804706 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:41.804674 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 15:11:42.635921 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:42.635892 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:11:42.710709 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:42.710630 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-workload-socket\") pod \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\" (UID: \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\") " Jul 24 15:11:42.710709 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:42.710674 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-istio-envoy\") pod \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\" (UID: \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\") " Jul 24 15:11:42.710709 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:42.710711 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-credential-socket\") pod \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\" (UID: \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\") " Jul 24 15:11:42.710998 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:42.710730 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-istio-podinfo\") pod \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\" (UID: \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\") " Jul 24 15:11:42.710998 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:42.710752 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8hhm\" (UniqueName: \"kubernetes.io/projected/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-kube-api-access-z8hhm\") pod \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\" (UID: \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\") " Jul 24 15:11:42.710998 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:42.710780 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-istio-token\") pod \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\" (UID: \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\") " Jul 24 15:11:42.710998 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:42.710843 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-workload-certs\") pod \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\" (UID: \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\") " Jul 24 15:11:42.710998 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:42.710882 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-istio-data\") pod \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\" (UID: \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\") " Jul 24 15:11:42.710998 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:42.710928 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-istiod-ca-cert\") pod \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\" (UID: \"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6\") " Jul 24 15:11:42.710998 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:42.710941 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c8e718e1-a0b6-46ac-b52d-5d1f16b962b6" (UID: "c8e718e1-a0b6-46ac-b52d-5d1f16b962b6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:11:42.711411 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:42.711066 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c8e718e1-a0b6-46ac-b52d-5d1f16b962b6" (UID: "c8e718e1-a0b6-46ac-b52d-5d1f16b962b6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:11:42.711411 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:42.711190 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c8e718e1-a0b6-46ac-b52d-5d1f16b962b6" (UID: "c8e718e1-a0b6-46ac-b52d-5d1f16b962b6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:11:42.711411 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:42.711287 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-workload-socket\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 15:11:42.711411 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:42.711303 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-credential-socket\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 15:11:42.711411 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:42.711315 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-workload-certs\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 15:11:42.711411 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:42.711385 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c8e718e1-a0b6-46ac-b52d-5d1f16b962b6" (UID: "c8e718e1-a0b6-46ac-b52d-5d1f16b962b6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:11:42.711853 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:42.711831 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-istio-data" (OuterVolumeSpecName: "istio-data") pod "c8e718e1-a0b6-46ac-b52d-5d1f16b962b6" (UID: "c8e718e1-a0b6-46ac-b52d-5d1f16b962b6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:11:42.713133 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:42.713110 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-kube-api-access-z8hhm" (OuterVolumeSpecName: "kube-api-access-z8hhm") pod "c8e718e1-a0b6-46ac-b52d-5d1f16b962b6" (UID: "c8e718e1-a0b6-46ac-b52d-5d1f16b962b6"). InnerVolumeSpecName "kube-api-access-z8hhm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:11:42.713251 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:42.713113 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c8e718e1-a0b6-46ac-b52d-5d1f16b962b6" (UID: "c8e718e1-a0b6-46ac-b52d-5d1f16b962b6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 15:11:42.713414 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:42.713397 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-istio-token" (OuterVolumeSpecName: "istio-token") pod "c8e718e1-a0b6-46ac-b52d-5d1f16b962b6" (UID: "c8e718e1-a0b6-46ac-b52d-5d1f16b962b6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 15:11:42.713466 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:42.713398 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c8e718e1-a0b6-46ac-b52d-5d1f16b962b6" (UID: "c8e718e1-a0b6-46ac-b52d-5d1f16b962b6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 15:11:42.812242 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:42.812198 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-istio-podinfo\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 15:11:42.812242 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:42.812235 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8hhm\" (UniqueName: \"kubernetes.io/projected/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-kube-api-access-z8hhm\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 15:11:42.812242 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:42.812246 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-istio-token\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 15:11:42.812242 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:42.812254 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-istio-data\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 15:11:42.812242 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:42.812262 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-istiod-ca-cert\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 15:11:42.812543 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:42.812270 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6-istio-envoy\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 15:11:43.103061 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:43.103030 2581 generic.go:356] "Generic (PLEG): container finished" podID="c8e718e1-a0b6-46ac-b52d-5d1f16b962b6" containerID="6d7ddc2a6bc1be36fe13b593253c0d4fff62d2ff990c565823987b1cbd8199d7" exitCode=0 Jul 24 15:11:43.103268 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:43.103079 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" Jul 24 15:11:43.103268 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:43.103115 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" event={"ID":"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6","Type":"ContainerDied","Data":"6d7ddc2a6bc1be36fe13b593253c0d4fff62d2ff990c565823987b1cbd8199d7"} Jul 24 15:11:43.103268 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:43.103189 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m" event={"ID":"c8e718e1-a0b6-46ac-b52d-5d1f16b962b6","Type":"ContainerDied","Data":"b067ac044f2c5cc11634ae5cba9596095bcb8f5f028165f7e1c0c36ecafbb609"} Jul 24 15:11:43.103268 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:43.103220 2581 scope.go:117] "RemoveContainer" containerID="6d7ddc2a6bc1be36fe13b593253c0d4fff62d2ff990c565823987b1cbd8199d7" Jul 24 15:11:43.112929 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:43.112912 2581 scope.go:117] "RemoveContainer" containerID="504ff5ac4a1cae41097549587f3c6ec56661bfbc024214111200f607d80c7e8c" Jul 24 15:11:43.120763 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:43.120747 2581 scope.go:117] "RemoveContainer" containerID="6d7ddc2a6bc1be36fe13b593253c0d4fff62d2ff990c565823987b1cbd8199d7" Jul 24 15:11:43.121036 ip-10-0-131-12 kubenswrapper[2581]: E0724 15:11:43.121018 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d7ddc2a6bc1be36fe13b593253c0d4fff62d2ff990c565823987b1cbd8199d7\": container with ID starting with 6d7ddc2a6bc1be36fe13b593253c0d4fff62d2ff990c565823987b1cbd8199d7 not found: ID does not exist" containerID="6d7ddc2a6bc1be36fe13b593253c0d4fff62d2ff990c565823987b1cbd8199d7" Jul 24 15:11:43.121082 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:43.121045 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d7ddc2a6bc1be36fe13b593253c0d4fff62d2ff990c565823987b1cbd8199d7"} err="failed to get container status \"6d7ddc2a6bc1be36fe13b593253c0d4fff62d2ff990c565823987b1cbd8199d7\": rpc error: code = NotFound desc = could not find container \"6d7ddc2a6bc1be36fe13b593253c0d4fff62d2ff990c565823987b1cbd8199d7\": container with ID starting with 6d7ddc2a6bc1be36fe13b593253c0d4fff62d2ff990c565823987b1cbd8199d7 not found: ID does not exist" Jul 24 15:11:43.121082 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:43.121063 2581 scope.go:117] "RemoveContainer" containerID="504ff5ac4a1cae41097549587f3c6ec56661bfbc024214111200f607d80c7e8c" Jul 24 15:11:43.121317 ip-10-0-131-12 kubenswrapper[2581]: E0724 15:11:43.121301 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"504ff5ac4a1cae41097549587f3c6ec56661bfbc024214111200f607d80c7e8c\": container with ID starting with 504ff5ac4a1cae41097549587f3c6ec56661bfbc024214111200f607d80c7e8c not found: ID does not exist" containerID="504ff5ac4a1cae41097549587f3c6ec56661bfbc024214111200f607d80c7e8c" Jul 24 15:11:43.121360 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:43.121324 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"504ff5ac4a1cae41097549587f3c6ec56661bfbc024214111200f607d80c7e8c"} err="failed to get container status \"504ff5ac4a1cae41097549587f3c6ec56661bfbc024214111200f607d80c7e8c\": rpc error: code = NotFound desc = could not find container \"504ff5ac4a1cae41097549587f3c6ec56661bfbc024214111200f607d80c7e8c\": container with ID starting with 504ff5ac4a1cae41097549587f3c6ec56661bfbc024214111200f607d80c7e8c not found: ID does not exist" Jul 24 15:11:43.128438 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:43.128417 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m"] Jul 24 15:11:43.135861 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:43.135841 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-e61f3ca0-openshift-default-6f5748cb68-btt2m"] Jul 24 15:11:44.112399 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:44.112366 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8e718e1-a0b6-46ac-b52d-5d1f16b962b6" path="/var/lib/kubelet/pods/c8e718e1-a0b6-46ac-b52d-5d1f16b962b6/volumes" Jul 24 15:11:52.113118 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:11:52.113086 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 15:12:43.202288 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:12:43.202252 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 15:14:47.621895 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:14:47.621818 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6c969d-tjr7b"] Jul 24 15:14:47.624204 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:14:47.622148 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8e718e1-a0b6-46ac-b52d-5d1f16b962b6" containerName="istio-proxy" Jul 24 15:14:47.624204 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:14:47.622177 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8e718e1-a0b6-46ac-b52d-5d1f16b962b6" containerName="istio-proxy" Jul 24 15:14:47.624204 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:14:47.622192 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d3b71c5-5b8d-44d9-9916-aa8b2bdb1f7b" containerName="revoke-keys" Jul 24 15:14:47.624204 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:14:47.622198 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d3b71c5-5b8d-44d9-9916-aa8b2bdb1f7b" containerName="revoke-keys" Jul 24 15:14:47.624204 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:14:47.622212 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8e718e1-a0b6-46ac-b52d-5d1f16b962b6" containerName="istio-proxy" Jul 24 15:14:47.624204 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:14:47.622217 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8e718e1-a0b6-46ac-b52d-5d1f16b962b6" containerName="istio-proxy" Jul 24 15:14:47.624204 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:14:47.622271 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8e718e1-a0b6-46ac-b52d-5d1f16b962b6" containerName="istio-proxy" Jul 24 15:14:47.624204 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:14:47.622278 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d3b71c5-5b8d-44d9-9916-aa8b2bdb1f7b" containerName="revoke-keys" Jul 24 15:14:47.625078 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:14:47.625063 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6c969d-tjr7b" Jul 24 15:14:47.628427 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:14:47.628402 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-g4jrf\"" Jul 24 15:14:47.628537 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:14:47.628518 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 24 15:14:47.633417 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:14:47.633400 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0d92cec-f492-4b4e-9c0f-4638f981430f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-6c969d-tjr7b\" (UID: \"d0d92cec-f492-4b4e-9c0f-4638f981430f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6c969d-tjr7b" Jul 24 15:14:47.671438 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:14:47.671418 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6c969d-tjr7b"] Jul 24 15:14:47.734683 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:14:47.734656 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0d92cec-f492-4b4e-9c0f-4638f981430f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-6c969d-tjr7b\" (UID: \"d0d92cec-f492-4b4e-9c0f-4638f981430f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6c969d-tjr7b" Jul 24 15:14:47.735249 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:14:47.735232 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0d92cec-f492-4b4e-9c0f-4638f981430f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-6c969d-tjr7b\" (UID: \"d0d92cec-f492-4b4e-9c0f-4638f981430f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6c969d-tjr7b" Jul 24 15:14:47.935192 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:14:47.935137 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6c969d-tjr7b" Jul 24 15:14:48.288206 ip-10-0-131-12 kubenswrapper[2581]: W0724 15:14:48.288169 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0d92cec_f492_4b4e_9c0f_4638f981430f.slice/crio-019207b45a4b1921875c6700702518cd3c58b8edb8d9e173d8649c9d4a77b4dc WatchSource:0}: Error finding container 019207b45a4b1921875c6700702518cd3c58b8edb8d9e173d8649c9d4a77b4dc: Status 404 returned error can't find the container with id 019207b45a4b1921875c6700702518cd3c58b8edb8d9e173d8649c9d4a77b4dc Jul 24 15:14:48.288354 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:14:48.288330 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6c969d-tjr7b"] Jul 24 15:14:49.052863 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:14:49.052832 2581 generic.go:356] "Generic (PLEG): container finished" podID="d0d92cec-f492-4b4e-9c0f-4638f981430f" containerID="c75a9d85842d3842e4c4633bce6b511fb75098c6da9b5ce85881539971e0f806" exitCode=0 Jul 24 15:14:49.053217 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:14:49.052904 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6c969d-tjr7b" event={"ID":"d0d92cec-f492-4b4e-9c0f-4638f981430f","Type":"ContainerDied","Data":"c75a9d85842d3842e4c4633bce6b511fb75098c6da9b5ce85881539971e0f806"} Jul 24 15:14:49.053217 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:14:49.052985 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6c969d-tjr7b" event={"ID":"d0d92cec-f492-4b4e-9c0f-4638f981430f","Type":"ContainerStarted","Data":"019207b45a4b1921875c6700702518cd3c58b8edb8d9e173d8649c9d4a77b4dc"} Jul 24 15:14:50.190428 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:14:50.190404 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6c969d-tjr7b" Jul 24 15:14:50.257375 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:14:50.257351 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0d92cec-f492-4b4e-9c0f-4638f981430f-maas-api-service-ca\") pod \"d0d92cec-f492-4b4e-9c0f-4638f981430f\" (UID: \"d0d92cec-f492-4b4e-9c0f-4638f981430f\") " Jul 24 15:14:50.257748 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:14:50.257724 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0d92cec-f492-4b4e-9c0f-4638f981430f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d0d92cec-f492-4b4e-9c0f-4638f981430f" (UID: "d0d92cec-f492-4b4e-9c0f-4638f981430f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 15:14:50.358957 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:14:50.358887 2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0d92cec-f492-4b4e-9c0f-4638f981430f-maas-api-service-ca\") on node \"ip-10-0-131-12.ec2.internal\" DevicePath \"\"" Jul 24 15:14:51.065857 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:14:51.065828 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6c969d-tjr7b" Jul 24 15:14:51.066062 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:14:51.065872 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6c969d-tjr7b" event={"ID":"d0d92cec-f492-4b4e-9c0f-4638f981430f","Type":"ContainerDied","Data":"019207b45a4b1921875c6700702518cd3c58b8edb8d9e173d8649c9d4a77b4dc"} Jul 24 15:14:51.066062 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:14:51.065925 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="019207b45a4b1921875c6700702518cd3c58b8edb8d9e173d8649c9d4a77b4dc" Jul 24 15:15:00.192082 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:00.192043 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748435-5x4vq"] Jul 24 15:15:00.192516 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:00.192389 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0d92cec-f492-4b4e-9c0f-4638f981430f" containerName="revoke-keys" Jul 24 15:15:00.192516 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:00.192402 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0d92cec-f492-4b4e-9c0f-4638f981430f" containerName="revoke-keys" Jul 24 15:15:00.192516 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:00.192455 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8e718e1-a0b6-46ac-b52d-5d1f16b962b6" containerName="istio-proxy" Jul 24 15:15:00.192516 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:00.192467 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0d92cec-f492-4b4e-9c0f-4638f981430f" containerName="revoke-keys" Jul 24 15:15:00.195318 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:00.195299 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748435-5x4vq" Jul 24 15:15:00.210783 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:00.210764 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-g4jrf\"" Jul 24 15:15:00.215468 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:00.215455 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748435-5x4vq" Jul 24 15:15:00.222980 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:00.222956 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748435-5x4vq"] Jul 24 15:15:00.362378 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:00.362351 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748435-5x4vq"] Jul 24 15:15:00.363798 ip-10-0-131-12 kubenswrapper[2581]: W0724 15:15:00.363761 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2136b62_f7f0_42ed_9d71_2fe5810a3355.slice/crio-f7509190ecc1e44535f529a101f46d752450f35135faf4edd99561b52f89b41d WatchSource:0}: Error finding container f7509190ecc1e44535f529a101f46d752450f35135faf4edd99561b52f89b41d: Status 404 returned error can't find the container with id f7509190ecc1e44535f529a101f46d752450f35135faf4edd99561b52f89b41d Jul 24 15:15:01.121807 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:01.121776 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748435-5x4vq" event={"ID":"b2136b62-f7f0-42ed-9d71-2fe5810a3355","Type":"ContainerStarted","Data":"e6fd4be8c2209d8a625f31a4b3eb2af97a098cdd81f1e58abdf4fa4780b57119"} Jul 24 15:15:01.121977 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:01.121826 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748435-5x4vq" event={"ID":"b2136b62-f7f0-42ed-9d71-2fe5810a3355","Type":"ContainerStarted","Data":"f7509190ecc1e44535f529a101f46d752450f35135faf4edd99561b52f89b41d"} Jul 24 15:15:01.158272 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:01.158228 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748435-5x4vq" podStartSLOduration=1.158212995 podStartE2EDuration="1.158212995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 15:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:15:01.156798885 +0000 UTC m=+2441.694054838" watchObservedRunningTime="2026-07-24 15:15:01.158212995 +0000 UTC m=+2441.695468947" Jul 24 15:15:01.324133 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:01.324091 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f599l"] Jul 24 15:15:02.128447 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:02.128417 2581 generic.go:356] "Generic (PLEG): container finished" podID="b2136b62-f7f0-42ed-9d71-2fe5810a3355" containerID="e6fd4be8c2209d8a625f31a4b3eb2af97a098cdd81f1e58abdf4fa4780b57119" exitCode=0 Jul 24 15:15:02.128630 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:02.128488 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748435-5x4vq" event={"ID":"b2136b62-f7f0-42ed-9d71-2fe5810a3355","Type":"ContainerDied","Data":"e6fd4be8c2209d8a625f31a4b3eb2af97a098cdd81f1e58abdf4fa4780b57119"} Jul 24 15:15:02.775363 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:02.775330 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6c969d-tjr7b"] Jul 24 15:15:02.786501 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:02.786477 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6c969d-tjr7b"] Jul 24 15:15:03.263883 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:03.263861 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748435-5x4vq" Jul 24 15:15:04.112362 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:04.112334 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0d92cec-f492-4b4e-9c0f-4638f981430f" path="/var/lib/kubelet/pods/d0d92cec-f492-4b4e-9c0f-4638f981430f/volumes" Jul 24 15:15:04.139673 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:04.139645 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748435-5x4vq" Jul 24 15:15:04.139818 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:04.139650 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748435-5x4vq" event={"ID":"b2136b62-f7f0-42ed-9d71-2fe5810a3355","Type":"ContainerDied","Data":"f7509190ecc1e44535f529a101f46d752450f35135faf4edd99561b52f89b41d"} Jul 24 15:15:04.139818 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:04.139784 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f7509190ecc1e44535f529a101f46d752450f35135faf4edd99561b52f89b41d" Jul 24 15:15:18.037578 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:18.037553 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-696d5956bc-lzfmt_25b1a60c-85f3-4c74-b7ee-e3923e616719/copy-manifests/0.log" Jul 24 15:15:18.046259 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:18.046238 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-696d5956bc-lzfmt_25b1a60c-85f3-4c74-b7ee-e3923e616719/manager/0.log" Jul 24 15:15:18.790401 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:18.790373 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29748420-zl54h_552be55e-a7fe-449f-9724-2d819f8b9378/cleanup/0.log" Jul 24 15:15:18.909742 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:18.909716 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29748435-5x4vq_b2136b62-f7f0-42ed-9d71-2fe5810a3355/cleanup/0.log" Jul 24 15:15:19.843744 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:19.843717 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmpdm_7147f649-e4bb-4a00-a2e6-e16a639210b2/util/0.log" Jul 24 15:15:19.850744 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:19.850718 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmpdm_7147f649-e4bb-4a00-a2e6-e16a639210b2/pull/0.log" Jul 24 15:15:19.858431 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:19.858411 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmpdm_7147f649-e4bb-4a00-a2e6-e16a639210b2/extract/0.log" Jul 24 15:15:19.978923 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:19.978897 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5hfs_0c28712a-9b7e-4fb1-88dc-4d2514a57254/util/0.log" Jul 24 15:15:19.986796 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:19.986772 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5hfs_0c28712a-9b7e-4fb1-88dc-4d2514a57254/pull/0.log" Jul 24 15:15:19.997712 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:19.997690 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5hfs_0c28712a-9b7e-4fb1-88dc-4d2514a57254/extract/0.log" Jul 24 15:15:20.124639 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:20.124571 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735rkwz_cfc0ce19-6c06-4691-b4df-2e4096034d18/util/0.log" Jul 24 15:15:20.139703 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:20.139675 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735rkwz_cfc0ce19-6c06-4691-b4df-2e4096034d18/pull/0.log" Jul 24 15:15:20.159599 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:20.159568 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735rkwz_cfc0ce19-6c06-4691-b4df-2e4096034d18/extract/0.log" Jul 24 15:15:20.190886 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:20.190858 2581 scope.go:117] "RemoveContainer" containerID="007cb18480c347f430ecccec2d65e8ee8c07da6335fa5895d8320970034dbaec" Jul 24 15:15:20.282673 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:20.282649 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17h4xt_74684c06-2406-4a20-a37d-c3ba19c31f53/util/0.log" Jul 24 15:15:20.294755 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:20.294731 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17h4xt_74684c06-2406-4a20-a37d-c3ba19c31f53/pull/0.log" Jul 24 15:15:20.301679 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:20.301663 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17h4xt_74684c06-2406-4a20-a37d-c3ba19c31f53/extract/0.log" Jul 24 15:15:21.208963 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:21.208935 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-f599l_60a68218-50bc-42c7-80cf-b2181a743aa0/limitador/0.log" Jul 24 15:15:21.820690 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:21.820664 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-75lrr_aa1799bf-b00d-4024-9b3f-e58330985fc3/discovery/0.log" Jul 24 15:15:22.563113 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:22.563083 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78dd4996b7-bzkqg_ef917c53-72f3-4267-a655-84607918a723/router/0.log" Jul 24 15:15:23.298968 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:23.298938 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpl6z6_b1725524-e5f4-4e33-85d0-1d15c2630da6/main/0.log" Jul 24 15:15:32.547906 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:32.547874 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cwz72_7bf205e6-d5a4-4e93-a3c8-e3ea35355044/global-pull-secret-syncer/0.log" Jul 24 15:15:32.778525 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:32.778494 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ww5lq_94643644-01c1-41e6-b869-ca7f08f2010f/konnectivity-agent/0.log" Jul 24 15:15:32.834955 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:32.834884 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-12.ec2.internal_c18d0a8ddba5724c2819ddd49f257f64/haproxy/0.log" Jul 24 15:15:37.123052 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:37.123023 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmpdm_7147f649-e4bb-4a00-a2e6-e16a639210b2/extract/0.log" Jul 24 15:15:37.151966 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:37.151944 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmpdm_7147f649-e4bb-4a00-a2e6-e16a639210b2/util/0.log" Jul 24 15:15:37.180437 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:37.180417 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmpdm_7147f649-e4bb-4a00-a2e6-e16a639210b2/pull/0.log" Jul 24 15:15:37.211707 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:37.211687 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5hfs_0c28712a-9b7e-4fb1-88dc-4d2514a57254/extract/0.log" Jul 24 15:15:37.242202 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:37.242179 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5hfs_0c28712a-9b7e-4fb1-88dc-4d2514a57254/util/0.log" Jul 24 15:15:37.265920 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:37.265900 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s5hfs_0c28712a-9b7e-4fb1-88dc-4d2514a57254/pull/0.log" Jul 24 15:15:37.295361 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:37.295343 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735rkwz_cfc0ce19-6c06-4691-b4df-2e4096034d18/extract/0.log" Jul 24 15:15:37.322854 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:37.322830 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735rkwz_cfc0ce19-6c06-4691-b4df-2e4096034d18/util/0.log" Jul 24 15:15:37.352749 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:37.352726 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735rkwz_cfc0ce19-6c06-4691-b4df-2e4096034d18/pull/0.log" Jul 24 15:15:37.395517 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:37.395455 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17h4xt_74684c06-2406-4a20-a37d-c3ba19c31f53/extract/0.log" Jul 24 15:15:37.419315 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:37.419292 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17h4xt_74684c06-2406-4a20-a37d-c3ba19c31f53/util/0.log" Jul 24 15:15:37.450524 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:37.450500 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17h4xt_74684c06-2406-4a20-a37d-c3ba19c31f53/pull/0.log" Jul 24 15:15:38.141081 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:38.141052 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-f599l_60a68218-50bc-42c7-80cf-b2181a743aa0/limitador/0.log" Jul 24 15:15:40.055935 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:40.055894 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-tzpfp_ad44feb0-98db-4e8f-b9f9-b7495d6adf97/cluster-monitoring-operator/0.log" Jul 24 15:15:40.083202 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:40.083179 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-kcpd8_d34526b7-53c8-413d-8bd4-5ce333d5110f/kube-state-metrics/0.log" Jul 24 15:15:40.111328 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:40.111304 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-kcpd8_d34526b7-53c8-413d-8bd4-5ce333d5110f/kube-rbac-proxy-main/0.log" Jul 24 15:15:40.140317 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:40.140294 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-kcpd8_d34526b7-53c8-413d-8bd4-5ce333d5110f/kube-rbac-proxy-self/0.log" Jul 24 15:15:40.206531 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:40.206504 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-lf8fr_227b4e8c-bd3a-4d46-bad6-646a0f602d8f/monitoring-plugin/0.log" Jul 24 15:15:40.338516 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:40.338442 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9k5wm_1daa7811-550d-40f9-b791-ddb7c2ee0e49/node-exporter/0.log" Jul 24 15:15:40.375851 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:40.375826 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9k5wm_1daa7811-550d-40f9-b791-ddb7c2ee0e49/kube-rbac-proxy/0.log" Jul 24 15:15:40.405038 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:40.405018 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9k5wm_1daa7811-550d-40f9-b791-ddb7c2ee0e49/init-textfile/0.log" Jul 24 15:15:40.861387 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:40.861360 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-9fb9f9d68-847dm_dbdeb103-dbf4-4218-848a-b28616f0da5d/telemeter-client/0.log" Jul 24 15:15:40.884922 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:40.884901 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-9fb9f9d68-847dm_dbdeb103-dbf4-4218-848a-b28616f0da5d/reload/0.log" Jul 24 15:15:40.911690 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:40.911664 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-9fb9f9d68-847dm_dbdeb103-dbf4-4218-848a-b28616f0da5d/kube-rbac-proxy/0.log" Jul 24 15:15:40.949554 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:40.949534 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54544f6d4-4tx42_e9cfbc54-2b5d-45e2-83c8-6785654d79a5/thanos-query/0.log" Jul 24 15:15:40.986133 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:40.986111 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54544f6d4-4tx42_e9cfbc54-2b5d-45e2-83c8-6785654d79a5/kube-rbac-proxy-web/0.log" Jul 24 15:15:41.013360 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:41.013339 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54544f6d4-4tx42_e9cfbc54-2b5d-45e2-83c8-6785654d79a5/kube-rbac-proxy/0.log" Jul 24 15:15:41.039046 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:41.039030 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54544f6d4-4tx42_e9cfbc54-2b5d-45e2-83c8-6785654d79a5/prom-label-proxy/0.log" Jul 24 15:15:41.063618 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:41.063596 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54544f6d4-4tx42_e9cfbc54-2b5d-45e2-83c8-6785654d79a5/kube-rbac-proxy-rules/0.log" Jul 24 15:15:41.091655 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:41.091635 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54544f6d4-4tx42_e9cfbc54-2b5d-45e2-83c8-6785654d79a5/kube-rbac-proxy-metrics/0.log" Jul 24 15:15:41.907124 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:41.907086 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qd87v/perf-node-gather-daemonset-8shvk"] Jul 24 15:15:41.907440 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:41.907427 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2136b62-f7f0-42ed-9d71-2fe5810a3355" containerName="cleanup" Jul 24 15:15:41.907440 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:41.907441 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2136b62-f7f0-42ed-9d71-2fe5810a3355" containerName="cleanup" Jul 24 15:15:41.907518 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:41.907506 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2136b62-f7f0-42ed-9d71-2fe5810a3355" containerName="cleanup" Jul 24 15:15:41.910939 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:41.910918 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-8shvk" Jul 24 15:15:41.913791 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:41.913767 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qd87v\"/\"kube-root-ca.crt\"" Jul 24 15:15:41.915057 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:41.915042 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qd87v\"/\"openshift-service-ca.crt\"" Jul 24 15:15:41.915135 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:41.915047 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qd87v\"/\"default-dockercfg-m4jjv\"" Jul 24 15:15:41.920356 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:41.920335 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qd87v/perf-node-gather-daemonset-8shvk"] Jul 24 15:15:42.090882 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:42.090844 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fd05c202-954b-4336-9151-613eec8c66e0-proc\") pod \"perf-node-gather-daemonset-8shvk\" (UID: \"fd05c202-954b-4336-9151-613eec8c66e0\") " pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-8shvk" Jul 24 15:15:42.091356 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:42.090895 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fd05c202-954b-4336-9151-613eec8c66e0-lib-modules\") pod \"perf-node-gather-daemonset-8shvk\" (UID: \"fd05c202-954b-4336-9151-613eec8c66e0\") " pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-8shvk" Jul 24 15:15:42.091356 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:42.090937 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fd05c202-954b-4336-9151-613eec8c66e0-podres\") pod \"perf-node-gather-daemonset-8shvk\" (UID: \"fd05c202-954b-4336-9151-613eec8c66e0\") " pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-8shvk" Jul 24 15:15:42.091356 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:42.091062 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkw69\" (UniqueName: \"kubernetes.io/projected/fd05c202-954b-4336-9151-613eec8c66e0-kube-api-access-zkw69\") pod \"perf-node-gather-daemonset-8shvk\" (UID: \"fd05c202-954b-4336-9151-613eec8c66e0\") " pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-8shvk" Jul 24 15:15:42.091356 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:42.091109 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd05c202-954b-4336-9151-613eec8c66e0-sys\") pod \"perf-node-gather-daemonset-8shvk\" (UID: \"fd05c202-954b-4336-9151-613eec8c66e0\") " pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-8shvk" Jul 24 15:15:42.191610 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:42.191528 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkw69\" (UniqueName: \"kubernetes.io/projected/fd05c202-954b-4336-9151-613eec8c66e0-kube-api-access-zkw69\") pod \"perf-node-gather-daemonset-8shvk\" (UID: \"fd05c202-954b-4336-9151-613eec8c66e0\") " pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-8shvk" Jul 24 15:15:42.191610 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:42.191561 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd05c202-954b-4336-9151-613eec8c66e0-sys\") pod \"perf-node-gather-daemonset-8shvk\" (UID: \"fd05c202-954b-4336-9151-613eec8c66e0\") " pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-8shvk" Jul 24 15:15:42.191610 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:42.191588 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fd05c202-954b-4336-9151-613eec8c66e0-proc\") pod \"perf-node-gather-daemonset-8shvk\" (UID: \"fd05c202-954b-4336-9151-613eec8c66e0\") " pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-8shvk" Jul 24 15:15:42.191610 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:42.191605 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fd05c202-954b-4336-9151-613eec8c66e0-lib-modules\") pod \"perf-node-gather-daemonset-8shvk\" (UID: \"fd05c202-954b-4336-9151-613eec8c66e0\") " pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-8shvk" Jul 24 15:15:42.191890 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:42.191631 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fd05c202-954b-4336-9151-613eec8c66e0-podres\") pod \"perf-node-gather-daemonset-8shvk\" (UID: \"fd05c202-954b-4336-9151-613eec8c66e0\") " pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-8shvk" Jul 24 15:15:42.191890 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:42.191737 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd05c202-954b-4336-9151-613eec8c66e0-sys\") pod \"perf-node-gather-daemonset-8shvk\" (UID: \"fd05c202-954b-4336-9151-613eec8c66e0\") " pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-8shvk" Jul 24 15:15:42.191890 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:42.191746 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fd05c202-954b-4336-9151-613eec8c66e0-podres\") pod \"perf-node-gather-daemonset-8shvk\" (UID: \"fd05c202-954b-4336-9151-613eec8c66e0\") " pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-8shvk" Jul 24 15:15:42.191890 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:42.191773 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fd05c202-954b-4336-9151-613eec8c66e0-proc\") pod \"perf-node-gather-daemonset-8shvk\" (UID: \"fd05c202-954b-4336-9151-613eec8c66e0\") " pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-8shvk" Jul 24 15:15:42.191890 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:42.191842 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fd05c202-954b-4336-9151-613eec8c66e0-lib-modules\") pod \"perf-node-gather-daemonset-8shvk\" (UID: \"fd05c202-954b-4336-9151-613eec8c66e0\") " pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-8shvk" Jul 24 15:15:42.200615 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:42.200590 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkw69\" (UniqueName: \"kubernetes.io/projected/fd05c202-954b-4336-9151-613eec8c66e0-kube-api-access-zkw69\") pod \"perf-node-gather-daemonset-8shvk\" (UID: \"fd05c202-954b-4336-9151-613eec8c66e0\") " pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-8shvk" Jul 24 15:15:42.221310 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:42.221291 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-8shvk" Jul 24 15:15:42.251378 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:42.251348 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-njtks_4ca60a05-a187-4eff-85e3-6fff76c4d980/networking-console-plugin/0.log" Jul 24 15:15:42.354061 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:42.354038 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qd87v/perf-node-gather-daemonset-8shvk"] Jul 24 15:15:42.355642 ip-10-0-131-12 kubenswrapper[2581]: W0724 15:15:42.355616 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfd05c202_954b_4336_9151_613eec8c66e0.slice/crio-ed1e8f368795b30e243dc8e5d2ffabf418fde3ede826a0d9d98702c0bb238382 WatchSource:0}: Error finding container ed1e8f368795b30e243dc8e5d2ffabf418fde3ede826a0d9d98702c0bb238382: Status 404 returned error can't find the container with id ed1e8f368795b30e243dc8e5d2ffabf418fde3ede826a0d9d98702c0bb238382 Jul 24 15:15:43.318287 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:43.318262 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-89bf45b89-tm598_529a8628-7402-461d-8e82-89ce4dcd47ee/console/0.log" Jul 24 15:15:43.336677 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:43.336649 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-8shvk" event={"ID":"fd05c202-954b-4336-9151-613eec8c66e0","Type":"ContainerStarted","Data":"5c985bfff3bc0af09c254aad86456b449e952cf338f657c8ee343e6d955ed36f"} Jul 24 15:15:43.336835 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:43.336694 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-8shvk" event={"ID":"fd05c202-954b-4336-9151-613eec8c66e0","Type":"ContainerStarted","Data":"ed1e8f368795b30e243dc8e5d2ffabf418fde3ede826a0d9d98702c0bb238382"} Jul 24 15:15:43.336835 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:43.336771 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-8shvk" Jul 24 15:15:43.357732 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:43.357687 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-8shvk" podStartSLOduration=2.35767292 podStartE2EDuration="2.35767292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 15:15:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 15:15:43.357145485 +0000 UTC m=+2483.894401436" watchObservedRunningTime="2026-07-24 15:15:43.35767292 +0000 UTC m=+2483.894928872" Jul 24 15:15:45.066658 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:45.066627 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lxwhk_f1af447a-c7f6-4788-b687-514e2f6f732e/dns/0.log" Jul 24 15:15:45.091778 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:45.091757 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lxwhk_f1af447a-c7f6-4788-b687-514e2f6f732e/kube-rbac-proxy/0.log" Jul 24 15:15:45.194905 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:45.194877 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-shsqx_df66942e-5c07-46e0-93fe-04ad53865c89/dns-node-resolver/0.log" Jul 24 15:15:45.776427 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:45.776392 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-d88fcb476-xt485_e1ef4d3b-21c2-4fb4-9e4d-9c01393052f1/registry/0.log" Jul 24 15:15:45.835266 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:45.835234 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rrxgj_76abe981-1c84-4f65-82ff-a837b3e20722/node-ca/0.log" Jul 24 15:15:46.876659 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:46.876628 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-75lrr_aa1799bf-b00d-4024-9b3f-e58330985fc3/discovery/0.log" Jul 24 15:15:47.194814 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:47.194727 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78dd4996b7-bzkqg_ef917c53-72f3-4267-a655-84607918a723/router/0.log" Jul 24 15:15:48.056693 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:48.056666 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-df8sl_95c5e482-1abe-49b4-bb3e-154df4ac5486/serve-healthcheck-canary/0.log" Jul 24 15:15:48.622465 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:48.622423 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j9286_df7771c3-8bfb-4c8d-a827-a6ed71b7ced8/kube-rbac-proxy/0.log" Jul 24 15:15:48.666308 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:48.666287 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j9286_df7771c3-8bfb-4c8d-a827-a6ed71b7ced8/exporter/0.log" Jul 24 15:15:48.712242 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:48.712208 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j9286_df7771c3-8bfb-4c8d-a827-a6ed71b7ced8/extractor/0.log" Jul 24 15:15:49.351122 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:49.351097 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qd87v/perf-node-gather-daemonset-8shvk" Jul 24 15:15:51.524927 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:51.524850 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-75lrr_aa1799bf-b00d-4024-9b3f-e58330985fc3/discovery/0.log" Jul 24 15:15:51.729466 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:51.729440 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78dd4996b7-bzkqg_ef917c53-72f3-4267-a655-84607918a723/router/0.log" Jul 24 15:15:52.177028 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:52.176952 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-696d5956bc-lzfmt_25b1a60c-85f3-4c74-b7ee-e3923e616719/manager/0.log" Jul 24 15:15:52.209416 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:52.209398 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-696d5956bc-lzfmt_25b1a60c-85f3-4c74-b7ee-e3923e616719/copy-manifests/0.log" Jul 24 15:15:53.057776 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:53.057748 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-75lrr_aa1799bf-b00d-4024-9b3f-e58330985fc3/discovery/0.log" Jul 24 15:15:53.220422 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:53.220391 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78dd4996b7-bzkqg_ef917c53-72f3-4267-a655-84607918a723/router/0.log" Jul 24 15:15:53.503983 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:53.503957 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-f8c8cf8c7-r6t8r_e4ebfb1c-4442-4d16-a8ae-697c94808a86/manager/0.log" Jul 24 15:15:58.080863 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:58.080834 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-xpt99_d2669faf-0fa7-41fe-9672-39018dfab799/migrator/0.log" Jul 24 15:15:58.102666 ip-10-0-131-12 kubenswrapper[2581]: I0724 15:15:58.102640 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-xpt99_d2669faf-0fa7-41fe-9672-39018dfab799/graceful-termination/0.log"