Jul 10 14:08:36.927606 ip-10-0-142-2 systemd[1]: Starting Kubernetes Kubelet... Jul 10 14:08:37.546319 ip-10-0-142-2 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 14:08:37.546319 ip-10-0-142-2 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 10 14:08:37.546319 ip-10-0-142-2 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 14:08:37.546319 ip-10-0-142-2 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 10 14:08:37.546319 ip-10-0-142-2 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 14:08:37.546319 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.372106 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 10 14:08:37.546319 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377312 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 14:08:37.546319 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377325 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 14:08:37.546319 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377329 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 14:08:37.546319 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377332 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 14:08:37.546319 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377335 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 14:08:37.546319 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377339 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 14:08:37.546319 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377342 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 14:08:37.546319 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377345 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 14:08:37.463491 ip-10-0-142-2 systemd[1]: Started Kubernetes Kubelet. Jul 10 14:08:37.547524 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377348 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 14:08:37.547524 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377351 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 14:08:37.547524 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377355 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 14:08:37.547524 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377358 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 14:08:37.547524 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377361 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 14:08:37.547524 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377364 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 14:08:37.547524 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377367 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 14:08:37.547524 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377370 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 14:08:37.547524 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377373 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 14:08:37.547524 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377376 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 14:08:37.547524 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377379 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 14:08:37.547524 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377382 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 14:08:37.547524 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377389 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 14:08:37.547524 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377411 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 14:08:37.547524 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377415 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 14:08:37.547524 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377417 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 14:08:37.547524 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377421 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 14:08:37.547524 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377424 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 14:08:37.547524 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377427 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 14:08:37.547524 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377431 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 14:08:37.548231 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377434 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 14:08:37.548231 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377437 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 14:08:37.548231 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377440 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 14:08:37.548231 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377443 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 14:08:37.548231 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377446 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 14:08:37.548231 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377449 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 14:08:37.548231 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377451 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 14:08:37.548231 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377454 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 14:08:37.548231 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377457 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 14:08:37.548231 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377459 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 14:08:37.548231 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377462 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 14:08:37.548231 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377465 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 14:08:37.548231 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377468 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 14:08:37.548231 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377471 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 14:08:37.548231 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377474 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 14:08:37.548231 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377476 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 14:08:37.548231 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377480 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 14:08:37.548231 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377482 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 14:08:37.548231 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377485 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 14:08:37.548934 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377488 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 14:08:37.548934 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377490 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 14:08:37.548934 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377494 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 14:08:37.548934 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377497 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 14:08:37.548934 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377499 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 14:08:37.548934 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377502 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 14:08:37.548934 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377505 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 14:08:37.548934 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377508 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 14:08:37.548934 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377510 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 14:08:37.548934 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377513 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 14:08:37.548934 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377516 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 14:08:37.548934 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377520 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 14:08:37.548934 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377523 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 14:08:37.548934 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377526 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 14:08:37.548934 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377528 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 14:08:37.548934 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377531 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 14:08:37.548934 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377534 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 14:08:37.548934 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377536 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 14:08:37.548934 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377539 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 14:08:37.548934 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377542 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 14:08:37.549606 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377545 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 14:08:37.549606 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377547 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 14:08:37.549606 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377550 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 14:08:37.549606 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377553 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 14:08:37.549606 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377557 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 14:08:37.549606 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377560 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 14:08:37.549606 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377563 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 14:08:37.549606 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377566 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 14:08:37.549606 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377569 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 14:08:37.549606 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377572 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 14:08:37.549606 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377575 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 14:08:37.549606 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377577 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 14:08:37.549606 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377580 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 10 14:08:37.549606 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377586 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 14:08:37.549606 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377590 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 14:08:37.549606 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377594 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 14:08:37.549606 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377597 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 14:08:37.549606 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377600 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 14:08:37.549606 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377603 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 14:08:37.549606 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377606 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 14:08:37.550250 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377609 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 14:08:37.550250 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377612 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 14:08:37.550250 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377615 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 14:08:37.550250 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377619 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 14:08:37.550250 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377622 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 14:08:37.550250 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377625 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 14:08:37.550250 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377627 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 14:08:37.550250 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377632 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 14:08:37.550250 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377635 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 14:08:37.550250 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377639 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 14:08:37.550250 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377642 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 14:08:37.550250 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.377646 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 14:08:37.550250 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378501 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 14:08:37.550250 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378511 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 14:08:37.550250 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378516 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 14:08:37.550250 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378521 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 14:08:37.550250 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378525 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 14:08:37.550250 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378529 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 14:08:37.550831 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378532 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 14:08:37.550831 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378535 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 14:08:37.550831 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378538 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 14:08:37.550831 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378542 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 14:08:37.550831 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378544 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 14:08:37.550831 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378547 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 14:08:37.550831 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378550 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 14:08:37.550831 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378553 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 14:08:37.550831 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378556 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 14:08:37.550831 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378559 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 14:08:37.550831 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378562 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 14:08:37.550831 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378565 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 14:08:37.550831 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378568 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 14:08:37.550831 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378570 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 14:08:37.550831 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378575 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 14:08:37.550831 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378577 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 14:08:37.550831 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378580 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 14:08:37.550831 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378583 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 14:08:37.550831 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378586 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 14:08:37.550831 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378589 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 14:08:37.550831 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378592 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 14:08:37.551613 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378595 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 14:08:37.551613 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378599 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 14:08:37.551613 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378602 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 14:08:37.551613 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378605 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 14:08:37.551613 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378608 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 14:08:37.551613 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378611 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 14:08:37.551613 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378614 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 14:08:37.551613 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378617 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 14:08:37.551613 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378621 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 14:08:37.551613 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378624 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 14:08:37.551613 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378627 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 14:08:37.551613 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378631 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 14:08:37.551613 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378634 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 14:08:37.551613 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378637 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 14:08:37.551613 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378640 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 14:08:37.551613 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378643 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 14:08:37.551613 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378645 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 14:08:37.551613 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378648 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 14:08:37.551613 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378651 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 14:08:37.552229 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378656 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 14:08:37.552229 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378659 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 14:08:37.552229 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378663 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 14:08:37.552229 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378666 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 10 14:08:37.552229 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378670 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 14:08:37.552229 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378673 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 14:08:37.552229 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378676 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 14:08:37.552229 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378679 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 14:08:37.552229 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378682 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 14:08:37.552229 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378685 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 14:08:37.552229 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378688 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 14:08:37.552229 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378691 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 14:08:37.552229 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378694 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 14:08:37.552229 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378696 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 14:08:37.552229 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378699 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 14:08:37.552229 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378702 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 14:08:37.552229 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378705 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 14:08:37.552229 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378707 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 14:08:37.552229 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378713 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 14:08:37.552921 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378716 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 14:08:37.552921 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378719 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 14:08:37.552921 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378721 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 14:08:37.552921 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378724 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 14:08:37.552921 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378728 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 14:08:37.552921 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378731 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 14:08:37.552921 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378735 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 14:08:37.552921 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378737 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 14:08:37.552921 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378740 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 14:08:37.552921 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378743 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 14:08:37.552921 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378745 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 14:08:37.552921 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378748 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 14:08:37.552921 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378751 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 14:08:37.552921 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378753 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 14:08:37.552921 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378756 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 14:08:37.552921 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378759 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 14:08:37.552921 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378762 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 14:08:37.552921 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378765 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 14:08:37.552921 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378768 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 14:08:37.552921 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378770 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 14:08:37.553618 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378773 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 14:08:37.553618 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378776 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 14:08:37.553618 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378778 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 14:08:37.553618 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378781 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 14:08:37.553618 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378784 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 14:08:37.553618 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378787 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 14:08:37.553618 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378789 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 14:08:37.553618 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378792 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 14:08:37.553618 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378795 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 14:08:37.553618 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378797 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 14:08:37.553618 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378800 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 14:08:37.553618 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378804 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 14:08:37.553618 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378807 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 14:08:37.553618 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.378810 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 14:08:37.553618 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379321 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 14:08:37.553618 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379328 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 14:08:37.553618 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379333 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 14:08:37.553618 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379336 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 14:08:37.553618 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379339 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 14:08:37.553618 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379342 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 14:08:37.554264 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379346 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 14:08:37.554264 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379348 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 14:08:37.554264 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379351 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 14:08:37.554264 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379354 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 14:08:37.554264 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379358 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 14:08:37.554264 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379361 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 14:08:37.554264 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379364 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 14:08:37.554264 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379367 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 14:08:37.554264 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379370 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 14:08:37.554264 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379373 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 14:08:37.554264 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379375 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 14:08:37.554264 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379378 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 14:08:37.554264 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379382 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 14:08:37.554264 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379385 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 14:08:37.554264 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379387 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 14:08:37.554264 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379390 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 14:08:37.554264 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379409 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 14:08:37.554264 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379414 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 14:08:37.554264 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379418 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 14:08:37.554264 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379421 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 14:08:37.554893 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379424 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 14:08:37.554893 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379426 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 14:08:37.554893 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379430 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 14:08:37.554893 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379434 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 14:08:37.554893 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379437 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 14:08:37.554893 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379440 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 14:08:37.554893 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379443 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 14:08:37.554893 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379445 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 14:08:37.554893 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379450 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 14:08:37.554893 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379454 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 14:08:37.554893 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379457 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 14:08:37.554893 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379461 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 14:08:37.554893 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379464 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 14:08:37.554893 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379467 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 14:08:37.554893 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379471 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 14:08:37.554893 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379473 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 14:08:37.554893 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379476 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 14:08:37.554893 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379479 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 14:08:37.554893 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379482 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 14:08:37.555482 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379484 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 14:08:37.555482 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379487 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 14:08:37.555482 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379490 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 14:08:37.555482 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379492 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 14:08:37.555482 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379495 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 14:08:37.555482 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379498 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 14:08:37.555482 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379501 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 14:08:37.555482 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379503 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 14:08:37.555482 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379506 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 14:08:37.555482 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379509 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 14:08:37.555482 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379512 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 14:08:37.555482 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379515 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 14:08:37.555482 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379517 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 14:08:37.555482 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379520 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 14:08:37.555482 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379524 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 14:08:37.555482 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379527 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 14:08:37.555482 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379532 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 14:08:37.555482 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379535 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 14:08:37.555482 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379537 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 14:08:37.555482 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379541 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 14:08:37.556046 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379544 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 14:08:37.556046 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379546 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 14:08:37.556046 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379549 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 14:08:37.556046 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379553 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 14:08:37.556046 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379556 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 14:08:37.556046 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379560 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 14:08:37.556046 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379563 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 14:08:37.556046 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379566 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 14:08:37.556046 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379569 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 14:08:37.556046 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379573 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 10 14:08:37.556046 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379576 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 14:08:37.556046 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379579 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 14:08:37.556046 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379581 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 14:08:37.556046 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379584 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 14:08:37.556046 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379588 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 14:08:37.556046 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379591 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 14:08:37.556046 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379593 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 14:08:37.556046 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379596 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 14:08:37.556046 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379599 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 14:08:37.556046 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379601 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 14:08:37.556658 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379604 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 14:08:37.556658 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379607 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 14:08:37.556658 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379610 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 14:08:37.556658 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379613 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 14:08:37.556658 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379615 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 14:08:37.556658 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379618 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 14:08:37.556658 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379621 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 14:08:37.556658 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379625 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 14:08:37.556658 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379629 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 14:08:37.556658 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379631 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 14:08:37.556658 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379634 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 14:08:37.556658 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379637 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 14:08:37.556658 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379640 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 14:08:37.556658 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.379643 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 14:08:37.556658 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379719 2581 flags.go:64] FLAG: --address="0.0.0.0" Jul 10 14:08:37.556658 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379726 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 10 14:08:37.556658 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379733 2581 flags.go:64] FLAG: --anonymous-auth="true" Jul 10 14:08:37.556658 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379738 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 10 14:08:37.556658 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379742 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 10 14:08:37.556658 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379746 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 10 14:08:37.556658 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379751 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 10 14:08:37.557221 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379755 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 10 14:08:37.557221 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379759 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 10 14:08:37.557221 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379762 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 10 14:08:37.557221 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379766 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 10 14:08:37.557221 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379769 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 10 14:08:37.557221 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379773 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 10 14:08:37.557221 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379776 2581 flags.go:64] FLAG: --cgroup-root="" Jul 10 14:08:37.557221 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379779 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 10 14:08:37.557221 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379782 2581 flags.go:64] FLAG: --client-ca-file="" Jul 10 14:08:37.557221 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379785 2581 flags.go:64] FLAG: --cloud-provider="external" Jul 10 14:08:37.557221 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379788 2581 flags.go:64] FLAG: --cluster-dns="[]" Jul 10 14:08:37.557221 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379794 2581 flags.go:64] FLAG: --cluster-domain="" Jul 10 14:08:37.557221 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379797 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 10 14:08:37.557221 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379801 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 10 14:08:37.557221 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379804 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 10 14:08:37.557221 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379808 2581 flags.go:64] FLAG: --container-log-max-files="5" Jul 10 14:08:37.557221 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379811 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 10 14:08:37.557221 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379815 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 10 14:08:37.557221 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379820 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 10 14:08:37.557221 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379824 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 10 14:08:37.557221 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379828 2581 flags.go:64] FLAG: --contention-profiling="false" Jul 10 14:08:37.557221 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379831 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 10 14:08:37.557221 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379834 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 10 14:08:37.557221 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379838 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 10 14:08:37.557941 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379841 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 10 14:08:37.557941 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379845 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 10 14:08:37.557941 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379849 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 10 14:08:37.557941 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379851 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 10 14:08:37.557941 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379855 2581 flags.go:64] FLAG: --enable-load-reader="false" Jul 10 14:08:37.557941 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379858 2581 flags.go:64] FLAG: --enable-server="true" Jul 10 14:08:37.557941 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379862 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 10 14:08:37.557941 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379867 2581 flags.go:64] FLAG: --event-burst="100" Jul 10 14:08:37.557941 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379870 2581 flags.go:64] FLAG: --event-qps="50" Jul 10 14:08:37.557941 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379873 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 10 14:08:37.557941 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379876 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 10 14:08:37.557941 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379879 2581 flags.go:64] FLAG: --eviction-hard="" Jul 10 14:08:37.557941 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379883 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 10 14:08:37.557941 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379886 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 10 14:08:37.557941 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379890 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 10 14:08:37.557941 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379893 2581 flags.go:64] FLAG: --eviction-soft="" Jul 10 14:08:37.557941 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379896 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 10 14:08:37.557941 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379899 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 10 14:08:37.557941 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379902 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 10 14:08:37.557941 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379905 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jul 10 14:08:37.557941 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379908 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 10 14:08:37.557941 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379911 2581 flags.go:64] FLAG: --fail-swap-on="true" Jul 10 14:08:37.557941 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379914 2581 flags.go:64] FLAG: --feature-gates="" Jul 10 14:08:37.557941 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379918 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jul 10 14:08:37.557941 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379921 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 10 14:08:37.558714 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379925 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 10 14:08:37.558714 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379929 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 10 14:08:37.558714 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379944 2581 flags.go:64] FLAG: --healthz-port="10248" Jul 10 14:08:37.558714 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379948 2581 flags.go:64] FLAG: --help="false" Jul 10 14:08:37.558714 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379951 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-142-2.ec2.internal" Jul 10 14:08:37.558714 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379954 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 10 14:08:37.558714 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379958 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jul 10 14:08:37.558714 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379961 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 10 14:08:37.558714 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379965 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 10 14:08:37.558714 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379968 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 10 14:08:37.558714 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379971 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 10 14:08:37.558714 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379974 2581 flags.go:64] FLAG: --image-service-endpoint="" Jul 10 14:08:37.558714 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379977 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 10 14:08:37.558714 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379980 2581 flags.go:64] FLAG: --kube-api-burst="100" Jul 10 14:08:37.558714 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379985 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 10 14:08:37.558714 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379988 2581 flags.go:64] FLAG: --kube-api-qps="50" Jul 10 14:08:37.558714 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379991 2581 flags.go:64] FLAG: --kube-reserved="" Jul 10 14:08:37.558714 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379994 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 10 14:08:37.558714 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.379997 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 10 14:08:37.558714 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380001 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jul 10 14:08:37.558714 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380004 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 10 14:08:37.558714 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380007 2581 flags.go:64] FLAG: --lock-file="" Jul 10 14:08:37.558714 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380010 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 10 14:08:37.558714 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380013 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 10 14:08:37.559550 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380016 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 10 14:08:37.559550 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380022 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jul 10 14:08:37.559550 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380025 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 10 14:08:37.559550 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380028 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jul 10 14:08:37.559550 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380031 2581 flags.go:64] FLAG: --logging-format="text" Jul 10 14:08:37.559550 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380034 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 10 14:08:37.559550 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380038 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 10 14:08:37.559550 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380041 2581 flags.go:64] FLAG: --manifest-url="" Jul 10 14:08:37.559550 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380044 2581 flags.go:64] FLAG: --manifest-url-header="" Jul 10 14:08:37.559550 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380050 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 10 14:08:37.559550 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380056 2581 flags.go:64] FLAG: --max-open-files="1000000" Jul 10 14:08:37.559550 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380066 2581 flags.go:64] FLAG: --max-pods="110" Jul 10 14:08:37.559550 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380069 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 10 14:08:37.559550 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380072 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 10 14:08:37.559550 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380075 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jul 10 14:08:37.559550 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380079 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 10 14:08:37.559550 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380082 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 10 14:08:37.559550 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380085 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 10 14:08:37.559550 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380088 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 10 14:08:37.559550 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380096 2581 flags.go:64] FLAG: --node-status-max-images="50" Jul 10 14:08:37.559550 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380099 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 10 14:08:37.559550 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380103 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jul 10 14:08:37.559550 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380106 2581 flags.go:64] FLAG: --pod-cidr="" Jul 10 14:08:37.562044 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380110 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 10 14:08:37.562044 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380116 2581 flags.go:64] FLAG: --pod-manifest-path="" Jul 10 14:08:37.562044 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380119 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jul 10 14:08:37.562044 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380122 2581 flags.go:64] FLAG: --pods-per-core="0" Jul 10 14:08:37.562044 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380125 2581 flags.go:64] FLAG: --port="10250" Jul 10 14:08:37.562044 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380129 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 10 14:08:37.562044 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380132 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e81319521da286bd" Jul 10 14:08:37.562044 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380135 2581 flags.go:64] FLAG: --qos-reserved="" Jul 10 14:08:37.562044 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380138 2581 flags.go:64] FLAG: --read-only-port="10255" Jul 10 14:08:37.562044 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380142 2581 flags.go:64] FLAG: --register-node="true" Jul 10 14:08:37.562044 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380145 2581 flags.go:64] FLAG: --register-with-taints="" Jul 10 14:08:37.562044 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380148 2581 flags.go:64] FLAG: --registry-burst="10" Jul 10 14:08:37.562044 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380151 2581 flags.go:64] FLAG: --registry-qps="5" Jul 10 14:08:37.562044 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380155 2581 flags.go:64] FLAG: --reserved-cpus="" Jul 10 14:08:37.562044 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380158 2581 flags.go:64] FLAG: --reserved-memory="" Jul 10 14:08:37.562044 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380162 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 10 14:08:37.562044 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380165 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 10 14:08:37.562044 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380168 2581 flags.go:64] FLAG: --rotate-certificates="false" Jul 10 14:08:37.562044 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380173 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 10 14:08:37.562044 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380176 2581 flags.go:64] FLAG: --runonce="false" Jul 10 14:08:37.562044 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380180 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 10 14:08:37.562044 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380183 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 10 14:08:37.562044 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380186 2581 flags.go:64] FLAG: --seccomp-default="false" Jul 10 14:08:37.562044 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380189 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 10 14:08:37.562044 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380193 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 10 14:08:37.815189 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380196 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 10 14:08:37.815189 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380199 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 10 14:08:37.815189 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380202 2581 flags.go:64] FLAG: --storage-driver-password="root" Jul 10 14:08:37.815189 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380205 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jul 10 14:08:37.815189 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380208 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jul 10 14:08:37.815189 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380211 2581 flags.go:64] FLAG: --storage-driver-user="root" Jul 10 14:08:37.815189 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380214 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 10 14:08:37.815189 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380217 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 10 14:08:37.815189 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380221 2581 flags.go:64] FLAG: --system-cgroups="" Jul 10 14:08:37.815189 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380224 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 10 14:08:37.815189 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380230 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 10 14:08:37.815189 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380233 2581 flags.go:64] FLAG: --tls-cert-file="" Jul 10 14:08:37.815189 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380236 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 10 14:08:37.815189 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380241 2581 flags.go:64] FLAG: --tls-min-version="" Jul 10 14:08:37.815189 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380244 2581 flags.go:64] FLAG: --tls-private-key-file="" Jul 10 14:08:37.815189 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380247 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jul 10 14:08:37.815189 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380249 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 10 14:08:37.815189 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380253 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jul 10 14:08:37.815189 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380256 2581 flags.go:64] FLAG: --v="2" Jul 10 14:08:37.815189 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380260 2581 flags.go:64] FLAG: --version="false" Jul 10 14:08:37.815189 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380264 2581 flags.go:64] FLAG: --vmodule="" Jul 10 14:08:37.815189 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380268 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 10 14:08:37.815189 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.380272 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 10 14:08:37.815189 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380415 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 14:08:37.815189 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380419 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 14:08:37.844715 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380428 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 14:08:37.844715 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380431 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 14:08:37.844715 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380436 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 14:08:37.844715 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380439 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 14:08:37.844715 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380442 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 14:08:37.844715 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380444 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 14:08:37.844715 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380447 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 14:08:37.844715 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380450 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 14:08:37.844715 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380452 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 14:08:37.844715 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380455 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 14:08:37.844715 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380458 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 14:08:37.844715 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380461 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 14:08:37.844715 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380464 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 14:08:37.844715 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380466 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 14:08:37.844715 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380469 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 14:08:37.844715 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380472 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 14:08:37.844715 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380475 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 14:08:37.844715 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380478 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 14:08:37.844715 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380481 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 14:08:37.844715 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380484 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 14:08:37.845467 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380486 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 14:08:37.845467 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380489 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 14:08:37.845467 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380492 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 14:08:37.845467 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380494 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 14:08:37.845467 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380497 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 14:08:37.845467 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380500 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 14:08:37.845467 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380502 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 14:08:37.845467 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380505 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 14:08:37.845467 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380508 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 14:08:37.845467 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380510 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 14:08:37.845467 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380515 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 14:08:37.845467 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380518 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 14:08:37.845467 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380523 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 14:08:37.845467 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380528 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 14:08:37.845467 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380533 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 14:08:37.845467 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380536 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 14:08:37.845467 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380539 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 14:08:37.845467 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380542 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 14:08:37.845467 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380545 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 14:08:37.846026 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380548 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 14:08:37.846026 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380551 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 14:08:37.846026 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380553 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 14:08:37.846026 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380556 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 14:08:37.846026 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380559 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 14:08:37.846026 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380562 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 14:08:37.846026 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380565 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 14:08:37.846026 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380567 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 14:08:37.846026 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380570 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 14:08:37.846026 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380573 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 14:08:37.846026 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380577 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 14:08:37.846026 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380580 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 14:08:37.846026 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380582 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 14:08:37.846026 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380585 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 14:08:37.846026 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380588 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 14:08:37.846026 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380590 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 14:08:37.846026 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380593 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 14:08:37.846026 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380596 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 14:08:37.846026 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380599 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 14:08:37.846026 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380601 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 14:08:37.846679 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380604 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 14:08:37.846679 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380607 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 14:08:37.846679 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380610 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 14:08:37.846679 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380612 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 14:08:37.846679 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380615 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 14:08:37.846679 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380620 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 14:08:37.846679 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380624 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 10 14:08:37.846679 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380630 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 14:08:37.846679 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380634 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 14:08:37.846679 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380639 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 14:08:37.846679 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380643 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 14:08:37.846679 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380647 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 14:08:37.846679 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380651 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 14:08:37.846679 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380656 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 14:08:37.846679 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380661 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 14:08:37.846679 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380665 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 14:08:37.846679 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380669 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 14:08:37.846679 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380672 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 14:08:37.846679 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380675 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 14:08:37.847239 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380678 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 14:08:37.847239 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380681 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 14:08:37.847239 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380684 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 14:08:37.847239 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380686 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 14:08:37.847239 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380690 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 14:08:37.847239 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380693 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 14:08:37.847239 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380696 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 14:08:37.847239 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380699 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 14:08:37.847239 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380702 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 14:08:37.847239 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380704 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 14:08:37.847239 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380707 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 14:08:37.847239 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380710 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 14:08:37.847239 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380713 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 14:08:37.847239 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380715 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 14:08:37.847239 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380718 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 14:08:37.847239 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380720 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 14:08:37.847239 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380723 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 14:08:37.847239 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380726 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 14:08:37.847239 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.380730 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 14:08:37.847868 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.381597 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 14:08:37.847868 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.388963 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 10 14:08:37.847868 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.388981 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 10 14:08:37.847868 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.388998 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 10 14:08:37.847868 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.389005 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 10 14:08:37.847868 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389064 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 14:08:37.847868 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389070 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 14:08:37.847868 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389074 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 14:08:37.847868 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389077 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 14:08:37.847868 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389080 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 14:08:37.847868 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389083 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 14:08:37.847868 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389086 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 14:08:37.847868 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389089 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 14:08:37.847868 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389092 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 14:08:37.848318 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389095 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 14:08:37.848318 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389098 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 14:08:37.848318 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389101 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 14:08:37.848318 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389105 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 14:08:37.848318 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389108 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 14:08:37.848318 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389111 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 14:08:37.848318 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389113 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 14:08:37.848318 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389116 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 14:08:37.848318 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389119 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 14:08:37.848318 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389123 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 14:08:37.848318 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389125 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 14:08:37.848318 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389128 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 14:08:37.848318 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389131 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 14:08:37.848318 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389133 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 14:08:37.848318 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389136 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 14:08:37.848318 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389139 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 14:08:37.848318 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389142 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 14:08:37.848318 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389145 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 14:08:37.848318 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389147 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 14:08:37.848318 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389150 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 14:08:37.848990 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389153 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 14:08:37.848990 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389158 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 14:08:37.848990 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389160 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 14:08:37.848990 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389164 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 14:08:37.848990 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389167 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 14:08:37.848990 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389170 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 14:08:37.848990 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389173 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 14:08:37.848990 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389176 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 14:08:37.848990 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389179 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 14:08:37.848990 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389182 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 14:08:37.848990 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389185 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 14:08:37.848990 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389187 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 14:08:37.848990 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389190 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 14:08:37.848990 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389193 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 14:08:37.848990 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389196 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 14:08:37.848990 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389199 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 14:08:37.848990 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389202 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 14:08:37.848990 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389205 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 14:08:37.848990 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389207 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 14:08:37.849563 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389210 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 14:08:37.849563 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389213 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 14:08:37.849563 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389215 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 14:08:37.849563 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389218 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 14:08:37.849563 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389221 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 14:08:37.849563 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389223 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 14:08:37.849563 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389228 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 14:08:37.849563 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389232 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 14:08:37.849563 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389235 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 14:08:37.849563 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389238 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 14:08:37.849563 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389241 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 14:08:37.849563 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389245 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 14:08:37.849563 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389248 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 14:08:37.849563 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389251 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 14:08:37.849563 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389254 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 14:08:37.849563 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389257 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 14:08:37.849563 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389260 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 14:08:37.849563 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389263 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 14:08:37.849563 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389266 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 14:08:37.850208 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389269 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 14:08:37.850208 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389271 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 14:08:37.850208 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389274 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 14:08:37.850208 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389277 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 14:08:37.850208 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389279 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 14:08:37.850208 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389282 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 14:08:37.850208 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389285 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 14:08:37.850208 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389288 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 14:08:37.850208 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389291 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 14:08:37.850208 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389294 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 14:08:37.850208 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389297 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 14:08:37.850208 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389300 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 14:08:37.850208 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389303 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 14:08:37.850208 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389307 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 14:08:37.850208 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389311 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 14:08:37.850208 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389314 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 14:08:37.850208 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389318 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 14:08:37.850208 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389322 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 14:08:37.850208 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389325 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 14:08:37.850208 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389328 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 14:08:37.850839 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389331 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 14:08:37.850839 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389334 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 14:08:37.850839 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389337 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 14:08:37.850839 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389340 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 14:08:37.850839 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389344 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 14:08:37.850839 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389346 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 14:08:37.850839 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389353 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 14:08:37.850839 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389356 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 14:08:37.850839 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389359 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 14:08:37.850839 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389362 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 10 14:08:37.850839 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389365 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 14:08:37.850839 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389368 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 14:08:37.850839 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.389373 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 14:08:37.850839 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389512 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 14:08:37.850839 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389518 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 14:08:37.851361 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389522 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 14:08:37.851361 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389525 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 14:08:37.851361 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389528 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 14:08:37.851361 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389531 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 14:08:37.851361 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389534 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 14:08:37.851361 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389537 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 14:08:37.851361 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389540 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 14:08:37.851361 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389542 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 14:08:37.851361 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389545 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 14:08:37.851361 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389552 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 14:08:37.851361 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389555 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 14:08:37.851361 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389558 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 14:08:37.851361 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389561 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 14:08:37.851361 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389564 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 14:08:37.851361 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389567 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 14:08:37.851361 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389569 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 14:08:37.851361 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389572 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 14:08:37.851361 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389575 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 14:08:37.851361 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389578 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 14:08:37.851361 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389581 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 14:08:37.851953 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389583 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 14:08:37.851953 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389586 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 14:08:37.851953 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389589 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 14:08:37.851953 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389593 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 14:08:37.851953 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389596 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 14:08:37.851953 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389599 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 14:08:37.851953 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389602 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 14:08:37.851953 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389605 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 14:08:37.851953 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389607 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 14:08:37.851953 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389610 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 14:08:37.851953 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389613 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 14:08:37.851953 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389615 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 14:08:37.851953 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389618 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 14:08:37.851953 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389621 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 14:08:37.851953 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389624 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 14:08:37.851953 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389626 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 14:08:37.851953 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389629 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 14:08:37.851953 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389632 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 14:08:37.851953 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389634 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 14:08:37.851953 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389637 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 14:08:37.852603 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389640 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 14:08:37.852603 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389646 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 14:08:37.852603 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389651 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 14:08:37.852603 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389654 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 14:08:37.852603 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389657 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 14:08:37.852603 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389660 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 14:08:37.852603 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389664 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 14:08:37.852603 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389668 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 14:08:37.852603 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389671 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 14:08:37.852603 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389674 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 14:08:37.852603 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389677 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 14:08:37.852603 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389680 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 14:08:37.852603 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389683 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 14:08:37.852603 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389685 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 14:08:37.852603 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389688 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 14:08:37.852603 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389692 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 14:08:37.852603 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389695 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 14:08:37.852603 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389699 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 14:08:37.852603 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389702 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 14:08:37.853162 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389705 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 14:08:37.853162 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389708 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 14:08:37.853162 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389711 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 14:08:37.853162 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389714 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 14:08:37.853162 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389716 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 14:08:37.853162 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389719 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 14:08:37.853162 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389722 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 14:08:37.853162 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389725 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 14:08:37.853162 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389727 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 14:08:37.853162 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389730 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 14:08:37.853162 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389732 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 14:08:37.853162 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389735 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 14:08:37.853162 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389738 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 14:08:37.853162 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389741 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 14:08:37.853162 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389745 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 14:08:37.853162 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389747 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 14:08:37.853162 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389751 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 14:08:37.853162 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389754 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 14:08:37.853162 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389757 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 10 14:08:37.853162 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389759 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 14:08:37.853867 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389762 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 14:08:37.853867 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389764 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 14:08:37.853867 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389767 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 14:08:37.853867 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389770 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 14:08:37.853867 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389773 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 14:08:37.853867 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389775 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 14:08:37.853867 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389778 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 14:08:37.853867 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389781 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 14:08:37.853867 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389785 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 14:08:37.853867 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389787 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 14:08:37.853867 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389790 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 14:08:37.853867 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389793 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 14:08:37.853867 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389795 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 14:08:37.853867 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389798 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 14:08:37.853867 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389801 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 14:08:37.853867 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389804 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 14:08:37.853867 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389806 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 14:08:37.853867 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:37.389809 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 14:08:37.854386 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.389814 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 14:08:37.854386 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.389929 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jul 10 14:08:37.854386 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.392272 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 10 14:08:37.854386 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.394006 2581 server.go:1019] "Starting client certificate rotation" Jul 10 14:08:37.854386 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.394115 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 14:08:37.854386 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.394149 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 14:08:37.854386 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.398011 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 14:08:37.854386 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.402937 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 14:08:37.854386 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.416296 2581 log.go:25] "Validated CRI v1 runtime API" Jul 10 14:08:37.854386 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.418463 2581 log.go:25] "Validated CRI v1 image API" Jul 10 14:08:37.854386 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.419248 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 10 14:08:37.854386 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.424297 2581 fs.go:135] Filesystem UUIDs: map[029339a7-f0b3-409b-8731-be05e12cbfa0:/dev/nvme0n1p4 60e72098-5cb1-449b-bdb4-a6b85c725ee2:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 10 14:08:37.854813 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.424313 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 10 14:08:37.854813 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.428516 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 14:08:37.855185 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.429665 2581 manager.go:216] Machine: {Timestamp:2026-07-10 14:08:37.428412664 +0000 UTC m=+0.371984999 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099570 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29a97d4a125db26c29118190ac3d89 SystemUUID:ec29a97d-4a12-5db2-6c29-118190ac3d89 BootID:2dfd37a2-4588-4982-96c5-8c39918f1f2b Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:71:53:6a:33:21 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:71:53:6a:33:21 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:76:bc:75:18:67 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 10 14:08:37.855185 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.429766 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 10 14:08:37.855185 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.429872 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 10 14:08:37.855185 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.432520 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 10 14:08:37.855185 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.432544 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-2.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 10 14:08:37.855185 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.433300 2581 topology_manager.go:138] "Creating topology manager with none policy" Jul 10 14:08:37.855185 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.433310 2581 container_manager_linux.go:309] "Creating device plugin manager" Jul 10 14:08:37.855185 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.433322 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 14:08:37.855185 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.434317 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 14:08:37.855185 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.436451 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 10 14:08:37.855185 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.442970 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 10 14:08:37.855185 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.443116 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 10 14:08:37.855185 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.443147 2581 kubelet.go:486] "Attempting to sync node with API server" Jul 10 14:08:37.855185 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.443179 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 10 14:08:37.855185 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.443213 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 10 14:08:37.855185 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.443236 2581 kubelet.go:398] "Adding apiserver pod source" Jul 10 14:08:37.855185 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.443248 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 10 14:08:37.855185 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.443900 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.443916 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.446459 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.449623 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.449654 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.450511 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.450527 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.450534 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.450540 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.450550 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.450555 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.450563 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.450568 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.450576 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.450582 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.450591 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.450596 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.455012 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.455257 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:37.457985 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.459418 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-2.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:37.459890 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-2.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.462558 2581 server.go:1268] "Started kubelet" Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.462635 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.462657 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.462735 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.463914 2581 server.go:310] "Adding debug handlers to kubelet server" Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.465114 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.466878 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wxz2k" Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:37.468735 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.470919 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.470935 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:37.470996 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-2.ec2.internal\" not found" Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.471470 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.471477 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.471490 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.471588 2581 reconstruct.go:97] "Volume reconstruction finished" Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.471598 2581 reconciler.go:29] "Reconciler: start to sync state" Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.471857 2581 factory.go:55] Registering systemd factory Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.471884 2581 factory.go:223] Registration of the systemd container factory successfully Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.472122 2581 factory.go:153] Registering CRI-O factory Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.472133 2581 factory.go:223] Registration of the crio container factory successfully Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.472180 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.472205 2581 factory.go:103] Registering Raw factory Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.472215 2581 manager.go:1196] Started watching for new ooms in manager Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.472588 2581 manager.go:349] Starting recovery of all containers Jul 10 14:08:37.961136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.477777 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wxz2k" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:37.484033 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-2.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:37.484493 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:37.484111 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-2.ec2.internal.18c0f2e4ebe04b24 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-2.ec2.internal,UID:ip-10-0-142-2.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-2.ec2.internal,},FirstTimestamp:2026-07-10 14:08:37.462526756 +0000 UTC m=+0.406099090,LastTimestamp:2026-07-10 14:08:37.462526756 +0000 UTC m=+0.406099090,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-2.ec2.internal,}" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.487336 2581 manager.go:354] Recovery completed Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.493729 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.495603 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-2.ec2.internal" event="NodeHasSufficientMemory" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.495625 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-2.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.495635 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-2.ec2.internal" event="NodeHasSufficientPID" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.496315 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.496325 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.496342 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.496524 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.497184 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-2.ec2.internal" event="NodeHasSufficientMemory" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.497211 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-2.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.497222 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-2.ec2.internal" event="NodeHasSufficientPID" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.498570 2581 policy_none.go:49] "None policy: Start" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.498584 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.498594 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.500730 2581 policy_none.go:47] "Start" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.541949 2581 manager.go:337] "Starting Device Plugin manager" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:37.542124 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.542137 2581 server.go:87] "Starting device plugin registration server" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.542358 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.542390 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.542501 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.542579 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.542587 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:37.544776 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:37.545222 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-2.ec2.internal\" not found" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.636178 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.637330 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.637363 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.637384 2581 kubelet.go:2448] "Starting kubelet main sync loop" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:37.637433 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.640586 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.643432 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.644283 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-2.ec2.internal" event="NodeHasSufficientMemory" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.644313 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-2.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.644328 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-2.ec2.internal" event="NodeHasSufficientPID" Jul 10 14:08:37.962642 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.644353 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-2.ec2.internal" Jul 10 14:08:37.973618 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.652214 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-2.ec2.internal" Jul 10 14:08:37.973618 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:37.652232 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-2.ec2.internal\": node \"ip-10-0-142-2.ec2.internal\" not found" Jul 10 14:08:37.973618 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:37.672928 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-2.ec2.internal\" not found" Jul 10 14:08:37.973618 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.738833 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-2.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-2.ec2.internal"] Jul 10 14:08:37.973618 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.738908 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 14:08:37.973618 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.739732 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-2.ec2.internal" event="NodeHasSufficientMemory" Jul 10 14:08:37.973618 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.739757 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-2.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 14:08:37.973618 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.739772 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-2.ec2.internal" event="NodeHasSufficientPID" Jul 10 14:08:37.973618 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.742133 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 14:08:37.973618 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.742268 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-2.ec2.internal" Jul 10 14:08:37.973618 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.742303 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 14:08:37.973618 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.746563 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-2.ec2.internal" event="NodeHasSufficientMemory" Jul 10 14:08:37.973618 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.746590 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-2.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 14:08:37.973618 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.746606 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-2.ec2.internal" event="NodeHasSufficientPID" Jul 10 14:08:37.973618 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.746640 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-2.ec2.internal" event="NodeHasSufficientMemory" Jul 10 14:08:37.973618 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.746664 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-2.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 14:08:37.973618 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.746679 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-2.ec2.internal" event="NodeHasSufficientPID" Jul 10 14:08:37.973618 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.749019 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-2.ec2.internal" Jul 10 14:08:37.973618 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.749041 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 14:08:37.973618 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.751665 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-2.ec2.internal" event="NodeHasSufficientMemory" Jul 10 14:08:37.973618 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.751691 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-2.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 14:08:37.973618 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.751706 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-2.ec2.internal" event="NodeHasSufficientPID" Jul 10 14:08:37.973618 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:37.773685 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-2.ec2.internal\" not found" Jul 10 14:08:37.973618 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.773767 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/130301692bccfc59d122f1976e2fc55a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-2.ec2.internal\" (UID: \"130301692bccfc59d122f1976e2fc55a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-2.ec2.internal" Jul 10 14:08:37.973618 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.773787 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/130301692bccfc59d122f1976e2fc55a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-2.ec2.internal\" (UID: \"130301692bccfc59d122f1976e2fc55a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-2.ec2.internal" Jul 10 14:08:37.973618 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:37.773805 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/021b8c0c3b56b2050943ce01eeb73db5-config\") pod \"kube-apiserver-proxy-ip-10-0-142-2.ec2.internal\" (UID: \"021b8c0c3b56b2050943ce01eeb73db5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-2.ec2.internal" Jul 10 14:08:37.973618 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:37.786051 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-2.ec2.internal\" not found" node="ip-10-0-142-2.ec2.internal" Jul 10 14:08:37.973618 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:37.790991 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-2.ec2.internal\" not found" node="ip-10-0-142-2.ec2.internal" Jul 10 14:08:37.973618 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:37.874409 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-2.ec2.internal\" not found" Jul 10 14:08:37.977135 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:37.976482 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-2.ec2.internal\" not found" Jul 10 14:08:38.080339 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:38.078473 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-2.ec2.internal\" not found" Jul 10 14:08:38.181629 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:38.179511 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-2.ec2.internal\" not found" Jul 10 14:08:38.292707 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:38.280533 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-2.ec2.internal\" not found" Jul 10 14:08:38.403819 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:38.380570 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-2.ec2.internal\" not found" Jul 10 14:08:38.516060 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:38.481722 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-2.ec2.internal\" not found" Jul 10 14:08:38.516060 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:38.484040 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 14:03:37 +0000 UTC" deadline="2028-03-23 17:51:28.001788142 +0000 UTC" Jul 10 14:08:38.516060 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:38.484077 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14931h42m49.517714872s" Jul 10 14:08:38.630042 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:38.581809 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-2.ec2.internal\" not found" Jul 10 14:08:38.630042 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:38.620177 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 14:08:38.754166 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:38.682076 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-2.ec2.internal\" not found" Jul 10 14:08:38.871482 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:38.782383 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-2.ec2.internal\" not found" Jul 10 14:08:38.886595 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:38.882719 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-2.ec2.internal\" not found" Jul 10 14:08:38.990067 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:38.983859 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-2.ec2.internal\" not found" Jul 10 14:08:39.097776 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:39.082033 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 10 14:08:39.097776 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:39.082124 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/130301692bccfc59d122f1976e2fc55a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-2.ec2.internal\" (UID: \"130301692bccfc59d122f1976e2fc55a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-2.ec2.internal" Jul 10 14:08:39.097776 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:39.082162 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/130301692bccfc59d122f1976e2fc55a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-2.ec2.internal\" (UID: \"130301692bccfc59d122f1976e2fc55a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-2.ec2.internal" Jul 10 14:08:39.097776 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:39.082194 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/021b8c0c3b56b2050943ce01eeb73db5-config\") pod \"kube-apiserver-proxy-ip-10-0-142-2.ec2.internal\" (UID: \"021b8c0c3b56b2050943ce01eeb73db5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-2.ec2.internal" Jul 10 14:08:39.097776 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:39.082229 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 10 14:08:39.097776 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:39.082241 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/130301692bccfc59d122f1976e2fc55a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-2.ec2.internal\" (UID: \"130301692bccfc59d122f1976e2fc55a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-2.ec2.internal" Jul 10 14:08:39.097776 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:39.082241 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/130301692bccfc59d122f1976e2fc55a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-2.ec2.internal\" (UID: \"130301692bccfc59d122f1976e2fc55a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-2.ec2.internal" Jul 10 14:08:39.097776 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:39.082257 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/021b8c0c3b56b2050943ce01eeb73db5-config\") pod \"kube-apiserver-proxy-ip-10-0-142-2.ec2.internal\" (UID: \"021b8c0c3b56b2050943ce01eeb73db5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-2.ec2.internal" Jul 10 14:08:39.097776 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:39.084989 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-2.ec2.internal\" not found" Jul 10 14:08:39.097776 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:39.095553 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 14:08:39.097776 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:39.096919 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 14:08:39.171784 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:39.171754 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-2.ec2.internal" Jul 10 14:08:39.188729 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:39.188565 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 14:08:39.190331 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:39.190306 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-2.ec2.internal" Jul 10 14:08:39.201184 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:39.201168 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 14:08:39.288296 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:39.288242 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-2.ec2.internal" Jul 10 14:08:39.293957 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:39.293939 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-2.ec2.internal" Jul 10 14:08:39.936601 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:39.936569 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod021b8c0c3b56b2050943ce01eeb73db5.slice/crio-3c49281274fe588d6232ef97fa3f80b21ba73c5e05ef4b3cbeb9fab795b57066 WatchSource:0}: Error finding container 3c49281274fe588d6232ef97fa3f80b21ba73c5e05ef4b3cbeb9fab795b57066: Status 404 returned error can't find the container with id 3c49281274fe588d6232ef97fa3f80b21ba73c5e05ef4b3cbeb9fab795b57066 Jul 10 14:08:39.942144 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:39.942124 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 14:08:39.967660 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:39.967632 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod130301692bccfc59d122f1976e2fc55a.slice/crio-904be955e9bb971be42533dae2eee552ffd8fd53ac4cccfb0133cff6d7adede3 WatchSource:0}: Error finding container 904be955e9bb971be42533dae2eee552ffd8fd53ac4cccfb0133cff6d7adede3: Status 404 returned error can't find the container with id 904be955e9bb971be42533dae2eee552ffd8fd53ac4cccfb0133cff6d7adede3 Jul 10 14:08:40.083103 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.083003 2581 apiserver.go:52] "Watching apiserver" Jul 10 14:08:40.083103 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.083013 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 10 14:08:40.091858 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.091836 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 10 14:08:40.092223 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.092202 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-xtp2b","openshift-multus/multus-9wb6f","openshift-network-diagnostics/network-check-target-wcvvb","openshift-ovn-kubernetes/ovnkube-node-6z8gc","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4h6t","openshift-cluster-node-tuning-operator/tuned-dgvn4","openshift-dns/node-resolver-t65gv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-2.ec2.internal","openshift-multus/multus-additional-cni-plugins-dpgfx","openshift-multus/network-metrics-daemon-6jcf8","openshift-network-operator/iptables-alerter-4924f","kube-system/global-pull-secret-syncer-fd8lf","kube-system/konnectivity-agent-wlgmc","kube-system/kube-apiserver-proxy-ip-10-0-142-2.ec2.internal"] Jul 10 14:08:40.095158 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.095136 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t65gv" Jul 10 14:08:40.095855 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.095833 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 14:08:40.097177 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.097158 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wlgmc" Jul 10 14:08:40.097712 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.097687 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 10 14:08:40.097813 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.097798 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 10 14:08:40.097969 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.097954 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9rwzb\"" Jul 10 14:08:40.099505 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.099486 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 10 14:08:40.099602 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.099566 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:08:40.099665 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:40.099642 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcvvb" podUID="2814701c-e4da-4cc4-b7c4-550067a950b1" Jul 10 14:08:40.099791 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.099729 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 10 14:08:40.099885 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.099868 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6w5gk\"" Jul 10 14:08:40.102266 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.102246 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.104761 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.104740 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4h6t" Jul 10 14:08:40.105171 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.105152 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 10 14:08:40.105171 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.105159 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 10 14:08:40.105361 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.105211 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 10 14:08:40.105361 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.105240 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-x6fvb\"" Jul 10 14:08:40.105361 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.105243 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 10 14:08:40.105524 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.105374 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 10 14:08:40.106704 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.106688 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 10 14:08:40.107073 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.107054 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.108938 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.108919 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 10 14:08:40.109057 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.109038 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 10 14:08:40.109120 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.109072 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 10 14:08:40.109341 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.109320 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cv5c6\"" Jul 10 14:08:40.109525 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.109510 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dpgfx" Jul 10 14:08:40.111008 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.110968 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 10 14:08:40.111313 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.111207 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4rz7w\"" Jul 10 14:08:40.111583 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.111565 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 10 14:08:40.112989 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.112957 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 10 14:08:40.113090 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.113038 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-48bkj\"" Jul 10 14:08:40.113090 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.113070 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 10 14:08:40.113090 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.113081 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 10 14:08:40.113434 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.113294 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xtp2b" Jul 10 14:08:40.113865 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.113845 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 10 14:08:40.114212 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.113957 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 10 14:08:40.116454 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.116384 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 10 14:08:40.116549 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.116481 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.116655 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.116615 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 10 14:08:40.116655 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.116638 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 10 14:08:40.116942 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.116928 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-44z9s\"" Jul 10 14:08:40.119183 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.119158 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:08:40.119265 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.119232 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rgq5t\"" Jul 10 14:08:40.119265 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:40.119243 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcf8" podUID="5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae" Jul 10 14:08:40.119265 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.119257 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 10 14:08:40.120709 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.120689 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ldrzp" Jul 10 14:08:40.121898 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.121877 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4924f" Jul 10 14:08:40.124383 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.124366 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:08:40.124472 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:40.124447 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fd8lf" podUID="f3bf8565-febc-4cfa-8d86-11e5aeb3b516" Jul 10 14:08:40.125887 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.125870 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 10 14:08:40.125887 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.125880 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vcdfm\"" Jul 10 14:08:40.125992 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.125883 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 10 14:08:40.126296 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.126283 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 10 14:08:40.128173 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.128159 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ldrzp" Jul 10 14:08:40.172686 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.172669 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 10 14:08:40.188006 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.187984 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4bce65df-592e-4e75-9485-d788a0133cd4-cnibin\") pod \"multus-additional-cni-plugins-dpgfx\" (UID: \"4bce65df-592e-4e75-9485-d788a0133cd4\") " pod="openshift-multus/multus-additional-cni-plugins-dpgfx" Jul 10 14:08:40.188120 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188021 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b8795212-5e6f-43f4-baed-1c7c8bca70e4-iptables-alerter-script\") pod \"iptables-alerter-4924f\" (UID: \"b8795212-5e6f-43f4-baed-1c7c8bca70e4\") " pod="openshift-network-operator/iptables-alerter-4924f" Jul 10 14:08:40.188120 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188050 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8795212-5e6f-43f4-baed-1c7c8bca70e4-host-slash\") pod \"iptables-alerter-4924f\" (UID: \"b8795212-5e6f-43f4-baed-1c7c8bca70e4\") " pod="openshift-network-operator/iptables-alerter-4924f" Jul 10 14:08:40.188120 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188093 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-var-lib-openvswitch\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.188255 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188119 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4bce65df-592e-4e75-9485-d788a0133cd4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dpgfx\" (UID: \"4bce65df-592e-4e75-9485-d788a0133cd4\") " pod="openshift-multus/multus-additional-cni-plugins-dpgfx" Jul 10 14:08:40.188255 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188143 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-host-cni-bin\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.188255 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188188 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-system-cni-dir\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.188255 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188213 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f3bf8565-febc-4cfa-8d86-11e5aeb3b516-dbus\") pod \"global-pull-secret-syncer-fd8lf\" (UID: \"f3bf8565-febc-4cfa-8d86-11e5aeb3b516\") " pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:08:40.188255 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188228 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/60ccacff-e05b-4d1a-abe6-4824377bf277-etc-modprobe-d\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.188255 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188251 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-host-kubelet\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.188487 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188275 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvqgn\" (UniqueName: \"kubernetes.io/projected/88b0cb5c-d33e-42a2-a4cb-cf4ac90259bd-kube-api-access-hvqgn\") pod \"node-ca-xtp2b\" (UID: \"88b0cb5c-d33e-42a2-a4cb-cf4ac90259bd\") " pod="openshift-image-registry/node-ca-xtp2b" Jul 10 14:08:40.188487 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188293 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e9439b8d-1e36-423c-94c3-484c91f4708f-konnectivity-ca\") pod \"konnectivity-agent-wlgmc\" (UID: \"e9439b8d-1e36-423c-94c3-484c91f4708f\") " pod="kube-system/konnectivity-agent-wlgmc" Jul 10 14:08:40.188487 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188307 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/60ccacff-e05b-4d1a-abe6-4824377bf277-etc-systemd\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.188487 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188326 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/60ccacff-e05b-4d1a-abe6-4824377bf277-host\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.188487 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188371 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4bce65df-592e-4e75-9485-d788a0133cd4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dpgfx\" (UID: \"4bce65df-592e-4e75-9485-d788a0133cd4\") " pod="openshift-multus/multus-additional-cni-plugins-dpgfx" Jul 10 14:08:40.188487 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188387 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-systemd-units\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.188487 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188402 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-host-cni-netd\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.188487 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188420 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmnlv\" (UniqueName: \"kubernetes.io/projected/c64cf8f4-16ee-4162-aae6-f4293a47efc0-kube-api-access-nmnlv\") pod \"aws-ebs-csi-driver-node-m4h6t\" (UID: \"c64cf8f4-16ee-4162-aae6-f4293a47efc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4h6t" Jul 10 14:08:40.188487 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188449 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/72c7722f-6a58-4230-a5f4-9c440b6887ea-ovn-node-metrics-cert\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.188487 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188476 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-multus-socket-dir-parent\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.188868 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188495 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40d27be5-4ac9-4d9b-9b56-79bad16fed0d-tmp-dir\") pod \"node-resolver-t65gv\" (UID: \"40d27be5-4ac9-4d9b-9b56-79bad16fed0d\") " pod="openshift-dns/node-resolver-t65gv" Jul 10 14:08:40.188868 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188514 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grjls\" (UniqueName: \"kubernetes.io/projected/40d27be5-4ac9-4d9b-9b56-79bad16fed0d-kube-api-access-grjls\") pod \"node-resolver-t65gv\" (UID: \"40d27be5-4ac9-4d9b-9b56-79bad16fed0d\") " pod="openshift-dns/node-resolver-t65gv" Jul 10 14:08:40.188868 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188530 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60ccacff-e05b-4d1a-abe6-4824377bf277-etc-kubernetes\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.188868 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188544 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/60ccacff-e05b-4d1a-abe6-4824377bf277-etc-sysctl-conf\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.188868 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188558 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60ccacff-e05b-4d1a-abe6-4824377bf277-sys\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.188868 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188573 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c64cf8f4-16ee-4162-aae6-f4293a47efc0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m4h6t\" (UID: \"c64cf8f4-16ee-4162-aae6-f4293a47efc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4h6t" Jul 10 14:08:40.188868 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188588 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/88b0cb5c-d33e-42a2-a4cb-cf4ac90259bd-serviceca\") pod \"node-ca-xtp2b\" (UID: \"88b0cb5c-d33e-42a2-a4cb-cf4ac90259bd\") " pod="openshift-image-registry/node-ca-xtp2b" Jul 10 14:08:40.188868 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188611 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-host-var-lib-cni-multus\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.188868 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188641 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/979a9920-354f-4b26-b547-e9cd44e46701-multus-daemon-config\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.188868 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188665 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3bf8565-febc-4cfa-8d86-11e5aeb3b516-original-pull-secret\") pod \"global-pull-secret-syncer-fd8lf\" (UID: \"f3bf8565-febc-4cfa-8d86-11e5aeb3b516\") " pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:08:40.188868 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188685 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c64cf8f4-16ee-4162-aae6-f4293a47efc0-sys-fs\") pod \"aws-ebs-csi-driver-node-m4h6t\" (UID: \"c64cf8f4-16ee-4162-aae6-f4293a47efc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4h6t" Jul 10 14:08:40.188868 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188710 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/60ccacff-e05b-4d1a-abe6-4824377bf277-run\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.188868 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188732 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4bce65df-592e-4e75-9485-d788a0133cd4-os-release\") pod \"multus-additional-cni-plugins-dpgfx\" (UID: \"4bce65df-592e-4e75-9485-d788a0133cd4\") " pod="openshift-multus/multus-additional-cni-plugins-dpgfx" Jul 10 14:08:40.188868 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188746 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e9439b8d-1e36-423c-94c3-484c91f4708f-agent-certs\") pod \"konnectivity-agent-wlgmc\" (UID: \"e9439b8d-1e36-423c-94c3-484c91f4708f\") " pod="kube-system/konnectivity-agent-wlgmc" Jul 10 14:08:40.188868 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188766 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-run-openvswitch\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.188868 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188786 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-host-run-netns\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.189549 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188813 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-run-systemd\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.189549 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188834 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvtnp\" (UniqueName: \"kubernetes.io/projected/5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae-kube-api-access-kvtnp\") pod \"network-metrics-daemon-6jcf8\" (UID: \"5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae\") " pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:08:40.189549 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188850 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c64cf8f4-16ee-4162-aae6-f4293a47efc0-etc-selinux\") pod \"aws-ebs-csi-driver-node-m4h6t\" (UID: \"c64cf8f4-16ee-4162-aae6-f4293a47efc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4h6t" Jul 10 14:08:40.189549 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188866 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/60ccacff-e05b-4d1a-abe6-4824377bf277-etc-tuned\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.189549 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188889 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4bce65df-592e-4e75-9485-d788a0133cd4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dpgfx\" (UID: \"4bce65df-592e-4e75-9485-d788a0133cd4\") " pod="openshift-multus/multus-additional-cni-plugins-dpgfx" Jul 10 14:08:40.189549 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188905 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-run-ovn\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.189549 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188925 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-multus-cni-dir\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.189549 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.188971 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-host-run-k8s-cni-cncf-io\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.189549 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189006 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-host-run-netns\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.189549 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189022 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/40d27be5-4ac9-4d9b-9b56-79bad16fed0d-hosts-file\") pod \"node-resolver-t65gv\" (UID: \"40d27be5-4ac9-4d9b-9b56-79bad16fed0d\") " pod="openshift-dns/node-resolver-t65gv" Jul 10 14:08:40.189549 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189045 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-node-log\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.189549 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189070 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-etc-openvswitch\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.189549 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189084 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/72c7722f-6a58-4230-a5f4-9c440b6887ea-env-overrides\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.189549 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189099 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-os-release\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.189549 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189115 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f3bf8565-febc-4cfa-8d86-11e5aeb3b516-kubelet-config\") pod \"global-pull-secret-syncer-fd8lf\" (UID: \"f3bf8565-febc-4cfa-8d86-11e5aeb3b516\") " pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:08:40.189549 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189130 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60ccacff-e05b-4d1a-abe6-4824377bf277-lib-modules\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.190294 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189146 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.190294 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189163 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-host-var-lib-kubelet\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.190294 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189178 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp9tw\" (UniqueName: \"kubernetes.io/projected/60ccacff-e05b-4d1a-abe6-4824377bf277-kube-api-access-sp9tw\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.190294 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189194 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9479k\" (UniqueName: \"kubernetes.io/projected/4bce65df-592e-4e75-9485-d788a0133cd4-kube-api-access-9479k\") pod \"multus-additional-cni-plugins-dpgfx\" (UID: \"4bce65df-592e-4e75-9485-d788a0133cd4\") " pod="openshift-multus/multus-additional-cni-plugins-dpgfx" Jul 10 14:08:40.190294 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189244 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/72c7722f-6a58-4230-a5f4-9c440b6887ea-ovnkube-config\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.190294 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189276 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-host-var-lib-cni-bin\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.190294 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189303 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4bce65df-592e-4e75-9485-d788a0133cd4-cni-binary-copy\") pod \"multus-additional-cni-plugins-dpgfx\" (UID: \"4bce65df-592e-4e75-9485-d788a0133cd4\") " pod="openshift-multus/multus-additional-cni-plugins-dpgfx" Jul 10 14:08:40.190294 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189345 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88hp4\" (UniqueName: \"kubernetes.io/projected/b8795212-5e6f-43f4-baed-1c7c8bca70e4-kube-api-access-88hp4\") pod \"iptables-alerter-4924f\" (UID: \"b8795212-5e6f-43f4-baed-1c7c8bca70e4\") " pod="openshift-network-operator/iptables-alerter-4924f" Jul 10 14:08:40.190294 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189370 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c64cf8f4-16ee-4162-aae6-f4293a47efc0-socket-dir\") pod \"aws-ebs-csi-driver-node-m4h6t\" (UID: \"c64cf8f4-16ee-4162-aae6-f4293a47efc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4h6t" Jul 10 14:08:40.190294 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189397 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmthw\" (UniqueName: \"kubernetes.io/projected/2814701c-e4da-4cc4-b7c4-550067a950b1-kube-api-access-xmthw\") pod \"network-check-target-wcvvb\" (UID: \"2814701c-e4da-4cc4-b7c4-550067a950b1\") " pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:08:40.190294 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189421 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-log-socket\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.190294 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189444 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-cnibin\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.190294 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189469 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-etc-kubernetes\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.190294 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189500 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.190294 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189533 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/979a9920-354f-4b26-b547-e9cd44e46701-cni-binary-copy\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.190294 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189556 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-hostroot\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.191021 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189579 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-multus-conf-dir\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.191021 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189619 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-host-run-multus-certs\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.191021 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189643 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae-metrics-certs\") pod \"network-metrics-daemon-6jcf8\" (UID: \"5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae\") " pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:08:40.191021 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189668 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c64cf8f4-16ee-4162-aae6-f4293a47efc0-device-dir\") pod \"aws-ebs-csi-driver-node-m4h6t\" (UID: \"c64cf8f4-16ee-4162-aae6-f4293a47efc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4h6t" Jul 10 14:08:40.191021 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189696 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60ccacff-e05b-4d1a-abe6-4824377bf277-tmp\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.191021 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189719 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/72c7722f-6a58-4230-a5f4-9c440b6887ea-ovnkube-script-lib\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.191021 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189736 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65bh2\" (UniqueName: \"kubernetes.io/projected/72c7722f-6a58-4230-a5f4-9c440b6887ea-kube-api-access-65bh2\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.191021 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189756 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/88b0cb5c-d33e-42a2-a4cb-cf4ac90259bd-host\") pod \"node-ca-xtp2b\" (UID: \"88b0cb5c-d33e-42a2-a4cb-cf4ac90259bd\") " pod="openshift-image-registry/node-ca-xtp2b" Jul 10 14:08:40.191021 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189773 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c64cf8f4-16ee-4162-aae6-f4293a47efc0-registration-dir\") pod \"aws-ebs-csi-driver-node-m4h6t\" (UID: \"c64cf8f4-16ee-4162-aae6-f4293a47efc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4h6t" Jul 10 14:08:40.191021 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189803 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/60ccacff-e05b-4d1a-abe6-4824377bf277-etc-sysconfig\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.191021 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189833 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60ccacff-e05b-4d1a-abe6-4824377bf277-var-lib-kubelet\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.191021 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189858 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4bce65df-592e-4e75-9485-d788a0133cd4-system-cni-dir\") pod \"multus-additional-cni-plugins-dpgfx\" (UID: \"4bce65df-592e-4e75-9485-d788a0133cd4\") " pod="openshift-multus/multus-additional-cni-plugins-dpgfx" Jul 10 14:08:40.191021 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189885 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-host-slash\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.191021 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189919 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldjbh\" (UniqueName: \"kubernetes.io/projected/979a9920-354f-4b26-b547-e9cd44e46701-kube-api-access-ldjbh\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.191021 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.189973 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/60ccacff-e05b-4d1a-abe6-4824377bf277-etc-sysctl-d\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.290585 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.290543 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-host-var-lib-kubelet\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.290585 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.290588 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp9tw\" (UniqueName: \"kubernetes.io/projected/60ccacff-e05b-4d1a-abe6-4824377bf277-kube-api-access-sp9tw\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.290777 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.290608 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9479k\" (UniqueName: \"kubernetes.io/projected/4bce65df-592e-4e75-9485-d788a0133cd4-kube-api-access-9479k\") pod \"multus-additional-cni-plugins-dpgfx\" (UID: \"4bce65df-592e-4e75-9485-d788a0133cd4\") " pod="openshift-multus/multus-additional-cni-plugins-dpgfx" Jul 10 14:08:40.290777 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.290654 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-host-var-lib-kubelet\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.290777 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.290693 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/72c7722f-6a58-4230-a5f4-9c440b6887ea-ovnkube-config\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.290777 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.290717 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-host-var-lib-cni-bin\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.290777 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.290742 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4bce65df-592e-4e75-9485-d788a0133cd4-cni-binary-copy\") pod \"multus-additional-cni-plugins-dpgfx\" (UID: \"4bce65df-592e-4e75-9485-d788a0133cd4\") " pod="openshift-multus/multus-additional-cni-plugins-dpgfx" Jul 10 14:08:40.290777 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.290760 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88hp4\" (UniqueName: \"kubernetes.io/projected/b8795212-5e6f-43f4-baed-1c7c8bca70e4-kube-api-access-88hp4\") pod \"iptables-alerter-4924f\" (UID: \"b8795212-5e6f-43f4-baed-1c7c8bca70e4\") " pod="openshift-network-operator/iptables-alerter-4924f" Jul 10 14:08:40.290777 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.290770 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-host-var-lib-cni-bin\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.291124 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.290781 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c64cf8f4-16ee-4162-aae6-f4293a47efc0-socket-dir\") pod \"aws-ebs-csi-driver-node-m4h6t\" (UID: \"c64cf8f4-16ee-4162-aae6-f4293a47efc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4h6t" Jul 10 14:08:40.291124 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.290817 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmthw\" (UniqueName: \"kubernetes.io/projected/2814701c-e4da-4cc4-b7c4-550067a950b1-kube-api-access-xmthw\") pod \"network-check-target-wcvvb\" (UID: \"2814701c-e4da-4cc4-b7c4-550067a950b1\") " pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:08:40.291124 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.290836 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-log-socket\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.291124 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.290853 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-cnibin\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.291124 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.290870 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-etc-kubernetes\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.291124 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.290892 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.291124 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.290908 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c64cf8f4-16ee-4162-aae6-f4293a47efc0-socket-dir\") pod \"aws-ebs-csi-driver-node-m4h6t\" (UID: \"c64cf8f4-16ee-4162-aae6-f4293a47efc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4h6t" Jul 10 14:08:40.291124 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.290915 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/979a9920-354f-4b26-b547-e9cd44e46701-cni-binary-copy\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.291124 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.290947 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-hostroot\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.291124 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.290944 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-log-socket\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.291124 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.290978 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-cnibin\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.291124 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291076 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-multus-conf-dir\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.291124 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291081 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-hostroot\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.291124 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291105 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-host-run-multus-certs\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.291124 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291130 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae-metrics-certs\") pod \"network-metrics-daemon-6jcf8\" (UID: \"5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae\") " pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:08:40.291931 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291142 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-etc-kubernetes\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.291931 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291142 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-multus-conf-dir\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.291931 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291156 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c64cf8f4-16ee-4162-aae6-f4293a47efc0-device-dir\") pod \"aws-ebs-csi-driver-node-m4h6t\" (UID: \"c64cf8f4-16ee-4162-aae6-f4293a47efc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4h6t" Jul 10 14:08:40.291931 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291187 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.291931 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291201 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60ccacff-e05b-4d1a-abe6-4824377bf277-tmp\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.291931 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291216 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-host-run-multus-certs\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.291931 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:40.291240 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:08:40.291931 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291250 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c64cf8f4-16ee-4162-aae6-f4293a47efc0-device-dir\") pod \"aws-ebs-csi-driver-node-m4h6t\" (UID: \"c64cf8f4-16ee-4162-aae6-f4293a47efc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4h6t" Jul 10 14:08:40.291931 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291276 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/72c7722f-6a58-4230-a5f4-9c440b6887ea-ovnkube-script-lib\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.291931 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291294 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65bh2\" (UniqueName: \"kubernetes.io/projected/72c7722f-6a58-4230-a5f4-9c440b6887ea-kube-api-access-65bh2\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.291931 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:40.291339 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae-metrics-certs podName:5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae nodeName:}" failed. No retries permitted until 2026-07-10 14:08:40.791294041 +0000 UTC m=+3.734866375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae-metrics-certs") pod "network-metrics-daemon-6jcf8" (UID: "5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:08:40.291931 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291369 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/88b0cb5c-d33e-42a2-a4cb-cf4ac90259bd-host\") pod \"node-ca-xtp2b\" (UID: \"88b0cb5c-d33e-42a2-a4cb-cf4ac90259bd\") " pod="openshift-image-registry/node-ca-xtp2b" Jul 10 14:08:40.291931 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291415 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c64cf8f4-16ee-4162-aae6-f4293a47efc0-registration-dir\") pod \"aws-ebs-csi-driver-node-m4h6t\" (UID: \"c64cf8f4-16ee-4162-aae6-f4293a47efc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4h6t" Jul 10 14:08:40.291931 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291443 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/60ccacff-e05b-4d1a-abe6-4824377bf277-etc-sysconfig\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.291931 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291460 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4bce65df-592e-4e75-9485-d788a0133cd4-cni-binary-copy\") pod \"multus-additional-cni-plugins-dpgfx\" (UID: \"4bce65df-592e-4e75-9485-d788a0133cd4\") " pod="openshift-multus/multus-additional-cni-plugins-dpgfx" Jul 10 14:08:40.291931 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291493 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/72c7722f-6a58-4230-a5f4-9c440b6887ea-ovnkube-config\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.291931 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291470 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60ccacff-e05b-4d1a-abe6-4824377bf277-var-lib-kubelet\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.292661 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291526 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 10 14:08:40.292661 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291575 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60ccacff-e05b-4d1a-abe6-4824377bf277-var-lib-kubelet\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.292661 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291575 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4bce65df-592e-4e75-9485-d788a0133cd4-system-cni-dir\") pod \"multus-additional-cni-plugins-dpgfx\" (UID: \"4bce65df-592e-4e75-9485-d788a0133cd4\") " pod="openshift-multus/multus-additional-cni-plugins-dpgfx" Jul 10 14:08:40.292661 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291589 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/979a9920-354f-4b26-b547-e9cd44e46701-cni-binary-copy\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.292661 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291610 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-host-slash\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.292661 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291585 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/88b0cb5c-d33e-42a2-a4cb-cf4ac90259bd-host\") pod \"node-ca-xtp2b\" (UID: \"88b0cb5c-d33e-42a2-a4cb-cf4ac90259bd\") " pod="openshift-image-registry/node-ca-xtp2b" Jul 10 14:08:40.292661 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291631 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/60ccacff-e05b-4d1a-abe6-4824377bf277-etc-sysconfig\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.292661 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291619 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4bce65df-592e-4e75-9485-d788a0133cd4-system-cni-dir\") pod \"multus-additional-cni-plugins-dpgfx\" (UID: \"4bce65df-592e-4e75-9485-d788a0133cd4\") " pod="openshift-multus/multus-additional-cni-plugins-dpgfx" Jul 10 14:08:40.292661 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291634 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldjbh\" (UniqueName: \"kubernetes.io/projected/979a9920-354f-4b26-b547-e9cd44e46701-kube-api-access-ldjbh\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.292661 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291670 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-host-slash\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.292661 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291682 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/60ccacff-e05b-4d1a-abe6-4824377bf277-etc-sysctl-d\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.292661 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291709 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4bce65df-592e-4e75-9485-d788a0133cd4-cnibin\") pod \"multus-additional-cni-plugins-dpgfx\" (UID: \"4bce65df-592e-4e75-9485-d788a0133cd4\") " pod="openshift-multus/multus-additional-cni-plugins-dpgfx" Jul 10 14:08:40.292661 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291736 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b8795212-5e6f-43f4-baed-1c7c8bca70e4-iptables-alerter-script\") pod \"iptables-alerter-4924f\" (UID: \"b8795212-5e6f-43f4-baed-1c7c8bca70e4\") " pod="openshift-network-operator/iptables-alerter-4924f" Jul 10 14:08:40.292661 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291763 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8795212-5e6f-43f4-baed-1c7c8bca70e4-host-slash\") pod \"iptables-alerter-4924f\" (UID: \"b8795212-5e6f-43f4-baed-1c7c8bca70e4\") " pod="openshift-network-operator/iptables-alerter-4924f" Jul 10 14:08:40.292661 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291799 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-var-lib-openvswitch\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.292661 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291818 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8795212-5e6f-43f4-baed-1c7c8bca70e4-host-slash\") pod \"iptables-alerter-4924f\" (UID: \"b8795212-5e6f-43f4-baed-1c7c8bca70e4\") " pod="openshift-network-operator/iptables-alerter-4924f" Jul 10 14:08:40.292661 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291833 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4bce65df-592e-4e75-9485-d788a0133cd4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dpgfx\" (UID: \"4bce65df-592e-4e75-9485-d788a0133cd4\") " pod="openshift-multus/multus-additional-cni-plugins-dpgfx" Jul 10 14:08:40.292661 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291845 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4bce65df-592e-4e75-9485-d788a0133cd4-cnibin\") pod \"multus-additional-cni-plugins-dpgfx\" (UID: \"4bce65df-592e-4e75-9485-d788a0133cd4\") " pod="openshift-multus/multus-additional-cni-plugins-dpgfx" Jul 10 14:08:40.293632 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291851 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/72c7722f-6a58-4230-a5f4-9c440b6887ea-ovnkube-script-lib\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.293632 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291858 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-host-cni-bin\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.293632 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291546 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c64cf8f4-16ee-4162-aae6-f4293a47efc0-registration-dir\") pod \"aws-ebs-csi-driver-node-m4h6t\" (UID: \"c64cf8f4-16ee-4162-aae6-f4293a47efc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4h6t" Jul 10 14:08:40.293632 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291880 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-system-cni-dir\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.293632 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291919 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/60ccacff-e05b-4d1a-abe6-4824377bf277-etc-sysctl-d\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.293632 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.291942 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-var-lib-openvswitch\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.293632 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292025 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-host-cni-bin\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.293632 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292068 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-system-cni-dir\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.293632 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292089 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f3bf8565-febc-4cfa-8d86-11e5aeb3b516-dbus\") pod \"global-pull-secret-syncer-fd8lf\" (UID: \"f3bf8565-febc-4cfa-8d86-11e5aeb3b516\") " pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:08:40.293632 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292106 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/60ccacff-e05b-4d1a-abe6-4824377bf277-etc-modprobe-d\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.293632 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292128 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-host-kubelet\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.293632 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292153 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvqgn\" (UniqueName: \"kubernetes.io/projected/88b0cb5c-d33e-42a2-a4cb-cf4ac90259bd-kube-api-access-hvqgn\") pod \"node-ca-xtp2b\" (UID: \"88b0cb5c-d33e-42a2-a4cb-cf4ac90259bd\") " pod="openshift-image-registry/node-ca-xtp2b" Jul 10 14:08:40.293632 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292178 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e9439b8d-1e36-423c-94c3-484c91f4708f-konnectivity-ca\") pod \"konnectivity-agent-wlgmc\" (UID: \"e9439b8d-1e36-423c-94c3-484c91f4708f\") " pod="kube-system/konnectivity-agent-wlgmc" Jul 10 14:08:40.293632 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292202 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/60ccacff-e05b-4d1a-abe6-4824377bf277-etc-systemd\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.293632 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292226 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/60ccacff-e05b-4d1a-abe6-4824377bf277-host\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.293632 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292230 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-host-kubelet\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.293632 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292253 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4bce65df-592e-4e75-9485-d788a0133cd4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dpgfx\" (UID: \"4bce65df-592e-4e75-9485-d788a0133cd4\") " pod="openshift-multus/multus-additional-cni-plugins-dpgfx" Jul 10 14:08:40.294539 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292279 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-systemd-units\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.294539 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292277 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b8795212-5e6f-43f4-baed-1c7c8bca70e4-iptables-alerter-script\") pod \"iptables-alerter-4924f\" (UID: \"b8795212-5e6f-43f4-baed-1c7c8bca70e4\") " pod="openshift-network-operator/iptables-alerter-4924f" Jul 10 14:08:40.294539 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292305 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-host-cni-netd\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.294539 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292330 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/60ccacff-e05b-4d1a-abe6-4824377bf277-etc-systemd\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.294539 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292355 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmnlv\" (UniqueName: \"kubernetes.io/projected/c64cf8f4-16ee-4162-aae6-f4293a47efc0-kube-api-access-nmnlv\") pod \"aws-ebs-csi-driver-node-m4h6t\" (UID: \"c64cf8f4-16ee-4162-aae6-f4293a47efc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4h6t" Jul 10 14:08:40.294539 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292361 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-host-cni-netd\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.294539 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292385 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/72c7722f-6a58-4230-a5f4-9c440b6887ea-ovn-node-metrics-cert\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.294539 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292404 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-systemd-units\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.294539 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292430 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-multus-socket-dir-parent\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.294539 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292230 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/60ccacff-e05b-4d1a-abe6-4824377bf277-etc-modprobe-d\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.294539 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292450 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4bce65df-592e-4e75-9485-d788a0133cd4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dpgfx\" (UID: \"4bce65df-592e-4e75-9485-d788a0133cd4\") " pod="openshift-multus/multus-additional-cni-plugins-dpgfx" Jul 10 14:08:40.294539 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292457 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40d27be5-4ac9-4d9b-9b56-79bad16fed0d-tmp-dir\") pod \"node-resolver-t65gv\" (UID: \"40d27be5-4ac9-4d9b-9b56-79bad16fed0d\") " pod="openshift-dns/node-resolver-t65gv" Jul 10 14:08:40.294539 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292529 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grjls\" (UniqueName: \"kubernetes.io/projected/40d27be5-4ac9-4d9b-9b56-79bad16fed0d-kube-api-access-grjls\") pod \"node-resolver-t65gv\" (UID: \"40d27be5-4ac9-4d9b-9b56-79bad16fed0d\") " pod="openshift-dns/node-resolver-t65gv" Jul 10 14:08:40.294539 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292566 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60ccacff-e05b-4d1a-abe6-4824377bf277-etc-kubernetes\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.294539 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292587 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/60ccacff-e05b-4d1a-abe6-4824377bf277-etc-sysctl-conf\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.294539 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292606 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60ccacff-e05b-4d1a-abe6-4824377bf277-sys\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.294539 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292629 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c64cf8f4-16ee-4162-aae6-f4293a47efc0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m4h6t\" (UID: \"c64cf8f4-16ee-4162-aae6-f4293a47efc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4h6t" Jul 10 14:08:40.295447 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292657 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/88b0cb5c-d33e-42a2-a4cb-cf4ac90259bd-serviceca\") pod \"node-ca-xtp2b\" (UID: \"88b0cb5c-d33e-42a2-a4cb-cf4ac90259bd\") " pod="openshift-image-registry/node-ca-xtp2b" Jul 10 14:08:40.295447 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292679 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-host-var-lib-cni-multus\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.295447 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292701 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/979a9920-354f-4b26-b547-e9cd44e46701-multus-daemon-config\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.295447 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292722 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3bf8565-febc-4cfa-8d86-11e5aeb3b516-original-pull-secret\") pod \"global-pull-secret-syncer-fd8lf\" (UID: \"f3bf8565-febc-4cfa-8d86-11e5aeb3b516\") " pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:08:40.295447 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292744 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c64cf8f4-16ee-4162-aae6-f4293a47efc0-sys-fs\") pod \"aws-ebs-csi-driver-node-m4h6t\" (UID: \"c64cf8f4-16ee-4162-aae6-f4293a47efc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4h6t" Jul 10 14:08:40.295447 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292745 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40d27be5-4ac9-4d9b-9b56-79bad16fed0d-tmp-dir\") pod \"node-resolver-t65gv\" (UID: \"40d27be5-4ac9-4d9b-9b56-79bad16fed0d\") " pod="openshift-dns/node-resolver-t65gv" Jul 10 14:08:40.295447 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292764 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/60ccacff-e05b-4d1a-abe6-4824377bf277-run\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.295447 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292785 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4bce65df-592e-4e75-9485-d788a0133cd4-os-release\") pod \"multus-additional-cni-plugins-dpgfx\" (UID: \"4bce65df-592e-4e75-9485-d788a0133cd4\") " pod="openshift-multus/multus-additional-cni-plugins-dpgfx" Jul 10 14:08:40.295447 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292805 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-multus-socket-dir-parent\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.295447 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292821 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-host-var-lib-cni-multus\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.295447 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292822 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e9439b8d-1e36-423c-94c3-484c91f4708f-agent-certs\") pod \"konnectivity-agent-wlgmc\" (UID: \"e9439b8d-1e36-423c-94c3-484c91f4708f\") " pod="kube-system/konnectivity-agent-wlgmc" Jul 10 14:08:40.295447 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292860 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-run-openvswitch\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.295447 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292794 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e9439b8d-1e36-423c-94c3-484c91f4708f-konnectivity-ca\") pod \"konnectivity-agent-wlgmc\" (UID: \"e9439b8d-1e36-423c-94c3-484c91f4708f\") " pod="kube-system/konnectivity-agent-wlgmc" Jul 10 14:08:40.295447 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292885 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-host-run-netns\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.295447 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292914 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-host-run-netns\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.295447 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292914 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-run-systemd\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.295447 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292948 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvtnp\" (UniqueName: \"kubernetes.io/projected/5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae-kube-api-access-kvtnp\") pod \"network-metrics-daemon-6jcf8\" (UID: \"5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae\") " pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:08:40.295447 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292955 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60ccacff-e05b-4d1a-abe6-4824377bf277-etc-kubernetes\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.296177 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292974 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c64cf8f4-16ee-4162-aae6-f4293a47efc0-etc-selinux\") pod \"aws-ebs-csi-driver-node-m4h6t\" (UID: \"c64cf8f4-16ee-4162-aae6-f4293a47efc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4h6t" Jul 10 14:08:40.296177 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292999 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/60ccacff-e05b-4d1a-abe6-4824377bf277-etc-tuned\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.296177 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293022 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4bce65df-592e-4e75-9485-d788a0133cd4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dpgfx\" (UID: \"4bce65df-592e-4e75-9485-d788a0133cd4\") " pod="openshift-multus/multus-additional-cni-plugins-dpgfx" Jul 10 14:08:40.296177 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293046 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/60ccacff-e05b-4d1a-abe6-4824377bf277-etc-sysctl-conf\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.296177 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293047 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-run-ovn\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.296177 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293065 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f3bf8565-febc-4cfa-8d86-11e5aeb3b516-dbus\") pod \"global-pull-secret-syncer-fd8lf\" (UID: \"f3bf8565-febc-4cfa-8d86-11e5aeb3b516\") " pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:08:40.296177 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293083 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-multus-cni-dir\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.296177 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293111 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-host-run-k8s-cni-cncf-io\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.296177 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293138 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-host-run-netns\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.296177 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293165 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/40d27be5-4ac9-4d9b-9b56-79bad16fed0d-hosts-file\") pod \"node-resolver-t65gv\" (UID: \"40d27be5-4ac9-4d9b-9b56-79bad16fed0d\") " pod="openshift-dns/node-resolver-t65gv" Jul 10 14:08:40.296177 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:40.293189 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 14:08:40.296177 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293196 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-node-log\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.296177 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293225 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-etc-openvswitch\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.296177 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:40.293247 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3bf8565-febc-4cfa-8d86-11e5aeb3b516-original-pull-secret podName:f3bf8565-febc-4cfa-8d86-11e5aeb3b516 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:40.793229806 +0000 UTC m=+3.736802132 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f3bf8565-febc-4cfa-8d86-11e5aeb3b516-original-pull-secret") pod "global-pull-secret-syncer-fd8lf" (UID: "f3bf8565-febc-4cfa-8d86-11e5aeb3b516") : object "kube-system"/"original-pull-secret" not registered Jul 10 14:08:40.296177 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293267 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-etc-openvswitch\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.296177 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293274 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/72c7722f-6a58-4230-a5f4-9c440b6887ea-env-overrides\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.296177 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293300 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/979a9920-354f-4b26-b547-e9cd44e46701-multus-daemon-config\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.296700 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293317 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60ccacff-e05b-4d1a-abe6-4824377bf277-sys\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.296700 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293302 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-os-release\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.296700 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293359 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-os-release\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.296700 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293374 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c64cf8f4-16ee-4162-aae6-f4293a47efc0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m4h6t\" (UID: \"c64cf8f4-16ee-4162-aae6-f4293a47efc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4h6t" Jul 10 14:08:40.296700 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293382 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f3bf8565-febc-4cfa-8d86-11e5aeb3b516-kubelet-config\") pod \"global-pull-secret-syncer-fd8lf\" (UID: \"f3bf8565-febc-4cfa-8d86-11e5aeb3b516\") " pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:08:40.296700 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293414 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-run-ovn\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.296700 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.292500 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/60ccacff-e05b-4d1a-abe6-4824377bf277-host\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.296700 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293430 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60ccacff-e05b-4d1a-abe6-4824377bf277-lib-modules\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.296700 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293469 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.296700 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293499 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c64cf8f4-16ee-4162-aae6-f4293a47efc0-etc-selinux\") pod \"aws-ebs-csi-driver-node-m4h6t\" (UID: \"c64cf8f4-16ee-4162-aae6-f4293a47efc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4h6t" Jul 10 14:08:40.296700 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293531 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60ccacff-e05b-4d1a-abe6-4824377bf277-lib-modules\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.296700 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293537 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.296700 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293577 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-run-openvswitch\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.296700 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293587 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c64cf8f4-16ee-4162-aae6-f4293a47efc0-sys-fs\") pod \"aws-ebs-csi-driver-node-m4h6t\" (UID: \"c64cf8f4-16ee-4162-aae6-f4293a47efc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4h6t" Jul 10 14:08:40.296700 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293593 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4bce65df-592e-4e75-9485-d788a0133cd4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dpgfx\" (UID: \"4bce65df-592e-4e75-9485-d788a0133cd4\") " pod="openshift-multus/multus-additional-cni-plugins-dpgfx" Jul 10 14:08:40.296700 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293623 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/60ccacff-e05b-4d1a-abe6-4824377bf277-run\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.296700 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293628 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-host-run-k8s-cni-cncf-io\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.297175 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293635 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4bce65df-592e-4e75-9485-d788a0133cd4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dpgfx\" (UID: \"4bce65df-592e-4e75-9485-d788a0133cd4\") " pod="openshift-multus/multus-additional-cni-plugins-dpgfx" Jul 10 14:08:40.297175 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293822 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-run-systemd\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.297175 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293676 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4bce65df-592e-4e75-9485-d788a0133cd4-os-release\") pod \"multus-additional-cni-plugins-dpgfx\" (UID: \"4bce65df-592e-4e75-9485-d788a0133cd4\") " pod="openshift-multus/multus-additional-cni-plugins-dpgfx" Jul 10 14:08:40.297175 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293686 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/40d27be5-4ac9-4d9b-9b56-79bad16fed0d-hosts-file\") pod \"node-resolver-t65gv\" (UID: \"40d27be5-4ac9-4d9b-9b56-79bad16fed0d\") " pod="openshift-dns/node-resolver-t65gv" Jul 10 14:08:40.297175 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293717 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/72c7722f-6a58-4230-a5f4-9c440b6887ea-node-log\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.297175 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293720 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-multus-cni-dir\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.297175 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293737 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f3bf8565-febc-4cfa-8d86-11e5aeb3b516-kubelet-config\") pod \"global-pull-secret-syncer-fd8lf\" (UID: \"f3bf8565-febc-4cfa-8d86-11e5aeb3b516\") " pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:08:40.297175 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.293670 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/979a9920-354f-4b26-b547-e9cd44e46701-host-run-netns\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.297175 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.294165 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/72c7722f-6a58-4230-a5f4-9c440b6887ea-env-overrides\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.297175 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.294933 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/88b0cb5c-d33e-42a2-a4cb-cf4ac90259bd-serviceca\") pod \"node-ca-xtp2b\" (UID: \"88b0cb5c-d33e-42a2-a4cb-cf4ac90259bd\") " pod="openshift-image-registry/node-ca-xtp2b" Jul 10 14:08:40.297175 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.295514 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60ccacff-e05b-4d1a-abe6-4824377bf277-tmp\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.297175 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.295767 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/72c7722f-6a58-4230-a5f4-9c440b6887ea-ovn-node-metrics-cert\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.297175 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.295799 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/60ccacff-e05b-4d1a-abe6-4824377bf277-etc-tuned\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.297175 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.296214 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e9439b8d-1e36-423c-94c3-484c91f4708f-agent-certs\") pod \"konnectivity-agent-wlgmc\" (UID: \"e9439b8d-1e36-423c-94c3-484c91f4708f\") " pod="kube-system/konnectivity-agent-wlgmc" Jul 10 14:08:40.298434 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:40.298417 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 14:08:40.298434 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:40.298436 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 14:08:40.298585 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:40.298446 2581 projected.go:196] Error preparing data for projected volume kube-api-access-xmthw for pod openshift-network-diagnostics/network-check-target-wcvvb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:08:40.298585 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:40.298524 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2814701c-e4da-4cc4-b7c4-550067a950b1-kube-api-access-xmthw podName:2814701c-e4da-4cc4-b7c4-550067a950b1 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:40.798505582 +0000 UTC m=+3.742077927 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xmthw" (UniqueName: "kubernetes.io/projected/2814701c-e4da-4cc4-b7c4-550067a950b1-kube-api-access-xmthw") pod "network-check-target-wcvvb" (UID: "2814701c-e4da-4cc4-b7c4-550067a950b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:08:40.300369 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.300342 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9479k\" (UniqueName: \"kubernetes.io/projected/4bce65df-592e-4e75-9485-d788a0133cd4-kube-api-access-9479k\") pod \"multus-additional-cni-plugins-dpgfx\" (UID: \"4bce65df-592e-4e75-9485-d788a0133cd4\") " pod="openshift-multus/multus-additional-cni-plugins-dpgfx" Jul 10 14:08:40.300702 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.300680 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp9tw\" (UniqueName: \"kubernetes.io/projected/60ccacff-e05b-4d1a-abe6-4824377bf277-kube-api-access-sp9tw\") pod \"tuned-dgvn4\" (UID: \"60ccacff-e05b-4d1a-abe6-4824377bf277\") " pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.300793 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.300771 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88hp4\" (UniqueName: \"kubernetes.io/projected/b8795212-5e6f-43f4-baed-1c7c8bca70e4-kube-api-access-88hp4\") pod \"iptables-alerter-4924f\" (UID: \"b8795212-5e6f-43f4-baed-1c7c8bca70e4\") " pod="openshift-network-operator/iptables-alerter-4924f" Jul 10 14:08:40.301163 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.301138 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65bh2\" (UniqueName: \"kubernetes.io/projected/72c7722f-6a58-4230-a5f4-9c440b6887ea-kube-api-access-65bh2\") pod \"ovnkube-node-6z8gc\" (UID: \"72c7722f-6a58-4230-a5f4-9c440b6887ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.301993 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.301971 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldjbh\" (UniqueName: \"kubernetes.io/projected/979a9920-354f-4b26-b547-e9cd44e46701-kube-api-access-ldjbh\") pod \"multus-9wb6f\" (UID: \"979a9920-354f-4b26-b547-e9cd44e46701\") " pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.302232 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.302208 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvqgn\" (UniqueName: \"kubernetes.io/projected/88b0cb5c-d33e-42a2-a4cb-cf4ac90259bd-kube-api-access-hvqgn\") pod \"node-ca-xtp2b\" (UID: \"88b0cb5c-d33e-42a2-a4cb-cf4ac90259bd\") " pod="openshift-image-registry/node-ca-xtp2b" Jul 10 14:08:40.302418 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.302401 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grjls\" (UniqueName: \"kubernetes.io/projected/40d27be5-4ac9-4d9b-9b56-79bad16fed0d-kube-api-access-grjls\") pod \"node-resolver-t65gv\" (UID: \"40d27be5-4ac9-4d9b-9b56-79bad16fed0d\") " pod="openshift-dns/node-resolver-t65gv" Jul 10 14:08:40.303082 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.303063 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvtnp\" (UniqueName: \"kubernetes.io/projected/5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae-kube-api-access-kvtnp\") pod \"network-metrics-daemon-6jcf8\" (UID: \"5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae\") " pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:08:40.303469 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.303452 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmnlv\" (UniqueName: \"kubernetes.io/projected/c64cf8f4-16ee-4162-aae6-f4293a47efc0-kube-api-access-nmnlv\") pod \"aws-ebs-csi-driver-node-m4h6t\" (UID: \"c64cf8f4-16ee-4162-aae6-f4293a47efc0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4h6t" Jul 10 14:08:40.406072 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.405974 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t65gv" Jul 10 14:08:40.413001 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.412982 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wlgmc" Jul 10 14:08:40.417095 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:40.417065 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40d27be5_4ac9_4d9b_9b56_79bad16fed0d.slice/crio-cace78442996de0a9373f459a99da2cb8d9b61a935b53530175ebe2412afdf74 WatchSource:0}: Error finding container cace78442996de0a9373f459a99da2cb8d9b61a935b53530175ebe2412afdf74: Status 404 returned error can't find the container with id cace78442996de0a9373f459a99da2cb8d9b61a935b53530175ebe2412afdf74 Jul 10 14:08:40.421905 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:40.421884 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9439b8d_1e36_423c_94c3_484c91f4708f.slice/crio-2abec23e34a3fc8545a927fd3f72f1a8ef337b5c573fe347e32066839a58c3b3 WatchSource:0}: Error finding container 2abec23e34a3fc8545a927fd3f72f1a8ef337b5c573fe347e32066839a58c3b3: Status 404 returned error can't find the container with id 2abec23e34a3fc8545a927fd3f72f1a8ef337b5c573fe347e32066839a58c3b3 Jul 10 14:08:40.421992 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.421976 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:08:40.426013 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.425928 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4h6t" Jul 10 14:08:40.432393 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.432370 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" Jul 10 14:08:40.434082 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:40.434059 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72c7722f_6a58_4230_a5f4_9c440b6887ea.slice/crio-5fca5db5c387efe89d5dc71b343d459558bf9524bc40ba55f9f17b033c5e02bf WatchSource:0}: Error finding container 5fca5db5c387efe89d5dc71b343d459558bf9524bc40ba55f9f17b033c5e02bf: Status 404 returned error can't find the container with id 5fca5db5c387efe89d5dc71b343d459558bf9524bc40ba55f9f17b033c5e02bf Jul 10 14:08:40.438684 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.438660 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dpgfx" Jul 10 14:08:40.444220 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.444194 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xtp2b" Jul 10 14:08:40.445595 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:40.445572 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60ccacff_e05b_4d1a_abe6_4824377bf277.slice/crio-17bf54c1eeaec750d59434b7afd51196ac5034c605912d4c42198684a2f71d1c WatchSource:0}: Error finding container 17bf54c1eeaec750d59434b7afd51196ac5034c605912d4c42198684a2f71d1c: Status 404 returned error can't find the container with id 17bf54c1eeaec750d59434b7afd51196ac5034c605912d4c42198684a2f71d1c Jul 10 14:08:40.448713 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:40.448693 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bce65df_592e_4e75_9485_d788a0133cd4.slice/crio-b840d4d4b88727a8e44450944bc9a0bf522cd97d5d859d70ca80bb1cf7229160 WatchSource:0}: Error finding container b840d4d4b88727a8e44450944bc9a0bf522cd97d5d859d70ca80bb1cf7229160: Status 404 returned error can't find the container with id b840d4d4b88727a8e44450944bc9a0bf522cd97d5d859d70ca80bb1cf7229160 Jul 10 14:08:40.449832 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.449816 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9wb6f" Jul 10 14:08:40.453854 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:40.453831 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88b0cb5c_d33e_42a2_a4cb_cf4ac90259bd.slice/crio-95be99f558058f3c7cb237e753ee28c843c6b325afbf21f964f912d97deed404 WatchSource:0}: Error finding container 95be99f558058f3c7cb237e753ee28c843c6b325afbf21f964f912d97deed404: Status 404 returned error can't find the container with id 95be99f558058f3c7cb237e753ee28c843c6b325afbf21f964f912d97deed404 Jul 10 14:08:40.455380 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.455289 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4924f" Jul 10 14:08:40.460084 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:40.460065 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod979a9920_354f_4b26_b547_e9cd44e46701.slice/crio-dc725b59a3b4ca287aaa583a1fb886756517531872c7e1f85ccedecfccb0b53d WatchSource:0}: Error finding container dc725b59a3b4ca287aaa583a1fb886756517531872c7e1f85ccedecfccb0b53d: Status 404 returned error can't find the container with id dc725b59a3b4ca287aaa583a1fb886756517531872c7e1f85ccedecfccb0b53d Jul 10 14:08:40.464862 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:08:40.464803 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8795212_5e6f_43f4_baed_1c7c8bca70e4.slice/crio-d2a82a89f7063aa57aa644c37f177d2267f5c2f51d0fceeee97c8e071f90f379 WatchSource:0}: Error finding container d2a82a89f7063aa57aa644c37f177d2267f5c2f51d0fceeee97c8e071f90f379: Status 404 returned error can't find the container with id d2a82a89f7063aa57aa644c37f177d2267f5c2f51d0fceeee97c8e071f90f379 Jul 10 14:08:40.643836 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.643786 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9wb6f" event={"ID":"979a9920-354f-4b26-b547-e9cd44e46701","Type":"ContainerStarted","Data":"dc725b59a3b4ca287aaa583a1fb886756517531872c7e1f85ccedecfccb0b53d"} Jul 10 14:08:40.645044 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.645017 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dpgfx" event={"ID":"4bce65df-592e-4e75-9485-d788a0133cd4","Type":"ContainerStarted","Data":"b840d4d4b88727a8e44450944bc9a0bf522cd97d5d859d70ca80bb1cf7229160"} Jul 10 14:08:40.648971 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.648937 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" event={"ID":"60ccacff-e05b-4d1a-abe6-4824377bf277","Type":"ContainerStarted","Data":"17bf54c1eeaec750d59434b7afd51196ac5034c605912d4c42198684a2f71d1c"} Jul 10 14:08:40.649992 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.649971 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4h6t" event={"ID":"c64cf8f4-16ee-4162-aae6-f4293a47efc0","Type":"ContainerStarted","Data":"c8d4ef747f04ca170f76d42e7ed18321aab899eecce614ddb398402a9bfe0d43"} Jul 10 14:08:40.651014 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.650994 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" event={"ID":"72c7722f-6a58-4230-a5f4-9c440b6887ea","Type":"ContainerStarted","Data":"5fca5db5c387efe89d5dc71b343d459558bf9524bc40ba55f9f17b033c5e02bf"} Jul 10 14:08:40.652022 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.652000 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4924f" event={"ID":"b8795212-5e6f-43f4-baed-1c7c8bca70e4","Type":"ContainerStarted","Data":"d2a82a89f7063aa57aa644c37f177d2267f5c2f51d0fceeee97c8e071f90f379"} Jul 10 14:08:40.653060 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.653039 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xtp2b" event={"ID":"88b0cb5c-d33e-42a2-a4cb-cf4ac90259bd","Type":"ContainerStarted","Data":"95be99f558058f3c7cb237e753ee28c843c6b325afbf21f964f912d97deed404"} Jul 10 14:08:40.654099 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.654075 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wlgmc" event={"ID":"e9439b8d-1e36-423c-94c3-484c91f4708f","Type":"ContainerStarted","Data":"2abec23e34a3fc8545a927fd3f72f1a8ef337b5c573fe347e32066839a58c3b3"} Jul 10 14:08:40.655099 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.655080 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t65gv" event={"ID":"40d27be5-4ac9-4d9b-9b56-79bad16fed0d","Type":"ContainerStarted","Data":"cace78442996de0a9373f459a99da2cb8d9b61a935b53530175ebe2412afdf74"} Jul 10 14:08:40.656027 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.656010 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-2.ec2.internal" event={"ID":"130301692bccfc59d122f1976e2fc55a","Type":"ContainerStarted","Data":"904be955e9bb971be42533dae2eee552ffd8fd53ac4cccfb0133cff6d7adede3"} Jul 10 14:08:40.656967 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.656916 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-2.ec2.internal" event={"ID":"021b8c0c3b56b2050943ce01eeb73db5","Type":"ContainerStarted","Data":"3c49281274fe588d6232ef97fa3f80b21ba73c5e05ef4b3cbeb9fab795b57066"} Jul 10 14:08:40.798477 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.798445 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3bf8565-febc-4cfa-8d86-11e5aeb3b516-original-pull-secret\") pod \"global-pull-secret-syncer-fd8lf\" (UID: \"f3bf8565-febc-4cfa-8d86-11e5aeb3b516\") " pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:08:40.798638 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.798505 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae-metrics-certs\") pod \"network-metrics-daemon-6jcf8\" (UID: \"5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae\") " pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:08:40.798638 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:40.798607 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:08:40.798638 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:40.798609 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 14:08:40.798744 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:40.798659 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae-metrics-certs podName:5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae nodeName:}" failed. No retries permitted until 2026-07-10 14:08:41.798644177 +0000 UTC m=+4.742216499 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae-metrics-certs") pod "network-metrics-daemon-6jcf8" (UID: "5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:08:40.798744 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:40.798672 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3bf8565-febc-4cfa-8d86-11e5aeb3b516-original-pull-secret podName:f3bf8565-febc-4cfa-8d86-11e5aeb3b516 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:41.798666273 +0000 UTC m=+4.742238592 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f3bf8565-febc-4cfa-8d86-11e5aeb3b516-original-pull-secret") pod "global-pull-secret-syncer-fd8lf" (UID: "f3bf8565-febc-4cfa-8d86-11e5aeb3b516") : object "kube-system"/"original-pull-secret" not registered Jul 10 14:08:40.899791 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:40.899759 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmthw\" (UniqueName: \"kubernetes.io/projected/2814701c-e4da-4cc4-b7c4-550067a950b1-kube-api-access-xmthw\") pod \"network-check-target-wcvvb\" (UID: \"2814701c-e4da-4cc4-b7c4-550067a950b1\") " pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:08:40.899952 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:40.899912 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 14:08:40.899952 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:40.899927 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 14:08:40.899952 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:40.899937 2581 projected.go:196] Error preparing data for projected volume kube-api-access-xmthw for pod openshift-network-diagnostics/network-check-target-wcvvb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:08:40.900096 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:40.899986 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2814701c-e4da-4cc4-b7c4-550067a950b1-kube-api-access-xmthw podName:2814701c-e4da-4cc4-b7c4-550067a950b1 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:41.899972869 +0000 UTC m=+4.843545189 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xmthw" (UniqueName: "kubernetes.io/projected/2814701c-e4da-4cc4-b7c4-550067a950b1-kube-api-access-xmthw") pod "network-check-target-wcvvb" (UID: "2814701c-e4da-4cc4-b7c4-550067a950b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:08:41.131722 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:41.131609 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 14:03:40 +0000 UTC" deadline="2028-03-05 18:17:28.343494723 +0000 UTC" Jul 10 14:08:41.131722 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:41.131674 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14500h8m47.211824746s" Jul 10 14:08:41.519684 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:41.519603 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 14:08:41.644065 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:41.643081 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:08:41.644065 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:41.643215 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcvvb" podUID="2814701c-e4da-4cc4-b7c4-550067a950b1" Jul 10 14:08:41.644065 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:41.643681 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:08:41.644065 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:41.643800 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcf8" podUID="5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae" Jul 10 14:08:41.644065 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:41.643870 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:08:41.644065 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:41.643941 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fd8lf" podUID="f3bf8565-febc-4cfa-8d86-11e5aeb3b516" Jul 10 14:08:41.806516 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:41.806418 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae-metrics-certs\") pod \"network-metrics-daemon-6jcf8\" (UID: \"5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae\") " pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:08:41.806516 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:41.806502 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3bf8565-febc-4cfa-8d86-11e5aeb3b516-original-pull-secret\") pod \"global-pull-secret-syncer-fd8lf\" (UID: \"f3bf8565-febc-4cfa-8d86-11e5aeb3b516\") " pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:08:41.806755 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:41.806643 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 14:08:41.806755 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:41.806711 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3bf8565-febc-4cfa-8d86-11e5aeb3b516-original-pull-secret podName:f3bf8565-febc-4cfa-8d86-11e5aeb3b516 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:43.806690024 +0000 UTC m=+6.750262344 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f3bf8565-febc-4cfa-8d86-11e5aeb3b516-original-pull-secret") pod "global-pull-secret-syncer-fd8lf" (UID: "f3bf8565-febc-4cfa-8d86-11e5aeb3b516") : object "kube-system"/"original-pull-secret" not registered Jul 10 14:08:41.807172 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:41.807148 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:08:41.807260 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:41.807203 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae-metrics-certs podName:5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae nodeName:}" failed. No retries permitted until 2026-07-10 14:08:43.807186261 +0000 UTC m=+6.750758582 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae-metrics-certs") pod "network-metrics-daemon-6jcf8" (UID: "5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:08:41.908338 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:41.907657 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmthw\" (UniqueName: \"kubernetes.io/projected/2814701c-e4da-4cc4-b7c4-550067a950b1-kube-api-access-xmthw\") pod \"network-check-target-wcvvb\" (UID: \"2814701c-e4da-4cc4-b7c4-550067a950b1\") " pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:08:41.908338 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:41.907890 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 14:08:41.908338 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:41.907910 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 14:08:41.908338 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:41.907923 2581 projected.go:196] Error preparing data for projected volume kube-api-access-xmthw for pod openshift-network-diagnostics/network-check-target-wcvvb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:08:41.908338 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:41.907981 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2814701c-e4da-4cc4-b7c4-550067a950b1-kube-api-access-xmthw podName:2814701c-e4da-4cc4-b7c4-550067a950b1 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:43.907961861 +0000 UTC m=+6.851534184 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xmthw" (UniqueName: "kubernetes.io/projected/2814701c-e4da-4cc4-b7c4-550067a950b1-kube-api-access-xmthw") pod "network-check-target-wcvvb" (UID: "2814701c-e4da-4cc4-b7c4-550067a950b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:08:42.132817 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:42.132724 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 14:03:40 +0000 UTC" deadline="2028-04-25 11:58:07.553823934 +0000 UTC" Jul 10 14:08:42.132817 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:42.132763 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15717h49m25.421065065s" Jul 10 14:08:43.639457 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:43.639428 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:08:43.639920 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:43.639553 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcvvb" podUID="2814701c-e4da-4cc4-b7c4-550067a950b1" Jul 10 14:08:43.639988 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:43.639924 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:08:43.640098 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:43.640030 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcf8" podUID="5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae" Jul 10 14:08:43.640464 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:43.640287 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:08:43.640464 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:43.640397 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fd8lf" podUID="f3bf8565-febc-4cfa-8d86-11e5aeb3b516" Jul 10 14:08:43.828760 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:43.828021 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae-metrics-certs\") pod \"network-metrics-daemon-6jcf8\" (UID: \"5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae\") " pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:08:43.828760 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:43.828089 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3bf8565-febc-4cfa-8d86-11e5aeb3b516-original-pull-secret\") pod \"global-pull-secret-syncer-fd8lf\" (UID: \"f3bf8565-febc-4cfa-8d86-11e5aeb3b516\") " pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:08:43.828760 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:43.828218 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 14:08:43.828760 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:43.828278 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3bf8565-febc-4cfa-8d86-11e5aeb3b516-original-pull-secret podName:f3bf8565-febc-4cfa-8d86-11e5aeb3b516 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:47.828257692 +0000 UTC m=+10.771830015 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f3bf8565-febc-4cfa-8d86-11e5aeb3b516-original-pull-secret") pod "global-pull-secret-syncer-fd8lf" (UID: "f3bf8565-febc-4cfa-8d86-11e5aeb3b516") : object "kube-system"/"original-pull-secret" not registered Jul 10 14:08:43.828760 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:43.828675 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:08:43.828760 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:43.828728 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae-metrics-certs podName:5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae nodeName:}" failed. No retries permitted until 2026-07-10 14:08:47.828712046 +0000 UTC m=+10.772284368 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae-metrics-certs") pod "network-metrics-daemon-6jcf8" (UID: "5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:08:43.929536 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:43.929450 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmthw\" (UniqueName: \"kubernetes.io/projected/2814701c-e4da-4cc4-b7c4-550067a950b1-kube-api-access-xmthw\") pod \"network-check-target-wcvvb\" (UID: \"2814701c-e4da-4cc4-b7c4-550067a950b1\") " pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:08:43.929707 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:43.929630 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 14:08:43.929707 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:43.929654 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 14:08:43.929707 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:43.929667 2581 projected.go:196] Error preparing data for projected volume kube-api-access-xmthw for pod openshift-network-diagnostics/network-check-target-wcvvb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:08:43.929861 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:43.929727 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2814701c-e4da-4cc4-b7c4-550067a950b1-kube-api-access-xmthw podName:2814701c-e4da-4cc4-b7c4-550067a950b1 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:47.929707406 +0000 UTC m=+10.873279745 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xmthw" (UniqueName: "kubernetes.io/projected/2814701c-e4da-4cc4-b7c4-550067a950b1-kube-api-access-xmthw") pod "network-check-target-wcvvb" (UID: "2814701c-e4da-4cc4-b7c4-550067a950b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:08:45.637751 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:45.637664 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:08:45.638178 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:45.637670 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:08:45.638178 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:45.637804 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcvvb" podUID="2814701c-e4da-4cc4-b7c4-550067a950b1" Jul 10 14:08:45.638178 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:45.637912 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcf8" podUID="5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae" Jul 10 14:08:45.638178 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:45.637953 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:08:45.638178 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:45.638044 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fd8lf" podUID="f3bf8565-febc-4cfa-8d86-11e5aeb3b516" Jul 10 14:08:47.639261 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:47.639218 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:08:47.639740 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:47.639340 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcvvb" podUID="2814701c-e4da-4cc4-b7c4-550067a950b1" Jul 10 14:08:47.639740 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:47.639411 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:08:47.639740 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:47.639529 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fd8lf" podUID="f3bf8565-febc-4cfa-8d86-11e5aeb3b516" Jul 10 14:08:47.639740 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:47.639582 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:08:47.639740 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:47.639662 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcf8" podUID="5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae" Jul 10 14:08:47.860900 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:47.860860 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae-metrics-certs\") pod \"network-metrics-daemon-6jcf8\" (UID: \"5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae\") " pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:08:47.861080 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:47.860930 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3bf8565-febc-4cfa-8d86-11e5aeb3b516-original-pull-secret\") pod \"global-pull-secret-syncer-fd8lf\" (UID: \"f3bf8565-febc-4cfa-8d86-11e5aeb3b516\") " pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:08:47.861080 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:47.861034 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 14:08:47.861080 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:47.861035 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:08:47.861249 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:47.861099 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3bf8565-febc-4cfa-8d86-11e5aeb3b516-original-pull-secret podName:f3bf8565-febc-4cfa-8d86-11e5aeb3b516 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:55.861081075 +0000 UTC m=+18.804653426 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f3bf8565-febc-4cfa-8d86-11e5aeb3b516-original-pull-secret") pod "global-pull-secret-syncer-fd8lf" (UID: "f3bf8565-febc-4cfa-8d86-11e5aeb3b516") : object "kube-system"/"original-pull-secret" not registered Jul 10 14:08:47.861249 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:47.861117 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae-metrics-certs podName:5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae nodeName:}" failed. No retries permitted until 2026-07-10 14:08:55.861108563 +0000 UTC m=+18.804680881 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae-metrics-certs") pod "network-metrics-daemon-6jcf8" (UID: "5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:08:47.961709 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:47.961608 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmthw\" (UniqueName: \"kubernetes.io/projected/2814701c-e4da-4cc4-b7c4-550067a950b1-kube-api-access-xmthw\") pod \"network-check-target-wcvvb\" (UID: \"2814701c-e4da-4cc4-b7c4-550067a950b1\") " pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:08:47.961879 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:47.961790 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 14:08:47.961879 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:47.961813 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 14:08:47.961879 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:47.961824 2581 projected.go:196] Error preparing data for projected volume kube-api-access-xmthw for pod openshift-network-diagnostics/network-check-target-wcvvb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:08:47.961879 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:47.961877 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2814701c-e4da-4cc4-b7c4-550067a950b1-kube-api-access-xmthw podName:2814701c-e4da-4cc4-b7c4-550067a950b1 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:55.961859468 +0000 UTC m=+18.905431802 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xmthw" (UniqueName: "kubernetes.io/projected/2814701c-e4da-4cc4-b7c4-550067a950b1-kube-api-access-xmthw") pod "network-check-target-wcvvb" (UID: "2814701c-e4da-4cc4-b7c4-550067a950b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:08:49.638138 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:49.638106 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:08:49.638602 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:49.638117 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:08:49.638602 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:49.638234 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:08:49.638602 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:49.638235 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcvvb" podUID="2814701c-e4da-4cc4-b7c4-550067a950b1" Jul 10 14:08:49.638602 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:49.638364 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcf8" podUID="5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae" Jul 10 14:08:49.638602 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:49.638410 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fd8lf" podUID="f3bf8565-febc-4cfa-8d86-11e5aeb3b516" Jul 10 14:08:51.638474 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:51.638230 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:08:51.638935 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:51.638229 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:08:51.638935 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:51.638593 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcf8" podUID="5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae" Jul 10 14:08:51.638935 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:51.638230 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:08:51.638935 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:51.638674 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fd8lf" podUID="f3bf8565-febc-4cfa-8d86-11e5aeb3b516" Jul 10 14:08:51.638935 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:51.638725 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcvvb" podUID="2814701c-e4da-4cc4-b7c4-550067a950b1" Jul 10 14:08:53.638755 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:53.638710 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:08:53.639198 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:53.638711 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:08:53.639198 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:53.638846 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:08:53.639198 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:53.638838 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fd8lf" podUID="f3bf8565-febc-4cfa-8d86-11e5aeb3b516" Jul 10 14:08:53.639198 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:53.638955 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcf8" podUID="5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae" Jul 10 14:08:53.639198 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:53.639051 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcvvb" podUID="2814701c-e4da-4cc4-b7c4-550067a950b1" Jul 10 14:08:55.638034 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:55.637999 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:08:55.638553 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:55.637999 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:08:55.638553 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:55.638140 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcf8" podUID="5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae" Jul 10 14:08:55.638553 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:55.638221 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcvvb" podUID="2814701c-e4da-4cc4-b7c4-550067a950b1" Jul 10 14:08:55.638553 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:55.637999 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:08:55.638553 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:55.638379 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fd8lf" podUID="f3bf8565-febc-4cfa-8d86-11e5aeb3b516" Jul 10 14:08:55.921827 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:55.921741 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae-metrics-certs\") pod \"network-metrics-daemon-6jcf8\" (UID: \"5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae\") " pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:08:55.921827 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:55.921804 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3bf8565-febc-4cfa-8d86-11e5aeb3b516-original-pull-secret\") pod \"global-pull-secret-syncer-fd8lf\" (UID: \"f3bf8565-febc-4cfa-8d86-11e5aeb3b516\") " pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:08:55.922007 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:55.921900 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:08:55.922007 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:55.921965 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae-metrics-certs podName:5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae nodeName:}" failed. No retries permitted until 2026-07-10 14:09:11.921948828 +0000 UTC m=+34.865521146 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae-metrics-certs") pod "network-metrics-daemon-6jcf8" (UID: "5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:08:55.922007 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:55.921900 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 14:08:55.922128 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:55.922039 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3bf8565-febc-4cfa-8d86-11e5aeb3b516-original-pull-secret podName:f3bf8565-febc-4cfa-8d86-11e5aeb3b516 nodeName:}" failed. No retries permitted until 2026-07-10 14:09:11.922025252 +0000 UTC m=+34.865597570 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f3bf8565-febc-4cfa-8d86-11e5aeb3b516-original-pull-secret") pod "global-pull-secret-syncer-fd8lf" (UID: "f3bf8565-febc-4cfa-8d86-11e5aeb3b516") : object "kube-system"/"original-pull-secret" not registered Jul 10 14:08:56.022763 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:56.022730 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmthw\" (UniqueName: \"kubernetes.io/projected/2814701c-e4da-4cc4-b7c4-550067a950b1-kube-api-access-xmthw\") pod \"network-check-target-wcvvb\" (UID: \"2814701c-e4da-4cc4-b7c4-550067a950b1\") " pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:08:56.022940 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:56.022888 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 14:08:56.022940 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:56.022914 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 14:08:56.022940 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:56.022926 2581 projected.go:196] Error preparing data for projected volume kube-api-access-xmthw for pod openshift-network-diagnostics/network-check-target-wcvvb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:08:56.023096 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:56.022986 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2814701c-e4da-4cc4-b7c4-550067a950b1-kube-api-access-xmthw podName:2814701c-e4da-4cc4-b7c4-550067a950b1 nodeName:}" failed. No retries permitted until 2026-07-10 14:09:12.022967087 +0000 UTC m=+34.966539424 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xmthw" (UniqueName: "kubernetes.io/projected/2814701c-e4da-4cc4-b7c4-550067a950b1-kube-api-access-xmthw") pod "network-check-target-wcvvb" (UID: "2814701c-e4da-4cc4-b7c4-550067a950b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:08:57.638555 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:57.638524 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:08:57.639026 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:57.638605 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:08:57.639026 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:57.638614 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcvvb" podUID="2814701c-e4da-4cc4-b7c4-550067a950b1" Jul 10 14:08:57.639026 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:57.638736 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcf8" podUID="5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae" Jul 10 14:08:57.639026 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:57.638788 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:08:57.639026 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:57.638848 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fd8lf" podUID="f3bf8565-febc-4cfa-8d86-11e5aeb3b516" Jul 10 14:08:59.638058 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:59.638020 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:08:59.638511 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:59.638022 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:08:59.638511 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:59.638154 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcvvb" podUID="2814701c-e4da-4cc4-b7c4-550067a950b1" Jul 10 14:08:59.638511 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:08:59.638018 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:08:59.638511 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:59.638216 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fd8lf" podUID="f3bf8565-febc-4cfa-8d86-11e5aeb3b516" Jul 10 14:08:59.638511 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:08:59.638337 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcf8" podUID="5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae" Jul 10 14:09:01.637992 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:01.637647 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:09:01.638717 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:01.637644 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:09:01.638717 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:01.638019 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcf8" podUID="5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae" Jul 10 14:09:01.638717 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:01.637694 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:09:01.638717 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:01.638079 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcvvb" podUID="2814701c-e4da-4cc4-b7c4-550067a950b1" Jul 10 14:09:01.638717 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:01.638144 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fd8lf" podUID="f3bf8565-febc-4cfa-8d86-11e5aeb3b516" Jul 10 14:09:01.724810 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:01.724773 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xtp2b" event={"ID":"88b0cb5c-d33e-42a2-a4cb-cf4ac90259bd","Type":"ContainerStarted","Data":"4c92f54c2142fcc04ae596c11f8c7466bf20cd20bfd5166e9cba6b3e8226f833"} Jul 10 14:09:01.726691 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:01.726647 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wlgmc" event={"ID":"e9439b8d-1e36-423c-94c3-484c91f4708f","Type":"ContainerStarted","Data":"784c17ec18cc7893ec2abf0b0b94eddd65c55dc1edef995840366e31fbd9e77d"} Jul 10 14:09:01.728290 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:01.728241 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t65gv" event={"ID":"40d27be5-4ac9-4d9b-9b56-79bad16fed0d","Type":"ContainerStarted","Data":"84f99fdd1027a5079682a271ad8c75de5f9205d22796e911ad1765d6d5d1e07a"} Jul 10 14:09:01.729954 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:01.729927 2581 generic.go:356] "Generic (PLEG): container finished" podID="130301692bccfc59d122f1976e2fc55a" containerID="4c30442e1a57efb5534d1ec74a81b5d1f1d2f38abc9aac4a3ace06f37f96d7e5" exitCode=0 Jul 10 14:09:01.730083 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:01.730009 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-2.ec2.internal" event={"ID":"130301692bccfc59d122f1976e2fc55a","Type":"ContainerDied","Data":"4c30442e1a57efb5534d1ec74a81b5d1f1d2f38abc9aac4a3ace06f37f96d7e5"} Jul 10 14:09:01.731649 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:01.731618 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-2.ec2.internal" event={"ID":"021b8c0c3b56b2050943ce01eeb73db5","Type":"ContainerStarted","Data":"94319592b39bddb2c77901624dc3c772bcd17472c4d7d3db6775a0fb9276d56f"} Jul 10 14:09:01.733418 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:01.733393 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9wb6f" event={"ID":"979a9920-354f-4b26-b547-e9cd44e46701","Type":"ContainerStarted","Data":"92ec552eba7e5e34d926a5405cc3e2e35a8fd3fe154f08a111ad9df5d952f46a"} Jul 10 14:09:01.734942 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:01.734908 2581 generic.go:356] "Generic (PLEG): container finished" podID="4bce65df-592e-4e75-9485-d788a0133cd4" containerID="afb876a7f8fa6253f7236f0affa8efad3f6cf52f3a5dcb8c7cd6c9f148763984" exitCode=0 Jul 10 14:09:01.735054 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:01.734994 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dpgfx" event={"ID":"4bce65df-592e-4e75-9485-d788a0133cd4","Type":"ContainerDied","Data":"afb876a7f8fa6253f7236f0affa8efad3f6cf52f3a5dcb8c7cd6c9f148763984"} Jul 10 14:09:01.737617 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:01.737114 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" event={"ID":"60ccacff-e05b-4d1a-abe6-4824377bf277","Type":"ContainerStarted","Data":"7169d45bb2af0d97beeae583feaaf53416f0c32085ac9b6fd2c626fd19fa0825"} Jul 10 14:09:01.742299 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:01.742276 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4h6t" event={"ID":"c64cf8f4-16ee-4162-aae6-f4293a47efc0","Type":"ContainerStarted","Data":"8392fface849d1a534b312cd4817eec8b3b54150b69e776acdb9e999c24f4fe5"} Jul 10 14:09:01.745543 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:01.745526 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6z8gc_72c7722f-6a58-4230-a5f4-9c440b6887ea/ovn-acl-logging/0.log" Jul 10 14:09:01.745936 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:01.745913 2581 generic.go:356] "Generic (PLEG): container finished" podID="72c7722f-6a58-4230-a5f4-9c440b6887ea" containerID="c8176ac9b079bf52880e38eb6b2071a4f019592ccdc9ea80d85708b571af30ec" exitCode=1 Jul 10 14:09:01.746023 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:01.745946 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" event={"ID":"72c7722f-6a58-4230-a5f4-9c440b6887ea","Type":"ContainerStarted","Data":"5ff9841ca6b4b82687af870a4b3b61b18b535af25fe2b8429e511bfd624571e2"} Jul 10 14:09:01.746023 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:01.745997 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" event={"ID":"72c7722f-6a58-4230-a5f4-9c440b6887ea","Type":"ContainerStarted","Data":"b28117771f710fa31548a63e04bb7ed4e4a187b322fe6df3c15a6d980c149afd"} Jul 10 14:09:01.746103 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:01.746027 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" event={"ID":"72c7722f-6a58-4230-a5f4-9c440b6887ea","Type":"ContainerStarted","Data":"dd0b5acb19c606835087415518c48b995e849b2b1d8b0f1288768dd0e5820814"} Jul 10 14:09:01.746103 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:01.746054 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" event={"ID":"72c7722f-6a58-4230-a5f4-9c440b6887ea","Type":"ContainerStarted","Data":"a6b620bb5e4a3c53173939a07098e1b526d4ff4e0e55de0804d903b4bfe3dfd1"} Jul 10 14:09:01.746103 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:01.746081 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" event={"ID":"72c7722f-6a58-4230-a5f4-9c440b6887ea","Type":"ContainerDied","Data":"c8176ac9b079bf52880e38eb6b2071a4f019592ccdc9ea80d85708b571af30ec"} Jul 10 14:09:01.746193 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:01.746130 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" event={"ID":"72c7722f-6a58-4230-a5f4-9c440b6887ea","Type":"ContainerStarted","Data":"440189b4d08931197b6b488e43f9cffc7678d19313200c96c21c9e8c5d90776d"} Jul 10 14:09:01.756239 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:01.756192 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xtp2b" podStartSLOduration=12.432337737 podStartE2EDuration="23.75618091s" totalImagesPullingTime="11.323843173s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:08:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:01.740406155 +0000 UTC m=+24.683978493" watchObservedRunningTime="2026-07-10 14:09:01.75618091 +0000 UTC m=+24.699753305" Jul 10 14:09:01.756692 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:01.756663 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dgvn4" podStartSLOduration=3.526764227 podStartE2EDuration="23.756653456s" totalImagesPullingTime="20.229889229s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:08:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:01.756010054 +0000 UTC m=+24.699582394" watchObservedRunningTime="2026-07-10 14:09:01.756653456 +0000 UTC m=+24.700225796" Jul 10 14:09:01.785963 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:01.785917 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-2.ec2.internal" podStartSLOduration=22.785899422 podStartE2EDuration="22.785899422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:08:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:01.785812337 +0000 UTC m=+24.729384677" watchObservedRunningTime="2026-07-10 14:09:01.785899422 +0000 UTC m=+24.729471763" Jul 10 14:09:01.823996 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:01.823952 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9wb6f" podStartSLOduration=3.544809366 podStartE2EDuration="23.823936109s" totalImagesPullingTime="20.279126743s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:08:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:01.82370079 +0000 UTC m=+24.767273131" watchObservedRunningTime="2026-07-10 14:09:01.823936109 +0000 UTC m=+24.767508467" Jul 10 14:09:01.837793 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:01.837755 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-t65gv" podStartSLOduration=12.453747462 podStartE2EDuration="23.837741318s" totalImagesPullingTime="11.383993856s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:08:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:01.837383726 +0000 UTC m=+24.780956066" watchObservedRunningTime="2026-07-10 14:09:01.837741318 +0000 UTC m=+24.781313657" Jul 10 14:09:01.851029 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:01.850989 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wlgmc" podStartSLOduration=12.47191835 podStartE2EDuration="23.850973935s" totalImagesPullingTime="11.379055585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:08:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:01.850693517 +0000 UTC m=+24.794265856" watchObservedRunningTime="2026-07-10 14:09:01.850973935 +0000 UTC m=+24.794546274" Jul 10 14:09:02.536160 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:02.536141 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 10 14:09:02.749463 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:02.749383 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-2.ec2.internal" event={"ID":"130301692bccfc59d122f1976e2fc55a","Type":"ContainerStarted","Data":"82217100e9e13908285cae82d189dc42a11b9c42eeff7b53824528df4a1638e7"} Jul 10 14:09:02.751166 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:02.751143 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4h6t" event={"ID":"c64cf8f4-16ee-4162-aae6-f4293a47efc0","Type":"ContainerStarted","Data":"34a59c19264abd95c6e5dede163b41fe144b1d8057f8ceba21f7595cee22f2ef"} Jul 10 14:09:02.752452 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:02.752425 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4924f" event={"ID":"b8795212-5e6f-43f4-baed-1c7c8bca70e4","Type":"ContainerStarted","Data":"5799da22f73fb34b3a37ac2cb17bb61daeaa6c8bbf54fd5da421f9854a406210"} Jul 10 14:09:02.764820 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:02.764778 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-2.ec2.internal" podStartSLOduration=23.764765332 podStartE2EDuration="23.764765332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:08:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:02.764538639 +0000 UTC m=+25.708110979" watchObservedRunningTime="2026-07-10 14:09:02.764765332 +0000 UTC m=+25.708337672" Jul 10 14:09:02.781306 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:02.781269 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4924f" podStartSLOduration=13.440148534 podStartE2EDuration="24.781257845s" totalImagesPullingTime="11.341109311s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:08:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:02.781033708 +0000 UTC m=+25.724606059" watchObservedRunningTime="2026-07-10 14:09:02.781257845 +0000 UTC m=+25.724830185" Jul 10 14:09:03.095214 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:03.095068 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T14:09:02.536157505Z","UUID":"51414d29-2d17-43c5-9c23-1e68104cbb35","Handler":null,"Name":"","Endpoint":""} Jul 10 14:09:03.096447 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:03.096428 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 10 14:09:03.096563 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:03.096462 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 10 14:09:03.436189 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:03.436112 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wlgmc" Jul 10 14:09:03.436652 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:03.436637 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wlgmc" Jul 10 14:09:03.637828 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:03.637801 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:09:03.637996 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:03.637801 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:09:03.637996 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:03.637801 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:09:03.637996 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:03.637929 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcf8" podUID="5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae" Jul 10 14:09:03.637996 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:03.637984 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fd8lf" podUID="f3bf8565-febc-4cfa-8d86-11e5aeb3b516" Jul 10 14:09:03.638219 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:03.638048 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcvvb" podUID="2814701c-e4da-4cc4-b7c4-550067a950b1" Jul 10 14:09:03.757813 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:03.757739 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6z8gc_72c7722f-6a58-4230-a5f4-9c440b6887ea/ovn-acl-logging/0.log" Jul 10 14:09:03.758201 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:03.758176 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" event={"ID":"72c7722f-6a58-4230-a5f4-9c440b6887ea","Type":"ContainerStarted","Data":"b1b522b09a7348e5547a37ef45e7e0662e19730d153dd84065fbf5cc89913020"} Jul 10 14:09:04.762591 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:04.762352 2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 10 14:09:04.762989 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:04.762366 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4h6t" event={"ID":"c64cf8f4-16ee-4162-aae6-f4293a47efc0","Type":"ContainerStarted","Data":"0d1709cb68504a553077b906e9ce49d6509fbfa14c894988072e9732dc89e88b"} Jul 10 14:09:04.785189 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:04.785141 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4h6t" podStartSLOduration=12.102599485 podStartE2EDuration="26.785124526s" totalImagesPullingTime="14.682525041s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:08:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:04.784656995 +0000 UTC m=+27.728229335" watchObservedRunningTime="2026-07-10 14:09:04.785124526 +0000 UTC m=+27.728696879" Jul 10 14:09:05.638411 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:05.638315 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:09:05.638411 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:05.638363 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:09:05.638581 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:05.638444 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:09:05.638581 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:05.638452 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcf8" podUID="5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae" Jul 10 14:09:05.638688 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:05.638579 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcvvb" podUID="2814701c-e4da-4cc4-b7c4-550067a950b1" Jul 10 14:09:05.638759 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:05.638729 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fd8lf" podUID="f3bf8565-febc-4cfa-8d86-11e5aeb3b516" Jul 10 14:09:06.769215 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:06.769189 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6z8gc_72c7722f-6a58-4230-a5f4-9c440b6887ea/ovn-acl-logging/0.log" Jul 10 14:09:06.769998 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:06.769543 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" event={"ID":"72c7722f-6a58-4230-a5f4-9c440b6887ea","Type":"ContainerStarted","Data":"19e85bedba2f484ec3bc69dd632902c80d5d23a50b867e75922d2b134ae96d26"} Jul 10 14:09:06.769998 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:06.769854 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:09:06.769998 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:06.769917 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:09:06.769998 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:06.769987 2581 scope.go:117] "RemoveContainer" containerID="c8176ac9b079bf52880e38eb6b2071a4f019592ccdc9ea80d85708b571af30ec" Jul 10 14:09:06.787007 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:06.786804 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:09:07.639417 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:07.639379 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:09:07.639417 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:07.639402 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:09:07.639689 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:07.639477 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:09:07.639689 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:07.639497 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcvvb" podUID="2814701c-e4da-4cc4-b7c4-550067a950b1" Jul 10 14:09:07.639689 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:07.639575 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcf8" podUID="5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae" Jul 10 14:09:07.639689 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:07.639654 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fd8lf" podUID="f3bf8565-febc-4cfa-8d86-11e5aeb3b516" Jul 10 14:09:07.775245 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:07.775216 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6z8gc_72c7722f-6a58-4230-a5f4-9c440b6887ea/ovn-acl-logging/0.log" Jul 10 14:09:07.775638 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:07.775567 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" event={"ID":"72c7722f-6a58-4230-a5f4-9c440b6887ea","Type":"ContainerStarted","Data":"e816a1b239c35ae3ad50492d63b1b7a23c1fd19ad7fe03c478bd38e8ed608a1e"} Jul 10 14:09:07.775813 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:07.775795 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:09:07.786024 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:07.786001 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wlgmc" Jul 10 14:09:07.786147 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:07.786101 2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 10 14:09:07.786596 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:07.786548 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wlgmc" Jul 10 14:09:07.792935 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:07.792917 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:09:07.805033 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:07.804995 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" podStartSLOduration=9.514295808 podStartE2EDuration="29.804984245s" totalImagesPullingTime="20.290688437s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:08:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:07.804904526 +0000 UTC m=+30.748476891" watchObservedRunningTime="2026-07-10 14:09:07.804984245 +0000 UTC m=+30.748556584" Jul 10 14:09:09.638406 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:09.638382 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:09:09.638739 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:09.638386 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:09:09.638739 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:09.638383 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:09:09.638739 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:09.638498 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcvvb" podUID="2814701c-e4da-4cc4-b7c4-550067a950b1" Jul 10 14:09:09.638739 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:09.638575 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fd8lf" podUID="f3bf8565-febc-4cfa-8d86-11e5aeb3b516" Jul 10 14:09:09.638739 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:09.638672 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcf8" podUID="5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae" Jul 10 14:09:09.782004 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:09.781974 2581 generic.go:356] "Generic (PLEG): container finished" podID="4bce65df-592e-4e75-9485-d788a0133cd4" containerID="f1bb1b1161f9dffa354a4ad3d1ecd3222c8b76cfd8375e9b3813824f7c0fd68d" exitCode=0 Jul 10 14:09:09.782142 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:09.782051 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dpgfx" event={"ID":"4bce65df-592e-4e75-9485-d788a0133cd4","Type":"ContainerDied","Data":"f1bb1b1161f9dffa354a4ad3d1ecd3222c8b76cfd8375e9b3813824f7c0fd68d"} Jul 10 14:09:10.785628 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:10.785600 2581 generic.go:356] "Generic (PLEG): container finished" podID="4bce65df-592e-4e75-9485-d788a0133cd4" containerID="5c46316a708c3837d01f315388e61301b59c323b6cce5caa85841f3faf32eaa2" exitCode=0 Jul 10 14:09:10.785936 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:10.785651 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dpgfx" event={"ID":"4bce65df-592e-4e75-9485-d788a0133cd4","Type":"ContainerDied","Data":"5c46316a708c3837d01f315388e61301b59c323b6cce5caa85841f3faf32eaa2"} Jul 10 14:09:11.637912 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:11.637877 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:09:11.638104 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:11.637887 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:09:11.638104 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:11.637987 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:09:11.638104 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:11.637981 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcvvb" podUID="2814701c-e4da-4cc4-b7c4-550067a950b1" Jul 10 14:09:11.638104 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:11.638077 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcf8" podUID="5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae" Jul 10 14:09:11.638257 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:11.638156 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fd8lf" podUID="f3bf8565-febc-4cfa-8d86-11e5aeb3b516" Jul 10 14:09:11.939400 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:11.939269 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae-metrics-certs\") pod \"network-metrics-daemon-6jcf8\" (UID: \"5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae\") " pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:09:11.939400 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:11.939367 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3bf8565-febc-4cfa-8d86-11e5aeb3b516-original-pull-secret\") pod \"global-pull-secret-syncer-fd8lf\" (UID: \"f3bf8565-febc-4cfa-8d86-11e5aeb3b516\") " pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:09:11.939866 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:11.939419 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:09:11.939866 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:11.939465 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 14:09:11.939866 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:11.939484 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae-metrics-certs podName:5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae nodeName:}" failed. No retries permitted until 2026-07-10 14:09:43.939467767 +0000 UTC m=+66.883040086 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae-metrics-certs") pod "network-metrics-daemon-6jcf8" (UID: "5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:09:11.939866 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:11.939504 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3bf8565-febc-4cfa-8d86-11e5aeb3b516-original-pull-secret podName:f3bf8565-febc-4cfa-8d86-11e5aeb3b516 nodeName:}" failed. No retries permitted until 2026-07-10 14:09:43.939493293 +0000 UTC m=+66.883065611 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f3bf8565-febc-4cfa-8d86-11e5aeb3b516-original-pull-secret") pod "global-pull-secret-syncer-fd8lf" (UID: "f3bf8565-febc-4cfa-8d86-11e5aeb3b516") : object "kube-system"/"original-pull-secret" not registered Jul 10 14:09:12.040256 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:12.040218 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmthw\" (UniqueName: \"kubernetes.io/projected/2814701c-e4da-4cc4-b7c4-550067a950b1-kube-api-access-xmthw\") pod \"network-check-target-wcvvb\" (UID: \"2814701c-e4da-4cc4-b7c4-550067a950b1\") " pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:09:12.040418 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:12.040395 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 14:09:12.040418 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:12.040415 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 14:09:12.040502 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:12.040425 2581 projected.go:196] Error preparing data for projected volume kube-api-access-xmthw for pod openshift-network-diagnostics/network-check-target-wcvvb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:09:12.040502 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:12.040475 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2814701c-e4da-4cc4-b7c4-550067a950b1-kube-api-access-xmthw podName:2814701c-e4da-4cc4-b7c4-550067a950b1 nodeName:}" failed. No retries permitted until 2026-07-10 14:09:44.040462014 +0000 UTC m=+66.984034332 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xmthw" (UniqueName: "kubernetes.io/projected/2814701c-e4da-4cc4-b7c4-550067a950b1-kube-api-access-xmthw") pod "network-check-target-wcvvb" (UID: "2814701c-e4da-4cc4-b7c4-550067a950b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:09:13.637729 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:13.637700 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:09:13.638163 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:13.637708 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:09:13.638163 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:13.637801 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcf8" podUID="5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae" Jul 10 14:09:13.638163 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:13.637814 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:09:13.638163 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:13.637921 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fd8lf" podUID="f3bf8565-febc-4cfa-8d86-11e5aeb3b516" Jul 10 14:09:13.638163 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:13.638008 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcvvb" podUID="2814701c-e4da-4cc4-b7c4-550067a950b1" Jul 10 14:09:13.794200 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:13.794167 2581 generic.go:356] "Generic (PLEG): container finished" podID="4bce65df-592e-4e75-9485-d788a0133cd4" containerID="e6ef45ac1398687ab6e6ebc58d7eee16151ee326f629da29cf301aee2e4b488f" exitCode=0 Jul 10 14:09:13.794355 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:13.794226 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dpgfx" event={"ID":"4bce65df-592e-4e75-9485-d788a0133cd4","Type":"ContainerDied","Data":"e6ef45ac1398687ab6e6ebc58d7eee16151ee326f629da29cf301aee2e4b488f"} Jul 10 14:09:15.637823 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:15.637797 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:09:15.637823 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:15.637812 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:09:15.638216 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:15.637812 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:09:15.638216 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:15.637896 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcf8" podUID="5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae" Jul 10 14:09:15.638216 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:15.637990 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fd8lf" podUID="f3bf8565-febc-4cfa-8d86-11e5aeb3b516" Jul 10 14:09:15.638216 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:15.638076 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcvvb" podUID="2814701c-e4da-4cc4-b7c4-550067a950b1" Jul 10 14:09:17.642982 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:17.641264 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:09:17.643421 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:17.643209 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fd8lf" podUID="f3bf8565-febc-4cfa-8d86-11e5aeb3b516" Jul 10 14:09:17.643421 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:17.642488 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:09:17.643532 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:17.643426 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcf8" podUID="5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae" Jul 10 14:09:17.643980 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:17.642449 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:09:17.643980 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:17.643746 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcvvb" podUID="2814701c-e4da-4cc4-b7c4-550067a950b1" Jul 10 14:09:17.788658 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:17.788558 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6jcf8"] Jul 10 14:09:17.791458 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:17.791397 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wcvvb"] Jul 10 14:09:17.799764 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:17.799738 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fd8lf"] Jul 10 14:09:17.804661 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:17.804472 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:09:17.804661 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:17.804485 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:09:17.804661 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:17.804485 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:09:17.804661 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:17.804596 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fd8lf" podUID="f3bf8565-febc-4cfa-8d86-11e5aeb3b516" Jul 10 14:09:17.805646 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:17.804733 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcvvb" podUID="2814701c-e4da-4cc4-b7c4-550067a950b1" Jul 10 14:09:17.805646 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:17.804828 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcf8" podUID="5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae" Jul 10 14:09:19.638186 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:19.638154 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:09:19.638824 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:19.638154 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:09:19.638824 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:19.638288 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fd8lf" podUID="f3bf8565-febc-4cfa-8d86-11e5aeb3b516" Jul 10 14:09:19.638824 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:19.638155 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:09:19.638824 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:19.638371 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcvvb" podUID="2814701c-e4da-4cc4-b7c4-550067a950b1" Jul 10 14:09:19.638824 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:19.638426 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcf8" podUID="5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae" Jul 10 14:09:21.637893 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:21.637862 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:09:21.638529 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:21.637867 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:09:21.638529 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:21.637975 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:09:21.638529 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:21.637971 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcvvb" podUID="2814701c-e4da-4cc4-b7c4-550067a950b1" Jul 10 14:09:21.638529 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:21.638069 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6jcf8" podUID="5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae" Jul 10 14:09:21.638529 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:21.638157 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fd8lf" podUID="f3bf8565-febc-4cfa-8d86-11e5aeb3b516" Jul 10 14:09:21.815120 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:21.815086 2581 generic.go:356] "Generic (PLEG): container finished" podID="4bce65df-592e-4e75-9485-d788a0133cd4" containerID="0166abc620ab810fcb7ce9ce7615e34482120af9a6c51d3c8f35594e752b38c4" exitCode=0 Jul 10 14:09:21.815268 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:21.815127 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dpgfx" event={"ID":"4bce65df-592e-4e75-9485-d788a0133cd4","Type":"ContainerDied","Data":"0166abc620ab810fcb7ce9ce7615e34482120af9a6c51d3c8f35594e752b38c4"} Jul 10 14:09:22.319332 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.319298 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-2.ec2.internal" event="NodeReady" Jul 10 14:09:22.319440 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.319420 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 10 14:09:22.356187 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.356160 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-76bbfc4bc5-qgv94"] Jul 10 14:09:22.369468 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.369446 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ncp26"] Jul 10 14:09:22.369579 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.369563 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76bbfc4bc5-qgv94" Jul 10 14:09:22.373212 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.373184 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ww66r\"" Jul 10 14:09:22.373362 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.373346 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 10 14:09:22.373414 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.373401 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 10 14:09:22.373483 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.373467 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 10 14:09:22.379457 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.379436 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76bbfc4bc5-qgv94"] Jul 10 14:09:22.379571 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.379557 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ncp26" Jul 10 14:09:22.380420 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.380388 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 10 14:09:22.381547 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.381526 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gm82q"] Jul 10 14:09:22.383119 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.383101 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gwmhf\"" Jul 10 14:09:22.383212 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.383170 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 10 14:09:22.384294 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.384278 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 10 14:09:22.401484 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.401464 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ncp26"] Jul 10 14:09:22.401576 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.401494 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gm82q"] Jul 10 14:09:22.401576 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.401560 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gm82q" Jul 10 14:09:22.404130 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.404112 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 10 14:09:22.404130 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.404123 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 10 14:09:22.404299 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.404117 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2tvlk\"" Jul 10 14:09:22.404299 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.404181 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 10 14:09:22.415756 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.415740 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4jz4\" (UniqueName: \"kubernetes.io/projected/86fd7c6f-09db-48e0-b418-df64a19efa2c-kube-api-access-l4jz4\") pod \"image-registry-76bbfc4bc5-qgv94\" (UID: \"86fd7c6f-09db-48e0-b418-df64a19efa2c\") " pod="openshift-image-registry/image-registry-76bbfc4bc5-qgv94" Jul 10 14:09:22.415856 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.415763 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6mqg\" (UniqueName: \"kubernetes.io/projected/30a00187-297f-459c-8c9c-b584bdfac8b7-kube-api-access-q6mqg\") pod \"ingress-canary-gm82q\" (UID: \"30a00187-297f-459c-8c9c-b584bdfac8b7\") " pod="openshift-ingress-canary/ingress-canary-gm82q" Jul 10 14:09:22.415856 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.415780 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1086446b-6b80-40ba-bfd9-76e9b68fb565-metrics-tls\") pod \"dns-default-ncp26\" (UID: \"1086446b-6b80-40ba-bfd9-76e9b68fb565\") " pod="openshift-dns/dns-default-ncp26" Jul 10 14:09:22.415856 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.415798 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/86fd7c6f-09db-48e0-b418-df64a19efa2c-image-registry-private-configuration\") pod \"image-registry-76bbfc4bc5-qgv94\" (UID: \"86fd7c6f-09db-48e0-b418-df64a19efa2c\") " pod="openshift-image-registry/image-registry-76bbfc4bc5-qgv94" Jul 10 14:09:22.415856 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.415822 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8wk5\" (UniqueName: \"kubernetes.io/projected/1086446b-6b80-40ba-bfd9-76e9b68fb565-kube-api-access-r8wk5\") pod \"dns-default-ncp26\" (UID: \"1086446b-6b80-40ba-bfd9-76e9b68fb565\") " pod="openshift-dns/dns-default-ncp26" Jul 10 14:09:22.416068 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.415873 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/86fd7c6f-09db-48e0-b418-df64a19efa2c-registry-certificates\") pod \"image-registry-76bbfc4bc5-qgv94\" (UID: \"86fd7c6f-09db-48e0-b418-df64a19efa2c\") " pod="openshift-image-registry/image-registry-76bbfc4bc5-qgv94" Jul 10 14:09:22.416068 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.415910 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86fd7c6f-09db-48e0-b418-df64a19efa2c-bound-sa-token\") pod \"image-registry-76bbfc4bc5-qgv94\" (UID: \"86fd7c6f-09db-48e0-b418-df64a19efa2c\") " pod="openshift-image-registry/image-registry-76bbfc4bc5-qgv94" Jul 10 14:09:22.416068 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.415943 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30a00187-297f-459c-8c9c-b584bdfac8b7-cert\") pod \"ingress-canary-gm82q\" (UID: \"30a00187-297f-459c-8c9c-b584bdfac8b7\") " pod="openshift-ingress-canary/ingress-canary-gm82q" Jul 10 14:09:22.416068 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.415970 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1086446b-6b80-40ba-bfd9-76e9b68fb565-config-volume\") pod \"dns-default-ncp26\" (UID: \"1086446b-6b80-40ba-bfd9-76e9b68fb565\") " pod="openshift-dns/dns-default-ncp26" Jul 10 14:09:22.416068 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.416011 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/86fd7c6f-09db-48e0-b418-df64a19efa2c-ca-trust-extracted\") pod \"image-registry-76bbfc4bc5-qgv94\" (UID: \"86fd7c6f-09db-48e0-b418-df64a19efa2c\") " pod="openshift-image-registry/image-registry-76bbfc4bc5-qgv94" Jul 10 14:09:22.416068 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.416059 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86fd7c6f-09db-48e0-b418-df64a19efa2c-registry-tls\") pod \"image-registry-76bbfc4bc5-qgv94\" (UID: \"86fd7c6f-09db-48e0-b418-df64a19efa2c\") " pod="openshift-image-registry/image-registry-76bbfc4bc5-qgv94" Jul 10 14:09:22.416276 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.416084 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/86fd7c6f-09db-48e0-b418-df64a19efa2c-installation-pull-secrets\") pod \"image-registry-76bbfc4bc5-qgv94\" (UID: \"86fd7c6f-09db-48e0-b418-df64a19efa2c\") " pod="openshift-image-registry/image-registry-76bbfc4bc5-qgv94" Jul 10 14:09:22.416276 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.416128 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/86fd7c6f-09db-48e0-b418-df64a19efa2c-trusted-ca\") pod \"image-registry-76bbfc4bc5-qgv94\" (UID: \"86fd7c6f-09db-48e0-b418-df64a19efa2c\") " pod="openshift-image-registry/image-registry-76bbfc4bc5-qgv94" Jul 10 14:09:22.416276 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.416150 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1086446b-6b80-40ba-bfd9-76e9b68fb565-tmp-dir\") pod \"dns-default-ncp26\" (UID: \"1086446b-6b80-40ba-bfd9-76e9b68fb565\") " pod="openshift-dns/dns-default-ncp26" Jul 10 14:09:22.473843 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.473770 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7nhb9"] Jul 10 14:09:22.497456 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.497434 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7nhb9"] Jul 10 14:09:22.497571 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.497540 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7nhb9" Jul 10 14:09:22.500198 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.500172 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 10 14:09:22.500312 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.500208 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 10 14:09:22.500312 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.500226 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 10 14:09:22.500705 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.500689 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-54rbs\"" Jul 10 14:09:22.500777 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.500761 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 10 14:09:22.516740 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.516716 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/86fd7c6f-09db-48e0-b418-df64a19efa2c-ca-trust-extracted\") pod \"image-registry-76bbfc4bc5-qgv94\" (UID: \"86fd7c6f-09db-48e0-b418-df64a19efa2c\") " pod="openshift-image-registry/image-registry-76bbfc4bc5-qgv94" Jul 10 14:09:22.516841 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.516745 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a201eda6-6bb2-4ffd-a3ba-b02e648aad99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7nhb9\" (UID: \"a201eda6-6bb2-4ffd-a3ba-b02e648aad99\") " pod="openshift-insights/insights-runtime-extractor-7nhb9" Jul 10 14:09:22.516841 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.516777 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86fd7c6f-09db-48e0-b418-df64a19efa2c-registry-tls\") pod \"image-registry-76bbfc4bc5-qgv94\" (UID: \"86fd7c6f-09db-48e0-b418-df64a19efa2c\") " pod="openshift-image-registry/image-registry-76bbfc4bc5-qgv94" Jul 10 14:09:22.516841 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.516793 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/86fd7c6f-09db-48e0-b418-df64a19efa2c-installation-pull-secrets\") pod \"image-registry-76bbfc4bc5-qgv94\" (UID: \"86fd7c6f-09db-48e0-b418-df64a19efa2c\") " pod="openshift-image-registry/image-registry-76bbfc4bc5-qgv94" Jul 10 14:09:22.516994 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.516848 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a201eda6-6bb2-4ffd-a3ba-b02e648aad99-crio-socket\") pod \"insights-runtime-extractor-7nhb9\" (UID: \"a201eda6-6bb2-4ffd-a3ba-b02e648aad99\") " pod="openshift-insights/insights-runtime-extractor-7nhb9" Jul 10 14:09:22.516994 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.516891 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/86fd7c6f-09db-48e0-b418-df64a19efa2c-trusted-ca\") pod \"image-registry-76bbfc4bc5-qgv94\" (UID: \"86fd7c6f-09db-48e0-b418-df64a19efa2c\") " pod="openshift-image-registry/image-registry-76bbfc4bc5-qgv94" Jul 10 14:09:22.516994 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.516919 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1086446b-6b80-40ba-bfd9-76e9b68fb565-tmp-dir\") pod \"dns-default-ncp26\" (UID: \"1086446b-6b80-40ba-bfd9-76e9b68fb565\") " pod="openshift-dns/dns-default-ncp26" Jul 10 14:09:22.517139 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.516999 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4jz4\" (UniqueName: \"kubernetes.io/projected/86fd7c6f-09db-48e0-b418-df64a19efa2c-kube-api-access-l4jz4\") pod \"image-registry-76bbfc4bc5-qgv94\" (UID: \"86fd7c6f-09db-48e0-b418-df64a19efa2c\") " pod="openshift-image-registry/image-registry-76bbfc4bc5-qgv94" Jul 10 14:09:22.517139 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.517024 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6mqg\" (UniqueName: \"kubernetes.io/projected/30a00187-297f-459c-8c9c-b584bdfac8b7-kube-api-access-q6mqg\") pod \"ingress-canary-gm82q\" (UID: \"30a00187-297f-459c-8c9c-b584bdfac8b7\") " pod="openshift-ingress-canary/ingress-canary-gm82q" Jul 10 14:09:22.517139 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.517042 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1086446b-6b80-40ba-bfd9-76e9b68fb565-metrics-tls\") pod \"dns-default-ncp26\" (UID: \"1086446b-6b80-40ba-bfd9-76e9b68fb565\") " pod="openshift-dns/dns-default-ncp26" Jul 10 14:09:22.517139 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.517073 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/86fd7c6f-09db-48e0-b418-df64a19efa2c-image-registry-private-configuration\") pod \"image-registry-76bbfc4bc5-qgv94\" (UID: \"86fd7c6f-09db-48e0-b418-df64a19efa2c\") " pod="openshift-image-registry/image-registry-76bbfc4bc5-qgv94" Jul 10 14:09:22.517139 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.517100 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8wk5\" (UniqueName: \"kubernetes.io/projected/1086446b-6b80-40ba-bfd9-76e9b68fb565-kube-api-access-r8wk5\") pod \"dns-default-ncp26\" (UID: \"1086446b-6b80-40ba-bfd9-76e9b68fb565\") " pod="openshift-dns/dns-default-ncp26" Jul 10 14:09:22.517139 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.517125 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/86fd7c6f-09db-48e0-b418-df64a19efa2c-registry-certificates\") pod \"image-registry-76bbfc4bc5-qgv94\" (UID: \"86fd7c6f-09db-48e0-b418-df64a19efa2c\") " pod="openshift-image-registry/image-registry-76bbfc4bc5-qgv94" Jul 10 14:09:22.517449 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.517145 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/86fd7c6f-09db-48e0-b418-df64a19efa2c-ca-trust-extracted\") pod \"image-registry-76bbfc4bc5-qgv94\" (UID: \"86fd7c6f-09db-48e0-b418-df64a19efa2c\") " pod="openshift-image-registry/image-registry-76bbfc4bc5-qgv94" Jul 10 14:09:22.517449 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.517251 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1086446b-6b80-40ba-bfd9-76e9b68fb565-tmp-dir\") pod \"dns-default-ncp26\" (UID: \"1086446b-6b80-40ba-bfd9-76e9b68fb565\") " pod="openshift-dns/dns-default-ncp26" Jul 10 14:09:22.517449 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.517148 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86fd7c6f-09db-48e0-b418-df64a19efa2c-bound-sa-token\") pod \"image-registry-76bbfc4bc5-qgv94\" (UID: \"86fd7c6f-09db-48e0-b418-df64a19efa2c\") " pod="openshift-image-registry/image-registry-76bbfc4bc5-qgv94" Jul 10 14:09:22.517449 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.517301 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a201eda6-6bb2-4ffd-a3ba-b02e648aad99-data-volume\") pod \"insights-runtime-extractor-7nhb9\" (UID: \"a201eda6-6bb2-4ffd-a3ba-b02e648aad99\") " pod="openshift-insights/insights-runtime-extractor-7nhb9" Jul 10 14:09:22.517449 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.517356 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30a00187-297f-459c-8c9c-b584bdfac8b7-cert\") pod \"ingress-canary-gm82q\" (UID: \"30a00187-297f-459c-8c9c-b584bdfac8b7\") " pod="openshift-ingress-canary/ingress-canary-gm82q" Jul 10 14:09:22.517449 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.517384 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a201eda6-6bb2-4ffd-a3ba-b02e648aad99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7nhb9\" (UID: \"a201eda6-6bb2-4ffd-a3ba-b02e648aad99\") " pod="openshift-insights/insights-runtime-extractor-7nhb9" Jul 10 14:09:22.517449 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.517420 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzdcz\" (UniqueName: \"kubernetes.io/projected/a201eda6-6bb2-4ffd-a3ba-b02e648aad99-kube-api-access-pzdcz\") pod \"insights-runtime-extractor-7nhb9\" (UID: \"a201eda6-6bb2-4ffd-a3ba-b02e648aad99\") " pod="openshift-insights/insights-runtime-extractor-7nhb9" Jul 10 14:09:22.517772 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.517453 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1086446b-6b80-40ba-bfd9-76e9b68fb565-config-volume\") pod \"dns-default-ncp26\" (UID: \"1086446b-6b80-40ba-bfd9-76e9b68fb565\") " pod="openshift-dns/dns-default-ncp26" Jul 10 14:09:22.517899 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.517878 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/86fd7c6f-09db-48e0-b418-df64a19efa2c-trusted-ca\") pod \"image-registry-76bbfc4bc5-qgv94\" (UID: \"86fd7c6f-09db-48e0-b418-df64a19efa2c\") " pod="openshift-image-registry/image-registry-76bbfc4bc5-qgv94" Jul 10 14:09:22.517985 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.517968 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1086446b-6b80-40ba-bfd9-76e9b68fb565-config-volume\") pod \"dns-default-ncp26\" (UID: \"1086446b-6b80-40ba-bfd9-76e9b68fb565\") " pod="openshift-dns/dns-default-ncp26" Jul 10 14:09:22.518067 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.518047 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/86fd7c6f-09db-48e0-b418-df64a19efa2c-registry-certificates\") pod \"image-registry-76bbfc4bc5-qgv94\" (UID: \"86fd7c6f-09db-48e0-b418-df64a19efa2c\") " pod="openshift-image-registry/image-registry-76bbfc4bc5-qgv94" Jul 10 14:09:22.521037 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.521017 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1086446b-6b80-40ba-bfd9-76e9b68fb565-metrics-tls\") pod \"dns-default-ncp26\" (UID: \"1086446b-6b80-40ba-bfd9-76e9b68fb565\") " pod="openshift-dns/dns-default-ncp26" Jul 10 14:09:22.521125 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.521021 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/86fd7c6f-09db-48e0-b418-df64a19efa2c-installation-pull-secrets\") pod \"image-registry-76bbfc4bc5-qgv94\" (UID: \"86fd7c6f-09db-48e0-b418-df64a19efa2c\") " pod="openshift-image-registry/image-registry-76bbfc4bc5-qgv94" Jul 10 14:09:22.521164 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.521129 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86fd7c6f-09db-48e0-b418-df64a19efa2c-registry-tls\") pod \"image-registry-76bbfc4bc5-qgv94\" (UID: \"86fd7c6f-09db-48e0-b418-df64a19efa2c\") " pod="openshift-image-registry/image-registry-76bbfc4bc5-qgv94" Jul 10 14:09:22.521164 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.521141 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/86fd7c6f-09db-48e0-b418-df64a19efa2c-image-registry-private-configuration\") pod \"image-registry-76bbfc4bc5-qgv94\" (UID: \"86fd7c6f-09db-48e0-b418-df64a19efa2c\") " pod="openshift-image-registry/image-registry-76bbfc4bc5-qgv94" Jul 10 14:09:22.521164 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.521129 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30a00187-297f-459c-8c9c-b584bdfac8b7-cert\") pod \"ingress-canary-gm82q\" (UID: \"30a00187-297f-459c-8c9c-b584bdfac8b7\") " pod="openshift-ingress-canary/ingress-canary-gm82q" Jul 10 14:09:22.524889 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.524870 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8wk5\" (UniqueName: \"kubernetes.io/projected/1086446b-6b80-40ba-bfd9-76e9b68fb565-kube-api-access-r8wk5\") pod \"dns-default-ncp26\" (UID: \"1086446b-6b80-40ba-bfd9-76e9b68fb565\") " pod="openshift-dns/dns-default-ncp26" Jul 10 14:09:22.525108 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.525091 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86fd7c6f-09db-48e0-b418-df64a19efa2c-bound-sa-token\") pod \"image-registry-76bbfc4bc5-qgv94\" (UID: \"86fd7c6f-09db-48e0-b418-df64a19efa2c\") " pod="openshift-image-registry/image-registry-76bbfc4bc5-qgv94" Jul 10 14:09:22.525294 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.525278 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6mqg\" (UniqueName: \"kubernetes.io/projected/30a00187-297f-459c-8c9c-b584bdfac8b7-kube-api-access-q6mqg\") pod \"ingress-canary-gm82q\" (UID: \"30a00187-297f-459c-8c9c-b584bdfac8b7\") " pod="openshift-ingress-canary/ingress-canary-gm82q" Jul 10 14:09:22.525525 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.525509 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4jz4\" (UniqueName: \"kubernetes.io/projected/86fd7c6f-09db-48e0-b418-df64a19efa2c-kube-api-access-l4jz4\") pod \"image-registry-76bbfc4bc5-qgv94\" (UID: \"86fd7c6f-09db-48e0-b418-df64a19efa2c\") " pod="openshift-image-registry/image-registry-76bbfc4bc5-qgv94" Jul 10 14:09:22.618705 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.618679 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a201eda6-6bb2-4ffd-a3ba-b02e648aad99-data-volume\") pod \"insights-runtime-extractor-7nhb9\" (UID: \"a201eda6-6bb2-4ffd-a3ba-b02e648aad99\") " pod="openshift-insights/insights-runtime-extractor-7nhb9" Jul 10 14:09:22.618705 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.618707 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a201eda6-6bb2-4ffd-a3ba-b02e648aad99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7nhb9\" (UID: \"a201eda6-6bb2-4ffd-a3ba-b02e648aad99\") " pod="openshift-insights/insights-runtime-extractor-7nhb9" Jul 10 14:09:22.618892 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.618725 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzdcz\" (UniqueName: \"kubernetes.io/projected/a201eda6-6bb2-4ffd-a3ba-b02e648aad99-kube-api-access-pzdcz\") pod \"insights-runtime-extractor-7nhb9\" (UID: \"a201eda6-6bb2-4ffd-a3ba-b02e648aad99\") " pod="openshift-insights/insights-runtime-extractor-7nhb9" Jul 10 14:09:22.618892 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.618751 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a201eda6-6bb2-4ffd-a3ba-b02e648aad99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7nhb9\" (UID: \"a201eda6-6bb2-4ffd-a3ba-b02e648aad99\") " pod="openshift-insights/insights-runtime-extractor-7nhb9" Jul 10 14:09:22.618892 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.618782 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a201eda6-6bb2-4ffd-a3ba-b02e648aad99-crio-socket\") pod \"insights-runtime-extractor-7nhb9\" (UID: \"a201eda6-6bb2-4ffd-a3ba-b02e648aad99\") " pod="openshift-insights/insights-runtime-extractor-7nhb9" Jul 10 14:09:22.619046 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.618935 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a201eda6-6bb2-4ffd-a3ba-b02e648aad99-crio-socket\") pod \"insights-runtime-extractor-7nhb9\" (UID: \"a201eda6-6bb2-4ffd-a3ba-b02e648aad99\") " pod="openshift-insights/insights-runtime-extractor-7nhb9" Jul 10 14:09:22.619046 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.619028 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a201eda6-6bb2-4ffd-a3ba-b02e648aad99-data-volume\") pod \"insights-runtime-extractor-7nhb9\" (UID: \"a201eda6-6bb2-4ffd-a3ba-b02e648aad99\") " pod="openshift-insights/insights-runtime-extractor-7nhb9" Jul 10 14:09:22.619293 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.619276 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a201eda6-6bb2-4ffd-a3ba-b02e648aad99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7nhb9\" (UID: \"a201eda6-6bb2-4ffd-a3ba-b02e648aad99\") " pod="openshift-insights/insights-runtime-extractor-7nhb9" Jul 10 14:09:22.620854 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.620834 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a201eda6-6bb2-4ffd-a3ba-b02e648aad99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7nhb9\" (UID: \"a201eda6-6bb2-4ffd-a3ba-b02e648aad99\") " pod="openshift-insights/insights-runtime-extractor-7nhb9" Jul 10 14:09:22.626134 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.626114 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzdcz\" (UniqueName: \"kubernetes.io/projected/a201eda6-6bb2-4ffd-a3ba-b02e648aad99-kube-api-access-pzdcz\") pod \"insights-runtime-extractor-7nhb9\" (UID: \"a201eda6-6bb2-4ffd-a3ba-b02e648aad99\") " pod="openshift-insights/insights-runtime-extractor-7nhb9" Jul 10 14:09:22.682271 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.682237 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76bbfc4bc5-qgv94" Jul 10 14:09:22.690306 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.690281 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ncp26" Jul 10 14:09:22.709427 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.709402 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gm82q" Jul 10 14:09:22.806642 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.806113 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7nhb9" Jul 10 14:09:22.824220 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.823196 2581 generic.go:356] "Generic (PLEG): container finished" podID="4bce65df-592e-4e75-9485-d788a0133cd4" containerID="155652b154d7be5397647939c5a718b9fc228775e40416e1f0985c44f67e55a4" exitCode=0 Jul 10 14:09:22.824220 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.823264 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dpgfx" event={"ID":"4bce65df-592e-4e75-9485-d788a0133cd4","Type":"ContainerDied","Data":"155652b154d7be5397647939c5a718b9fc228775e40416e1f0985c44f67e55a4"} Jul 10 14:09:22.909342 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.909247 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ncp26"] Jul 10 14:09:22.914050 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.913241 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76bbfc4bc5-qgv94"] Jul 10 14:09:22.917093 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:09:22.917048 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1086446b_6b80_40ba_bfd9_76e9b68fb565.slice/crio-36fc0387b21ccc8b37d0aab5d35215f5649ddb017c4bc0e2625e56188ce60162 WatchSource:0}: Error finding container 36fc0387b21ccc8b37d0aab5d35215f5649ddb017c4bc0e2625e56188ce60162: Status 404 returned error can't find the container with id 36fc0387b21ccc8b37d0aab5d35215f5649ddb017c4bc0e2625e56188ce60162 Jul 10 14:09:22.922235 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:09:22.921957 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86fd7c6f_09db_48e0_b418_df64a19efa2c.slice/crio-631adcf14f4ee8962f6c91a10062f7018b083a9a95af28a186183849741733a3 WatchSource:0}: Error finding container 631adcf14f4ee8962f6c91a10062f7018b083a9a95af28a186183849741733a3: Status 404 returned error can't find the container with id 631adcf14f4ee8962f6c91a10062f7018b083a9a95af28a186183849741733a3 Jul 10 14:09:22.939903 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.939741 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gm82q"] Jul 10 14:09:22.948260 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:09:22.948234 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30a00187_297f_459c_8c9c_b584bdfac8b7.slice/crio-0effea4c5cb0d00ab7697abc4c8de4ddabaa02e39e9e68344baf1aef9faee49f WatchSource:0}: Error finding container 0effea4c5cb0d00ab7697abc4c8de4ddabaa02e39e9e68344baf1aef9faee49f: Status 404 returned error can't find the container with id 0effea4c5cb0d00ab7697abc4c8de4ddabaa02e39e9e68344baf1aef9faee49f Jul 10 14:09:22.986242 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:22.986194 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7nhb9"] Jul 10 14:09:22.988641 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:09:22.988600 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda201eda6_6bb2_4ffd_a3ba_b02e648aad99.slice/crio-d9216282c1ef73ea9b40936afa15d6cbb85ea82eb71075f4af8d38042bbb5084 WatchSource:0}: Error finding container d9216282c1ef73ea9b40936afa15d6cbb85ea82eb71075f4af8d38042bbb5084: Status 404 returned error can't find the container with id d9216282c1ef73ea9b40936afa15d6cbb85ea82eb71075f4af8d38042bbb5084 Jul 10 14:09:23.638881 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.638642 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:09:23.639097 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.638642 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:09:23.639097 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.638692 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:09:23.641717 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.641693 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 14:09:23.642839 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.642819 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 14:09:23.643078 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.643062 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 14:09:23.643173 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.643154 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fptgw\"" Jul 10 14:09:23.643229 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.643209 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 14:09:23.643273 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.643252 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7ddd8\"" Jul 10 14:09:23.832012 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.831947 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dpgfx" event={"ID":"4bce65df-592e-4e75-9485-d788a0133cd4","Type":"ContainerStarted","Data":"d517ee4c6f70a734a2fa56d75780ffb525536da7d5a6e7f06d2ddfcc3b3604b1"} Jul 10 14:09:23.833481 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.833429 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gm82q" event={"ID":"30a00187-297f-459c-8c9c-b584bdfac8b7","Type":"ContainerStarted","Data":"0effea4c5cb0d00ab7697abc4c8de4ddabaa02e39e9e68344baf1aef9faee49f"} Jul 10 14:09:23.834638 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.834616 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7nhb9" event={"ID":"a201eda6-6bb2-4ffd-a3ba-b02e648aad99","Type":"ContainerStarted","Data":"d9216282c1ef73ea9b40936afa15d6cbb85ea82eb71075f4af8d38042bbb5084"} Jul 10 14:09:23.835768 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.835743 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ncp26" event={"ID":"1086446b-6b80-40ba-bfd9-76e9b68fb565","Type":"ContainerStarted","Data":"36fc0387b21ccc8b37d0aab5d35215f5649ddb017c4bc0e2625e56188ce60162"} Jul 10 14:09:23.837522 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.837498 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76bbfc4bc5-qgv94" event={"ID":"86fd7c6f-09db-48e0-b418-df64a19efa2c","Type":"ContainerStarted","Data":"0b2918d587b6987807d7b98cfd74f30b95b79c8558785a9b9d9e50c4754cce22"} Jul 10 14:09:23.837626 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.837542 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76bbfc4bc5-qgv94" event={"ID":"86fd7c6f-09db-48e0-b418-df64a19efa2c","Type":"ContainerStarted","Data":"631adcf14f4ee8962f6c91a10062f7018b083a9a95af28a186183849741733a3"} Jul 10 14:09:23.837680 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.837659 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-76bbfc4bc5-qgv94" Jul 10 14:09:23.856792 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.856736 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dpgfx" podStartSLOduration=16.342875977 podStartE2EDuration="45.856719801s" totalImagesPullingTime="29.513843824s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:08:38 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:23.855261877 +0000 UTC m=+46.798834219" watchObservedRunningTime="2026-07-10 14:09:23.856719801 +0000 UTC m=+46.800292140" Jul 10 14:09:23.879109 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.879059 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-76bbfc4bc5-qgv94" podStartSLOduration=7.879041552 podStartE2EDuration="7.879041552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:09:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:23.87788896 +0000 UTC m=+46.821461301" watchObservedRunningTime="2026-07-10 14:09:23.879041552 +0000 UTC m=+46.822613893" Jul 10 14:09:23.886300 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.886274 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-554d9d9d8c-gbnfr"] Jul 10 14:09:23.907090 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.907037 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-554d9d9d8c-gbnfr"] Jul 10 14:09:23.907194 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.907147 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-554d9d9d8c-gbnfr" Jul 10 14:09:23.910087 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.910067 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 10 14:09:23.910267 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.910128 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 10 14:09:23.910267 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.910147 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 10 14:09:23.910267 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.910202 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-89tl4\"" Jul 10 14:09:23.910267 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.910206 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 10 14:09:23.910540 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.910525 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 10 14:09:23.910649 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.910560 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 10 14:09:23.910786 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.910770 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 10 14:09:23.915575 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.915554 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 10 14:09:23.928993 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.928960 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d38f10c-f077-4068-9337-a6b569f924fa-oauth-serving-cert\") pod \"console-554d9d9d8c-gbnfr\" (UID: \"2d38f10c-f077-4068-9337-a6b569f924fa\") " pod="openshift-console/console-554d9d9d8c-gbnfr" Jul 10 14:09:23.929135 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.929037 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d38f10c-f077-4068-9337-a6b569f924fa-trusted-ca-bundle\") pod \"console-554d9d9d8c-gbnfr\" (UID: \"2d38f10c-f077-4068-9337-a6b569f924fa\") " pod="openshift-console/console-554d9d9d8c-gbnfr" Jul 10 14:09:23.929768 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.929680 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d38f10c-f077-4068-9337-a6b569f924fa-console-oauth-config\") pod \"console-554d9d9d8c-gbnfr\" (UID: \"2d38f10c-f077-4068-9337-a6b569f924fa\") " pod="openshift-console/console-554d9d9d8c-gbnfr" Jul 10 14:09:23.929883 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.929821 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d38f10c-f077-4068-9337-a6b569f924fa-service-ca\") pod \"console-554d9d9d8c-gbnfr\" (UID: \"2d38f10c-f077-4068-9337-a6b569f924fa\") " pod="openshift-console/console-554d9d9d8c-gbnfr" Jul 10 14:09:23.929943 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.929904 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d38f10c-f077-4068-9337-a6b569f924fa-console-config\") pod \"console-554d9d9d8c-gbnfr\" (UID: \"2d38f10c-f077-4068-9337-a6b569f924fa\") " pod="openshift-console/console-554d9d9d8c-gbnfr" Jul 10 14:09:23.929943 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.929938 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d38f10c-f077-4068-9337-a6b569f924fa-console-serving-cert\") pod \"console-554d9d9d8c-gbnfr\" (UID: \"2d38f10c-f077-4068-9337-a6b569f924fa\") " pod="openshift-console/console-554d9d9d8c-gbnfr" Jul 10 14:09:23.930044 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:23.929993 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6phw5\" (UniqueName: \"kubernetes.io/projected/2d38f10c-f077-4068-9337-a6b569f924fa-kube-api-access-6phw5\") pod \"console-554d9d9d8c-gbnfr\" (UID: \"2d38f10c-f077-4068-9337-a6b569f924fa\") " pod="openshift-console/console-554d9d9d8c-gbnfr" Jul 10 14:09:24.031028 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:24.030860 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d38f10c-f077-4068-9337-a6b569f924fa-oauth-serving-cert\") pod \"console-554d9d9d8c-gbnfr\" (UID: \"2d38f10c-f077-4068-9337-a6b569f924fa\") " pod="openshift-console/console-554d9d9d8c-gbnfr" Jul 10 14:09:24.031214 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:24.031120 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d38f10c-f077-4068-9337-a6b569f924fa-trusted-ca-bundle\") pod \"console-554d9d9d8c-gbnfr\" (UID: \"2d38f10c-f077-4068-9337-a6b569f924fa\") " pod="openshift-console/console-554d9d9d8c-gbnfr" Jul 10 14:09:24.031214 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:24.031156 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d38f10c-f077-4068-9337-a6b569f924fa-console-oauth-config\") pod \"console-554d9d9d8c-gbnfr\" (UID: \"2d38f10c-f077-4068-9337-a6b569f924fa\") " pod="openshift-console/console-554d9d9d8c-gbnfr" Jul 10 14:09:24.031214 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:24.031183 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d38f10c-f077-4068-9337-a6b569f924fa-service-ca\") pod \"console-554d9d9d8c-gbnfr\" (UID: \"2d38f10c-f077-4068-9337-a6b569f924fa\") " pod="openshift-console/console-554d9d9d8c-gbnfr" Jul 10 14:09:24.031409 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:24.031217 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d38f10c-f077-4068-9337-a6b569f924fa-console-config\") pod \"console-554d9d9d8c-gbnfr\" (UID: \"2d38f10c-f077-4068-9337-a6b569f924fa\") " pod="openshift-console/console-554d9d9d8c-gbnfr" Jul 10 14:09:24.031409 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:24.031243 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d38f10c-f077-4068-9337-a6b569f924fa-console-serving-cert\") pod \"console-554d9d9d8c-gbnfr\" (UID: \"2d38f10c-f077-4068-9337-a6b569f924fa\") " pod="openshift-console/console-554d9d9d8c-gbnfr" Jul 10 14:09:24.031409 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:24.031273 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6phw5\" (UniqueName: \"kubernetes.io/projected/2d38f10c-f077-4068-9337-a6b569f924fa-kube-api-access-6phw5\") pod \"console-554d9d9d8c-gbnfr\" (UID: \"2d38f10c-f077-4068-9337-a6b569f924fa\") " pod="openshift-console/console-554d9d9d8c-gbnfr" Jul 10 14:09:24.031682 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:24.031632 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d38f10c-f077-4068-9337-a6b569f924fa-oauth-serving-cert\") pod \"console-554d9d9d8c-gbnfr\" (UID: \"2d38f10c-f077-4068-9337-a6b569f924fa\") " pod="openshift-console/console-554d9d9d8c-gbnfr" Jul 10 14:09:24.032005 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:24.031983 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d38f10c-f077-4068-9337-a6b569f924fa-trusted-ca-bundle\") pod \"console-554d9d9d8c-gbnfr\" (UID: \"2d38f10c-f077-4068-9337-a6b569f924fa\") " pod="openshift-console/console-554d9d9d8c-gbnfr" Jul 10 14:09:24.032092 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:24.032054 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d38f10c-f077-4068-9337-a6b569f924fa-console-config\") pod \"console-554d9d9d8c-gbnfr\" (UID: \"2d38f10c-f077-4068-9337-a6b569f924fa\") " pod="openshift-console/console-554d9d9d8c-gbnfr" Jul 10 14:09:24.032201 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:24.032177 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d38f10c-f077-4068-9337-a6b569f924fa-service-ca\") pod \"console-554d9d9d8c-gbnfr\" (UID: \"2d38f10c-f077-4068-9337-a6b569f924fa\") " pod="openshift-console/console-554d9d9d8c-gbnfr" Jul 10 14:09:24.036238 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:24.036190 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d38f10c-f077-4068-9337-a6b569f924fa-console-oauth-config\") pod \"console-554d9d9d8c-gbnfr\" (UID: \"2d38f10c-f077-4068-9337-a6b569f924fa\") " pod="openshift-console/console-554d9d9d8c-gbnfr" Jul 10 14:09:24.036438 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:24.036413 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d38f10c-f077-4068-9337-a6b569f924fa-console-serving-cert\") pod \"console-554d9d9d8c-gbnfr\" (UID: \"2d38f10c-f077-4068-9337-a6b569f924fa\") " pod="openshift-console/console-554d9d9d8c-gbnfr" Jul 10 14:09:24.040375 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:24.040355 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6phw5\" (UniqueName: \"kubernetes.io/projected/2d38f10c-f077-4068-9337-a6b569f924fa-kube-api-access-6phw5\") pod \"console-554d9d9d8c-gbnfr\" (UID: \"2d38f10c-f077-4068-9337-a6b569f924fa\") " pod="openshift-console/console-554d9d9d8c-gbnfr" Jul 10 14:09:24.217866 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:24.217764 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-554d9d9d8c-gbnfr" Jul 10 14:09:24.400312 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:24.400205 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-554d9d9d8c-gbnfr"] Jul 10 14:09:24.404551 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:09:24.404519 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d38f10c_f077_4068_9337_a6b569f924fa.slice/crio-827cf1a40994e9cf60f23243cbc617862c8c9096569167ef4e358b3aabec61c6 WatchSource:0}: Error finding container 827cf1a40994e9cf60f23243cbc617862c8c9096569167ef4e358b3aabec61c6: Status 404 returned error can't find the container with id 827cf1a40994e9cf60f23243cbc617862c8c9096569167ef4e358b3aabec61c6 Jul 10 14:09:24.841952 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:24.841916 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-554d9d9d8c-gbnfr" event={"ID":"2d38f10c-f077-4068-9337-a6b569f924fa","Type":"ContainerStarted","Data":"827cf1a40994e9cf60f23243cbc617862c8c9096569167ef4e358b3aabec61c6"} Jul 10 14:09:27.799890 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.799711 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-dfqm6"] Jul 10 14:09:27.810145 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.810121 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dfqm6" Jul 10 14:09:27.814940 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.814591 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-4wjd7\"" Jul 10 14:09:27.814940 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.814625 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 10 14:09:27.814940 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.814788 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 10 14:09:27.814940 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.814841 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 10 14:09:27.815209 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.815015 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 10 14:09:27.815463 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.815280 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 10 14:09:27.822145 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.822124 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-dfqm6"] Jul 10 14:09:27.822784 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.822764 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-zkpxn"] Jul 10 14:09:27.843934 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.843797 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8p52j"] Jul 10 14:09:27.844041 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.843999 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-zkpxn" Jul 10 14:09:27.846390 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.846370 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-9qvcx\"" Jul 10 14:09:27.846540 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.846515 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 10 14:09:27.846813 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.846785 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 10 14:09:27.846813 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.846789 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 10 14:09:27.862400 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.862380 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-zkpxn"] Jul 10 14:09:27.862498 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.862487 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8p52j" Jul 10 14:09:27.864473 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.864453 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgjxf\" (UniqueName: \"kubernetes.io/projected/7382bc84-f403-4e1e-b1d0-5e0f76009aa0-kube-api-access-cgjxf\") pod \"kube-state-metrics-785778ff74-zkpxn\" (UID: \"7382bc84-f403-4e1e-b1d0-5e0f76009aa0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zkpxn" Jul 10 14:09:27.864567 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.864484 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7382bc84-f403-4e1e-b1d0-5e0f76009aa0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-zkpxn\" (UID: \"7382bc84-f403-4e1e-b1d0-5e0f76009aa0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zkpxn" Jul 10 14:09:27.864619 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.864565 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-dfqm6\" (UID: \"f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dfqm6" Jul 10 14:09:27.864619 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.864594 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7382bc84-f403-4e1e-b1d0-5e0f76009aa0-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-zkpxn\" (UID: \"7382bc84-f403-4e1e-b1d0-5e0f76009aa0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zkpxn" Jul 10 14:09:27.864696 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.864641 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzmq4\" (UniqueName: \"kubernetes.io/projected/f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c-kube-api-access-kzmq4\") pod \"openshift-state-metrics-84bd68b896-dfqm6\" (UID: \"f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dfqm6" Jul 10 14:09:27.864696 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.864678 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7382bc84-f403-4e1e-b1d0-5e0f76009aa0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-zkpxn\" (UID: \"7382bc84-f403-4e1e-b1d0-5e0f76009aa0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zkpxn" Jul 10 14:09:27.864783 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.864694 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7382bc84-f403-4e1e-b1d0-5e0f76009aa0-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-zkpxn\" (UID: \"7382bc84-f403-4e1e-b1d0-5e0f76009aa0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zkpxn" Jul 10 14:09:27.864783 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.864711 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-dfqm6\" (UID: \"f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dfqm6" Jul 10 14:09:27.864783 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.864730 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-dfqm6\" (UID: \"f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dfqm6" Jul 10 14:09:27.864783 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.864746 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7382bc84-f403-4e1e-b1d0-5e0f76009aa0-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-zkpxn\" (UID: \"7382bc84-f403-4e1e-b1d0-5e0f76009aa0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zkpxn" Jul 10 14:09:27.865127 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.865114 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 10 14:09:27.865290 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.865272 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 10 14:09:27.865413 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.865298 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tn4nf\"" Jul 10 14:09:27.865413 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.865364 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 10 14:09:27.965107 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.965077 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9a337a14-c834-4363-868b-ee4330013be7-node-exporter-wtmp\") pod \"node-exporter-8p52j\" (UID: \"9a337a14-c834-4363-868b-ee4330013be7\") " pod="openshift-monitoring/node-exporter-8p52j" Jul 10 14:09:27.965285 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.965126 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7382bc84-f403-4e1e-b1d0-5e0f76009aa0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-zkpxn\" (UID: \"7382bc84-f403-4e1e-b1d0-5e0f76009aa0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zkpxn" Jul 10 14:09:27.965285 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.965159 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a337a14-c834-4363-868b-ee4330013be7-metrics-client-ca\") pod \"node-exporter-8p52j\" (UID: \"9a337a14-c834-4363-868b-ee4330013be7\") " pod="openshift-monitoring/node-exporter-8p52j" Jul 10 14:09:27.965285 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.965186 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7382bc84-f403-4e1e-b1d0-5e0f76009aa0-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-zkpxn\" (UID: \"7382bc84-f403-4e1e-b1d0-5e0f76009aa0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zkpxn" Jul 10 14:09:27.965285 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.965252 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-dfqm6\" (UID: \"f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dfqm6" Jul 10 14:09:27.965512 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.965311 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-dfqm6\" (UID: \"f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dfqm6" Jul 10 14:09:27.965512 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:27.965277 2581 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 10 14:09:27.965512 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.965364 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7382bc84-f403-4e1e-b1d0-5e0f76009aa0-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-zkpxn\" (UID: \"7382bc84-f403-4e1e-b1d0-5e0f76009aa0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zkpxn" Jul 10 14:09:27.965512 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.965397 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9a337a14-c834-4363-868b-ee4330013be7-node-exporter-tls\") pod \"node-exporter-8p52j\" (UID: \"9a337a14-c834-4363-868b-ee4330013be7\") " pod="openshift-monitoring/node-exporter-8p52j" Jul 10 14:09:27.965512 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.965431 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9a337a14-c834-4363-868b-ee4330013be7-node-exporter-textfile\") pod \"node-exporter-8p52j\" (UID: \"9a337a14-c834-4363-868b-ee4330013be7\") " pod="openshift-monitoring/node-exporter-8p52j" Jul 10 14:09:27.965512 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:27.965457 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7382bc84-f403-4e1e-b1d0-5e0f76009aa0-kube-state-metrics-tls podName:7382bc84-f403-4e1e-b1d0-5e0f76009aa0 nodeName:}" failed. No retries permitted until 2026-07-10 14:09:28.465428691 +0000 UTC m=+51.409001023 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/7382bc84-f403-4e1e-b1d0-5e0f76009aa0-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-zkpxn" (UID: "7382bc84-f403-4e1e-b1d0-5e0f76009aa0") : secret "kube-state-metrics-tls" not found Jul 10 14:09:27.965512 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.965510 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgjxf\" (UniqueName: \"kubernetes.io/projected/7382bc84-f403-4e1e-b1d0-5e0f76009aa0-kube-api-access-cgjxf\") pod \"kube-state-metrics-785778ff74-zkpxn\" (UID: \"7382bc84-f403-4e1e-b1d0-5e0f76009aa0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zkpxn" Jul 10 14:09:27.965846 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.965548 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7382bc84-f403-4e1e-b1d0-5e0f76009aa0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-zkpxn\" (UID: \"7382bc84-f403-4e1e-b1d0-5e0f76009aa0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zkpxn" Jul 10 14:09:27.965846 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.965582 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8rvk\" (UniqueName: \"kubernetes.io/projected/9a337a14-c834-4363-868b-ee4330013be7-kube-api-access-d8rvk\") pod \"node-exporter-8p52j\" (UID: \"9a337a14-c834-4363-868b-ee4330013be7\") " pod="openshift-monitoring/node-exporter-8p52j" Jul 10 14:09:27.965846 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.965622 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9a337a14-c834-4363-868b-ee4330013be7-root\") pod \"node-exporter-8p52j\" (UID: \"9a337a14-c834-4363-868b-ee4330013be7\") " pod="openshift-monitoring/node-exporter-8p52j" Jul 10 14:09:27.965846 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.965664 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-dfqm6\" (UID: \"f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dfqm6" Jul 10 14:09:27.965846 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.965690 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9a337a14-c834-4363-868b-ee4330013be7-node-exporter-accelerators-collector-config\") pod \"node-exporter-8p52j\" (UID: \"9a337a14-c834-4363-868b-ee4330013be7\") " pod="openshift-monitoring/node-exporter-8p52j" Jul 10 14:09:27.965846 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.965718 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7382bc84-f403-4e1e-b1d0-5e0f76009aa0-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-zkpxn\" (UID: \"7382bc84-f403-4e1e-b1d0-5e0f76009aa0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zkpxn" Jul 10 14:09:27.965846 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.965779 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a337a14-c834-4363-868b-ee4330013be7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8p52j\" (UID: \"9a337a14-c834-4363-868b-ee4330013be7\") " pod="openshift-monitoring/node-exporter-8p52j" Jul 10 14:09:27.965846 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:27.965802 2581 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 10 14:09:27.965846 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.965814 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a337a14-c834-4363-868b-ee4330013be7-sys\") pod \"node-exporter-8p52j\" (UID: \"9a337a14-c834-4363-868b-ee4330013be7\") " pod="openshift-monitoring/node-exporter-8p52j" Jul 10 14:09:27.965846 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:09:27.965841 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c-openshift-state-metrics-tls podName:f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c nodeName:}" failed. No retries permitted until 2026-07-10 14:09:28.465828929 +0000 UTC m=+51.409401247 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-dfqm6" (UID: "f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c") : secret "openshift-state-metrics-tls" not found Jul 10 14:09:27.966460 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.965860 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzmq4\" (UniqueName: \"kubernetes.io/projected/f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c-kube-api-access-kzmq4\") pod \"openshift-state-metrics-84bd68b896-dfqm6\" (UID: \"f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dfqm6" Jul 10 14:09:27.966460 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.966139 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7382bc84-f403-4e1e-b1d0-5e0f76009aa0-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-zkpxn\" (UID: \"7382bc84-f403-4e1e-b1d0-5e0f76009aa0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zkpxn" Jul 10 14:09:27.966460 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.966157 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7382bc84-f403-4e1e-b1d0-5e0f76009aa0-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-zkpxn\" (UID: \"7382bc84-f403-4e1e-b1d0-5e0f76009aa0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zkpxn" Jul 10 14:09:27.966460 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.966185 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-dfqm6\" (UID: \"f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dfqm6" Jul 10 14:09:27.966634 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.966512 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7382bc84-f403-4e1e-b1d0-5e0f76009aa0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-zkpxn\" (UID: \"7382bc84-f403-4e1e-b1d0-5e0f76009aa0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zkpxn" Jul 10 14:09:27.969014 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.968991 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7382bc84-f403-4e1e-b1d0-5e0f76009aa0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-zkpxn\" (UID: \"7382bc84-f403-4e1e-b1d0-5e0f76009aa0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zkpxn" Jul 10 14:09:27.969123 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.969015 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-dfqm6\" (UID: \"f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dfqm6" Jul 10 14:09:27.974331 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.974274 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgjxf\" (UniqueName: \"kubernetes.io/projected/7382bc84-f403-4e1e-b1d0-5e0f76009aa0-kube-api-access-cgjxf\") pod \"kube-state-metrics-785778ff74-zkpxn\" (UID: \"7382bc84-f403-4e1e-b1d0-5e0f76009aa0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zkpxn" Jul 10 14:09:27.974440 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:27.974312 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzmq4\" (UniqueName: \"kubernetes.io/projected/f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c-kube-api-access-kzmq4\") pod \"openshift-state-metrics-84bd68b896-dfqm6\" (UID: \"f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dfqm6" Jul 10 14:09:28.066637 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.066554 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9a337a14-c834-4363-868b-ee4330013be7-node-exporter-wtmp\") pod \"node-exporter-8p52j\" (UID: \"9a337a14-c834-4363-868b-ee4330013be7\") " pod="openshift-monitoring/node-exporter-8p52j" Jul 10 14:09:28.066637 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.066613 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a337a14-c834-4363-868b-ee4330013be7-metrics-client-ca\") pod \"node-exporter-8p52j\" (UID: \"9a337a14-c834-4363-868b-ee4330013be7\") " pod="openshift-monitoring/node-exporter-8p52j" Jul 10 14:09:28.066850 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.066747 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9a337a14-c834-4363-868b-ee4330013be7-node-exporter-wtmp\") pod \"node-exporter-8p52j\" (UID: \"9a337a14-c834-4363-868b-ee4330013be7\") " pod="openshift-monitoring/node-exporter-8p52j" Jul 10 14:09:28.066850 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.066815 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9a337a14-c834-4363-868b-ee4330013be7-node-exporter-tls\") pod \"node-exporter-8p52j\" (UID: \"9a337a14-c834-4363-868b-ee4330013be7\") " pod="openshift-monitoring/node-exporter-8p52j" Jul 10 14:09:28.066850 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.066834 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9a337a14-c834-4363-868b-ee4330013be7-node-exporter-textfile\") pod \"node-exporter-8p52j\" (UID: \"9a337a14-c834-4363-868b-ee4330013be7\") " pod="openshift-monitoring/node-exporter-8p52j" Jul 10 14:09:28.066999 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.066873 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8rvk\" (UniqueName: \"kubernetes.io/projected/9a337a14-c834-4363-868b-ee4330013be7-kube-api-access-d8rvk\") pod \"node-exporter-8p52j\" (UID: \"9a337a14-c834-4363-868b-ee4330013be7\") " pod="openshift-monitoring/node-exporter-8p52j" Jul 10 14:09:28.066999 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.066898 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9a337a14-c834-4363-868b-ee4330013be7-root\") pod \"node-exporter-8p52j\" (UID: \"9a337a14-c834-4363-868b-ee4330013be7\") " pod="openshift-monitoring/node-exporter-8p52j" Jul 10 14:09:28.066999 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.066947 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9a337a14-c834-4363-868b-ee4330013be7-node-exporter-accelerators-collector-config\") pod \"node-exporter-8p52j\" (UID: \"9a337a14-c834-4363-868b-ee4330013be7\") " pod="openshift-monitoring/node-exporter-8p52j" Jul 10 14:09:28.067138 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.067007 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a337a14-c834-4363-868b-ee4330013be7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8p52j\" (UID: \"9a337a14-c834-4363-868b-ee4330013be7\") " pod="openshift-monitoring/node-exporter-8p52j" Jul 10 14:09:28.067138 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.067041 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a337a14-c834-4363-868b-ee4330013be7-sys\") pod \"node-exporter-8p52j\" (UID: \"9a337a14-c834-4363-868b-ee4330013be7\") " pod="openshift-monitoring/node-exporter-8p52j" Jul 10 14:09:28.067138 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.067115 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a337a14-c834-4363-868b-ee4330013be7-sys\") pod \"node-exporter-8p52j\" (UID: \"9a337a14-c834-4363-868b-ee4330013be7\") " pod="openshift-monitoring/node-exporter-8p52j" Jul 10 14:09:28.067291 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.067184 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9a337a14-c834-4363-868b-ee4330013be7-root\") pod \"node-exporter-8p52j\" (UID: \"9a337a14-c834-4363-868b-ee4330013be7\") " pod="openshift-monitoring/node-exporter-8p52j" Jul 10 14:09:28.067291 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.067223 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9a337a14-c834-4363-868b-ee4330013be7-node-exporter-textfile\") pod \"node-exporter-8p52j\" (UID: \"9a337a14-c834-4363-868b-ee4330013be7\") " pod="openshift-monitoring/node-exporter-8p52j" Jul 10 14:09:28.067291 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.067226 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a337a14-c834-4363-868b-ee4330013be7-metrics-client-ca\") pod \"node-exporter-8p52j\" (UID: \"9a337a14-c834-4363-868b-ee4330013be7\") " pod="openshift-monitoring/node-exporter-8p52j" Jul 10 14:09:28.067663 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.067633 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9a337a14-c834-4363-868b-ee4330013be7-node-exporter-accelerators-collector-config\") pod \"node-exporter-8p52j\" (UID: \"9a337a14-c834-4363-868b-ee4330013be7\") " pod="openshift-monitoring/node-exporter-8p52j" Jul 10 14:09:28.069475 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.069440 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9a337a14-c834-4363-868b-ee4330013be7-node-exporter-tls\") pod \"node-exporter-8p52j\" (UID: \"9a337a14-c834-4363-868b-ee4330013be7\") " pod="openshift-monitoring/node-exporter-8p52j" Jul 10 14:09:28.069601 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.069586 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a337a14-c834-4363-868b-ee4330013be7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8p52j\" (UID: \"9a337a14-c834-4363-868b-ee4330013be7\") " pod="openshift-monitoring/node-exporter-8p52j" Jul 10 14:09:28.075529 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.075510 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8rvk\" (UniqueName: \"kubernetes.io/projected/9a337a14-c834-4363-868b-ee4330013be7-kube-api-access-d8rvk\") pod \"node-exporter-8p52j\" (UID: \"9a337a14-c834-4363-868b-ee4330013be7\") " pod="openshift-monitoring/node-exporter-8p52j" Jul 10 14:09:28.171083 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.171053 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8p52j" Jul 10 14:09:28.470373 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.470277 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-dfqm6\" (UID: \"f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dfqm6" Jul 10 14:09:28.470519 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.470395 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7382bc84-f403-4e1e-b1d0-5e0f76009aa0-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-zkpxn\" (UID: \"7382bc84-f403-4e1e-b1d0-5e0f76009aa0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zkpxn" Jul 10 14:09:28.472909 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.472887 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7382bc84-f403-4e1e-b1d0-5e0f76009aa0-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-zkpxn\" (UID: \"7382bc84-f403-4e1e-b1d0-5e0f76009aa0\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zkpxn" Jul 10 14:09:28.472909 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.472889 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-dfqm6\" (UID: \"f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dfqm6" Jul 10 14:09:28.721870 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.721795 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dfqm6" Jul 10 14:09:28.753627 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.753597 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-zkpxn" Jul 10 14:09:28.886762 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.886732 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 14:09:28.901829 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.901802 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:28.905064 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.904844 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 10 14:09:28.905064 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.904865 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 10 14:09:28.905064 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.904905 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tpd9l\"" Jul 10 14:09:28.905064 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.904942 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 10 14:09:28.905064 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.904977 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 10 14:09:28.905064 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.904844 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 10 14:09:28.905064 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.904854 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 10 14:09:28.905500 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.905291 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 10 14:09:28.905500 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.905481 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 10 14:09:28.905597 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.905509 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 10 14:09:28.910256 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.910178 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 14:09:28.974240 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.974143 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a59535cb-a172-4689-baa2-e972130283ce-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:28.974240 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.974189 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cvc9\" (UniqueName: \"kubernetes.io/projected/a59535cb-a172-4689-baa2-e972130283ce-kube-api-access-5cvc9\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:28.974479 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.974270 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:28.974479 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.974333 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a59535cb-a172-4689-baa2-e972130283ce-config-out\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:28.974479 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.974378 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-web-config\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:28.974479 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.974432 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a59535cb-a172-4689-baa2-e972130283ce-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:28.974479 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.974469 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a59535cb-a172-4689-baa2-e972130283ce-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:28.974714 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.974529 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:28.974714 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.974558 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a59535cb-a172-4689-baa2-e972130283ce-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:28.974714 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.974637 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-config-volume\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:28.974714 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.974674 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:28.974714 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.974705 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:28.974943 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:28.974777 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:29.075625 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:29.075599 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:29.075753 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:29.075636 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a59535cb-a172-4689-baa2-e972130283ce-config-out\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:29.075753 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:29.075658 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-web-config\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:29.075753 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:29.075683 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a59535cb-a172-4689-baa2-e972130283ce-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:29.075753 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:29.075714 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a59535cb-a172-4689-baa2-e972130283ce-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:29.075753 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:29.075740 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:29.076047 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:29.075765 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a59535cb-a172-4689-baa2-e972130283ce-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:29.076047 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:29.075817 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-config-volume\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:29.076047 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:29.075846 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:29.076047 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:29.075868 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:29.076047 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:29.075906 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:29.076047 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:29.075938 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a59535cb-a172-4689-baa2-e972130283ce-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:29.076047 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:29.075964 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cvc9\" (UniqueName: \"kubernetes.io/projected/a59535cb-a172-4689-baa2-e972130283ce-kube-api-access-5cvc9\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:29.076341 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:29.076120 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a59535cb-a172-4689-baa2-e972130283ce-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:29.076738 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:29.076554 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a59535cb-a172-4689-baa2-e972130283ce-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:29.077525 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:29.077177 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a59535cb-a172-4689-baa2-e972130283ce-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:29.078699 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:29.078672 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:29.078979 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:29.078956 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a59535cb-a172-4689-baa2-e972130283ce-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:29.079136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:29.079113 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:29.079460 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:29.079441 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a59535cb-a172-4689-baa2-e972130283ce-config-out\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:29.079603 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:29.079586 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:29.079689 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:29.079614 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:29.079729 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:29.079696 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-web-config\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:29.080061 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:29.080039 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-config-volume\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:29.080798 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:29.080778 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:29.084054 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:29.084033 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cvc9\" (UniqueName: \"kubernetes.io/projected/a59535cb-a172-4689-baa2-e972130283ce-kube-api-access-5cvc9\") pod \"alertmanager-main-0\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:29.213304 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:29.213273 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:09:30.874967 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:30.874889 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8p52j" event={"ID":"9a337a14-c834-4363-868b-ee4330013be7","Type":"ContainerStarted","Data":"334d92bd1ea8cbe9e6aa7953bb40dfa7afa589cea80b673d04c7cb494b878edf"} Jul 10 14:09:30.963171 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:30.962911 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-zkpxn"] Jul 10 14:09:30.968006 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:09:30.967966 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7382bc84_f403_4e1e_b1d0_5e0f76009aa0.slice/crio-9dd16d5be02af7d2048b7d54c489dce8cdff4858f1a790519db86fba14235a3e WatchSource:0}: Error finding container 9dd16d5be02af7d2048b7d54c489dce8cdff4858f1a790519db86fba14235a3e: Status 404 returned error can't find the container with id 9dd16d5be02af7d2048b7d54c489dce8cdff4858f1a790519db86fba14235a3e Jul 10 14:09:30.978518 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:30.978388 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-dfqm6"] Jul 10 14:09:30.988812 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:09:30.988616 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5b8e4cb_586c_4df6_83c7_4a46f6ca1d3c.slice/crio-4ebf7e759b61e30b97febb3e6875e06c0c04ea6e0e38a158e4eaf554b8cc8b02 WatchSource:0}: Error finding container 4ebf7e759b61e30b97febb3e6875e06c0c04ea6e0e38a158e4eaf554b8cc8b02: Status 404 returned error can't find the container with id 4ebf7e759b61e30b97febb3e6875e06c0c04ea6e0e38a158e4eaf554b8cc8b02 Jul 10 14:09:30.988812 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:30.988687 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 14:09:30.990867 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:09:30.990787 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda59535cb_a172_4689_baa2_e972130283ce.slice/crio-7d646a6e9e171960e6c95786ed574d5f09c15dd1ea0c911d7145a8d970126e01 WatchSource:0}: Error finding container 7d646a6e9e171960e6c95786ed574d5f09c15dd1ea0c911d7145a8d970126e01: Status 404 returned error can't find the container with id 7d646a6e9e171960e6c95786ed574d5f09c15dd1ea0c911d7145a8d970126e01 Jul 10 14:09:31.882443 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:31.882218 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-554d9d9d8c-gbnfr" event={"ID":"2d38f10c-f077-4068-9337-a6b569f924fa","Type":"ContainerStarted","Data":"b88adeb8ae9ab1cdd9d6da49723edf383c6fa34b6d28530d690526671014b0e8"} Jul 10 14:09:31.883626 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:31.883584 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-zkpxn" event={"ID":"7382bc84-f403-4e1e-b1d0-5e0f76009aa0","Type":"ContainerStarted","Data":"9dd16d5be02af7d2048b7d54c489dce8cdff4858f1a790519db86fba14235a3e"} Jul 10 14:09:31.884902 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:31.884828 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a59535cb-a172-4689-baa2-e972130283ce","Type":"ContainerStarted","Data":"7d646a6e9e171960e6c95786ed574d5f09c15dd1ea0c911d7145a8d970126e01"} Jul 10 14:09:31.886679 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:31.886620 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7nhb9" event={"ID":"a201eda6-6bb2-4ffd-a3ba-b02e648aad99","Type":"ContainerStarted","Data":"042ab87cd0b903566ee2c74bafdcdf71315d2abc98acdf2df66c892d4282bece"} Jul 10 14:09:31.888954 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:31.888816 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ncp26" event={"ID":"1086446b-6b80-40ba-bfd9-76e9b68fb565","Type":"ContainerStarted","Data":"3a469ee165dd964e6e2604067902de555c11b77eb6f6938f38b4e05e0a48e450"} Jul 10 14:09:31.888954 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:31.888881 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ncp26" Jul 10 14:09:31.888954 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:31.888921 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ncp26" event={"ID":"1086446b-6b80-40ba-bfd9-76e9b68fb565","Type":"ContainerStarted","Data":"28d50c742cfcc24ed6ba58c98ac3ba53fa04f58839c1368971c97526d6945d3a"} Jul 10 14:09:31.890749 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:31.890701 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gm82q" event={"ID":"30a00187-297f-459c-8c9c-b584bdfac8b7","Type":"ContainerStarted","Data":"fac02b5292b77d63f12c4e9e5d390851f93432c957b617633607762288f8823d"} Jul 10 14:09:31.892624 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:31.892599 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dfqm6" event={"ID":"f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c","Type":"ContainerStarted","Data":"8e29379f12562b574a52f010365579ae6d98b4a9a1f7e3e8e44393856250f467"} Jul 10 14:09:31.892725 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:31.892658 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dfqm6" event={"ID":"f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c","Type":"ContainerStarted","Data":"4f4ecc79f6260a690a7a9f937a09df8791a58d0c0ff10d14585d5404438cbcbd"} Jul 10 14:09:31.892725 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:31.892691 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dfqm6" event={"ID":"f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c","Type":"ContainerStarted","Data":"4ebf7e759b61e30b97febb3e6875e06c0c04ea6e0e38a158e4eaf554b8cc8b02"} Jul 10 14:09:31.905468 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:31.905310 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-554d9d9d8c-gbnfr" podStartSLOduration=2.5083880240000003 podStartE2EDuration="8.905292762s" totalImagesPullingTime="6.396904738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:09:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:31.903109794 +0000 UTC m=+54.846682131" watchObservedRunningTime="2026-07-10 14:09:31.905292762 +0000 UTC m=+54.848865080" Jul 10 14:09:31.937895 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:31.937842 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gm82q" podStartSLOduration=2.096436154 podStartE2EDuration="9.937824752s" totalImagesPullingTime="7.841388598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:09:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:31.937618166 +0000 UTC m=+54.881190508" watchObservedRunningTime="2026-07-10 14:09:31.937824752 +0000 UTC m=+54.881397115" Jul 10 14:09:31.938235 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:31.938165 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ncp26" podStartSLOduration=7.400006058 podStartE2EDuration="9.938152564s" totalImagesPullingTime="2.538146506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:09:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:31.921713552 +0000 UTC m=+54.865285895" watchObservedRunningTime="2026-07-10 14:09:31.938152564 +0000 UTC m=+54.881724912" Jul 10 14:09:32.897558 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:32.897375 2581 generic.go:356] "Generic (PLEG): container finished" podID="9a337a14-c834-4363-868b-ee4330013be7" containerID="6a7033050de637abf72f59901775f1ac63e503737b1ef1516386300467aba483" exitCode=0 Jul 10 14:09:32.897980 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:32.897455 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8p52j" event={"ID":"9a337a14-c834-4363-868b-ee4330013be7","Type":"ContainerDied","Data":"6a7033050de637abf72f59901775f1ac63e503737b1ef1516386300467aba483"} Jul 10 14:09:32.899561 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:32.899537 2581 generic.go:356] "Generic (PLEG): container finished" podID="a59535cb-a172-4689-baa2-e972130283ce" containerID="d1b099f05efd74f5ff720e88ad70824d1e41f770b548b40c196602f6a2fed48e" exitCode=0 Jul 10 14:09:32.899670 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:32.899616 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a59535cb-a172-4689-baa2-e972130283ce","Type":"ContainerDied","Data":"d1b099f05efd74f5ff720e88ad70824d1e41f770b548b40c196602f6a2fed48e"} Jul 10 14:09:33.291118 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:33.291092 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-554d9d9d8c-gbnfr"] Jul 10 14:09:33.907095 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:33.907016 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7nhb9" event={"ID":"a201eda6-6bb2-4ffd-a3ba-b02e648aad99","Type":"ContainerStarted","Data":"fa0f5b9a5cbf19b90d918d924c017b69918f9058485f586b0c14028e669dc852"} Jul 10 14:09:33.909839 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:33.909779 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8p52j" event={"ID":"9a337a14-c834-4363-868b-ee4330013be7","Type":"ContainerStarted","Data":"c0a3344756b036776bade612121609f10744b25b1e83c3d58c1595429ee1e18d"} Jul 10 14:09:33.909971 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:33.909850 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8p52j" event={"ID":"9a337a14-c834-4363-868b-ee4330013be7","Type":"ContainerStarted","Data":"890e1d8e89d3641ba78b3c67f9138117c5566d24d9650f7e23b667d23e386a46"} Jul 10 14:09:33.955921 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:33.955800 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8p52j" podStartSLOduration=5.112457048 podStartE2EDuration="6.955779732s" totalImagesPullingTime="1.772419301s" totalInitContainerRuntime="70.903383ms" isStatefulPod=true podCreationTimestamp="2026-07-10 14:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:33.933118268 +0000 UTC m=+56.876690610" watchObservedRunningTime="2026-07-10 14:09:33.955779732 +0000 UTC m=+56.899352073" Jul 10 14:09:34.218817 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:34.218704 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-554d9d9d8c-gbnfr" Jul 10 14:09:34.925205 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:34.924441 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dfqm6" event={"ID":"f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c","Type":"ContainerStarted","Data":"25fb3f0da01d85977819d0998913dc56ae7b4eb214c0acbae09c1bacbc266a4b"} Jul 10 14:09:34.927335 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:34.927288 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-zkpxn" event={"ID":"7382bc84-f403-4e1e-b1d0-5e0f76009aa0","Type":"ContainerStarted","Data":"3c17fbe6f2d1bbfa419edf1a43f0934d71dc2812cee74f6fd8d4d307a41b8f79"} Jul 10 14:09:34.944618 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:34.944565 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dfqm6" podStartSLOduration=4.872497621 podStartE2EDuration="7.944543629s" totalImagesPullingTime="3.072046008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:34.94177433 +0000 UTC m=+57.885346673" watchObservedRunningTime="2026-07-10 14:09:34.944543629 +0000 UTC m=+57.888115970" Jul 10 14:09:36.935718 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:36.935683 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7nhb9" event={"ID":"a201eda6-6bb2-4ffd-a3ba-b02e648aad99","Type":"ContainerStarted","Data":"93820011dd1f9eced4a8fb6fe2d5f5583a1cf2dcbb399cc4ca154bcd28841187"} Jul 10 14:09:36.937649 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:36.937617 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-zkpxn" event={"ID":"7382bc84-f403-4e1e-b1d0-5e0f76009aa0","Type":"ContainerStarted","Data":"0b2b405f68d8d4f518485e0c048d08c3b7dfc843f00e85aaf264fdb8787efbd0"} Jul 10 14:09:36.937769 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:36.937678 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-zkpxn" event={"ID":"7382bc84-f403-4e1e-b1d0-5e0f76009aa0","Type":"ContainerStarted","Data":"22bd1ec2a17631a8e14a1a6bc45ae5414d329dbf7250f4a7260f20c9d49a57f7"} Jul 10 14:09:36.940374 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:36.940355 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a59535cb-a172-4689-baa2-e972130283ce","Type":"ContainerStarted","Data":"40172c04e578276bce2e37ea0147131bc487b70e1244698cfc04e159d752e96b"} Jul 10 14:09:36.940486 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:36.940402 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a59535cb-a172-4689-baa2-e972130283ce","Type":"ContainerStarted","Data":"13a44acc2051d9118ac0c0951c1b19ad4294f3ca5c71b960fb09bb639290e760"} Jul 10 14:09:36.940486 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:36.940427 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a59535cb-a172-4689-baa2-e972130283ce","Type":"ContainerStarted","Data":"74b51fa6e0b0cc944fc92a51f1de7cf1b6a810d0e0a7e97482d5d0ad788fbb7c"} Jul 10 14:09:36.940486 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:36.940451 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a59535cb-a172-4689-baa2-e972130283ce","Type":"ContainerStarted","Data":"8e935f53f29af37b48e892b34f8572ae21bab43e2d1ae4588f7dbca9800a83b7"} Jul 10 14:09:36.940486 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:36.940472 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a59535cb-a172-4689-baa2-e972130283ce","Type":"ContainerStarted","Data":"7be9752548a11361069ab8dd469a95c0da77d58a53fe329227776a7758b151d8"} Jul 10 14:09:36.957122 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:36.957080 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7nhb9" podStartSLOduration=1.867387732 podStartE2EDuration="14.957067217s" totalImagesPullingTime="13.089679485s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:09:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:36.956713098 +0000 UTC m=+59.900285440" watchObservedRunningTime="2026-07-10 14:09:36.957067217 +0000 UTC m=+59.900639560" Jul 10 14:09:36.978573 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:36.978539 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-zkpxn" podStartSLOduration=6.156953085 podStartE2EDuration="9.978526798s" totalImagesPullingTime="3.821573713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:36.977626897 +0000 UTC m=+59.921199239" watchObservedRunningTime="2026-07-10 14:09:36.978526798 +0000 UTC m=+59.922099137" Jul 10 14:09:37.949358 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:37.949308 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a59535cb-a172-4689-baa2-e972130283ce","Type":"ContainerStarted","Data":"7897d4ce1fbce53c5ac303e93a4c67f162b6799d928cf80252a2200163c37ae2"} Jul 10 14:09:37.985181 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:37.985089 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.683026595 podStartE2EDuration="9.985028001s" totalImagesPullingTime="6.288070373s" totalInitContainerRuntime="13.931033ms" isStatefulPod=false podCreationTimestamp="2026-07-10 14:09:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:37.983681542 +0000 UTC m=+60.927253883" watchObservedRunningTime="2026-07-10 14:09:37.985028001 +0000 UTC m=+60.928600342" Jul 10 14:09:39.793135 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:39.793110 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6z8gc" Jul 10 14:09:41.901706 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:41.901679 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ncp26" Jul 10 14:09:44.010008 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.009971 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae-metrics-certs\") pod \"network-metrics-daemon-6jcf8\" (UID: \"5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae\") " pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:09:44.010434 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.010058 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3bf8565-febc-4cfa-8d86-11e5aeb3b516-original-pull-secret\") pod \"global-pull-secret-syncer-fd8lf\" (UID: \"f3bf8565-febc-4cfa-8d86-11e5aeb3b516\") " pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:09:44.012792 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.012775 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 14:09:44.013933 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.013917 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 14:09:44.023356 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.023333 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3bf8565-febc-4cfa-8d86-11e5aeb3b516-original-pull-secret\") pod \"global-pull-secret-syncer-fd8lf\" (UID: \"f3bf8565-febc-4cfa-8d86-11e5aeb3b516\") " pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:09:44.023461 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.023405 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae-metrics-certs\") pod \"network-metrics-daemon-6jcf8\" (UID: \"5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae\") " pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:09:44.063391 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.063367 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fptgw\"" Jul 10 14:09:44.063998 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.063984 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fd8lf" Jul 10 14:09:44.069524 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.069505 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6jcf8" Jul 10 14:09:44.108709 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.108684 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7db8dc7d46-lt9qb"] Jul 10 14:09:44.111468 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.111444 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmthw\" (UniqueName: \"kubernetes.io/projected/2814701c-e4da-4cc4-b7c4-550067a950b1-kube-api-access-xmthw\") pod \"network-check-target-wcvvb\" (UID: \"2814701c-e4da-4cc4-b7c4-550067a950b1\") " pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:09:44.114553 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.114534 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 14:09:44.124514 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.124485 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 14:09:44.136551 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.136526 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmthw\" (UniqueName: \"kubernetes.io/projected/2814701c-e4da-4cc4-b7c4-550067a950b1-kube-api-access-xmthw\") pod \"network-check-target-wcvvb\" (UID: \"2814701c-e4da-4cc4-b7c4-550067a950b1\") " pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:09:44.137599 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.137578 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7db8dc7d46-lt9qb"] Jul 10 14:09:44.137700 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.137686 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7db8dc7d46-lt9qb" Jul 10 14:09:44.212849 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.211872 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90ae30f7-6a28-4242-a02d-733e65772872-console-serving-cert\") pod \"console-7db8dc7d46-lt9qb\" (UID: \"90ae30f7-6a28-4242-a02d-733e65772872\") " pod="openshift-console/console-7db8dc7d46-lt9qb" Jul 10 14:09:44.212849 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.211909 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90ae30f7-6a28-4242-a02d-733e65772872-oauth-serving-cert\") pod \"console-7db8dc7d46-lt9qb\" (UID: \"90ae30f7-6a28-4242-a02d-733e65772872\") " pod="openshift-console/console-7db8dc7d46-lt9qb" Jul 10 14:09:44.212849 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.211925 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90ae30f7-6a28-4242-a02d-733e65772872-console-oauth-config\") pod \"console-7db8dc7d46-lt9qb\" (UID: \"90ae30f7-6a28-4242-a02d-733e65772872\") " pod="openshift-console/console-7db8dc7d46-lt9qb" Jul 10 14:09:44.212849 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.211940 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90ae30f7-6a28-4242-a02d-733e65772872-trusted-ca-bundle\") pod \"console-7db8dc7d46-lt9qb\" (UID: \"90ae30f7-6a28-4242-a02d-733e65772872\") " pod="openshift-console/console-7db8dc7d46-lt9qb" Jul 10 14:09:44.212849 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.211965 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90ae30f7-6a28-4242-a02d-733e65772872-service-ca\") pod \"console-7db8dc7d46-lt9qb\" (UID: \"90ae30f7-6a28-4242-a02d-733e65772872\") " pod="openshift-console/console-7db8dc7d46-lt9qb" Jul 10 14:09:44.212849 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.212001 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6rlh\" (UniqueName: \"kubernetes.io/projected/90ae30f7-6a28-4242-a02d-733e65772872-kube-api-access-x6rlh\") pod \"console-7db8dc7d46-lt9qb\" (UID: \"90ae30f7-6a28-4242-a02d-733e65772872\") " pod="openshift-console/console-7db8dc7d46-lt9qb" Jul 10 14:09:44.212849 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.212022 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90ae30f7-6a28-4242-a02d-733e65772872-console-config\") pod \"console-7db8dc7d46-lt9qb\" (UID: \"90ae30f7-6a28-4242-a02d-733e65772872\") " pod="openshift-console/console-7db8dc7d46-lt9qb" Jul 10 14:09:44.238298 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.238264 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fd8lf"] Jul 10 14:09:44.242653 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:09:44.242623 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3bf8565_febc_4cfa_8d86_11e5aeb3b516.slice/crio-7fa8d934b4468d0ca76daa39fbdbecfb887d9895581215b1f912952ae0ef3937 WatchSource:0}: Error finding container 7fa8d934b4468d0ca76daa39fbdbecfb887d9895581215b1f912952ae0ef3937: Status 404 returned error can't find the container with id 7fa8d934b4468d0ca76daa39fbdbecfb887d9895581215b1f912952ae0ef3937 Jul 10 14:09:44.260911 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.260891 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6jcf8"] Jul 10 14:09:44.262936 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:09:44.262914 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f12f4d0_6ae5_45ee_a011_05e26cd3a3ae.slice/crio-751aa7b48331e25d377f7c282ecc8cbd2de699afd4b745f872b1cf914dce7fc9 WatchSource:0}: Error finding container 751aa7b48331e25d377f7c282ecc8cbd2de699afd4b745f872b1cf914dce7fc9: Status 404 returned error can't find the container with id 751aa7b48331e25d377f7c282ecc8cbd2de699afd4b745f872b1cf914dce7fc9 Jul 10 14:09:44.312377 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.312355 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90ae30f7-6a28-4242-a02d-733e65772872-console-serving-cert\") pod \"console-7db8dc7d46-lt9qb\" (UID: \"90ae30f7-6a28-4242-a02d-733e65772872\") " pod="openshift-console/console-7db8dc7d46-lt9qb" Jul 10 14:09:44.312497 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.312385 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90ae30f7-6a28-4242-a02d-733e65772872-oauth-serving-cert\") pod \"console-7db8dc7d46-lt9qb\" (UID: \"90ae30f7-6a28-4242-a02d-733e65772872\") " pod="openshift-console/console-7db8dc7d46-lt9qb" Jul 10 14:09:44.312497 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.312404 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90ae30f7-6a28-4242-a02d-733e65772872-console-oauth-config\") pod \"console-7db8dc7d46-lt9qb\" (UID: \"90ae30f7-6a28-4242-a02d-733e65772872\") " pod="openshift-console/console-7db8dc7d46-lt9qb" Jul 10 14:09:44.312497 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.312491 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90ae30f7-6a28-4242-a02d-733e65772872-trusted-ca-bundle\") pod \"console-7db8dc7d46-lt9qb\" (UID: \"90ae30f7-6a28-4242-a02d-733e65772872\") " pod="openshift-console/console-7db8dc7d46-lt9qb" Jul 10 14:09:44.312607 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.312521 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90ae30f7-6a28-4242-a02d-733e65772872-service-ca\") pod \"console-7db8dc7d46-lt9qb\" (UID: \"90ae30f7-6a28-4242-a02d-733e65772872\") " pod="openshift-console/console-7db8dc7d46-lt9qb" Jul 10 14:09:44.312607 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.312561 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6rlh\" (UniqueName: \"kubernetes.io/projected/90ae30f7-6a28-4242-a02d-733e65772872-kube-api-access-x6rlh\") pod \"console-7db8dc7d46-lt9qb\" (UID: \"90ae30f7-6a28-4242-a02d-733e65772872\") " pod="openshift-console/console-7db8dc7d46-lt9qb" Jul 10 14:09:44.312607 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.312583 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90ae30f7-6a28-4242-a02d-733e65772872-console-config\") pod \"console-7db8dc7d46-lt9qb\" (UID: \"90ae30f7-6a28-4242-a02d-733e65772872\") " pod="openshift-console/console-7db8dc7d46-lt9qb" Jul 10 14:09:44.313362 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.313339 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90ae30f7-6a28-4242-a02d-733e65772872-service-ca\") pod \"console-7db8dc7d46-lt9qb\" (UID: \"90ae30f7-6a28-4242-a02d-733e65772872\") " pod="openshift-console/console-7db8dc7d46-lt9qb" Jul 10 14:09:44.313451 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.313341 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90ae30f7-6a28-4242-a02d-733e65772872-console-config\") pod \"console-7db8dc7d46-lt9qb\" (UID: \"90ae30f7-6a28-4242-a02d-733e65772872\") " pod="openshift-console/console-7db8dc7d46-lt9qb" Jul 10 14:09:44.313523 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.313507 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90ae30f7-6a28-4242-a02d-733e65772872-trusted-ca-bundle\") pod \"console-7db8dc7d46-lt9qb\" (UID: \"90ae30f7-6a28-4242-a02d-733e65772872\") " pod="openshift-console/console-7db8dc7d46-lt9qb" Jul 10 14:09:44.313613 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.313589 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90ae30f7-6a28-4242-a02d-733e65772872-oauth-serving-cert\") pod \"console-7db8dc7d46-lt9qb\" (UID: \"90ae30f7-6a28-4242-a02d-733e65772872\") " pod="openshift-console/console-7db8dc7d46-lt9qb" Jul 10 14:09:44.314928 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.314912 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90ae30f7-6a28-4242-a02d-733e65772872-console-serving-cert\") pod \"console-7db8dc7d46-lt9qb\" (UID: \"90ae30f7-6a28-4242-a02d-733e65772872\") " pod="openshift-console/console-7db8dc7d46-lt9qb" Jul 10 14:09:44.315373 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.315350 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90ae30f7-6a28-4242-a02d-733e65772872-console-oauth-config\") pod \"console-7db8dc7d46-lt9qb\" (UID: \"90ae30f7-6a28-4242-a02d-733e65772872\") " pod="openshift-console/console-7db8dc7d46-lt9qb" Jul 10 14:09:44.320812 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.320792 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6rlh\" (UniqueName: \"kubernetes.io/projected/90ae30f7-6a28-4242-a02d-733e65772872-kube-api-access-x6rlh\") pod \"console-7db8dc7d46-lt9qb\" (UID: \"90ae30f7-6a28-4242-a02d-733e65772872\") " pod="openshift-console/console-7db8dc7d46-lt9qb" Jul 10 14:09:44.353948 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.353928 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7ddd8\"" Jul 10 14:09:44.361921 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.361907 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:09:44.448380 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.448352 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7db8dc7d46-lt9qb" Jul 10 14:09:44.512118 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.512039 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wcvvb"] Jul 10 14:09:44.515670 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:09:44.515632 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2814701c_e4da_4cc4_b7c4_550067a950b1.slice/crio-292a17289f4548d6a9dc6d05f37953f527a16af09b059b5eab3e3be4c05b029c WatchSource:0}: Error finding container 292a17289f4548d6a9dc6d05f37953f527a16af09b059b5eab3e3be4c05b029c: Status 404 returned error can't find the container with id 292a17289f4548d6a9dc6d05f37953f527a16af09b059b5eab3e3be4c05b029c Jul 10 14:09:44.587350 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.587310 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7db8dc7d46-lt9qb"] Jul 10 14:09:44.589556 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:09:44.589533 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90ae30f7_6a28_4242_a02d_733e65772872.slice/crio-f699f32f59c903f881f73e1e6500430054e60cf3bb811d015af5e783849a8318 WatchSource:0}: Error finding container f699f32f59c903f881f73e1e6500430054e60cf3bb811d015af5e783849a8318: Status 404 returned error can't find the container with id f699f32f59c903f881f73e1e6500430054e60cf3bb811d015af5e783849a8318 Jul 10 14:09:44.846876 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.846848 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-76bbfc4bc5-qgv94" Jul 10 14:09:44.976963 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.976924 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7db8dc7d46-lt9qb" event={"ID":"90ae30f7-6a28-4242-a02d-733e65772872","Type":"ContainerStarted","Data":"8a46c11f8f5760e4cdc3f32ffcbffcc031a0c32f77ea4edd3566195eca542031"} Jul 10 14:09:44.977167 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.976980 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7db8dc7d46-lt9qb" event={"ID":"90ae30f7-6a28-4242-a02d-733e65772872","Type":"ContainerStarted","Data":"f699f32f59c903f881f73e1e6500430054e60cf3bb811d015af5e783849a8318"} Jul 10 14:09:44.978131 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.978103 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6jcf8" event={"ID":"5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae","Type":"ContainerStarted","Data":"751aa7b48331e25d377f7c282ecc8cbd2de699afd4b745f872b1cf914dce7fc9"} Jul 10 14:09:44.979364 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.979337 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fd8lf" event={"ID":"f3bf8565-febc-4cfa-8d86-11e5aeb3b516","Type":"ContainerStarted","Data":"7fa8d934b4468d0ca76daa39fbdbecfb887d9895581215b1f912952ae0ef3937"} Jul 10 14:09:44.980465 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.980425 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wcvvb" event={"ID":"2814701c-e4da-4cc4-b7c4-550067a950b1","Type":"ContainerStarted","Data":"292a17289f4548d6a9dc6d05f37953f527a16af09b059b5eab3e3be4c05b029c"} Jul 10 14:09:44.997249 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:44.997125 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7db8dc7d46-lt9qb" podStartSLOduration=0.997107413 podStartE2EDuration="997.107413ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:09:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:44.995834978 +0000 UTC m=+67.939407319" watchObservedRunningTime="2026-07-10 14:09:44.997107413 +0000 UTC m=+67.940679754" Jul 10 14:09:45.987692 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:45.987654 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6jcf8" event={"ID":"5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae","Type":"ContainerStarted","Data":"53df17cbf5cedf91b0795b28c648b3c97674956b2a16b3bc42a8978cec9e6b99"} Jul 10 14:09:45.988143 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:45.987726 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6jcf8" event={"ID":"5f12f4d0-6ae5-45ee-a011-05e26cd3a3ae","Type":"ContainerStarted","Data":"081ca91441494b15146a190d091e4708809e76392cb17a4268a3b7ebf919dc83"} Jul 10 14:09:46.015648 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:46.015590 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6jcf8" podStartSLOduration=66.804836249 podStartE2EDuration="1m8.015570356s" totalImagesPullingTime="1.210734107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:08:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:46.015243894 +0000 UTC m=+68.958816237" watchObservedRunningTime="2026-07-10 14:09:46.015570356 +0000 UTC m=+68.959142698" Jul 10 14:09:51.013491 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:51.013452 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fd8lf" event={"ID":"f3bf8565-febc-4cfa-8d86-11e5aeb3b516","Type":"ContainerStarted","Data":"b5dcc95d04dab284587953c0a36f6dde6d9384e73384333fe19160da19ee2a96"} Jul 10 14:09:51.014911 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:51.014882 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wcvvb" event={"ID":"2814701c-e4da-4cc4-b7c4-550067a950b1","Type":"ContainerStarted","Data":"56b75a7944e56a198f96288bda23271dea6555c688d30d9aed4c48f6b51e4f24"} Jul 10 14:09:51.015026 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:51.014991 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:09:51.030764 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:51.030715 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fd8lf" podStartSLOduration=67.152983803 podStartE2EDuration="1m13.030700538s" totalImagesPullingTime="5.877716735s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:08:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:51.030256172 +0000 UTC m=+73.973828514" watchObservedRunningTime="2026-07-10 14:09:51.030700538 +0000 UTC m=+73.974272878" Jul 10 14:09:51.045251 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:51.045211 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wcvvb" podStartSLOduration=67.431677026 podStartE2EDuration="1m13.045200313s" totalImagesPullingTime="5.613523287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:08:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:51.044608434 +0000 UTC m=+73.988180775" watchObservedRunningTime="2026-07-10 14:09:51.045200313 +0000 UTC m=+73.988772652" Jul 10 14:09:54.449390 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:54.449360 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7db8dc7d46-lt9qb" Jul 10 14:09:54.449800 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:54.449507 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7db8dc7d46-lt9qb" Jul 10 14:09:54.454374 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:54.454355 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7db8dc7d46-lt9qb" Jul 10 14:09:55.033409 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:55.033380 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7db8dc7d46-lt9qb" Jul 10 14:09:58.940670 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:58.940497 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-554d9d9d8c-gbnfr" podUID="2d38f10c-f077-4068-9337-a6b569f924fa" containerName="console" containerID="cri-o://b88adeb8ae9ab1cdd9d6da49723edf383c6fa34b6d28530d690526671014b0e8" gracePeriod=15 Jul 10 14:09:59.712610 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:59.712582 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-554d9d9d8c-gbnfr" Jul 10 14:09:59.844310 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:59.844238 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d38f10c-f077-4068-9337-a6b569f924fa-service-ca\") pod \"2d38f10c-f077-4068-9337-a6b569f924fa\" (UID: \"2d38f10c-f077-4068-9337-a6b569f924fa\") " Jul 10 14:09:59.844310 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:59.844274 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d38f10c-f077-4068-9337-a6b569f924fa-trusted-ca-bundle\") pod \"2d38f10c-f077-4068-9337-a6b569f924fa\" (UID: \"2d38f10c-f077-4068-9337-a6b569f924fa\") " Jul 10 14:09:59.844310 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:59.844299 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d38f10c-f077-4068-9337-a6b569f924fa-console-serving-cert\") pod \"2d38f10c-f077-4068-9337-a6b569f924fa\" (UID: \"2d38f10c-f077-4068-9337-a6b569f924fa\") " Jul 10 14:09:59.844565 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:59.844335 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d38f10c-f077-4068-9337-a6b569f924fa-oauth-serving-cert\") pod \"2d38f10c-f077-4068-9337-a6b569f924fa\" (UID: \"2d38f10c-f077-4068-9337-a6b569f924fa\") " Jul 10 14:09:59.844565 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:59.844366 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d38f10c-f077-4068-9337-a6b569f924fa-console-config\") pod \"2d38f10c-f077-4068-9337-a6b569f924fa\" (UID: \"2d38f10c-f077-4068-9337-a6b569f924fa\") " Jul 10 14:09:59.844565 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:59.844401 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d38f10c-f077-4068-9337-a6b569f924fa-console-oauth-config\") pod \"2d38f10c-f077-4068-9337-a6b569f924fa\" (UID: \"2d38f10c-f077-4068-9337-a6b569f924fa\") " Jul 10 14:09:59.844565 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:59.844441 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6phw5\" (UniqueName: \"kubernetes.io/projected/2d38f10c-f077-4068-9337-a6b569f924fa-kube-api-access-6phw5\") pod \"2d38f10c-f077-4068-9337-a6b569f924fa\" (UID: \"2d38f10c-f077-4068-9337-a6b569f924fa\") " Jul 10 14:09:59.844757 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:59.844625 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d38f10c-f077-4068-9337-a6b569f924fa-service-ca" (OuterVolumeSpecName: "service-ca") pod "2d38f10c-f077-4068-9337-a6b569f924fa" (UID: "2d38f10c-f077-4068-9337-a6b569f924fa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:09:59.844824 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:59.844801 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d38f10c-f077-4068-9337-a6b569f924fa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2d38f10c-f077-4068-9337-a6b569f924fa" (UID: "2d38f10c-f077-4068-9337-a6b569f924fa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:09:59.844824 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:59.844808 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d38f10c-f077-4068-9337-a6b569f924fa-console-config" (OuterVolumeSpecName: "console-config") pod "2d38f10c-f077-4068-9337-a6b569f924fa" (UID: "2d38f10c-f077-4068-9337-a6b569f924fa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:09:59.845130 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:59.845109 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d38f10c-f077-4068-9337-a6b569f924fa-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2d38f10c-f077-4068-9337-a6b569f924fa" (UID: "2d38f10c-f077-4068-9337-a6b569f924fa"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:09:59.846658 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:59.846638 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d38f10c-f077-4068-9337-a6b569f924fa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2d38f10c-f077-4068-9337-a6b569f924fa" (UID: "2d38f10c-f077-4068-9337-a6b569f924fa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:09:59.846754 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:59.846731 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d38f10c-f077-4068-9337-a6b569f924fa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2d38f10c-f077-4068-9337-a6b569f924fa" (UID: "2d38f10c-f077-4068-9337-a6b569f924fa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:09:59.846796 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:59.846773 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d38f10c-f077-4068-9337-a6b569f924fa-kube-api-access-6phw5" (OuterVolumeSpecName: "kube-api-access-6phw5") pod "2d38f10c-f077-4068-9337-a6b569f924fa" (UID: "2d38f10c-f077-4068-9337-a6b569f924fa"). InnerVolumeSpecName "kube-api-access-6phw5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:09:59.945146 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:59.945118 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6phw5\" (UniqueName: \"kubernetes.io/projected/2d38f10c-f077-4068-9337-a6b569f924fa-kube-api-access-6phw5\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:09:59.945146 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:59.945143 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d38f10c-f077-4068-9337-a6b569f924fa-service-ca\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:09:59.945146 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:59.945153 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d38f10c-f077-4068-9337-a6b569f924fa-trusted-ca-bundle\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:09:59.945542 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:59.945162 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d38f10c-f077-4068-9337-a6b569f924fa-console-serving-cert\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:09:59.945542 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:59.945170 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d38f10c-f077-4068-9337-a6b569f924fa-oauth-serving-cert\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:09:59.945542 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:59.945178 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d38f10c-f077-4068-9337-a6b569f924fa-console-config\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:09:59.945542 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:09:59.945187 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d38f10c-f077-4068-9337-a6b569f924fa-console-oauth-config\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:10:00.046524 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:00.046491 2581 generic.go:356] "Generic (PLEG): container finished" podID="2d38f10c-f077-4068-9337-a6b569f924fa" containerID="b88adeb8ae9ab1cdd9d6da49723edf383c6fa34b6d28530d690526671014b0e8" exitCode=0 Jul 10 14:10:00.046692 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:00.046550 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-554d9d9d8c-gbnfr" Jul 10 14:10:00.046692 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:00.046558 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-554d9d9d8c-gbnfr" event={"ID":"2d38f10c-f077-4068-9337-a6b569f924fa","Type":"ContainerDied","Data":"b88adeb8ae9ab1cdd9d6da49723edf383c6fa34b6d28530d690526671014b0e8"} Jul 10 14:10:00.046692 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:00.046609 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-554d9d9d8c-gbnfr" event={"ID":"2d38f10c-f077-4068-9337-a6b569f924fa","Type":"ContainerDied","Data":"827cf1a40994e9cf60f23243cbc617862c8c9096569167ef4e358b3aabec61c6"} Jul 10 14:10:00.046692 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:00.046650 2581 scope.go:117] "RemoveContainer" containerID="b88adeb8ae9ab1cdd9d6da49723edf383c6fa34b6d28530d690526671014b0e8" Jul 10 14:10:00.060575 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:00.060559 2581 scope.go:117] "RemoveContainer" containerID="b88adeb8ae9ab1cdd9d6da49723edf383c6fa34b6d28530d690526671014b0e8" Jul 10 14:10:00.060819 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:10:00.060803 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b88adeb8ae9ab1cdd9d6da49723edf383c6fa34b6d28530d690526671014b0e8\": container with ID starting with b88adeb8ae9ab1cdd9d6da49723edf383c6fa34b6d28530d690526671014b0e8 not found: ID does not exist" containerID="b88adeb8ae9ab1cdd9d6da49723edf383c6fa34b6d28530d690526671014b0e8" Jul 10 14:10:00.060861 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:00.060826 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b88adeb8ae9ab1cdd9d6da49723edf383c6fa34b6d28530d690526671014b0e8"} err="failed to get container status \"b88adeb8ae9ab1cdd9d6da49723edf383c6fa34b6d28530d690526671014b0e8\": rpc error: code = NotFound desc = could not find container \"b88adeb8ae9ab1cdd9d6da49723edf383c6fa34b6d28530d690526671014b0e8\": container with ID starting with b88adeb8ae9ab1cdd9d6da49723edf383c6fa34b6d28530d690526671014b0e8 not found: ID does not exist" Jul 10 14:10:00.066875 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:00.066853 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-554d9d9d8c-gbnfr"] Jul 10 14:10:00.070434 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:00.070416 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-554d9d9d8c-gbnfr"] Jul 10 14:10:01.642230 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:01.642195 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d38f10c-f077-4068-9337-a6b569f924fa" path="/var/lib/kubelet/pods/2d38f10c-f077-4068-9337-a6b569f924fa/volumes" Jul 10 14:10:22.020794 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:22.020759 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wcvvb" Jul 10 14:10:28.185568 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:28.185535 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 14:10:28.185961 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:28.185796 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a59535cb-a172-4689-baa2-e972130283ce" containerName="alertmanager" containerID="cri-o://7be9752548a11361069ab8dd469a95c0da77d58a53fe329227776a7758b151d8" gracePeriod=120 Jul 10 14:10:28.185961 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:28.185882 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a59535cb-a172-4689-baa2-e972130283ce" containerName="kube-rbac-proxy-metric" containerID="cri-o://40172c04e578276bce2e37ea0147131bc487b70e1244698cfc04e159d752e96b" gracePeriod=120 Jul 10 14:10:28.185961 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:28.185908 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a59535cb-a172-4689-baa2-e972130283ce" containerName="prom-label-proxy" containerID="cri-o://7897d4ce1fbce53c5ac303e93a4c67f162b6799d928cf80252a2200163c37ae2" gracePeriod=120 Jul 10 14:10:28.186124 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:28.185945 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a59535cb-a172-4689-baa2-e972130283ce" containerName="kube-rbac-proxy" containerID="cri-o://13a44acc2051d9118ac0c0951c1b19ad4294f3ca5c71b960fb09bb639290e760" gracePeriod=120 Jul 10 14:10:28.186124 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:28.185912 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a59535cb-a172-4689-baa2-e972130283ce" containerName="kube-rbac-proxy-web" containerID="cri-o://74b51fa6e0b0cc944fc92a51f1de7cf1b6a810d0e0a7e97482d5d0ad788fbb7c" gracePeriod=120 Jul 10 14:10:28.186809 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:28.186507 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a59535cb-a172-4689-baa2-e972130283ce" containerName="config-reloader" containerID="cri-o://8e935f53f29af37b48e892b34f8572ae21bab43e2d1ae4588f7dbca9800a83b7" gracePeriod=120 Jul 10 14:10:29.152431 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.152401 2581 generic.go:356] "Generic (PLEG): container finished" podID="a59535cb-a172-4689-baa2-e972130283ce" containerID="7897d4ce1fbce53c5ac303e93a4c67f162b6799d928cf80252a2200163c37ae2" exitCode=0 Jul 10 14:10:29.152431 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.152426 2581 generic.go:356] "Generic (PLEG): container finished" podID="a59535cb-a172-4689-baa2-e972130283ce" containerID="40172c04e578276bce2e37ea0147131bc487b70e1244698cfc04e159d752e96b" exitCode=0 Jul 10 14:10:29.152431 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.152433 2581 generic.go:356] "Generic (PLEG): container finished" podID="a59535cb-a172-4689-baa2-e972130283ce" containerID="13a44acc2051d9118ac0c0951c1b19ad4294f3ca5c71b960fb09bb639290e760" exitCode=0 Jul 10 14:10:29.152431 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.152439 2581 generic.go:356] "Generic (PLEG): container finished" podID="a59535cb-a172-4689-baa2-e972130283ce" containerID="8e935f53f29af37b48e892b34f8572ae21bab43e2d1ae4588f7dbca9800a83b7" exitCode=0 Jul 10 14:10:29.152766 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.152444 2581 generic.go:356] "Generic (PLEG): container finished" podID="a59535cb-a172-4689-baa2-e972130283ce" containerID="7be9752548a11361069ab8dd469a95c0da77d58a53fe329227776a7758b151d8" exitCode=0 Jul 10 14:10:29.152766 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.152478 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a59535cb-a172-4689-baa2-e972130283ce","Type":"ContainerDied","Data":"7897d4ce1fbce53c5ac303e93a4c67f162b6799d928cf80252a2200163c37ae2"} Jul 10 14:10:29.152766 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.152557 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a59535cb-a172-4689-baa2-e972130283ce","Type":"ContainerDied","Data":"40172c04e578276bce2e37ea0147131bc487b70e1244698cfc04e159d752e96b"} Jul 10 14:10:29.152766 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.152596 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a59535cb-a172-4689-baa2-e972130283ce","Type":"ContainerDied","Data":"13a44acc2051d9118ac0c0951c1b19ad4294f3ca5c71b960fb09bb639290e760"} Jul 10 14:10:29.152766 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.152630 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a59535cb-a172-4689-baa2-e972130283ce","Type":"ContainerDied","Data":"8e935f53f29af37b48e892b34f8572ae21bab43e2d1ae4588f7dbca9800a83b7"} Jul 10 14:10:29.152766 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.152672 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a59535cb-a172-4689-baa2-e972130283ce","Type":"ContainerDied","Data":"7be9752548a11361069ab8dd469a95c0da77d58a53fe329227776a7758b151d8"} Jul 10 14:10:29.428938 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.428917 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:29.448103 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.448080 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a59535cb-a172-4689-baa2-e972130283ce-metrics-client-ca\") pod \"a59535cb-a172-4689-baa2-e972130283ce\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " Jul 10 14:10:29.448214 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.448113 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-secret-alertmanager-main-tls\") pod \"a59535cb-a172-4689-baa2-e972130283ce\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " Jul 10 14:10:29.448214 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.448136 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-secret-alertmanager-kube-rbac-proxy\") pod \"a59535cb-a172-4689-baa2-e972130283ce\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " Jul 10 14:10:29.448214 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.448161 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-config-volume\") pod \"a59535cb-a172-4689-baa2-e972130283ce\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " Jul 10 14:10:29.448214 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.448190 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cvc9\" (UniqueName: \"kubernetes.io/projected/a59535cb-a172-4689-baa2-e972130283ce-kube-api-access-5cvc9\") pod \"a59535cb-a172-4689-baa2-e972130283ce\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " Jul 10 14:10:29.448448 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.448216 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-web-config\") pod \"a59535cb-a172-4689-baa2-e972130283ce\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " Jul 10 14:10:29.448448 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.448250 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a59535cb-a172-4689-baa2-e972130283ce-alertmanager-trusted-ca-bundle\") pod \"a59535cb-a172-4689-baa2-e972130283ce\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " Jul 10 14:10:29.448448 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.448275 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-secret-alertmanager-kube-rbac-proxy-metric\") pod \"a59535cb-a172-4689-baa2-e972130283ce\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " Jul 10 14:10:29.448448 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.448306 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a59535cb-a172-4689-baa2-e972130283ce-tls-assets\") pod \"a59535cb-a172-4689-baa2-e972130283ce\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " Jul 10 14:10:29.448448 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.448394 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a59535cb-a172-4689-baa2-e972130283ce-alertmanager-main-db\") pod \"a59535cb-a172-4689-baa2-e972130283ce\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " Jul 10 14:10:29.448448 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.448423 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a59535cb-a172-4689-baa2-e972130283ce-config-out\") pod \"a59535cb-a172-4689-baa2-e972130283ce\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " Jul 10 14:10:29.448737 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.448472 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-secret-alertmanager-kube-rbac-proxy-web\") pod \"a59535cb-a172-4689-baa2-e972130283ce\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " Jul 10 14:10:29.448737 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.448503 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-cluster-tls-config\") pod \"a59535cb-a172-4689-baa2-e972130283ce\" (UID: \"a59535cb-a172-4689-baa2-e972130283ce\") " Jul 10 14:10:29.448737 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.448584 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a59535cb-a172-4689-baa2-e972130283ce-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "a59535cb-a172-4689-baa2-e972130283ce" (UID: "a59535cb-a172-4689-baa2-e972130283ce"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:10:29.448890 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.448764 2581 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a59535cb-a172-4689-baa2-e972130283ce-metrics-client-ca\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:10:29.448890 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.448828 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a59535cb-a172-4689-baa2-e972130283ce-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "a59535cb-a172-4689-baa2-e972130283ce" (UID: "a59535cb-a172-4689-baa2-e972130283ce"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:10:29.449278 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.449253 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a59535cb-a172-4689-baa2-e972130283ce-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "a59535cb-a172-4689-baa2-e972130283ce" (UID: "a59535cb-a172-4689-baa2-e972130283ce"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:10:29.451548 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.451501 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "a59535cb-a172-4689-baa2-e972130283ce" (UID: "a59535cb-a172-4689-baa2-e972130283ce"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:10:29.451752 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.451707 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a59535cb-a172-4689-baa2-e972130283ce-kube-api-access-5cvc9" (OuterVolumeSpecName: "kube-api-access-5cvc9") pod "a59535cb-a172-4689-baa2-e972130283ce" (UID: "a59535cb-a172-4689-baa2-e972130283ce"). InnerVolumeSpecName "kube-api-access-5cvc9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:10:29.451752 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.451736 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-config-volume" (OuterVolumeSpecName: "config-volume") pod "a59535cb-a172-4689-baa2-e972130283ce" (UID: "a59535cb-a172-4689-baa2-e972130283ce"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:10:29.451925 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.451898 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a59535cb-a172-4689-baa2-e972130283ce-config-out" (OuterVolumeSpecName: "config-out") pod "a59535cb-a172-4689-baa2-e972130283ce" (UID: "a59535cb-a172-4689-baa2-e972130283ce"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:10:29.451993 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.451963 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "a59535cb-a172-4689-baa2-e972130283ce" (UID: "a59535cb-a172-4689-baa2-e972130283ce"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:10:29.452501 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.452475 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "a59535cb-a172-4689-baa2-e972130283ce" (UID: "a59535cb-a172-4689-baa2-e972130283ce"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:10:29.453045 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.453024 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a59535cb-a172-4689-baa2-e972130283ce-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a59535cb-a172-4689-baa2-e972130283ce" (UID: "a59535cb-a172-4689-baa2-e972130283ce"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:10:29.453158 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.453138 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "a59535cb-a172-4689-baa2-e972130283ce" (UID: "a59535cb-a172-4689-baa2-e972130283ce"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:10:29.456933 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.456912 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "a59535cb-a172-4689-baa2-e972130283ce" (UID: "a59535cb-a172-4689-baa2-e972130283ce"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:10:29.464404 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.464382 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-web-config" (OuterVolumeSpecName: "web-config") pod "a59535cb-a172-4689-baa2-e972130283ce" (UID: "a59535cb-a172-4689-baa2-e972130283ce"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:10:29.549289 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.549255 2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a59535cb-a172-4689-baa2-e972130283ce-alertmanager-main-db\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:10:29.549289 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.549285 2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a59535cb-a172-4689-baa2-e972130283ce-config-out\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:10:29.549289 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.549295 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:10:29.549529 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.549304 2581 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-cluster-tls-config\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:10:29.549529 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.549313 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-secret-alertmanager-main-tls\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:10:29.549529 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.549339 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:10:29.549529 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.549347 2581 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-config-volume\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:10:29.549529 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.549355 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cvc9\" (UniqueName: \"kubernetes.io/projected/a59535cb-a172-4689-baa2-e972130283ce-kube-api-access-5cvc9\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:10:29.549529 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.549363 2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-web-config\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:10:29.549529 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.549371 2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a59535cb-a172-4689-baa2-e972130283ce-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:10:29.549529 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.549379 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a59535cb-a172-4689-baa2-e972130283ce-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:10:29.549529 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:29.549387 2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a59535cb-a172-4689-baa2-e972130283ce-tls-assets\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:10:30.158966 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.158934 2581 generic.go:356] "Generic (PLEG): container finished" podID="a59535cb-a172-4689-baa2-e972130283ce" containerID="74b51fa6e0b0cc944fc92a51f1de7cf1b6a810d0e0a7e97482d5d0ad788fbb7c" exitCode=0 Jul 10 14:10:30.159134 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.158987 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a59535cb-a172-4689-baa2-e972130283ce","Type":"ContainerDied","Data":"74b51fa6e0b0cc944fc92a51f1de7cf1b6a810d0e0a7e97482d5d0ad788fbb7c"} Jul 10 14:10:30.159134 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.159015 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.159134 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.159043 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a59535cb-a172-4689-baa2-e972130283ce","Type":"ContainerDied","Data":"7d646a6e9e171960e6c95786ed574d5f09c15dd1ea0c911d7145a8d970126e01"} Jul 10 14:10:30.159134 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.159077 2581 scope.go:117] "RemoveContainer" containerID="7897d4ce1fbce53c5ac303e93a4c67f162b6799d928cf80252a2200163c37ae2" Jul 10 14:10:30.170631 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.167245 2581 scope.go:117] "RemoveContainer" containerID="40172c04e578276bce2e37ea0147131bc487b70e1244698cfc04e159d752e96b" Jul 10 14:10:30.179460 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.179437 2581 scope.go:117] "RemoveContainer" containerID="13a44acc2051d9118ac0c0951c1b19ad4294f3ca5c71b960fb09bb639290e760" Jul 10 14:10:30.184868 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.184846 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 14:10:30.187118 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.187099 2581 scope.go:117] "RemoveContainer" containerID="74b51fa6e0b0cc944fc92a51f1de7cf1b6a810d0e0a7e97482d5d0ad788fbb7c" Jul 10 14:10:30.189559 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.189540 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 14:10:30.193739 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.193723 2581 scope.go:117] "RemoveContainer" containerID="8e935f53f29af37b48e892b34f8572ae21bab43e2d1ae4588f7dbca9800a83b7" Jul 10 14:10:30.200040 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.200026 2581 scope.go:117] "RemoveContainer" containerID="7be9752548a11361069ab8dd469a95c0da77d58a53fe329227776a7758b151d8" Jul 10 14:10:30.206536 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.206520 2581 scope.go:117] "RemoveContainer" containerID="d1b099f05efd74f5ff720e88ad70824d1e41f770b548b40c196602f6a2fed48e" Jul 10 14:10:30.213148 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.213130 2581 scope.go:117] "RemoveContainer" containerID="7897d4ce1fbce53c5ac303e93a4c67f162b6799d928cf80252a2200163c37ae2" Jul 10 14:10:30.213422 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:10:30.213403 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7897d4ce1fbce53c5ac303e93a4c67f162b6799d928cf80252a2200163c37ae2\": container with ID starting with 7897d4ce1fbce53c5ac303e93a4c67f162b6799d928cf80252a2200163c37ae2 not found: ID does not exist" containerID="7897d4ce1fbce53c5ac303e93a4c67f162b6799d928cf80252a2200163c37ae2" Jul 10 14:10:30.213470 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.213430 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7897d4ce1fbce53c5ac303e93a4c67f162b6799d928cf80252a2200163c37ae2"} err="failed to get container status \"7897d4ce1fbce53c5ac303e93a4c67f162b6799d928cf80252a2200163c37ae2\": rpc error: code = NotFound desc = could not find container \"7897d4ce1fbce53c5ac303e93a4c67f162b6799d928cf80252a2200163c37ae2\": container with ID starting with 7897d4ce1fbce53c5ac303e93a4c67f162b6799d928cf80252a2200163c37ae2 not found: ID does not exist" Jul 10 14:10:30.213470 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.213448 2581 scope.go:117] "RemoveContainer" containerID="40172c04e578276bce2e37ea0147131bc487b70e1244698cfc04e159d752e96b" Jul 10 14:10:30.213685 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:10:30.213669 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40172c04e578276bce2e37ea0147131bc487b70e1244698cfc04e159d752e96b\": container with ID starting with 40172c04e578276bce2e37ea0147131bc487b70e1244698cfc04e159d752e96b not found: ID does not exist" containerID="40172c04e578276bce2e37ea0147131bc487b70e1244698cfc04e159d752e96b" Jul 10 14:10:30.213726 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.213690 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40172c04e578276bce2e37ea0147131bc487b70e1244698cfc04e159d752e96b"} err="failed to get container status \"40172c04e578276bce2e37ea0147131bc487b70e1244698cfc04e159d752e96b\": rpc error: code = NotFound desc = could not find container \"40172c04e578276bce2e37ea0147131bc487b70e1244698cfc04e159d752e96b\": container with ID starting with 40172c04e578276bce2e37ea0147131bc487b70e1244698cfc04e159d752e96b not found: ID does not exist" Jul 10 14:10:30.213726 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.213705 2581 scope.go:117] "RemoveContainer" containerID="13a44acc2051d9118ac0c0951c1b19ad4294f3ca5c71b960fb09bb639290e760" Jul 10 14:10:30.213912 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:10:30.213896 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13a44acc2051d9118ac0c0951c1b19ad4294f3ca5c71b960fb09bb639290e760\": container with ID starting with 13a44acc2051d9118ac0c0951c1b19ad4294f3ca5c71b960fb09bb639290e760 not found: ID does not exist" containerID="13a44acc2051d9118ac0c0951c1b19ad4294f3ca5c71b960fb09bb639290e760" Jul 10 14:10:30.213949 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.213916 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13a44acc2051d9118ac0c0951c1b19ad4294f3ca5c71b960fb09bb639290e760"} err="failed to get container status \"13a44acc2051d9118ac0c0951c1b19ad4294f3ca5c71b960fb09bb639290e760\": rpc error: code = NotFound desc = could not find container \"13a44acc2051d9118ac0c0951c1b19ad4294f3ca5c71b960fb09bb639290e760\": container with ID starting with 13a44acc2051d9118ac0c0951c1b19ad4294f3ca5c71b960fb09bb639290e760 not found: ID does not exist" Jul 10 14:10:30.213949 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.213930 2581 scope.go:117] "RemoveContainer" containerID="74b51fa6e0b0cc944fc92a51f1de7cf1b6a810d0e0a7e97482d5d0ad788fbb7c" Jul 10 14:10:30.214144 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:10:30.214127 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74b51fa6e0b0cc944fc92a51f1de7cf1b6a810d0e0a7e97482d5d0ad788fbb7c\": container with ID starting with 74b51fa6e0b0cc944fc92a51f1de7cf1b6a810d0e0a7e97482d5d0ad788fbb7c not found: ID does not exist" containerID="74b51fa6e0b0cc944fc92a51f1de7cf1b6a810d0e0a7e97482d5d0ad788fbb7c" Jul 10 14:10:30.214186 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.214149 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74b51fa6e0b0cc944fc92a51f1de7cf1b6a810d0e0a7e97482d5d0ad788fbb7c"} err="failed to get container status \"74b51fa6e0b0cc944fc92a51f1de7cf1b6a810d0e0a7e97482d5d0ad788fbb7c\": rpc error: code = NotFound desc = could not find container \"74b51fa6e0b0cc944fc92a51f1de7cf1b6a810d0e0a7e97482d5d0ad788fbb7c\": container with ID starting with 74b51fa6e0b0cc944fc92a51f1de7cf1b6a810d0e0a7e97482d5d0ad788fbb7c not found: ID does not exist" Jul 10 14:10:30.214186 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.214164 2581 scope.go:117] "RemoveContainer" containerID="8e935f53f29af37b48e892b34f8572ae21bab43e2d1ae4588f7dbca9800a83b7" Jul 10 14:10:30.214394 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:10:30.214380 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e935f53f29af37b48e892b34f8572ae21bab43e2d1ae4588f7dbca9800a83b7\": container with ID starting with 8e935f53f29af37b48e892b34f8572ae21bab43e2d1ae4588f7dbca9800a83b7 not found: ID does not exist" containerID="8e935f53f29af37b48e892b34f8572ae21bab43e2d1ae4588f7dbca9800a83b7" Jul 10 14:10:30.214440 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.214398 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e935f53f29af37b48e892b34f8572ae21bab43e2d1ae4588f7dbca9800a83b7"} err="failed to get container status \"8e935f53f29af37b48e892b34f8572ae21bab43e2d1ae4588f7dbca9800a83b7\": rpc error: code = NotFound desc = could not find container \"8e935f53f29af37b48e892b34f8572ae21bab43e2d1ae4588f7dbca9800a83b7\": container with ID starting with 8e935f53f29af37b48e892b34f8572ae21bab43e2d1ae4588f7dbca9800a83b7 not found: ID does not exist" Jul 10 14:10:30.214440 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.214411 2581 scope.go:117] "RemoveContainer" containerID="7be9752548a11361069ab8dd469a95c0da77d58a53fe329227776a7758b151d8" Jul 10 14:10:30.214633 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:10:30.214618 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7be9752548a11361069ab8dd469a95c0da77d58a53fe329227776a7758b151d8\": container with ID starting with 7be9752548a11361069ab8dd469a95c0da77d58a53fe329227776a7758b151d8 not found: ID does not exist" containerID="7be9752548a11361069ab8dd469a95c0da77d58a53fe329227776a7758b151d8" Jul 10 14:10:30.214674 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.214637 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7be9752548a11361069ab8dd469a95c0da77d58a53fe329227776a7758b151d8"} err="failed to get container status \"7be9752548a11361069ab8dd469a95c0da77d58a53fe329227776a7758b151d8\": rpc error: code = NotFound desc = could not find container \"7be9752548a11361069ab8dd469a95c0da77d58a53fe329227776a7758b151d8\": container with ID starting with 7be9752548a11361069ab8dd469a95c0da77d58a53fe329227776a7758b151d8 not found: ID does not exist" Jul 10 14:10:30.214674 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.214650 2581 scope.go:117] "RemoveContainer" containerID="d1b099f05efd74f5ff720e88ad70824d1e41f770b548b40c196602f6a2fed48e" Jul 10 14:10:30.214871 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:10:30.214855 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1b099f05efd74f5ff720e88ad70824d1e41f770b548b40c196602f6a2fed48e\": container with ID starting with d1b099f05efd74f5ff720e88ad70824d1e41f770b548b40c196602f6a2fed48e not found: ID does not exist" containerID="d1b099f05efd74f5ff720e88ad70824d1e41f770b548b40c196602f6a2fed48e" Jul 10 14:10:30.214911 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.214875 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1b099f05efd74f5ff720e88ad70824d1e41f770b548b40c196602f6a2fed48e"} err="failed to get container status \"d1b099f05efd74f5ff720e88ad70824d1e41f770b548b40c196602f6a2fed48e\": rpc error: code = NotFound desc = could not find container \"d1b099f05efd74f5ff720e88ad70824d1e41f770b548b40c196602f6a2fed48e\": container with ID starting with d1b099f05efd74f5ff720e88ad70824d1e41f770b548b40c196602f6a2fed48e not found: ID does not exist" Jul 10 14:10:30.219413 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.219392 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 14:10:30.219679 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.219664 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a59535cb-a172-4689-baa2-e972130283ce" containerName="alertmanager" Jul 10 14:10:30.219748 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.219682 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a59535cb-a172-4689-baa2-e972130283ce" containerName="alertmanager" Jul 10 14:10:30.219748 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.219693 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a59535cb-a172-4689-baa2-e972130283ce" containerName="kube-rbac-proxy-web" Jul 10 14:10:30.219748 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.219702 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a59535cb-a172-4689-baa2-e972130283ce" containerName="kube-rbac-proxy-web" Jul 10 14:10:30.219748 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.219722 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a59535cb-a172-4689-baa2-e972130283ce" containerName="prom-label-proxy" Jul 10 14:10:30.219748 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.219731 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a59535cb-a172-4689-baa2-e972130283ce" containerName="prom-label-proxy" Jul 10 14:10:30.219748 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.219740 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a59535cb-a172-4689-baa2-e972130283ce" containerName="init-config-reloader" Jul 10 14:10:30.219748 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.219748 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a59535cb-a172-4689-baa2-e972130283ce" containerName="init-config-reloader" Jul 10 14:10:30.220069 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.219758 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a59535cb-a172-4689-baa2-e972130283ce" containerName="kube-rbac-proxy-metric" Jul 10 14:10:30.220069 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.219766 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a59535cb-a172-4689-baa2-e972130283ce" containerName="kube-rbac-proxy-metric" Jul 10 14:10:30.220069 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.219780 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d38f10c-f077-4068-9337-a6b569f924fa" containerName="console" Jul 10 14:10:30.220069 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.219788 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d38f10c-f077-4068-9337-a6b569f924fa" containerName="console" Jul 10 14:10:30.220069 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.219797 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a59535cb-a172-4689-baa2-e972130283ce" containerName="config-reloader" Jul 10 14:10:30.220069 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.219805 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a59535cb-a172-4689-baa2-e972130283ce" containerName="config-reloader" Jul 10 14:10:30.220069 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.219815 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a59535cb-a172-4689-baa2-e972130283ce" containerName="kube-rbac-proxy" Jul 10 14:10:30.220069 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.219823 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a59535cb-a172-4689-baa2-e972130283ce" containerName="kube-rbac-proxy" Jul 10 14:10:30.220069 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.219887 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a59535cb-a172-4689-baa2-e972130283ce" containerName="kube-rbac-proxy" Jul 10 14:10:30.220069 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.219898 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a59535cb-a172-4689-baa2-e972130283ce" containerName="alertmanager" Jul 10 14:10:30.220069 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.219907 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a59535cb-a172-4689-baa2-e972130283ce" containerName="prom-label-proxy" Jul 10 14:10:30.220069 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.219915 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a59535cb-a172-4689-baa2-e972130283ce" containerName="kube-rbac-proxy-web" Jul 10 14:10:30.220069 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.219925 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d38f10c-f077-4068-9337-a6b569f924fa" containerName="console" Jul 10 14:10:30.220069 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.219935 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a59535cb-a172-4689-baa2-e972130283ce" containerName="config-reloader" Jul 10 14:10:30.220069 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.219943 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a59535cb-a172-4689-baa2-e972130283ce" containerName="kube-rbac-proxy-metric" Jul 10 14:10:30.223838 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.223821 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.226722 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.226696 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 10 14:10:30.226843 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.226769 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 10 14:10:30.226843 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.226800 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 10 14:10:30.226843 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.226824 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 10 14:10:30.227071 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.227056 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 10 14:10:30.227071 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.227066 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tpd9l\"" Jul 10 14:10:30.227306 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.227293 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 10 14:10:30.227388 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.227307 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 10 14:10:30.227574 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.227560 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 10 14:10:30.232879 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.232863 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 10 14:10:30.238310 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.238292 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 14:10:30.254167 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.254148 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.254253 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.254174 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.254253 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.254193 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.254253 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.254214 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.254253 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.254238 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.254412 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.254259 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-467b7\" (UniqueName: \"kubernetes.io/projected/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-kube-api-access-467b7\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.254412 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.254279 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-web-config\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.254412 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.254294 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-config-out\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.254412 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.254332 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.254412 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.254354 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-config-volume\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.254412 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.254372 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.254412 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.254389 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.254412 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.254405 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.355453 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.355420 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.355453 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.355454 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.355639 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.355473 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.355639 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.355496 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.355639 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.355522 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.355639 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.355539 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-467b7\" (UniqueName: \"kubernetes.io/projected/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-kube-api-access-467b7\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.355639 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.355560 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-web-config\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.355639 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.355575 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-config-out\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.355639 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.355598 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.355639 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.355620 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-config-volume\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.355959 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.355647 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.356013 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.355970 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.356063 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.356010 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.356711 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.356382 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.356824 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.356754 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.357159 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.357133 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.358895 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.358861 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.359048 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.359025 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-config-volume\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.359132 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.359054 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-config-out\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.359198 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.359184 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.359403 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.359386 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.359471 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.359391 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.359471 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.359428 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.359747 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.359734 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-web-config\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.360807 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.360792 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.364139 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.364116 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-467b7\" (UniqueName: \"kubernetes.io/projected/208f5dfa-a108-4ceb-bc36-e7eb285acaa2-kube-api-access-467b7\") pod \"alertmanager-main-0\" (UID: \"208f5dfa-a108-4ceb-bc36-e7eb285acaa2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.533609 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.533587 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:10:30.666606 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:30.666567 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 14:10:30.669688 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:10:30.669661 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod208f5dfa_a108_4ceb_bc36_e7eb285acaa2.slice/crio-22f1b318c2f6e0bc778dc983d9a4d20e0ea37aae24d62e389966d3eebe3019d0 WatchSource:0}: Error finding container 22f1b318c2f6e0bc778dc983d9a4d20e0ea37aae24d62e389966d3eebe3019d0: Status 404 returned error can't find the container with id 22f1b318c2f6e0bc778dc983d9a4d20e0ea37aae24d62e389966d3eebe3019d0 Jul 10 14:10:31.164990 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:31.164953 2581 generic.go:356] "Generic (PLEG): container finished" podID="208f5dfa-a108-4ceb-bc36-e7eb285acaa2" containerID="b2733f3e6ca63f0ffe2fcee4e9d1b5d38bf052130ba58a8f7e1a20660cd0e6c1" exitCode=0 Jul 10 14:10:31.165149 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:31.165040 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"208f5dfa-a108-4ceb-bc36-e7eb285acaa2","Type":"ContainerDied","Data":"b2733f3e6ca63f0ffe2fcee4e9d1b5d38bf052130ba58a8f7e1a20660cd0e6c1"} Jul 10 14:10:31.165149 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:31.165110 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"208f5dfa-a108-4ceb-bc36-e7eb285acaa2","Type":"ContainerStarted","Data":"22f1b318c2f6e0bc778dc983d9a4d20e0ea37aae24d62e389966d3eebe3019d0"} Jul 10 14:10:31.642499 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:31.642457 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a59535cb-a172-4689-baa2-e972130283ce" path="/var/lib/kubelet/pods/a59535cb-a172-4689-baa2-e972130283ce/volumes" Jul 10 14:10:31.812421 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:31.812381 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59985bb565-775x4"] Jul 10 14:10:31.815107 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:31.815087 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59985bb565-775x4" Jul 10 14:10:31.828051 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:31.828021 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59985bb565-775x4"] Jul 10 14:10:31.867235 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:31.867202 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8bf29380-e778-4274-bb82-744156dd0ee5-console-oauth-config\") pod \"console-59985bb565-775x4\" (UID: \"8bf29380-e778-4274-bb82-744156dd0ee5\") " pod="openshift-console/console-59985bb565-775x4" Jul 10 14:10:31.867235 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:31.867237 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8bf29380-e778-4274-bb82-744156dd0ee5-oauth-serving-cert\") pod \"console-59985bb565-775x4\" (UID: \"8bf29380-e778-4274-bb82-744156dd0ee5\") " pod="openshift-console/console-59985bb565-775x4" Jul 10 14:10:31.867501 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:31.867265 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bf29380-e778-4274-bb82-744156dd0ee5-trusted-ca-bundle\") pod \"console-59985bb565-775x4\" (UID: \"8bf29380-e778-4274-bb82-744156dd0ee5\") " pod="openshift-console/console-59985bb565-775x4" Jul 10 14:10:31.867501 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:31.867288 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sff4s\" (UniqueName: \"kubernetes.io/projected/8bf29380-e778-4274-bb82-744156dd0ee5-kube-api-access-sff4s\") pod \"console-59985bb565-775x4\" (UID: \"8bf29380-e778-4274-bb82-744156dd0ee5\") " pod="openshift-console/console-59985bb565-775x4" Jul 10 14:10:31.867501 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:31.867357 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8bf29380-e778-4274-bb82-744156dd0ee5-console-config\") pod \"console-59985bb565-775x4\" (UID: \"8bf29380-e778-4274-bb82-744156dd0ee5\") " pod="openshift-console/console-59985bb565-775x4" Jul 10 14:10:31.867501 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:31.867404 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8bf29380-e778-4274-bb82-744156dd0ee5-console-serving-cert\") pod \"console-59985bb565-775x4\" (UID: \"8bf29380-e778-4274-bb82-744156dd0ee5\") " pod="openshift-console/console-59985bb565-775x4" Jul 10 14:10:31.867501 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:31.867430 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8bf29380-e778-4274-bb82-744156dd0ee5-service-ca\") pod \"console-59985bb565-775x4\" (UID: \"8bf29380-e778-4274-bb82-744156dd0ee5\") " pod="openshift-console/console-59985bb565-775x4" Jul 10 14:10:31.968285 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:31.968238 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bf29380-e778-4274-bb82-744156dd0ee5-trusted-ca-bundle\") pod \"console-59985bb565-775x4\" (UID: \"8bf29380-e778-4274-bb82-744156dd0ee5\") " pod="openshift-console/console-59985bb565-775x4" Jul 10 14:10:31.968453 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:31.968292 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sff4s\" (UniqueName: \"kubernetes.io/projected/8bf29380-e778-4274-bb82-744156dd0ee5-kube-api-access-sff4s\") pod \"console-59985bb565-775x4\" (UID: \"8bf29380-e778-4274-bb82-744156dd0ee5\") " pod="openshift-console/console-59985bb565-775x4" Jul 10 14:10:31.968453 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:31.968353 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8bf29380-e778-4274-bb82-744156dd0ee5-console-config\") pod \"console-59985bb565-775x4\" (UID: \"8bf29380-e778-4274-bb82-744156dd0ee5\") " pod="openshift-console/console-59985bb565-775x4" Jul 10 14:10:31.968453 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:31.968401 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8bf29380-e778-4274-bb82-744156dd0ee5-console-serving-cert\") pod \"console-59985bb565-775x4\" (UID: \"8bf29380-e778-4274-bb82-744156dd0ee5\") " pod="openshift-console/console-59985bb565-775x4" Jul 10 14:10:31.968453 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:31.968438 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8bf29380-e778-4274-bb82-744156dd0ee5-service-ca\") pod \"console-59985bb565-775x4\" (UID: \"8bf29380-e778-4274-bb82-744156dd0ee5\") " pod="openshift-console/console-59985bb565-775x4" Jul 10 14:10:31.968653 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:31.968532 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8bf29380-e778-4274-bb82-744156dd0ee5-console-oauth-config\") pod \"console-59985bb565-775x4\" (UID: \"8bf29380-e778-4274-bb82-744156dd0ee5\") " pod="openshift-console/console-59985bb565-775x4" Jul 10 14:10:31.968653 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:31.968558 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8bf29380-e778-4274-bb82-744156dd0ee5-oauth-serving-cert\") pod \"console-59985bb565-775x4\" (UID: \"8bf29380-e778-4274-bb82-744156dd0ee5\") " pod="openshift-console/console-59985bb565-775x4" Jul 10 14:10:31.969129 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:31.969097 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8bf29380-e778-4274-bb82-744156dd0ee5-console-config\") pod \"console-59985bb565-775x4\" (UID: \"8bf29380-e778-4274-bb82-744156dd0ee5\") " pod="openshift-console/console-59985bb565-775x4" Jul 10 14:10:31.969275 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:31.969186 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8bf29380-e778-4274-bb82-744156dd0ee5-service-ca\") pod \"console-59985bb565-775x4\" (UID: \"8bf29380-e778-4274-bb82-744156dd0ee5\") " pod="openshift-console/console-59985bb565-775x4" Jul 10 14:10:31.969275 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:31.969232 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bf29380-e778-4274-bb82-744156dd0ee5-trusted-ca-bundle\") pod \"console-59985bb565-775x4\" (UID: \"8bf29380-e778-4274-bb82-744156dd0ee5\") " pod="openshift-console/console-59985bb565-775x4" Jul 10 14:10:31.969394 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:31.969338 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8bf29380-e778-4274-bb82-744156dd0ee5-oauth-serving-cert\") pod \"console-59985bb565-775x4\" (UID: \"8bf29380-e778-4274-bb82-744156dd0ee5\") " pod="openshift-console/console-59985bb565-775x4" Jul 10 14:10:31.971382 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:31.971355 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8bf29380-e778-4274-bb82-744156dd0ee5-console-serving-cert\") pod \"console-59985bb565-775x4\" (UID: \"8bf29380-e778-4274-bb82-744156dd0ee5\") " pod="openshift-console/console-59985bb565-775x4" Jul 10 14:10:31.971473 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:31.971382 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8bf29380-e778-4274-bb82-744156dd0ee5-console-oauth-config\") pod \"console-59985bb565-775x4\" (UID: \"8bf29380-e778-4274-bb82-744156dd0ee5\") " pod="openshift-console/console-59985bb565-775x4" Jul 10 14:10:31.977819 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:31.977795 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sff4s\" (UniqueName: \"kubernetes.io/projected/8bf29380-e778-4274-bb82-744156dd0ee5-kube-api-access-sff4s\") pod \"console-59985bb565-775x4\" (UID: \"8bf29380-e778-4274-bb82-744156dd0ee5\") " pod="openshift-console/console-59985bb565-775x4" Jul 10 14:10:32.124815 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:32.124725 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59985bb565-775x4" Jul 10 14:10:32.173136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:32.172839 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"208f5dfa-a108-4ceb-bc36-e7eb285acaa2","Type":"ContainerStarted","Data":"f2dacd3251f9ef9424ea1bd46de6f6c0794e5985506c5673be7cb423429e80f4"} Jul 10 14:10:32.173136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:32.172907 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"208f5dfa-a108-4ceb-bc36-e7eb285acaa2","Type":"ContainerStarted","Data":"42ed832867e2127892199b7bf929afc5d5abc617629299f38dc8c5b790d57087"} Jul 10 14:10:32.173136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:32.172933 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"208f5dfa-a108-4ceb-bc36-e7eb285acaa2","Type":"ContainerStarted","Data":"3fe52515b385df3580105f956f064f80b9c0033130976a075274a947e2ef729b"} Jul 10 14:10:32.173136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:32.172958 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"208f5dfa-a108-4ceb-bc36-e7eb285acaa2","Type":"ContainerStarted","Data":"6e06cc3b1cead627f089b5e696c7a029eb2e301dc6b240fe682690eabda42797"} Jul 10 14:10:32.173136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:32.173004 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"208f5dfa-a108-4ceb-bc36-e7eb285acaa2","Type":"ContainerStarted","Data":"11b6f4d2a00029557e9df98f6ff9f5184d98b37c6aae31b26ba6ad6b991b9a17"} Jul 10 14:10:32.173136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:32.173029 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"208f5dfa-a108-4ceb-bc36-e7eb285acaa2","Type":"ContainerStarted","Data":"c0724381cb6f6b6af6cbfdc742e64c10c2fe9f5df6174a9b739c5a94ab67bec7"} Jul 10 14:10:32.199625 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:32.199560 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.180392036 podStartE2EDuration="2.199540136s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.1481ms" isStatefulPod=false podCreationTimestamp="2026-07-10 14:10:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:10:32.198097167 +0000 UTC m=+115.141669531" watchObservedRunningTime="2026-07-10 14:10:32.199540136 +0000 UTC m=+115.143112480" Jul 10 14:10:32.260234 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:32.260198 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59985bb565-775x4"] Jul 10 14:10:32.263840 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:10:32.263811 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bf29380_e778_4274_bb82_744156dd0ee5.slice/crio-648ae7fd86f0265c32ca6a6241e8beca0b30d0508d5cbd54594b8fa042798ae5 WatchSource:0}: Error finding container 648ae7fd86f0265c32ca6a6241e8beca0b30d0508d5cbd54594b8fa042798ae5: Status 404 returned error can't find the container with id 648ae7fd86f0265c32ca6a6241e8beca0b30d0508d5cbd54594b8fa042798ae5 Jul 10 14:10:33.178577 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:33.178536 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59985bb565-775x4" event={"ID":"8bf29380-e778-4274-bb82-744156dd0ee5","Type":"ContainerStarted","Data":"59bbc90ab3035daa2d87668fffecd1f9ddd949edc659b3ad0b873dccbbd78654"} Jul 10 14:10:33.179021 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:33.178589 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59985bb565-775x4" event={"ID":"8bf29380-e778-4274-bb82-744156dd0ee5","Type":"ContainerStarted","Data":"648ae7fd86f0265c32ca6a6241e8beca0b30d0508d5cbd54594b8fa042798ae5"} Jul 10 14:10:33.197464 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:33.197417 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59985bb565-775x4" podStartSLOduration=2.197400286 podStartE2EDuration="2.197400286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:10:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:10:33.196845052 +0000 UTC m=+116.140417418" watchObservedRunningTime="2026-07-10 14:10:33.197400286 +0000 UTC m=+116.140972627" Jul 10 14:10:42.125773 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:42.125723 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59985bb565-775x4" Jul 10 14:10:42.125773 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:42.125791 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59985bb565-775x4" Jul 10 14:10:42.130444 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:42.130418 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59985bb565-775x4" Jul 10 14:10:42.214492 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:42.214466 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59985bb565-775x4" Jul 10 14:10:42.267949 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:10:42.267915 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7db8dc7d46-lt9qb"] Jul 10 14:11:07.288961 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:07.288901 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7db8dc7d46-lt9qb" podUID="90ae30f7-6a28-4242-a02d-733e65772872" containerName="console" containerID="cri-o://8a46c11f8f5760e4cdc3f32ffcbffcc031a0c32f77ea4edd3566195eca542031" gracePeriod=15 Jul 10 14:11:07.527518 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:07.527497 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7db8dc7d46-lt9qb" Jul 10 14:11:07.651941 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:07.651867 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90ae30f7-6a28-4242-a02d-733e65772872-service-ca\") pod \"90ae30f7-6a28-4242-a02d-733e65772872\" (UID: \"90ae30f7-6a28-4242-a02d-733e65772872\") " Jul 10 14:11:07.651941 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:07.651915 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90ae30f7-6a28-4242-a02d-733e65772872-trusted-ca-bundle\") pod \"90ae30f7-6a28-4242-a02d-733e65772872\" (UID: \"90ae30f7-6a28-4242-a02d-733e65772872\") " Jul 10 14:11:07.652094 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:07.651944 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90ae30f7-6a28-4242-a02d-733e65772872-console-config\") pod \"90ae30f7-6a28-4242-a02d-733e65772872\" (UID: \"90ae30f7-6a28-4242-a02d-733e65772872\") " Jul 10 14:11:07.652094 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:07.651973 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6rlh\" (UniqueName: \"kubernetes.io/projected/90ae30f7-6a28-4242-a02d-733e65772872-kube-api-access-x6rlh\") pod \"90ae30f7-6a28-4242-a02d-733e65772872\" (UID: \"90ae30f7-6a28-4242-a02d-733e65772872\") " Jul 10 14:11:07.652094 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:07.652008 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90ae30f7-6a28-4242-a02d-733e65772872-console-serving-cert\") pod \"90ae30f7-6a28-4242-a02d-733e65772872\" (UID: \"90ae30f7-6a28-4242-a02d-733e65772872\") " Jul 10 14:11:07.652094 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:07.652079 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90ae30f7-6a28-4242-a02d-733e65772872-console-oauth-config\") pod \"90ae30f7-6a28-4242-a02d-733e65772872\" (UID: \"90ae30f7-6a28-4242-a02d-733e65772872\") " Jul 10 14:11:07.652292 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:07.652105 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90ae30f7-6a28-4242-a02d-733e65772872-oauth-serving-cert\") pod \"90ae30f7-6a28-4242-a02d-733e65772872\" (UID: \"90ae30f7-6a28-4242-a02d-733e65772872\") " Jul 10 14:11:07.652526 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:07.652402 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90ae30f7-6a28-4242-a02d-733e65772872-console-config" (OuterVolumeSpecName: "console-config") pod "90ae30f7-6a28-4242-a02d-733e65772872" (UID: "90ae30f7-6a28-4242-a02d-733e65772872"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:11:07.652526 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:07.652365 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90ae30f7-6a28-4242-a02d-733e65772872-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "90ae30f7-6a28-4242-a02d-733e65772872" (UID: "90ae30f7-6a28-4242-a02d-733e65772872"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:11:07.652674 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:07.652528 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90ae30f7-6a28-4242-a02d-733e65772872-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "90ae30f7-6a28-4242-a02d-733e65772872" (UID: "90ae30f7-6a28-4242-a02d-733e65772872"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:11:07.652674 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:07.652563 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90ae30f7-6a28-4242-a02d-733e65772872-service-ca" (OuterVolumeSpecName: "service-ca") pod "90ae30f7-6a28-4242-a02d-733e65772872" (UID: "90ae30f7-6a28-4242-a02d-733e65772872"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:11:07.654262 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:07.654230 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90ae30f7-6a28-4242-a02d-733e65772872-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "90ae30f7-6a28-4242-a02d-733e65772872" (UID: "90ae30f7-6a28-4242-a02d-733e65772872"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:11:07.654262 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:07.654236 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90ae30f7-6a28-4242-a02d-733e65772872-kube-api-access-x6rlh" (OuterVolumeSpecName: "kube-api-access-x6rlh") pod "90ae30f7-6a28-4242-a02d-733e65772872" (UID: "90ae30f7-6a28-4242-a02d-733e65772872"). InnerVolumeSpecName "kube-api-access-x6rlh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:11:07.654457 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:07.654298 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90ae30f7-6a28-4242-a02d-733e65772872-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "90ae30f7-6a28-4242-a02d-733e65772872" (UID: "90ae30f7-6a28-4242-a02d-733e65772872"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:11:07.753619 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:07.753594 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90ae30f7-6a28-4242-a02d-733e65772872-console-oauth-config\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:11:07.753619 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:07.753615 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90ae30f7-6a28-4242-a02d-733e65772872-oauth-serving-cert\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:11:07.753769 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:07.753626 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90ae30f7-6a28-4242-a02d-733e65772872-service-ca\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:11:07.753769 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:07.753635 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90ae30f7-6a28-4242-a02d-733e65772872-trusted-ca-bundle\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:11:07.753769 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:07.753642 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90ae30f7-6a28-4242-a02d-733e65772872-console-config\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:11:07.753769 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:07.753651 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6rlh\" (UniqueName: \"kubernetes.io/projected/90ae30f7-6a28-4242-a02d-733e65772872-kube-api-access-x6rlh\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:11:07.753769 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:07.753659 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90ae30f7-6a28-4242-a02d-733e65772872-console-serving-cert\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:11:08.301635 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:08.301603 2581 generic.go:356] "Generic (PLEG): container finished" podID="90ae30f7-6a28-4242-a02d-733e65772872" containerID="8a46c11f8f5760e4cdc3f32ffcbffcc031a0c32f77ea4edd3566195eca542031" exitCode=0 Jul 10 14:11:08.302050 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:08.301649 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7db8dc7d46-lt9qb" Jul 10 14:11:08.302050 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:08.301654 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7db8dc7d46-lt9qb" event={"ID":"90ae30f7-6a28-4242-a02d-733e65772872","Type":"ContainerDied","Data":"8a46c11f8f5760e4cdc3f32ffcbffcc031a0c32f77ea4edd3566195eca542031"} Jul 10 14:11:08.302050 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:08.301694 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7db8dc7d46-lt9qb" event={"ID":"90ae30f7-6a28-4242-a02d-733e65772872","Type":"ContainerDied","Data":"f699f32f59c903f881f73e1e6500430054e60cf3bb811d015af5e783849a8318"} Jul 10 14:11:08.302050 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:08.301713 2581 scope.go:117] "RemoveContainer" containerID="8a46c11f8f5760e4cdc3f32ffcbffcc031a0c32f77ea4edd3566195eca542031" Jul 10 14:11:08.309671 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:08.309653 2581 scope.go:117] "RemoveContainer" containerID="8a46c11f8f5760e4cdc3f32ffcbffcc031a0c32f77ea4edd3566195eca542031" Jul 10 14:11:08.309929 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:11:08.309912 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a46c11f8f5760e4cdc3f32ffcbffcc031a0c32f77ea4edd3566195eca542031\": container with ID starting with 8a46c11f8f5760e4cdc3f32ffcbffcc031a0c32f77ea4edd3566195eca542031 not found: ID does not exist" containerID="8a46c11f8f5760e4cdc3f32ffcbffcc031a0c32f77ea4edd3566195eca542031" Jul 10 14:11:08.309986 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:08.309937 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a46c11f8f5760e4cdc3f32ffcbffcc031a0c32f77ea4edd3566195eca542031"} err="failed to get container status \"8a46c11f8f5760e4cdc3f32ffcbffcc031a0c32f77ea4edd3566195eca542031\": rpc error: code = NotFound desc = could not find container \"8a46c11f8f5760e4cdc3f32ffcbffcc031a0c32f77ea4edd3566195eca542031\": container with ID starting with 8a46c11f8f5760e4cdc3f32ffcbffcc031a0c32f77ea4edd3566195eca542031 not found: ID does not exist" Jul 10 14:11:08.322134 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:08.322107 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7db8dc7d46-lt9qb"] Jul 10 14:11:08.326743 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:08.326723 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7db8dc7d46-lt9qb"] Jul 10 14:11:09.642049 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:09.642020 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90ae30f7-6a28-4242-a02d-733e65772872" path="/var/lib/kubelet/pods/90ae30f7-6a28-4242-a02d-733e65772872/volumes" Jul 10 14:11:22.731616 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:22.731578 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dsqf6"] Jul 10 14:11:22.732167 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:22.731959 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90ae30f7-6a28-4242-a02d-733e65772872" containerName="console" Jul 10 14:11:22.732167 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:22.731976 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="90ae30f7-6a28-4242-a02d-733e65772872" containerName="console" Jul 10 14:11:22.732167 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:22.732050 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="90ae30f7-6a28-4242-a02d-733e65772872" containerName="console" Jul 10 14:11:22.736543 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:22.736521 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dsqf6" Jul 10 14:11:22.739332 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:22.739291 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 10 14:11:22.739332 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:22.739312 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-82ht9\"" Jul 10 14:11:22.740478 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:22.740464 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 10 14:11:22.754879 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:22.754856 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dsqf6"] Jul 10 14:11:22.865809 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:22.865783 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f75a589-921c-433f-8f37-93d58abf8cd1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dsqf6\" (UID: \"6f75a589-921c-433f-8f37-93d58abf8cd1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dsqf6" Jul 10 14:11:22.865959 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:22.865834 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f75a589-921c-433f-8f37-93d58abf8cd1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dsqf6\" (UID: \"6f75a589-921c-433f-8f37-93d58abf8cd1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dsqf6" Jul 10 14:11:22.865959 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:22.865893 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxwtv\" (UniqueName: \"kubernetes.io/projected/6f75a589-921c-433f-8f37-93d58abf8cd1-kube-api-access-sxwtv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dsqf6\" (UID: \"6f75a589-921c-433f-8f37-93d58abf8cd1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dsqf6" Jul 10 14:11:22.966880 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:22.966839 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f75a589-921c-433f-8f37-93d58abf8cd1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dsqf6\" (UID: \"6f75a589-921c-433f-8f37-93d58abf8cd1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dsqf6" Jul 10 14:11:22.967057 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:22.966931 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxwtv\" (UniqueName: \"kubernetes.io/projected/6f75a589-921c-433f-8f37-93d58abf8cd1-kube-api-access-sxwtv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dsqf6\" (UID: \"6f75a589-921c-433f-8f37-93d58abf8cd1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dsqf6" Jul 10 14:11:22.967057 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:22.966974 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f75a589-921c-433f-8f37-93d58abf8cd1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dsqf6\" (UID: \"6f75a589-921c-433f-8f37-93d58abf8cd1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dsqf6" Jul 10 14:11:22.967264 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:22.967238 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f75a589-921c-433f-8f37-93d58abf8cd1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dsqf6\" (UID: \"6f75a589-921c-433f-8f37-93d58abf8cd1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dsqf6" Jul 10 14:11:22.967417 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:22.967266 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f75a589-921c-433f-8f37-93d58abf8cd1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dsqf6\" (UID: \"6f75a589-921c-433f-8f37-93d58abf8cd1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dsqf6" Jul 10 14:11:22.976639 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:22.976611 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxwtv\" (UniqueName: \"kubernetes.io/projected/6f75a589-921c-433f-8f37-93d58abf8cd1-kube-api-access-sxwtv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dsqf6\" (UID: \"6f75a589-921c-433f-8f37-93d58abf8cd1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dsqf6" Jul 10 14:11:23.045190 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:23.045170 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dsqf6" Jul 10 14:11:23.172209 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:23.172179 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dsqf6"] Jul 10 14:11:23.174453 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:11:23.174426 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f75a589_921c_433f_8f37_93d58abf8cd1.slice/crio-299b40e3992c22dcb37fa1a91396dca14493de5dcb0de4ccbd4509fb9948010c WatchSource:0}: Error finding container 299b40e3992c22dcb37fa1a91396dca14493de5dcb0de4ccbd4509fb9948010c: Status 404 returned error can't find the container with id 299b40e3992c22dcb37fa1a91396dca14493de5dcb0de4ccbd4509fb9948010c Jul 10 14:11:23.356640 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:23.356555 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dsqf6" event={"ID":"6f75a589-921c-433f-8f37-93d58abf8cd1","Type":"ContainerStarted","Data":"299b40e3992c22dcb37fa1a91396dca14493de5dcb0de4ccbd4509fb9948010c"} Jul 10 14:11:32.394082 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:32.394043 2581 generic.go:356] "Generic (PLEG): container finished" podID="6f75a589-921c-433f-8f37-93d58abf8cd1" containerID="b81cae5091bed9cfe760a7ca2185c1dc65ea5eb741aec15db0da62ec31c2a513" exitCode=0 Jul 10 14:11:32.394508 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:32.394128 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dsqf6" event={"ID":"6f75a589-921c-433f-8f37-93d58abf8cd1","Type":"ContainerDied","Data":"b81cae5091bed9cfe760a7ca2185c1dc65ea5eb741aec15db0da62ec31c2a513"} Jul 10 14:11:34.403958 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:34.403928 2581 generic.go:356] "Generic (PLEG): container finished" podID="6f75a589-921c-433f-8f37-93d58abf8cd1" containerID="c7e2ae590e5a1ae07518d36edcc6ffa4ed8698471b68935d2054258054b91815" exitCode=0 Jul 10 14:11:34.404287 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:34.403991 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dsqf6" event={"ID":"6f75a589-921c-433f-8f37-93d58abf8cd1","Type":"ContainerDied","Data":"c7e2ae590e5a1ae07518d36edcc6ffa4ed8698471b68935d2054258054b91815"} Jul 10 14:11:46.455536 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:46.455505 2581 generic.go:356] "Generic (PLEG): container finished" podID="6f75a589-921c-433f-8f37-93d58abf8cd1" containerID="95c3ee3959e7d2aaaddfdb2aa18db1acd2a90cf0c41d5ef3a274a845994e9cc7" exitCode=0 Jul 10 14:11:46.455897 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:46.455581 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dsqf6" event={"ID":"6f75a589-921c-433f-8f37-93d58abf8cd1","Type":"ContainerDied","Data":"95c3ee3959e7d2aaaddfdb2aa18db1acd2a90cf0c41d5ef3a274a845994e9cc7"} Jul 10 14:11:47.597048 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:47.597020 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dsqf6" Jul 10 14:11:47.664403 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:47.664381 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxwtv\" (UniqueName: \"kubernetes.io/projected/6f75a589-921c-433f-8f37-93d58abf8cd1-kube-api-access-sxwtv\") pod \"6f75a589-921c-433f-8f37-93d58abf8cd1\" (UID: \"6f75a589-921c-433f-8f37-93d58abf8cd1\") " Jul 10 14:11:47.664554 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:47.664450 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f75a589-921c-433f-8f37-93d58abf8cd1-util\") pod \"6f75a589-921c-433f-8f37-93d58abf8cd1\" (UID: \"6f75a589-921c-433f-8f37-93d58abf8cd1\") " Jul 10 14:11:47.664554 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:47.664474 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f75a589-921c-433f-8f37-93d58abf8cd1-bundle\") pod \"6f75a589-921c-433f-8f37-93d58abf8cd1\" (UID: \"6f75a589-921c-433f-8f37-93d58abf8cd1\") " Jul 10 14:11:47.665087 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:47.665062 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f75a589-921c-433f-8f37-93d58abf8cd1-bundle" (OuterVolumeSpecName: "bundle") pod "6f75a589-921c-433f-8f37-93d58abf8cd1" (UID: "6f75a589-921c-433f-8f37-93d58abf8cd1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:11:47.666648 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:47.666618 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f75a589-921c-433f-8f37-93d58abf8cd1-kube-api-access-sxwtv" (OuterVolumeSpecName: "kube-api-access-sxwtv") pod "6f75a589-921c-433f-8f37-93d58abf8cd1" (UID: "6f75a589-921c-433f-8f37-93d58abf8cd1"). InnerVolumeSpecName "kube-api-access-sxwtv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:11:47.668834 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:47.668813 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f75a589-921c-433f-8f37-93d58abf8cd1-util" (OuterVolumeSpecName: "util") pod "6f75a589-921c-433f-8f37-93d58abf8cd1" (UID: "6f75a589-921c-433f-8f37-93d58abf8cd1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:11:47.765503 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:47.765436 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxwtv\" (UniqueName: \"kubernetes.io/projected/6f75a589-921c-433f-8f37-93d58abf8cd1-kube-api-access-sxwtv\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:11:47.765503 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:47.765460 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f75a589-921c-433f-8f37-93d58abf8cd1-util\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:11:47.765503 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:47.765469 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f75a589-921c-433f-8f37-93d58abf8cd1-bundle\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:11:48.464283 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:48.464246 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dsqf6" event={"ID":"6f75a589-921c-433f-8f37-93d58abf8cd1","Type":"ContainerDied","Data":"299b40e3992c22dcb37fa1a91396dca14493de5dcb0de4ccbd4509fb9948010c"} Jul 10 14:11:48.464472 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:48.464337 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="299b40e3992c22dcb37fa1a91396dca14493de5dcb0de4ccbd4509fb9948010c" Jul 10 14:11:48.464472 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:48.464336 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dsqf6" Jul 10 14:11:56.416753 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:56.416717 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kxrs9"] Jul 10 14:11:56.417203 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:56.416997 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f75a589-921c-433f-8f37-93d58abf8cd1" containerName="pull" Jul 10 14:11:56.417203 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:56.417008 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f75a589-921c-433f-8f37-93d58abf8cd1" containerName="pull" Jul 10 14:11:56.417203 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:56.417016 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f75a589-921c-433f-8f37-93d58abf8cd1" containerName="extract" Jul 10 14:11:56.417203 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:56.417022 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f75a589-921c-433f-8f37-93d58abf8cd1" containerName="extract" Jul 10 14:11:56.417203 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:56.417039 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f75a589-921c-433f-8f37-93d58abf8cd1" containerName="util" Jul 10 14:11:56.417203 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:56.417044 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f75a589-921c-433f-8f37-93d58abf8cd1" containerName="util" Jul 10 14:11:56.417203 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:56.417080 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f75a589-921c-433f-8f37-93d58abf8cd1" containerName="extract" Jul 10 14:11:56.419072 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:56.419056 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kxrs9" Jul 10 14:11:56.421807 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:56.421782 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-lmfg7\"" Jul 10 14:11:56.422046 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:56.422031 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 10 14:11:56.422362 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:56.422339 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 10 14:11:56.439745 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:56.439726 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kxrs9"] Jul 10 14:11:56.534745 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:56.534707 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32eeb4c4-9417-46e1-b84d-8a040cf81e51-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kxrs9\" (UID: \"32eeb4c4-9417-46e1-b84d-8a040cf81e51\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kxrs9" Jul 10 14:11:56.534914 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:56.534769 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgk6s\" (UniqueName: \"kubernetes.io/projected/32eeb4c4-9417-46e1-b84d-8a040cf81e51-kube-api-access-bgk6s\") pod \"cert-manager-operator-controller-manager-55c444bf86-kxrs9\" (UID: \"32eeb4c4-9417-46e1-b84d-8a040cf81e51\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kxrs9" Jul 10 14:11:56.635523 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:56.635492 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32eeb4c4-9417-46e1-b84d-8a040cf81e51-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kxrs9\" (UID: \"32eeb4c4-9417-46e1-b84d-8a040cf81e51\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kxrs9" Jul 10 14:11:56.635654 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:56.635545 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgk6s\" (UniqueName: \"kubernetes.io/projected/32eeb4c4-9417-46e1-b84d-8a040cf81e51-kube-api-access-bgk6s\") pod \"cert-manager-operator-controller-manager-55c444bf86-kxrs9\" (UID: \"32eeb4c4-9417-46e1-b84d-8a040cf81e51\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kxrs9" Jul 10 14:11:56.635860 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:56.635843 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32eeb4c4-9417-46e1-b84d-8a040cf81e51-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kxrs9\" (UID: \"32eeb4c4-9417-46e1-b84d-8a040cf81e51\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kxrs9" Jul 10 14:11:56.647434 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:56.647409 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgk6s\" (UniqueName: \"kubernetes.io/projected/32eeb4c4-9417-46e1-b84d-8a040cf81e51-kube-api-access-bgk6s\") pod \"cert-manager-operator-controller-manager-55c444bf86-kxrs9\" (UID: \"32eeb4c4-9417-46e1-b84d-8a040cf81e51\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kxrs9" Jul 10 14:11:56.728304 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:56.728216 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kxrs9" Jul 10 14:11:56.868170 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:56.868142 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kxrs9"] Jul 10 14:11:56.870703 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:11:56.870664 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32eeb4c4_9417_46e1_b84d_8a040cf81e51.slice/crio-f25baf9a0fc810c45645027b97a2778efcbb9e3bb7e4d37965f9416327336a0c WatchSource:0}: Error finding container f25baf9a0fc810c45645027b97a2778efcbb9e3bb7e4d37965f9416327336a0c: Status 404 returned error can't find the container with id f25baf9a0fc810c45645027b97a2778efcbb9e3bb7e4d37965f9416327336a0c Jul 10 14:11:57.497218 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:57.497183 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kxrs9" event={"ID":"32eeb4c4-9417-46e1-b84d-8a040cf81e51","Type":"ContainerStarted","Data":"f25baf9a0fc810c45645027b97a2778efcbb9e3bb7e4d37965f9416327336a0c"} Jul 10 14:11:59.507296 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:11:59.507266 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kxrs9" event={"ID":"32eeb4c4-9417-46e1-b84d-8a040cf81e51","Type":"ContainerStarted","Data":"e11692cd93d0e1d4f30201bc290c0b9486d5816506efa227a19b0fe615b14b98"} Jul 10 14:12:00.557333 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:00.557277 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kxrs9" podStartSLOduration=2.818132677 podStartE2EDuration="4.557259038s" totalImagesPullingTime="1.739126361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:11:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:11:59.581892636 +0000 UTC m=+202.525464988" watchObservedRunningTime="2026-07-10 14:12:00.557259038 +0000 UTC m=+203.500831379" Jul 10 14:12:00.558553 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:00.558529 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplssw"] Jul 10 14:12:00.564314 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:00.564286 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplssw" Jul 10 14:12:00.568976 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:00.568953 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 10 14:12:00.569223 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:00.569206 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 10 14:12:00.570219 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:00.570199 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-82ht9\"" Jul 10 14:12:00.588349 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:00.588311 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplssw"] Jul 10 14:12:00.669220 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:00.669194 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0db9d72-8489-433e-a3c4-97585e510c49-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplssw\" (UID: \"d0db9d72-8489-433e-a3c4-97585e510c49\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplssw" Jul 10 14:12:00.669355 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:00.669238 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0db9d72-8489-433e-a3c4-97585e510c49-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplssw\" (UID: \"d0db9d72-8489-433e-a3c4-97585e510c49\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplssw" Jul 10 14:12:00.669426 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:00.669407 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpcbq\" (UniqueName: \"kubernetes.io/projected/d0db9d72-8489-433e-a3c4-97585e510c49-kube-api-access-vpcbq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplssw\" (UID: \"d0db9d72-8489-433e-a3c4-97585e510c49\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplssw" Jul 10 14:12:00.770537 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:00.770510 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0db9d72-8489-433e-a3c4-97585e510c49-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplssw\" (UID: \"d0db9d72-8489-433e-a3c4-97585e510c49\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplssw" Jul 10 14:12:00.770676 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:00.770573 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0db9d72-8489-433e-a3c4-97585e510c49-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplssw\" (UID: \"d0db9d72-8489-433e-a3c4-97585e510c49\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplssw" Jul 10 14:12:00.770676 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:00.770636 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpcbq\" (UniqueName: \"kubernetes.io/projected/d0db9d72-8489-433e-a3c4-97585e510c49-kube-api-access-vpcbq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplssw\" (UID: \"d0db9d72-8489-433e-a3c4-97585e510c49\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplssw" Jul 10 14:12:00.771036 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:00.771011 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0db9d72-8489-433e-a3c4-97585e510c49-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplssw\" (UID: \"d0db9d72-8489-433e-a3c4-97585e510c49\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplssw" Jul 10 14:12:00.771036 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:00.771030 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0db9d72-8489-433e-a3c4-97585e510c49-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplssw\" (UID: \"d0db9d72-8489-433e-a3c4-97585e510c49\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplssw" Jul 10 14:12:00.814968 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:00.814910 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpcbq\" (UniqueName: \"kubernetes.io/projected/d0db9d72-8489-433e-a3c4-97585e510c49-kube-api-access-vpcbq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplssw\" (UID: \"d0db9d72-8489-433e-a3c4-97585e510c49\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplssw" Jul 10 14:12:00.873560 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:00.873537 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplssw" Jul 10 14:12:01.029355 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:01.029304 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplssw"] Jul 10 14:12:01.031431 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:12:01.031405 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0db9d72_8489_433e_a3c4_97585e510c49.slice/crio-b1aaf3ddd60080e06218fc43158017dc1599450152d20eaf7b9a4d998b583ba6 WatchSource:0}: Error finding container b1aaf3ddd60080e06218fc43158017dc1599450152d20eaf7b9a4d998b583ba6: Status 404 returned error can't find the container with id b1aaf3ddd60080e06218fc43158017dc1599450152d20eaf7b9a4d998b583ba6 Jul 10 14:12:01.519519 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:01.519436 2581 generic.go:356] "Generic (PLEG): container finished" podID="d0db9d72-8489-433e-a3c4-97585e510c49" containerID="50cf37b901bf8ccb0108b36821fa64b7330b5609d7d17e63fc1016e2d322df2a" exitCode=0 Jul 10 14:12:01.519691 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:01.519527 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplssw" event={"ID":"d0db9d72-8489-433e-a3c4-97585e510c49","Type":"ContainerDied","Data":"50cf37b901bf8ccb0108b36821fa64b7330b5609d7d17e63fc1016e2d322df2a"} Jul 10 14:12:01.519691 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:01.519578 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplssw" event={"ID":"d0db9d72-8489-433e-a3c4-97585e510c49","Type":"ContainerStarted","Data":"b1aaf3ddd60080e06218fc43158017dc1599450152d20eaf7b9a4d998b583ba6"} Jul 10 14:12:04.535862 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:04.535827 2581 generic.go:356] "Generic (PLEG): container finished" podID="d0db9d72-8489-433e-a3c4-97585e510c49" containerID="4dad0be1970964f49e1ef0ef4cbb830adb57be0fde76496ac2357bcda25ccb9e" exitCode=0 Jul 10 14:12:04.536259 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:04.535874 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplssw" event={"ID":"d0db9d72-8489-433e-a3c4-97585e510c49","Type":"ContainerDied","Data":"4dad0be1970964f49e1ef0ef4cbb830adb57be0fde76496ac2357bcda25ccb9e"} Jul 10 14:12:04.844428 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:04.844346 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xkqc6"] Jul 10 14:12:04.846751 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:04.846735 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xkqc6" Jul 10 14:12:04.849644 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:04.849622 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 10 14:12:04.849852 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:04.849832 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-cbdk5\"" Jul 10 14:12:04.849899 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:04.849844 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 10 14:12:04.856774 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:04.856755 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xkqc6"] Jul 10 14:12:05.002810 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:05.002779 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/baa71170-3220-4099-8418-938797a5a708-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xkqc6\" (UID: \"baa71170-3220-4099-8418-938797a5a708\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xkqc6" Jul 10 14:12:05.002810 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:05.002813 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw28v\" (UniqueName: \"kubernetes.io/projected/baa71170-3220-4099-8418-938797a5a708-kube-api-access-xw28v\") pod \"cert-manager-cainjector-559cdd8c87-xkqc6\" (UID: \"baa71170-3220-4099-8418-938797a5a708\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xkqc6" Jul 10 14:12:05.103226 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:05.103154 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/baa71170-3220-4099-8418-938797a5a708-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xkqc6\" (UID: \"baa71170-3220-4099-8418-938797a5a708\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xkqc6" Jul 10 14:12:05.103226 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:05.103186 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw28v\" (UniqueName: \"kubernetes.io/projected/baa71170-3220-4099-8418-938797a5a708-kube-api-access-xw28v\") pod \"cert-manager-cainjector-559cdd8c87-xkqc6\" (UID: \"baa71170-3220-4099-8418-938797a5a708\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xkqc6" Jul 10 14:12:05.117237 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:05.112887 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/baa71170-3220-4099-8418-938797a5a708-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xkqc6\" (UID: \"baa71170-3220-4099-8418-938797a5a708\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xkqc6" Jul 10 14:12:05.117237 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:05.112929 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw28v\" (UniqueName: \"kubernetes.io/projected/baa71170-3220-4099-8418-938797a5a708-kube-api-access-xw28v\") pod \"cert-manager-cainjector-559cdd8c87-xkqc6\" (UID: \"baa71170-3220-4099-8418-938797a5a708\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xkqc6" Jul 10 14:12:05.167533 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:05.167507 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xkqc6" Jul 10 14:12:05.287262 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:05.287232 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xkqc6"] Jul 10 14:12:05.289649 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:12:05.289616 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbaa71170_3220_4099_8418_938797a5a708.slice/crio-dfa4ce8c5f2cf5ee7ee0243857dbbf7de2f441ea225911aab82e2d4f33800a06 WatchSource:0}: Error finding container dfa4ce8c5f2cf5ee7ee0243857dbbf7de2f441ea225911aab82e2d4f33800a06: Status 404 returned error can't find the container with id dfa4ce8c5f2cf5ee7ee0243857dbbf7de2f441ea225911aab82e2d4f33800a06 Jul 10 14:12:05.540945 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:05.540912 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xkqc6" event={"ID":"baa71170-3220-4099-8418-938797a5a708","Type":"ContainerStarted","Data":"dfa4ce8c5f2cf5ee7ee0243857dbbf7de2f441ea225911aab82e2d4f33800a06"} Jul 10 14:12:05.542940 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:05.542909 2581 generic.go:356] "Generic (PLEG): container finished" podID="d0db9d72-8489-433e-a3c4-97585e510c49" containerID="f8dbdc3960baba9acf63bf77ca921aa4a6ddd5561900710b432912281507107b" exitCode=0 Jul 10 14:12:05.543022 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:05.542944 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplssw" event={"ID":"d0db9d72-8489-433e-a3c4-97585e510c49","Type":"ContainerDied","Data":"f8dbdc3960baba9acf63bf77ca921aa4a6ddd5561900710b432912281507107b"} Jul 10 14:12:06.701520 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:06.701495 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplssw" Jul 10 14:12:06.815879 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:06.815776 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0db9d72-8489-433e-a3c4-97585e510c49-bundle\") pod \"d0db9d72-8489-433e-a3c4-97585e510c49\" (UID: \"d0db9d72-8489-433e-a3c4-97585e510c49\") " Jul 10 14:12:06.815879 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:06.815861 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vpcbq\" (UniqueName: \"kubernetes.io/projected/d0db9d72-8489-433e-a3c4-97585e510c49-kube-api-access-vpcbq\") pod \"d0db9d72-8489-433e-a3c4-97585e510c49\" (UID: \"d0db9d72-8489-433e-a3c4-97585e510c49\") " Jul 10 14:12:06.816108 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:06.815917 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0db9d72-8489-433e-a3c4-97585e510c49-util\") pod \"d0db9d72-8489-433e-a3c4-97585e510c49\" (UID: \"d0db9d72-8489-433e-a3c4-97585e510c49\") " Jul 10 14:12:06.816388 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:06.816354 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0db9d72-8489-433e-a3c4-97585e510c49-bundle" (OuterVolumeSpecName: "bundle") pod "d0db9d72-8489-433e-a3c4-97585e510c49" (UID: "d0db9d72-8489-433e-a3c4-97585e510c49"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:12:06.818915 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:06.818880 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0db9d72-8489-433e-a3c4-97585e510c49-kube-api-access-vpcbq" (OuterVolumeSpecName: "kube-api-access-vpcbq") pod "d0db9d72-8489-433e-a3c4-97585e510c49" (UID: "d0db9d72-8489-433e-a3c4-97585e510c49"). InnerVolumeSpecName "kube-api-access-vpcbq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:12:06.823370 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:06.823311 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0db9d72-8489-433e-a3c4-97585e510c49-util" (OuterVolumeSpecName: "util") pod "d0db9d72-8489-433e-a3c4-97585e510c49" (UID: "d0db9d72-8489-433e-a3c4-97585e510c49"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:12:06.916557 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:06.916527 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0db9d72-8489-433e-a3c4-97585e510c49-bundle\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:12:06.916557 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:06.916554 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vpcbq\" (UniqueName: \"kubernetes.io/projected/d0db9d72-8489-433e-a3c4-97585e510c49-kube-api-access-vpcbq\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:12:06.916804 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:06.916567 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0db9d72-8489-433e-a3c4-97585e510c49-util\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:12:07.077642 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:07.077562 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-qjlmg"] Jul 10 14:12:07.077907 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:07.077885 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0db9d72-8489-433e-a3c4-97585e510c49" containerName="util" Jul 10 14:12:07.077907 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:07.077903 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0db9d72-8489-433e-a3c4-97585e510c49" containerName="util" Jul 10 14:12:07.077907 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:07.077913 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0db9d72-8489-433e-a3c4-97585e510c49" containerName="extract" Jul 10 14:12:07.078164 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:07.077921 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0db9d72-8489-433e-a3c4-97585e510c49" containerName="extract" Jul 10 14:12:07.078164 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:07.077940 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0db9d72-8489-433e-a3c4-97585e510c49" containerName="pull" Jul 10 14:12:07.078164 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:07.077949 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0db9d72-8489-433e-a3c4-97585e510c49" containerName="pull" Jul 10 14:12:07.078164 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:07.078012 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0db9d72-8489-433e-a3c4-97585e510c49" containerName="extract" Jul 10 14:12:07.081936 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:07.081914 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-qjlmg" Jul 10 14:12:07.085753 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:07.085726 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-zt8qq\"" Jul 10 14:12:07.096959 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:07.096937 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-qjlmg"] Jul 10 14:12:07.219415 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:07.219382 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp6jp\" (UniqueName: \"kubernetes.io/projected/5f2863e7-0c01-49e2-9932-e3b3612ab3ff-kube-api-access-mp6jp\") pod \"cert-manager-webhook-6486ffd997-qjlmg\" (UID: \"5f2863e7-0c01-49e2-9932-e3b3612ab3ff\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qjlmg" Jul 10 14:12:07.219613 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:07.219489 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f2863e7-0c01-49e2-9932-e3b3612ab3ff-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-qjlmg\" (UID: \"5f2863e7-0c01-49e2-9932-e3b3612ab3ff\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qjlmg" Jul 10 14:12:07.320527 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:07.320484 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f2863e7-0c01-49e2-9932-e3b3612ab3ff-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-qjlmg\" (UID: \"5f2863e7-0c01-49e2-9932-e3b3612ab3ff\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qjlmg" Jul 10 14:12:07.320714 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:07.320574 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp6jp\" (UniqueName: \"kubernetes.io/projected/5f2863e7-0c01-49e2-9932-e3b3612ab3ff-kube-api-access-mp6jp\") pod \"cert-manager-webhook-6486ffd997-qjlmg\" (UID: \"5f2863e7-0c01-49e2-9932-e3b3612ab3ff\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qjlmg" Jul 10 14:12:07.329109 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:07.329044 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f2863e7-0c01-49e2-9932-e3b3612ab3ff-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-qjlmg\" (UID: \"5f2863e7-0c01-49e2-9932-e3b3612ab3ff\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qjlmg" Jul 10 14:12:07.329296 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:07.329273 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp6jp\" (UniqueName: \"kubernetes.io/projected/5f2863e7-0c01-49e2-9932-e3b3612ab3ff-kube-api-access-mp6jp\") pod \"cert-manager-webhook-6486ffd997-qjlmg\" (UID: \"5f2863e7-0c01-49e2-9932-e3b3612ab3ff\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qjlmg" Jul 10 14:12:07.393225 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:07.393185 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-qjlmg" Jul 10 14:12:07.554205 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:07.554167 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplssw" event={"ID":"d0db9d72-8489-433e-a3c4-97585e510c49","Type":"ContainerDied","Data":"b1aaf3ddd60080e06218fc43158017dc1599450152d20eaf7b9a4d998b583ba6"} Jul 10 14:12:07.554442 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:07.554217 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fplssw" Jul 10 14:12:07.554442 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:07.554228 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b1aaf3ddd60080e06218fc43158017dc1599450152d20eaf7b9a4d998b583ba6" Jul 10 14:12:08.131152 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:08.131128 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-qjlmg"] Jul 10 14:12:08.133855 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:12:08.133826 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f2863e7_0c01_49e2_9932_e3b3612ab3ff.slice/crio-5d28395477e7e03e8957d5933367a4329a255aecb5292d307073e83a689f55a2 WatchSource:0}: Error finding container 5d28395477e7e03e8957d5933367a4329a255aecb5292d307073e83a689f55a2: Status 404 returned error can't find the container with id 5d28395477e7e03e8957d5933367a4329a255aecb5292d307073e83a689f55a2 Jul 10 14:12:08.565104 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:08.565068 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-qjlmg" event={"ID":"5f2863e7-0c01-49e2-9932-e3b3612ab3ff","Type":"ContainerStarted","Data":"7da1fba1ca2bebc00c850c17f1e9c14e9619546023e73d698374564606b59f5e"} Jul 10 14:12:08.565391 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:08.565364 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-qjlmg" event={"ID":"5f2863e7-0c01-49e2-9932-e3b3612ab3ff","Type":"ContainerStarted","Data":"5d28395477e7e03e8957d5933367a4329a255aecb5292d307073e83a689f55a2"} Jul 10 14:12:08.565391 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:08.565395 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-qjlmg" Jul 10 14:12:08.566505 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:08.566483 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xkqc6" event={"ID":"baa71170-3220-4099-8418-938797a5a708","Type":"ContainerStarted","Data":"2597bb0554b8e1d60db96ae23c83fcbadc590bfade7b4a6e2e64bfd7419e8bde"} Jul 10 14:12:08.584031 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:08.583987 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-qjlmg" podStartSLOduration=1.583971935 podStartE2EDuration="1.583971935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:12:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:12:08.582378729 +0000 UTC m=+211.525951071" watchObservedRunningTime="2026-07-10 14:12:08.583971935 +0000 UTC m=+211.527544265" Jul 10 14:12:08.600546 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:08.600502 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xkqc6" podStartSLOduration=1.838369559 podStartE2EDuration="4.600489169s" totalImagesPullingTime="2.76211961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:12:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:12:08.598691045 +0000 UTC m=+211.542263387" watchObservedRunningTime="2026-07-10 14:12:08.600489169 +0000 UTC m=+211.544061511" Jul 10 14:12:14.572916 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:14.572887 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-qjlmg" Jul 10 14:12:19.158171 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:19.158139 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af78trd"] Jul 10 14:12:19.210404 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:19.210370 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af78trd"] Jul 10 14:12:19.210550 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:19.210488 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af78trd" Jul 10 14:12:19.213433 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:19.213409 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-82ht9\"" Jul 10 14:12:19.213433 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:19.213417 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 10 14:12:19.214029 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:19.214005 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 10 14:12:19.318672 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:19.318637 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9d4w\" (UniqueName: \"kubernetes.io/projected/10c425e5-ba33-48c8-a362-b409e1c4a3e0-kube-api-access-x9d4w\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af78trd\" (UID: \"10c425e5-ba33-48c8-a362-b409e1c4a3e0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af78trd" Jul 10 14:12:19.318830 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:19.318678 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10c425e5-ba33-48c8-a362-b409e1c4a3e0-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af78trd\" (UID: \"10c425e5-ba33-48c8-a362-b409e1c4a3e0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af78trd" Jul 10 14:12:19.318830 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:19.318706 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10c425e5-ba33-48c8-a362-b409e1c4a3e0-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af78trd\" (UID: \"10c425e5-ba33-48c8-a362-b409e1c4a3e0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af78trd" Jul 10 14:12:19.419505 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:19.419434 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9d4w\" (UniqueName: \"kubernetes.io/projected/10c425e5-ba33-48c8-a362-b409e1c4a3e0-kube-api-access-x9d4w\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af78trd\" (UID: \"10c425e5-ba33-48c8-a362-b409e1c4a3e0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af78trd" Jul 10 14:12:19.419505 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:19.419469 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10c425e5-ba33-48c8-a362-b409e1c4a3e0-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af78trd\" (UID: \"10c425e5-ba33-48c8-a362-b409e1c4a3e0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af78trd" Jul 10 14:12:19.419505 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:19.419486 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10c425e5-ba33-48c8-a362-b409e1c4a3e0-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af78trd\" (UID: \"10c425e5-ba33-48c8-a362-b409e1c4a3e0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af78trd" Jul 10 14:12:19.419890 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:19.419869 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10c425e5-ba33-48c8-a362-b409e1c4a3e0-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af78trd\" (UID: \"10c425e5-ba33-48c8-a362-b409e1c4a3e0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af78trd" Jul 10 14:12:19.419926 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:19.419880 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10c425e5-ba33-48c8-a362-b409e1c4a3e0-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af78trd\" (UID: \"10c425e5-ba33-48c8-a362-b409e1c4a3e0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af78trd" Jul 10 14:12:19.428234 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:19.428215 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9d4w\" (UniqueName: \"kubernetes.io/projected/10c425e5-ba33-48c8-a362-b409e1c4a3e0-kube-api-access-x9d4w\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af78trd\" (UID: \"10c425e5-ba33-48c8-a362-b409e1c4a3e0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af78trd" Jul 10 14:12:19.520407 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:19.520384 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af78trd" Jul 10 14:12:19.657482 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:19.657455 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af78trd"] Jul 10 14:12:19.660444 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:12:19.660418 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10c425e5_ba33_48c8_a362_b409e1c4a3e0.slice/crio-c93169e1c966887132388d164611d63c8bc72f9a08b2de8a9c5f0519ef6a1a68 WatchSource:0}: Error finding container c93169e1c966887132388d164611d63c8bc72f9a08b2de8a9c5f0519ef6a1a68: Status 404 returned error can't find the container with id c93169e1c966887132388d164611d63c8bc72f9a08b2de8a9c5f0519ef6a1a68 Jul 10 14:12:20.617066 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:20.617030 2581 generic.go:356] "Generic (PLEG): container finished" podID="10c425e5-ba33-48c8-a362-b409e1c4a3e0" containerID="2c792c849c6ee6344a2f73d5b76a4c81df0d5be85e1ae05f319fd7fdd2481f68" exitCode=0 Jul 10 14:12:20.617482 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:20.617119 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af78trd" event={"ID":"10c425e5-ba33-48c8-a362-b409e1c4a3e0","Type":"ContainerDied","Data":"2c792c849c6ee6344a2f73d5b76a4c81df0d5be85e1ae05f319fd7fdd2481f68"} Jul 10 14:12:20.617482 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:20.617181 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af78trd" event={"ID":"10c425e5-ba33-48c8-a362-b409e1c4a3e0","Type":"ContainerStarted","Data":"c93169e1c966887132388d164611d63c8bc72f9a08b2de8a9c5f0519ef6a1a68"} Jul 10 14:12:22.627856 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:22.627820 2581 generic.go:356] "Generic (PLEG): container finished" podID="10c425e5-ba33-48c8-a362-b409e1c4a3e0" containerID="026ef7502f1094f310a771aae468fb9af2149e382aa6a93ed637acc22e3f2066" exitCode=0 Jul 10 14:12:22.628212 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:22.627894 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af78trd" event={"ID":"10c425e5-ba33-48c8-a362-b409e1c4a3e0","Type":"ContainerDied","Data":"026ef7502f1094f310a771aae468fb9af2149e382aa6a93ed637acc22e3f2066"} Jul 10 14:12:23.634014 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:23.633982 2581 generic.go:356] "Generic (PLEG): container finished" podID="10c425e5-ba33-48c8-a362-b409e1c4a3e0" containerID="94b6b85cc93323e645f5722012637bab307f6c5cf43b67ed64e79690ebb0acab" exitCode=0 Jul 10 14:12:23.634464 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:23.634032 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af78trd" event={"ID":"10c425e5-ba33-48c8-a362-b409e1c4a3e0","Type":"ContainerDied","Data":"94b6b85cc93323e645f5722012637bab307f6c5cf43b67ed64e79690ebb0acab"} Jul 10 14:12:24.763362 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:24.763337 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af78trd" Jul 10 14:12:24.856151 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:24.856122 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10c425e5-ba33-48c8-a362-b409e1c4a3e0-util\") pod \"10c425e5-ba33-48c8-a362-b409e1c4a3e0\" (UID: \"10c425e5-ba33-48c8-a362-b409e1c4a3e0\") " Jul 10 14:12:24.856274 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:24.856158 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9d4w\" (UniqueName: \"kubernetes.io/projected/10c425e5-ba33-48c8-a362-b409e1c4a3e0-kube-api-access-x9d4w\") pod \"10c425e5-ba33-48c8-a362-b409e1c4a3e0\" (UID: \"10c425e5-ba33-48c8-a362-b409e1c4a3e0\") " Jul 10 14:12:24.856274 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:24.856177 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10c425e5-ba33-48c8-a362-b409e1c4a3e0-bundle\") pod \"10c425e5-ba33-48c8-a362-b409e1c4a3e0\" (UID: \"10c425e5-ba33-48c8-a362-b409e1c4a3e0\") " Jul 10 14:12:24.856917 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:24.856893 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10c425e5-ba33-48c8-a362-b409e1c4a3e0-bundle" (OuterVolumeSpecName: "bundle") pod "10c425e5-ba33-48c8-a362-b409e1c4a3e0" (UID: "10c425e5-ba33-48c8-a362-b409e1c4a3e0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:12:24.858195 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:24.858169 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10c425e5-ba33-48c8-a362-b409e1c4a3e0-kube-api-access-x9d4w" (OuterVolumeSpecName: "kube-api-access-x9d4w") pod "10c425e5-ba33-48c8-a362-b409e1c4a3e0" (UID: "10c425e5-ba33-48c8-a362-b409e1c4a3e0"). InnerVolumeSpecName "kube-api-access-x9d4w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:12:24.861753 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:24.861708 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10c425e5-ba33-48c8-a362-b409e1c4a3e0-util" (OuterVolumeSpecName: "util") pod "10c425e5-ba33-48c8-a362-b409e1c4a3e0" (UID: "10c425e5-ba33-48c8-a362-b409e1c4a3e0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:12:24.956835 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:24.956769 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10c425e5-ba33-48c8-a362-b409e1c4a3e0-util\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:12:24.956835 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:24.956803 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9d4w\" (UniqueName: \"kubernetes.io/projected/10c425e5-ba33-48c8-a362-b409e1c4a3e0-kube-api-access-x9d4w\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:12:24.956835 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:24.956813 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10c425e5-ba33-48c8-a362-b409e1c4a3e0-bundle\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:12:25.643607 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:25.643565 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af78trd" event={"ID":"10c425e5-ba33-48c8-a362-b409e1c4a3e0","Type":"ContainerDied","Data":"c93169e1c966887132388d164611d63c8bc72f9a08b2de8a9c5f0519ef6a1a68"} Jul 10 14:12:25.643841 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:25.643629 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c93169e1c966887132388d164611d63c8bc72f9a08b2de8a9c5f0519ef6a1a68" Jul 10 14:12:25.643841 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:25.643588 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af78trd" Jul 10 14:12:32.304576 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:32.304548 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d47b746d6-tsr5v"] Jul 10 14:12:32.305003 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:32.304922 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10c425e5-ba33-48c8-a362-b409e1c4a3e0" containerName="util" Jul 10 14:12:32.305003 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:32.304940 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="10c425e5-ba33-48c8-a362-b409e1c4a3e0" containerName="util" Jul 10 14:12:32.305003 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:32.304953 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10c425e5-ba33-48c8-a362-b409e1c4a3e0" containerName="pull" Jul 10 14:12:32.305003 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:32.304962 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="10c425e5-ba33-48c8-a362-b409e1c4a3e0" containerName="pull" Jul 10 14:12:32.305003 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:32.304972 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10c425e5-ba33-48c8-a362-b409e1c4a3e0" containerName="extract" Jul 10 14:12:32.305003 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:32.304978 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="10c425e5-ba33-48c8-a362-b409e1c4a3e0" containerName="extract" Jul 10 14:12:32.305201 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:32.305019 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="10c425e5-ba33-48c8-a362-b409e1c4a3e0" containerName="extract" Jul 10 14:12:32.306817 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:32.306801 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-tsr5v" Jul 10 14:12:32.310273 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:32.310243 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 10 14:12:32.310425 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:32.310366 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 10 14:12:32.310708 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:32.310684 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cw2fh\"" Jul 10 14:12:32.310999 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:32.310980 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 10 14:12:32.311259 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:32.311244 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 10 14:12:32.335674 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:32.335650 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d47b746d6-tsr5v"] Jul 10 14:12:32.404910 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:32.404876 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b06d174-3822-402d-9f16-1eafe43c807d-tmp\") pod \"opendatahub-operator-controller-manager-5d47b746d6-tsr5v\" (UID: \"4b06d174-3822-402d-9f16-1eafe43c807d\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-tsr5v" Jul 10 14:12:32.405076 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:32.404965 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4b06d174-3822-402d-9f16-1eafe43c807d-manifests\") pod \"opendatahub-operator-controller-manager-5d47b746d6-tsr5v\" (UID: \"4b06d174-3822-402d-9f16-1eafe43c807d\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-tsr5v" Jul 10 14:12:32.405076 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:32.404993 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4b06d174-3822-402d-9f16-1eafe43c807d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d47b746d6-tsr5v\" (UID: \"4b06d174-3822-402d-9f16-1eafe43c807d\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-tsr5v" Jul 10 14:12:32.405076 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:32.405025 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2blcq\" (UniqueName: \"kubernetes.io/projected/4b06d174-3822-402d-9f16-1eafe43c807d-kube-api-access-2blcq\") pod \"opendatahub-operator-controller-manager-5d47b746d6-tsr5v\" (UID: \"4b06d174-3822-402d-9f16-1eafe43c807d\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-tsr5v" Jul 10 14:12:32.405229 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:32.405119 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b06d174-3822-402d-9f16-1eafe43c807d-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d47b746d6-tsr5v\" (UID: \"4b06d174-3822-402d-9f16-1eafe43c807d\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-tsr5v" Jul 10 14:12:32.505582 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:32.505553 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b06d174-3822-402d-9f16-1eafe43c807d-tmp\") pod \"opendatahub-operator-controller-manager-5d47b746d6-tsr5v\" (UID: \"4b06d174-3822-402d-9f16-1eafe43c807d\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-tsr5v" Jul 10 14:12:32.505710 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:32.505601 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4b06d174-3822-402d-9f16-1eafe43c807d-manifests\") pod \"opendatahub-operator-controller-manager-5d47b746d6-tsr5v\" (UID: \"4b06d174-3822-402d-9f16-1eafe43c807d\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-tsr5v" Jul 10 14:12:32.505775 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:32.505722 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4b06d174-3822-402d-9f16-1eafe43c807d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d47b746d6-tsr5v\" (UID: \"4b06d174-3822-402d-9f16-1eafe43c807d\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-tsr5v" Jul 10 14:12:32.505834 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:32.505787 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2blcq\" (UniqueName: \"kubernetes.io/projected/4b06d174-3822-402d-9f16-1eafe43c807d-kube-api-access-2blcq\") pod \"opendatahub-operator-controller-manager-5d47b746d6-tsr5v\" (UID: \"4b06d174-3822-402d-9f16-1eafe43c807d\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-tsr5v" Jul 10 14:12:32.505887 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:32.505836 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b06d174-3822-402d-9f16-1eafe43c807d-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d47b746d6-tsr5v\" (UID: \"4b06d174-3822-402d-9f16-1eafe43c807d\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-tsr5v" Jul 10 14:12:32.505958 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:32.505938 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4b06d174-3822-402d-9f16-1eafe43c807d-manifests\") pod \"opendatahub-operator-controller-manager-5d47b746d6-tsr5v\" (UID: \"4b06d174-3822-402d-9f16-1eafe43c807d\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-tsr5v" Jul 10 14:12:32.507827 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:32.507798 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b06d174-3822-402d-9f16-1eafe43c807d-tmp\") pod \"opendatahub-operator-controller-manager-5d47b746d6-tsr5v\" (UID: \"4b06d174-3822-402d-9f16-1eafe43c807d\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-tsr5v" Jul 10 14:12:32.508034 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:32.508018 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b06d174-3822-402d-9f16-1eafe43c807d-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d47b746d6-tsr5v\" (UID: \"4b06d174-3822-402d-9f16-1eafe43c807d\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-tsr5v" Jul 10 14:12:32.508080 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:32.508063 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4b06d174-3822-402d-9f16-1eafe43c807d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d47b746d6-tsr5v\" (UID: \"4b06d174-3822-402d-9f16-1eafe43c807d\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-tsr5v" Jul 10 14:12:32.514595 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:32.514566 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2blcq\" (UniqueName: \"kubernetes.io/projected/4b06d174-3822-402d-9f16-1eafe43c807d-kube-api-access-2blcq\") pod \"opendatahub-operator-controller-manager-5d47b746d6-tsr5v\" (UID: \"4b06d174-3822-402d-9f16-1eafe43c807d\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-tsr5v" Jul 10 14:12:32.620079 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:32.620005 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-tsr5v" Jul 10 14:12:32.751454 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:32.751345 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d47b746d6-tsr5v"] Jul 10 14:12:32.753851 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:12:32.753822 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b06d174_3822_402d_9f16_1eafe43c807d.slice/crio-6229e198896313d15347780c3fc18e3becd36115c5f2f5a0c5317bcd0f1a4694 WatchSource:0}: Error finding container 6229e198896313d15347780c3fc18e3becd36115c5f2f5a0c5317bcd0f1a4694: Status 404 returned error can't find the container with id 6229e198896313d15347780c3fc18e3becd36115c5f2f5a0c5317bcd0f1a4694 Jul 10 14:12:33.683415 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:33.683368 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-tsr5v" event={"ID":"4b06d174-3822-402d-9f16-1eafe43c807d","Type":"ContainerStarted","Data":"6229e198896313d15347780c3fc18e3becd36115c5f2f5a0c5317bcd0f1a4694"} Jul 10 14:12:36.697413 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:36.697375 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-tsr5v" event={"ID":"4b06d174-3822-402d-9f16-1eafe43c807d","Type":"ContainerStarted","Data":"ea8d727b514596ec0d82db87c4382354c3ac90de35f4cf2947ff6a8cde254d32"} Jul 10 14:12:37.702771 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:37.702725 2581 generic.go:356] "Generic (PLEG): container finished" podID="4b06d174-3822-402d-9f16-1eafe43c807d" containerID="ea8d727b514596ec0d82db87c4382354c3ac90de35f4cf2947ff6a8cde254d32" exitCode=0 Jul 10 14:12:37.703162 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:37.702812 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-tsr5v" event={"ID":"4b06d174-3822-402d-9f16-1eafe43c807d","Type":"ContainerDied","Data":"ea8d727b514596ec0d82db87c4382354c3ac90de35f4cf2947ff6a8cde254d32"} Jul 10 14:12:38.709618 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:38.709580 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-tsr5v" event={"ID":"4b06d174-3822-402d-9f16-1eafe43c807d","Type":"ContainerStarted","Data":"15d7e01d263170234567b188e1d4c4fac6f00633e9083a48531794c66fac0370"} Jul 10 14:12:38.709972 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:38.709721 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-tsr5v" Jul 10 14:12:38.732292 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:38.732242 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-tsr5v" podStartSLOduration=1.657831565 podStartE2EDuration="6.73222474s" totalImagesPullingTime="4.06989817s" totalInitContainerRuntime="1.004495005s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:12:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:12:38.731499318 +0000 UTC m=+241.675071695" watchObservedRunningTime="2026-07-10 14:12:38.73222474 +0000 UTC m=+241.675797081" Jul 10 14:12:49.716381 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:49.716352 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-tsr5v" Jul 10 14:12:52.257957 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:52.257924 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8545bb46c8-pplx9"] Jul 10 14:12:52.267782 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:52.267757 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8545bb46c8-pplx9" Jul 10 14:12:52.274360 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:52.274122 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 10 14:12:52.276900 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:52.276884 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 10 14:12:52.276955 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:52.276927 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 10 14:12:52.277002 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:52.276957 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 10 14:12:52.300604 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:52.300575 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8545bb46c8-pplx9"] Jul 10 14:12:52.342939 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:52.342908 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06574f2a-a8f5-447d-b436-1445ac3e4c03-tls-certs\") pod \"kube-auth-proxy-8545bb46c8-pplx9\" (UID: \"06574f2a-a8f5-447d-b436-1445ac3e4c03\") " pod="openshift-ingress/kube-auth-proxy-8545bb46c8-pplx9" Jul 10 14:12:52.343066 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:52.342945 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnshp\" (UniqueName: \"kubernetes.io/projected/06574f2a-a8f5-447d-b436-1445ac3e4c03-kube-api-access-nnshp\") pod \"kube-auth-proxy-8545bb46c8-pplx9\" (UID: \"06574f2a-a8f5-447d-b436-1445ac3e4c03\") " pod="openshift-ingress/kube-auth-proxy-8545bb46c8-pplx9" Jul 10 14:12:52.343066 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:52.343023 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06574f2a-a8f5-447d-b436-1445ac3e4c03-tmp\") pod \"kube-auth-proxy-8545bb46c8-pplx9\" (UID: \"06574f2a-a8f5-447d-b436-1445ac3e4c03\") " pod="openshift-ingress/kube-auth-proxy-8545bb46c8-pplx9" Jul 10 14:12:52.444007 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:52.443980 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06574f2a-a8f5-447d-b436-1445ac3e4c03-tmp\") pod \"kube-auth-proxy-8545bb46c8-pplx9\" (UID: \"06574f2a-a8f5-447d-b436-1445ac3e4c03\") " pod="openshift-ingress/kube-auth-proxy-8545bb46c8-pplx9" Jul 10 14:12:52.444149 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:52.444025 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06574f2a-a8f5-447d-b436-1445ac3e4c03-tls-certs\") pod \"kube-auth-proxy-8545bb46c8-pplx9\" (UID: \"06574f2a-a8f5-447d-b436-1445ac3e4c03\") " pod="openshift-ingress/kube-auth-proxy-8545bb46c8-pplx9" Jul 10 14:12:52.444149 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:52.444048 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnshp\" (UniqueName: \"kubernetes.io/projected/06574f2a-a8f5-447d-b436-1445ac3e4c03-kube-api-access-nnshp\") pod \"kube-auth-proxy-8545bb46c8-pplx9\" (UID: \"06574f2a-a8f5-447d-b436-1445ac3e4c03\") " pod="openshift-ingress/kube-auth-proxy-8545bb46c8-pplx9" Jul 10 14:12:52.446202 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:52.446182 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06574f2a-a8f5-447d-b436-1445ac3e4c03-tmp\") pod \"kube-auth-proxy-8545bb46c8-pplx9\" (UID: \"06574f2a-a8f5-447d-b436-1445ac3e4c03\") " pod="openshift-ingress/kube-auth-proxy-8545bb46c8-pplx9" Jul 10 14:12:52.446451 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:52.446423 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06574f2a-a8f5-447d-b436-1445ac3e4c03-tls-certs\") pod \"kube-auth-proxy-8545bb46c8-pplx9\" (UID: \"06574f2a-a8f5-447d-b436-1445ac3e4c03\") " pod="openshift-ingress/kube-auth-proxy-8545bb46c8-pplx9" Jul 10 14:12:52.456826 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:52.456807 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnshp\" (UniqueName: \"kubernetes.io/projected/06574f2a-a8f5-447d-b436-1445ac3e4c03-kube-api-access-nnshp\") pod \"kube-auth-proxy-8545bb46c8-pplx9\" (UID: \"06574f2a-a8f5-447d-b436-1445ac3e4c03\") " pod="openshift-ingress/kube-auth-proxy-8545bb46c8-pplx9" Jul 10 14:12:52.531239 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:52.531174 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-gz6kn"] Jul 10 14:12:52.533369 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:52.533353 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-gz6kn" Jul 10 14:12:52.538855 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:52.538827 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 10 14:12:52.538964 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:52.538908 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-mpczr\"" Jul 10 14:12:52.544357 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:52.544335 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1632c406-6c81-445d-93cf-d70679c60fd8-cert\") pod \"odh-model-controller-7998c67dc4-gz6kn\" (UID: \"1632c406-6c81-445d-93cf-d70679c60fd8\") " pod="opendatahub/odh-model-controller-7998c67dc4-gz6kn" Jul 10 14:12:52.544440 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:52.544384 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9nrq\" (UniqueName: \"kubernetes.io/projected/1632c406-6c81-445d-93cf-d70679c60fd8-kube-api-access-h9nrq\") pod \"odh-model-controller-7998c67dc4-gz6kn\" (UID: \"1632c406-6c81-445d-93cf-d70679c60fd8\") " pod="opendatahub/odh-model-controller-7998c67dc4-gz6kn" Jul 10 14:12:52.548087 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:52.548067 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-gz6kn"] Jul 10 14:12:52.576664 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:52.576634 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8545bb46c8-pplx9" Jul 10 14:12:52.645899 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:52.645783 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1632c406-6c81-445d-93cf-d70679c60fd8-cert\") pod \"odh-model-controller-7998c67dc4-gz6kn\" (UID: \"1632c406-6c81-445d-93cf-d70679c60fd8\") " pod="opendatahub/odh-model-controller-7998c67dc4-gz6kn" Jul 10 14:12:52.645899 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:52.645858 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9nrq\" (UniqueName: \"kubernetes.io/projected/1632c406-6c81-445d-93cf-d70679c60fd8-kube-api-access-h9nrq\") pod \"odh-model-controller-7998c67dc4-gz6kn\" (UID: \"1632c406-6c81-445d-93cf-d70679c60fd8\") " pod="opendatahub/odh-model-controller-7998c67dc4-gz6kn" Jul 10 14:12:52.646183 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:12:52.646075 2581 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 10 14:12:52.646183 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:12:52.646122 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1632c406-6c81-445d-93cf-d70679c60fd8-cert podName:1632c406-6c81-445d-93cf-d70679c60fd8 nodeName:}" failed. No retries permitted until 2026-07-10 14:12:53.146106224 +0000 UTC m=+256.089678545 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1632c406-6c81-445d-93cf-d70679c60fd8-cert") pod "odh-model-controller-7998c67dc4-gz6kn" (UID: "1632c406-6c81-445d-93cf-d70679c60fd8") : secret "odh-model-controller-webhook-cert" not found Jul 10 14:12:52.663738 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:52.663698 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9nrq\" (UniqueName: \"kubernetes.io/projected/1632c406-6c81-445d-93cf-d70679c60fd8-kube-api-access-h9nrq\") pod \"odh-model-controller-7998c67dc4-gz6kn\" (UID: \"1632c406-6c81-445d-93cf-d70679c60fd8\") " pod="opendatahub/odh-model-controller-7998c67dc4-gz6kn" Jul 10 14:12:52.714137 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:52.714114 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8545bb46c8-pplx9"] Jul 10 14:12:52.716004 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:12:52.715979 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06574f2a_a8f5_447d_b436_1445ac3e4c03.slice/crio-9077f89f19be77c179076b069841dd2cee862a3c277ada0516d3bff0dbe8eef1 WatchSource:0}: Error finding container 9077f89f19be77c179076b069841dd2cee862a3c277ada0516d3bff0dbe8eef1: Status 404 returned error can't find the container with id 9077f89f19be77c179076b069841dd2cee862a3c277ada0516d3bff0dbe8eef1 Jul 10 14:12:52.768081 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:52.768051 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8545bb46c8-pplx9" event={"ID":"06574f2a-a8f5-447d-b436-1445ac3e4c03","Type":"ContainerStarted","Data":"9077f89f19be77c179076b069841dd2cee862a3c277ada0516d3bff0dbe8eef1"} Jul 10 14:12:53.153387 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:53.153343 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1632c406-6c81-445d-93cf-d70679c60fd8-cert\") pod \"odh-model-controller-7998c67dc4-gz6kn\" (UID: \"1632c406-6c81-445d-93cf-d70679c60fd8\") " pod="opendatahub/odh-model-controller-7998c67dc4-gz6kn" Jul 10 14:12:53.153572 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:12:53.153485 2581 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 10 14:12:53.153572 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:12:53.153547 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1632c406-6c81-445d-93cf-d70679c60fd8-cert podName:1632c406-6c81-445d-93cf-d70679c60fd8 nodeName:}" failed. No retries permitted until 2026-07-10 14:12:54.153529776 +0000 UTC m=+257.097102102 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1632c406-6c81-445d-93cf-d70679c60fd8-cert") pod "odh-model-controller-7998c67dc4-gz6kn" (UID: "1632c406-6c81-445d-93cf-d70679c60fd8") : secret "odh-model-controller-webhook-cert" not found Jul 10 14:12:53.619907 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:53.619876 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-x2z8r"] Jul 10 14:12:53.622972 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:53.622955 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-x2z8r" Jul 10 14:12:53.626184 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:53.626162 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 10 14:12:53.626280 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:53.626234 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-fwplc\"" Jul 10 14:12:53.644429 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:53.644405 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-x2z8r"] Jul 10 14:12:53.658751 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:53.658727 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n997t\" (UniqueName: \"kubernetes.io/projected/dc1a3bb6-e954-444e-8990-0269c46bea25-kube-api-access-n997t\") pod \"model-serving-api-54d89bd5fc-x2z8r\" (UID: \"dc1a3bb6-e954-444e-8990-0269c46bea25\") " pod="opendatahub/model-serving-api-54d89bd5fc-x2z8r" Jul 10 14:12:53.658874 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:53.658845 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc1a3bb6-e954-444e-8990-0269c46bea25-tls-certs\") pod \"model-serving-api-54d89bd5fc-x2z8r\" (UID: \"dc1a3bb6-e954-444e-8990-0269c46bea25\") " pod="opendatahub/model-serving-api-54d89bd5fc-x2z8r" Jul 10 14:12:53.759776 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:53.759744 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n997t\" (UniqueName: \"kubernetes.io/projected/dc1a3bb6-e954-444e-8990-0269c46bea25-kube-api-access-n997t\") pod \"model-serving-api-54d89bd5fc-x2z8r\" (UID: \"dc1a3bb6-e954-444e-8990-0269c46bea25\") " pod="opendatahub/model-serving-api-54d89bd5fc-x2z8r" Jul 10 14:12:53.759917 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:53.759829 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc1a3bb6-e954-444e-8990-0269c46bea25-tls-certs\") pod \"model-serving-api-54d89bd5fc-x2z8r\" (UID: \"dc1a3bb6-e954-444e-8990-0269c46bea25\") " pod="opendatahub/model-serving-api-54d89bd5fc-x2z8r" Jul 10 14:12:53.759958 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:12:53.759918 2581 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 10 14:12:53.759995 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:12:53.759978 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc1a3bb6-e954-444e-8990-0269c46bea25-tls-certs podName:dc1a3bb6-e954-444e-8990-0269c46bea25 nodeName:}" failed. No retries permitted until 2026-07-10 14:12:54.259959799 +0000 UTC m=+257.203532119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/dc1a3bb6-e954-444e-8990-0269c46bea25-tls-certs") pod "model-serving-api-54d89bd5fc-x2z8r" (UID: "dc1a3bb6-e954-444e-8990-0269c46bea25") : secret "model-serving-api-tls" not found Jul 10 14:12:53.777234 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:53.777204 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n997t\" (UniqueName: \"kubernetes.io/projected/dc1a3bb6-e954-444e-8990-0269c46bea25-kube-api-access-n997t\") pod \"model-serving-api-54d89bd5fc-x2z8r\" (UID: \"dc1a3bb6-e954-444e-8990-0269c46bea25\") " pod="opendatahub/model-serving-api-54d89bd5fc-x2z8r" Jul 10 14:12:53.871064 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:53.870995 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4"] Jul 10 14:12:53.875064 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:53.875050 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4" Jul 10 14:12:53.878331 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:53.878304 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 10 14:12:53.879400 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:53.879382 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 10 14:12:53.879489 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:53.879384 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 10 14:12:53.879489 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:53.879387 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 10 14:12:53.881656 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:53.881608 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-q8vlk\"" Jul 10 14:12:53.903915 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:53.903895 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4"] Jul 10 14:12:53.961009 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:53.960978 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bvtp\" (UniqueName: \"kubernetes.io/projected/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-kube-api-access-7bvtp\") pod \"istiod-openshift-gateway-7574459656-qhdn4\" (UID: \"9237d1cf-f84d-4aed-94f4-0fbd751bd23c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4" Jul 10 14:12:53.961152 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:53.961027 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-qhdn4\" (UID: \"9237d1cf-f84d-4aed-94f4-0fbd751bd23c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4" Jul 10 14:12:53.961152 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:53.961062 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-istio-token\") pod \"istiod-openshift-gateway-7574459656-qhdn4\" (UID: \"9237d1cf-f84d-4aed-94f4-0fbd751bd23c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4" Jul 10 14:12:53.961152 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:53.961091 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-cacerts\") pod \"istiod-openshift-gateway-7574459656-qhdn4\" (UID: \"9237d1cf-f84d-4aed-94f4-0fbd751bd23c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4" Jul 10 14:12:53.961152 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:53.961113 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-qhdn4\" (UID: \"9237d1cf-f84d-4aed-94f4-0fbd751bd23c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4" Jul 10 14:12:53.961380 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:53.961207 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-qhdn4\" (UID: \"9237d1cf-f84d-4aed-94f4-0fbd751bd23c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4" Jul 10 14:12:53.961380 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:53.961255 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-local-certs\") pod \"istiod-openshift-gateway-7574459656-qhdn4\" (UID: \"9237d1cf-f84d-4aed-94f4-0fbd751bd23c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4" Jul 10 14:12:54.062490 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:54.062460 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-qhdn4\" (UID: \"9237d1cf-f84d-4aed-94f4-0fbd751bd23c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4" Jul 10 14:12:54.062627 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:54.062509 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-local-certs\") pod \"istiod-openshift-gateway-7574459656-qhdn4\" (UID: \"9237d1cf-f84d-4aed-94f4-0fbd751bd23c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4" Jul 10 14:12:54.062627 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:54.062535 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bvtp\" (UniqueName: \"kubernetes.io/projected/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-kube-api-access-7bvtp\") pod \"istiod-openshift-gateway-7574459656-qhdn4\" (UID: \"9237d1cf-f84d-4aed-94f4-0fbd751bd23c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4" Jul 10 14:12:54.062627 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:54.062559 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-qhdn4\" (UID: \"9237d1cf-f84d-4aed-94f4-0fbd751bd23c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4" Jul 10 14:12:54.062627 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:54.062606 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-istio-token\") pod \"istiod-openshift-gateway-7574459656-qhdn4\" (UID: \"9237d1cf-f84d-4aed-94f4-0fbd751bd23c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4" Jul 10 14:12:54.062820 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:54.062636 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-cacerts\") pod \"istiod-openshift-gateway-7574459656-qhdn4\" (UID: \"9237d1cf-f84d-4aed-94f4-0fbd751bd23c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4" Jul 10 14:12:54.062820 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:54.062762 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-qhdn4\" (UID: \"9237d1cf-f84d-4aed-94f4-0fbd751bd23c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4" Jul 10 14:12:54.063120 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:54.063097 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-qhdn4\" (UID: \"9237d1cf-f84d-4aed-94f4-0fbd751bd23c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4" Jul 10 14:12:54.065377 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:54.065352 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-qhdn4\" (UID: \"9237d1cf-f84d-4aed-94f4-0fbd751bd23c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4" Jul 10 14:12:54.065484 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:54.065394 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-cacerts\") pod \"istiod-openshift-gateway-7574459656-qhdn4\" (UID: \"9237d1cf-f84d-4aed-94f4-0fbd751bd23c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4" Jul 10 14:12:54.065484 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:54.065453 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-local-certs\") pod \"istiod-openshift-gateway-7574459656-qhdn4\" (UID: \"9237d1cf-f84d-4aed-94f4-0fbd751bd23c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4" Jul 10 14:12:54.070099 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:54.070070 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-qhdn4\" (UID: \"9237d1cf-f84d-4aed-94f4-0fbd751bd23c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4" Jul 10 14:12:54.072003 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:54.071983 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-istio-token\") pod \"istiod-openshift-gateway-7574459656-qhdn4\" (UID: \"9237d1cf-f84d-4aed-94f4-0fbd751bd23c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4" Jul 10 14:12:54.072288 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:54.072270 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bvtp\" (UniqueName: \"kubernetes.io/projected/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-kube-api-access-7bvtp\") pod \"istiod-openshift-gateway-7574459656-qhdn4\" (UID: \"9237d1cf-f84d-4aed-94f4-0fbd751bd23c\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4" Jul 10 14:12:54.163613 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:54.163535 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1632c406-6c81-445d-93cf-d70679c60fd8-cert\") pod \"odh-model-controller-7998c67dc4-gz6kn\" (UID: \"1632c406-6c81-445d-93cf-d70679c60fd8\") " pod="opendatahub/odh-model-controller-7998c67dc4-gz6kn" Jul 10 14:12:54.165712 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:54.165687 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1632c406-6c81-445d-93cf-d70679c60fd8-cert\") pod \"odh-model-controller-7998c67dc4-gz6kn\" (UID: \"1632c406-6c81-445d-93cf-d70679c60fd8\") " pod="opendatahub/odh-model-controller-7998c67dc4-gz6kn" Jul 10 14:12:54.184727 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:54.184709 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4" Jul 10 14:12:54.264858 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:54.264828 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc1a3bb6-e954-444e-8990-0269c46bea25-tls-certs\") pod \"model-serving-api-54d89bd5fc-x2z8r\" (UID: \"dc1a3bb6-e954-444e-8990-0269c46bea25\") " pod="opendatahub/model-serving-api-54d89bd5fc-x2z8r" Jul 10 14:12:54.267337 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:54.267295 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc1a3bb6-e954-444e-8990-0269c46bea25-tls-certs\") pod \"model-serving-api-54d89bd5fc-x2z8r\" (UID: \"dc1a3bb6-e954-444e-8990-0269c46bea25\") " pod="opendatahub/model-serving-api-54d89bd5fc-x2z8r" Jul 10 14:12:54.312795 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:54.312771 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4"] Jul 10 14:12:54.314461 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:12:54.314437 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9237d1cf_f84d_4aed_94f4_0fbd751bd23c.slice/crio-fd3c4854026d9b6b5c3791109768201d03205da569654f151ced377ce248a215 WatchSource:0}: Error finding container fd3c4854026d9b6b5c3791109768201d03205da569654f151ced377ce248a215: Status 404 returned error can't find the container with id fd3c4854026d9b6b5c3791109768201d03205da569654f151ced377ce248a215 Jul 10 14:12:54.343426 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:54.343399 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-gz6kn" Jul 10 14:12:54.483739 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:54.483704 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-gz6kn"] Jul 10 14:12:54.485732 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:12:54.485694 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1632c406_6c81_445d_93cf_d70679c60fd8.slice/crio-ec7d93938686a9e92bdfb4e5a46aca339b7dcf4193479335e6c3f734e3bbda83 WatchSource:0}: Error finding container ec7d93938686a9e92bdfb4e5a46aca339b7dcf4193479335e6c3f734e3bbda83: Status 404 returned error can't find the container with id ec7d93938686a9e92bdfb4e5a46aca339b7dcf4193479335e6c3f734e3bbda83 Jul 10 14:12:54.532985 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:54.532963 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-x2z8r" Jul 10 14:12:54.659085 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:54.659061 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-x2z8r"] Jul 10 14:12:54.661591 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:12:54.661562 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc1a3bb6_e954_444e_8990_0269c46bea25.slice/crio-61c4c9d16a0eac2d12ad1fd77c3edd3f1ffa4fe910fa0e69949e54dbfb42b320 WatchSource:0}: Error finding container 61c4c9d16a0eac2d12ad1fd77c3edd3f1ffa4fe910fa0e69949e54dbfb42b320: Status 404 returned error can't find the container with id 61c4c9d16a0eac2d12ad1fd77c3edd3f1ffa4fe910fa0e69949e54dbfb42b320 Jul 10 14:12:54.777619 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:54.777530 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-gz6kn" event={"ID":"1632c406-6c81-445d-93cf-d70679c60fd8","Type":"ContainerStarted","Data":"ec7d93938686a9e92bdfb4e5a46aca339b7dcf4193479335e6c3f734e3bbda83"} Jul 10 14:12:54.779073 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:54.779043 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4" event={"ID":"9237d1cf-f84d-4aed-94f4-0fbd751bd23c","Type":"ContainerStarted","Data":"fd3c4854026d9b6b5c3791109768201d03205da569654f151ced377ce248a215"} Jul 10 14:12:54.780265 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:54.780229 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-x2z8r" event={"ID":"dc1a3bb6-e954-444e-8990-0269c46bea25","Type":"ContainerStarted","Data":"61c4c9d16a0eac2d12ad1fd77c3edd3f1ffa4fe910fa0e69949e54dbfb42b320"} Jul 10 14:12:59.563674 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:59.563606 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:12:59.564030 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:59.563688 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:12:59.806824 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:59.806780 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4" event={"ID":"9237d1cf-f84d-4aed-94f4-0fbd751bd23c","Type":"ContainerStarted","Data":"e4038895eb00819d7fca82a1d7c2f49450e8fb2531d86da5e6aaac7f714f533e"} Jul 10 14:12:59.807023 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:59.806918 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4" Jul 10 14:12:59.808596 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:59.808570 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8545bb46c8-pplx9" event={"ID":"06574f2a-a8f5-447d-b436-1445ac3e4c03","Type":"ContainerStarted","Data":"4af0726b4a95584c0a8a44eefacc60ca0799a08246544edd1740609df71d4f71"} Jul 10 14:12:59.810346 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:59.810267 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-x2z8r" event={"ID":"dc1a3bb6-e954-444e-8990-0269c46bea25","Type":"ContainerStarted","Data":"7daff066ae383701b573d668a90df193c848b287052493215d9b213f2359fd4e"} Jul 10 14:12:59.810346 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:59.810336 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-x2z8r" Jul 10 14:12:59.811929 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:59.811907 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-gz6kn" event={"ID":"1632c406-6c81-445d-93cf-d70679c60fd8","Type":"ContainerStarted","Data":"ad926b83c78d8109b8fec5af0bda9b064022528a8d03af60666064a6a51ef029"} Jul 10 14:12:59.812068 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:59.812049 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-gz6kn" Jul 10 14:12:59.830570 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:59.830527 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4" podStartSLOduration=1.583647203 podStartE2EDuration="6.830513966s" totalImagesPullingTime="5.246866763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:12:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:12:59.827915133 +0000 UTC m=+262.771487531" watchObservedRunningTime="2026-07-10 14:12:59.830513966 +0000 UTC m=+262.774086283" Jul 10 14:12:59.848665 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:59.848615 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8545bb46c8-pplx9" podStartSLOduration=0.968726372 podStartE2EDuration="7.848600099s" totalImagesPullingTime="6.879873727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:12:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:12:59.847405313 +0000 UTC m=+262.790977654" watchObservedRunningTime="2026-07-10 14:12:59.848600099 +0000 UTC m=+262.792172439" Jul 10 14:12:59.864091 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:59.864044 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-x2z8r" podStartSLOduration=1.965205671 podStartE2EDuration="6.864030478s" totalImagesPullingTime="4.898824807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:12:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:12:59.86360232 +0000 UTC m=+262.807174661" watchObservedRunningTime="2026-07-10 14:12:59.864030478 +0000 UTC m=+262.807602818" Jul 10 14:12:59.885961 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:12:59.885909 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-gz6kn" podStartSLOduration=2.759608229 podStartE2EDuration="7.885892613s" totalImagesPullingTime="5.126284384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:12:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:12:59.883760566 +0000 UTC m=+262.827332906" watchObservedRunningTime="2026-07-10 14:12:59.885892613 +0000 UTC m=+262.829464953" Jul 10 14:13:00.010551 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:00.010516 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfk2z"] Jul 10 14:13:00.013894 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:00.013874 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfk2z" Jul 10 14:13:00.033268 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:00.033246 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfk2z"] Jul 10 14:13:00.118617 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:00.118516 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f00d450-51ca-48e4-941a-36e605a06edf-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-dfk2z\" (UID: \"7f00d450-51ca-48e4-941a-36e605a06edf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfk2z" Jul 10 14:13:00.118617 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:00.118571 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7f00d450-51ca-48e4-941a-36e605a06edf-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-dfk2z\" (UID: \"7f00d450-51ca-48e4-941a-36e605a06edf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfk2z" Jul 10 14:13:00.118843 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:00.118641 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk9xv\" (UniqueName: \"kubernetes.io/projected/7f00d450-51ca-48e4-941a-36e605a06edf-kube-api-access-wk9xv\") pod \"istiod-openshift-gateway-94bb8fbfd-dfk2z\" (UID: \"7f00d450-51ca-48e4-941a-36e605a06edf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfk2z" Jul 10 14:13:00.118843 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:00.118697 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f00d450-51ca-48e4-941a-36e605a06edf-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-dfk2z\" (UID: \"7f00d450-51ca-48e4-941a-36e605a06edf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfk2z" Jul 10 14:13:00.118843 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:00.118733 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7f00d450-51ca-48e4-941a-36e605a06edf-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-dfk2z\" (UID: \"7f00d450-51ca-48e4-941a-36e605a06edf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfk2z" Jul 10 14:13:00.118843 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:00.118785 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7f00d450-51ca-48e4-941a-36e605a06edf-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-dfk2z\" (UID: \"7f00d450-51ca-48e4-941a-36e605a06edf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfk2z" Jul 10 14:13:00.118843 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:00.118839 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7f00d450-51ca-48e4-941a-36e605a06edf-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-dfk2z\" (UID: \"7f00d450-51ca-48e4-941a-36e605a06edf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfk2z" Jul 10 14:13:00.219567 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:00.219529 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk9xv\" (UniqueName: \"kubernetes.io/projected/7f00d450-51ca-48e4-941a-36e605a06edf-kube-api-access-wk9xv\") pod \"istiod-openshift-gateway-94bb8fbfd-dfk2z\" (UID: \"7f00d450-51ca-48e4-941a-36e605a06edf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfk2z" Jul 10 14:13:00.219567 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:00.219579 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f00d450-51ca-48e4-941a-36e605a06edf-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-dfk2z\" (UID: \"7f00d450-51ca-48e4-941a-36e605a06edf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfk2z" Jul 10 14:13:00.219836 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:00.219761 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7f00d450-51ca-48e4-941a-36e605a06edf-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-dfk2z\" (UID: \"7f00d450-51ca-48e4-941a-36e605a06edf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfk2z" Jul 10 14:13:00.219889 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:00.219834 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7f00d450-51ca-48e4-941a-36e605a06edf-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-dfk2z\" (UID: \"7f00d450-51ca-48e4-941a-36e605a06edf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfk2z" Jul 10 14:13:00.220009 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:00.219991 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7f00d450-51ca-48e4-941a-36e605a06edf-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-dfk2z\" (UID: \"7f00d450-51ca-48e4-941a-36e605a06edf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfk2z" Jul 10 14:13:00.220096 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:00.220084 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f00d450-51ca-48e4-941a-36e605a06edf-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-dfk2z\" (UID: \"7f00d450-51ca-48e4-941a-36e605a06edf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfk2z" Jul 10 14:13:00.220150 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:00.220123 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7f00d450-51ca-48e4-941a-36e605a06edf-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-dfk2z\" (UID: \"7f00d450-51ca-48e4-941a-36e605a06edf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfk2z" Jul 10 14:13:00.220806 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:00.220773 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7f00d450-51ca-48e4-941a-36e605a06edf-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-dfk2z\" (UID: \"7f00d450-51ca-48e4-941a-36e605a06edf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfk2z" Jul 10 14:13:00.222451 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:00.222427 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7f00d450-51ca-48e4-941a-36e605a06edf-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-dfk2z\" (UID: \"7f00d450-51ca-48e4-941a-36e605a06edf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfk2z" Jul 10 14:13:00.222620 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:00.222597 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7f00d450-51ca-48e4-941a-36e605a06edf-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-dfk2z\" (UID: \"7f00d450-51ca-48e4-941a-36e605a06edf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfk2z" Jul 10 14:13:00.222688 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:00.222632 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7f00d450-51ca-48e4-941a-36e605a06edf-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-dfk2z\" (UID: \"7f00d450-51ca-48e4-941a-36e605a06edf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfk2z" Jul 10 14:13:00.223122 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:00.223095 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f00d450-51ca-48e4-941a-36e605a06edf-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-dfk2z\" (UID: \"7f00d450-51ca-48e4-941a-36e605a06edf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfk2z" Jul 10 14:13:00.232970 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:00.232949 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk9xv\" (UniqueName: \"kubernetes.io/projected/7f00d450-51ca-48e4-941a-36e605a06edf-kube-api-access-wk9xv\") pod \"istiod-openshift-gateway-94bb8fbfd-dfk2z\" (UID: \"7f00d450-51ca-48e4-941a-36e605a06edf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfk2z" Jul 10 14:13:00.233052 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:00.232958 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f00d450-51ca-48e4-941a-36e605a06edf-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-dfk2z\" (UID: \"7f00d450-51ca-48e4-941a-36e605a06edf\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfk2z" Jul 10 14:13:00.326487 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:00.326464 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfk2z" Jul 10 14:13:00.464339 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:00.464299 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfk2z"] Jul 10 14:13:00.466103 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:13:00.466070 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f00d450_51ca_48e4_941a_36e605a06edf.slice/crio-c12d2e7086a9d6e0b3935a09c9ffc31898919131058164ec5670d805ff58df30 WatchSource:0}: Error finding container c12d2e7086a9d6e0b3935a09c9ffc31898919131058164ec5670d805ff58df30: Status 404 returned error can't find the container with id c12d2e7086a9d6e0b3935a09c9ffc31898919131058164ec5670d805ff58df30 Jul 10 14:13:00.469087 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:00.469057 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:13:00.469184 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:00.469124 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:13:00.818450 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:00.818402 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfk2z" event={"ID":"7f00d450-51ca-48e4-941a-36e605a06edf","Type":"ContainerStarted","Data":"0f4ec01beb8f1f6e672aef6d0131e0df0d85a5e3b39ed3a2c48934ca299241be"} Jul 10 14:13:00.818892 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:00.818461 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfk2z" event={"ID":"7f00d450-51ca-48e4-941a-36e605a06edf","Type":"ContainerStarted","Data":"c12d2e7086a9d6e0b3935a09c9ffc31898919131058164ec5670d805ff58df30"} Jul 10 14:13:00.818892 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:00.818689 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfk2z" Jul 10 14:13:00.820401 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:00.820374 2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-qhdn4 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 10 14:13:00.820539 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:00.820423 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4" podUID="9237d1cf-f84d-4aed-94f4-0fbd751bd23c" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 14:13:00.865909 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:00.865855 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfk2z" podStartSLOduration=1.8658354670000001 podStartE2EDuration="1.865835467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:12:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:13:00.861547965 +0000 UTC m=+263.805120307" watchObservedRunningTime="2026-07-10 14:13:00.865835467 +0000 UTC m=+263.809407810" Jul 10 14:13:01.824435 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:01.824404 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-dfk2z" Jul 10 14:13:01.923496 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:01.923457 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4"] Jul 10 14:13:01.923701 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:01.923674 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4" podUID="9237d1cf-f84d-4aed-94f4-0fbd751bd23c" containerName="discovery" containerID="cri-o://e4038895eb00819d7fca82a1d7c2f49450e8fb2531d86da5e6aaac7f714f533e" gracePeriod=30 Jul 10 14:13:01.925817 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:01.925703 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4" Jul 10 14:13:02.177644 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:02.177617 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4" Jul 10 14:13:02.241704 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:02.241672 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-istio-csr-ca-configmap\") pod \"9237d1cf-f84d-4aed-94f4-0fbd751bd23c\" (UID: \"9237d1cf-f84d-4aed-94f4-0fbd751bd23c\") " Jul 10 14:13:02.241874 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:02.241727 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-cacerts\") pod \"9237d1cf-f84d-4aed-94f4-0fbd751bd23c\" (UID: \"9237d1cf-f84d-4aed-94f4-0fbd751bd23c\") " Jul 10 14:13:02.241874 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:02.241781 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-istio-csr-dns-cert\") pod \"9237d1cf-f84d-4aed-94f4-0fbd751bd23c\" (UID: \"9237d1cf-f84d-4aed-94f4-0fbd751bd23c\") " Jul 10 14:13:02.241874 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:02.241835 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-istio-token\") pod \"9237d1cf-f84d-4aed-94f4-0fbd751bd23c\" (UID: \"9237d1cf-f84d-4aed-94f4-0fbd751bd23c\") " Jul 10 14:13:02.241874 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:02.241865 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bvtp\" (UniqueName: \"kubernetes.io/projected/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-kube-api-access-7bvtp\") pod \"9237d1cf-f84d-4aed-94f4-0fbd751bd23c\" (UID: \"9237d1cf-f84d-4aed-94f4-0fbd751bd23c\") " Jul 10 14:13:02.242080 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:02.241917 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-istio-kubeconfig\") pod \"9237d1cf-f84d-4aed-94f4-0fbd751bd23c\" (UID: \"9237d1cf-f84d-4aed-94f4-0fbd751bd23c\") " Jul 10 14:13:02.242080 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:02.241950 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-local-certs\") pod \"9237d1cf-f84d-4aed-94f4-0fbd751bd23c\" (UID: \"9237d1cf-f84d-4aed-94f4-0fbd751bd23c\") " Jul 10 14:13:02.242168 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:02.242100 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "9237d1cf-f84d-4aed-94f4-0fbd751bd23c" (UID: "9237d1cf-f84d-4aed-94f4-0fbd751bd23c"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:13:02.242219 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:02.242205 2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-istio-csr-ca-configmap\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:13:02.244353 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:02.244309 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-local-certs" (OuterVolumeSpecName: "local-certs") pod "9237d1cf-f84d-4aed-94f4-0fbd751bd23c" (UID: "9237d1cf-f84d-4aed-94f4-0fbd751bd23c"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:13:02.244477 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:02.244449 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-cacerts" (OuterVolumeSpecName: "cacerts") pod "9237d1cf-f84d-4aed-94f4-0fbd751bd23c" (UID: "9237d1cf-f84d-4aed-94f4-0fbd751bd23c"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:13:02.244532 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:02.244478 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "9237d1cf-f84d-4aed-94f4-0fbd751bd23c" (UID: "9237d1cf-f84d-4aed-94f4-0fbd751bd23c"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:13:02.244532 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:02.244516 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-kube-api-access-7bvtp" (OuterVolumeSpecName: "kube-api-access-7bvtp") pod "9237d1cf-f84d-4aed-94f4-0fbd751bd23c" (UID: "9237d1cf-f84d-4aed-94f4-0fbd751bd23c"). InnerVolumeSpecName "kube-api-access-7bvtp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:13:02.244595 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:02.244520 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-istio-token" (OuterVolumeSpecName: "istio-token") pod "9237d1cf-f84d-4aed-94f4-0fbd751bd23c" (UID: "9237d1cf-f84d-4aed-94f4-0fbd751bd23c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:13:02.244595 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:02.244535 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "9237d1cf-f84d-4aed-94f4-0fbd751bd23c" (UID: "9237d1cf-f84d-4aed-94f4-0fbd751bd23c"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:13:02.342828 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:02.342749 2581 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-cacerts\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:13:02.342828 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:02.342796 2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-istio-csr-dns-cert\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:13:02.342828 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:02.342822 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-istio-token\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:13:02.343029 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:02.342832 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bvtp\" (UniqueName: \"kubernetes.io/projected/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-kube-api-access-7bvtp\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:13:02.343029 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:02.342842 2581 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-istio-kubeconfig\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:13:02.343029 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:02.342851 2581 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9237d1cf-f84d-4aed-94f4-0fbd751bd23c-local-certs\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:13:02.828703 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:02.828667 2581 generic.go:356] "Generic (PLEG): container finished" podID="9237d1cf-f84d-4aed-94f4-0fbd751bd23c" containerID="e4038895eb00819d7fca82a1d7c2f49450e8fb2531d86da5e6aaac7f714f533e" exitCode=0 Jul 10 14:13:02.829214 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:02.828717 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4" Jul 10 14:13:02.829214 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:02.828750 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4" event={"ID":"9237d1cf-f84d-4aed-94f4-0fbd751bd23c","Type":"ContainerDied","Data":"e4038895eb00819d7fca82a1d7c2f49450e8fb2531d86da5e6aaac7f714f533e"} Jul 10 14:13:02.829214 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:02.828816 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4" event={"ID":"9237d1cf-f84d-4aed-94f4-0fbd751bd23c","Type":"ContainerDied","Data":"fd3c4854026d9b6b5c3791109768201d03205da569654f151ced377ce248a215"} Jul 10 14:13:02.829214 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:02.828851 2581 scope.go:117] "RemoveContainer" containerID="e4038895eb00819d7fca82a1d7c2f49450e8fb2531d86da5e6aaac7f714f533e" Jul 10 14:13:02.838963 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:02.838942 2581 scope.go:117] "RemoveContainer" containerID="e4038895eb00819d7fca82a1d7c2f49450e8fb2531d86da5e6aaac7f714f533e" Jul 10 14:13:02.839277 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:13:02.839253 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4038895eb00819d7fca82a1d7c2f49450e8fb2531d86da5e6aaac7f714f533e\": container with ID starting with e4038895eb00819d7fca82a1d7c2f49450e8fb2531d86da5e6aaac7f714f533e not found: ID does not exist" containerID="e4038895eb00819d7fca82a1d7c2f49450e8fb2531d86da5e6aaac7f714f533e" Jul 10 14:13:02.839378 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:02.839292 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4038895eb00819d7fca82a1d7c2f49450e8fb2531d86da5e6aaac7f714f533e"} err="failed to get container status \"e4038895eb00819d7fca82a1d7c2f49450e8fb2531d86da5e6aaac7f714f533e\": rpc error: code = NotFound desc = could not find container \"e4038895eb00819d7fca82a1d7c2f49450e8fb2531d86da5e6aaac7f714f533e\": container with ID starting with e4038895eb00819d7fca82a1d7c2f49450e8fb2531d86da5e6aaac7f714f533e not found: ID does not exist" Jul 10 14:13:02.872172 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:02.872150 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4"] Jul 10 14:13:02.879446 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:02.879424 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qhdn4"] Jul 10 14:13:03.077490 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:03.077461 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-n97h4"] Jul 10 14:13:03.077802 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:03.077789 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9237d1cf-f84d-4aed-94f4-0fbd751bd23c" containerName="discovery" Jul 10 14:13:03.077845 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:03.077804 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9237d1cf-f84d-4aed-94f4-0fbd751bd23c" containerName="discovery" Jul 10 14:13:03.077883 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:03.077873 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9237d1cf-f84d-4aed-94f4-0fbd751bd23c" containerName="discovery" Jul 10 14:13:03.082516 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:03.082469 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-n97h4" Jul 10 14:13:03.085774 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:03.085755 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-x7g7s\"" Jul 10 14:13:03.086063 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:03.086051 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 10 14:13:03.092174 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:03.092153 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-b9dhk"] Jul 10 14:13:03.095104 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:03.095087 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b9dhk" Jul 10 14:13:03.096134 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:03.096116 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-n97h4"] Jul 10 14:13:03.098051 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:03.098033 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-pdb7x\"" Jul 10 14:13:03.098750 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:03.098733 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 10 14:13:03.113687 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:03.113650 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-b9dhk"] Jul 10 14:13:03.149145 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:03.149122 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9802e15d-32ce-4ca0-b336-18b6ef0326ee-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-b9dhk\" (UID: \"9802e15d-32ce-4ca0-b336-18b6ef0326ee\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b9dhk" Jul 10 14:13:03.149244 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:03.149159 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k6f9\" (UniqueName: \"kubernetes.io/projected/e37f911d-4d6f-47f6-93c7-bca3f3690909-kube-api-access-5k6f9\") pod \"kserve-controller-manager-d6f4b65b8-n97h4\" (UID: \"e37f911d-4d6f-47f6-93c7-bca3f3690909\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-n97h4" Jul 10 14:13:03.149244 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:03.149228 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e37f911d-4d6f-47f6-93c7-bca3f3690909-cert\") pod \"kserve-controller-manager-d6f4b65b8-n97h4\" (UID: \"e37f911d-4d6f-47f6-93c7-bca3f3690909\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-n97h4" Jul 10 14:13:03.149315 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:03.149264 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2zf4\" (UniqueName: \"kubernetes.io/projected/9802e15d-32ce-4ca0-b336-18b6ef0326ee-kube-api-access-p2zf4\") pod \"llmisvc-controller-manager-777c6bd7d5-b9dhk\" (UID: \"9802e15d-32ce-4ca0-b336-18b6ef0326ee\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b9dhk" Jul 10 14:13:03.250611 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:03.250570 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9802e15d-32ce-4ca0-b336-18b6ef0326ee-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-b9dhk\" (UID: \"9802e15d-32ce-4ca0-b336-18b6ef0326ee\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b9dhk" Jul 10 14:13:03.250757 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:03.250630 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k6f9\" (UniqueName: \"kubernetes.io/projected/e37f911d-4d6f-47f6-93c7-bca3f3690909-kube-api-access-5k6f9\") pod \"kserve-controller-manager-d6f4b65b8-n97h4\" (UID: \"e37f911d-4d6f-47f6-93c7-bca3f3690909\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-n97h4" Jul 10 14:13:03.250757 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:03.250688 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e37f911d-4d6f-47f6-93c7-bca3f3690909-cert\") pod \"kserve-controller-manager-d6f4b65b8-n97h4\" (UID: \"e37f911d-4d6f-47f6-93c7-bca3f3690909\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-n97h4" Jul 10 14:13:03.250757 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:13:03.250722 2581 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 10 14:13:03.250916 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:03.250726 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2zf4\" (UniqueName: \"kubernetes.io/projected/9802e15d-32ce-4ca0-b336-18b6ef0326ee-kube-api-access-p2zf4\") pod \"llmisvc-controller-manager-777c6bd7d5-b9dhk\" (UID: \"9802e15d-32ce-4ca0-b336-18b6ef0326ee\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b9dhk" Jul 10 14:13:03.250916 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:13:03.250782 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9802e15d-32ce-4ca0-b336-18b6ef0326ee-cert podName:9802e15d-32ce-4ca0-b336-18b6ef0326ee nodeName:}" failed. No retries permitted until 2026-07-10 14:13:03.750763267 +0000 UTC m=+266.694335586 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9802e15d-32ce-4ca0-b336-18b6ef0326ee-cert") pod "llmisvc-controller-manager-777c6bd7d5-b9dhk" (UID: "9802e15d-32ce-4ca0-b336-18b6ef0326ee") : secret "llmisvc-webhook-server-cert" not found Jul 10 14:13:03.250916 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:13:03.250821 2581 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 10 14:13:03.250916 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:13:03.250875 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e37f911d-4d6f-47f6-93c7-bca3f3690909-cert podName:e37f911d-4d6f-47f6-93c7-bca3f3690909 nodeName:}" failed. No retries permitted until 2026-07-10 14:13:03.750861046 +0000 UTC m=+266.694433364 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e37f911d-4d6f-47f6-93c7-bca3f3690909-cert") pod "kserve-controller-manager-d6f4b65b8-n97h4" (UID: "e37f911d-4d6f-47f6-93c7-bca3f3690909") : secret "kserve-webhook-server-cert" not found Jul 10 14:13:03.259917 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:03.259890 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2zf4\" (UniqueName: \"kubernetes.io/projected/9802e15d-32ce-4ca0-b336-18b6ef0326ee-kube-api-access-p2zf4\") pod \"llmisvc-controller-manager-777c6bd7d5-b9dhk\" (UID: \"9802e15d-32ce-4ca0-b336-18b6ef0326ee\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b9dhk" Jul 10 14:13:03.260366 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:03.260347 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k6f9\" (UniqueName: \"kubernetes.io/projected/e37f911d-4d6f-47f6-93c7-bca3f3690909-kube-api-access-5k6f9\") pod \"kserve-controller-manager-d6f4b65b8-n97h4\" (UID: \"e37f911d-4d6f-47f6-93c7-bca3f3690909\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-n97h4" Jul 10 14:13:03.644055 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:03.644020 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9237d1cf-f84d-4aed-94f4-0fbd751bd23c" path="/var/lib/kubelet/pods/9237d1cf-f84d-4aed-94f4-0fbd751bd23c/volumes" Jul 10 14:13:03.755463 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:03.755433 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9802e15d-32ce-4ca0-b336-18b6ef0326ee-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-b9dhk\" (UID: \"9802e15d-32ce-4ca0-b336-18b6ef0326ee\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b9dhk" Jul 10 14:13:03.755624 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:03.755606 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e37f911d-4d6f-47f6-93c7-bca3f3690909-cert\") pod \"kserve-controller-manager-d6f4b65b8-n97h4\" (UID: \"e37f911d-4d6f-47f6-93c7-bca3f3690909\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-n97h4" Jul 10 14:13:03.757851 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:03.757829 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9802e15d-32ce-4ca0-b336-18b6ef0326ee-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-b9dhk\" (UID: \"9802e15d-32ce-4ca0-b336-18b6ef0326ee\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b9dhk" Jul 10 14:13:03.757992 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:03.757972 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e37f911d-4d6f-47f6-93c7-bca3f3690909-cert\") pod \"kserve-controller-manager-d6f4b65b8-n97h4\" (UID: \"e37f911d-4d6f-47f6-93c7-bca3f3690909\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-n97h4" Jul 10 14:13:03.993723 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:03.993640 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-n97h4" Jul 10 14:13:04.005474 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:04.005448 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b9dhk" Jul 10 14:13:04.137811 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:04.137739 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-n97h4"] Jul 10 14:13:04.140032 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:13:04.140007 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode37f911d_4d6f_47f6_93c7_bca3f3690909.slice/crio-101a13abccb1746ca9ab5bee363869de176953139c8593be015e8f996c662035 WatchSource:0}: Error finding container 101a13abccb1746ca9ab5bee363869de176953139c8593be015e8f996c662035: Status 404 returned error can't find the container with id 101a13abccb1746ca9ab5bee363869de176953139c8593be015e8f996c662035 Jul 10 14:13:04.161405 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:04.161385 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-b9dhk"] Jul 10 14:13:04.163296 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:13:04.163272 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9802e15d_32ce_4ca0_b336_18b6ef0326ee.slice/crio-afa3f622b26a16ba62cb3e5a6721baf9e20a1354abacb4995e460518259b3ad6 WatchSource:0}: Error finding container afa3f622b26a16ba62cb3e5a6721baf9e20a1354abacb4995e460518259b3ad6: Status 404 returned error can't find the container with id afa3f622b26a16ba62cb3e5a6721baf9e20a1354abacb4995e460518259b3ad6 Jul 10 14:13:04.840535 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:04.840493 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-n97h4" event={"ID":"e37f911d-4d6f-47f6-93c7-bca3f3690909","Type":"ContainerStarted","Data":"101a13abccb1746ca9ab5bee363869de176953139c8593be015e8f996c662035"} Jul 10 14:13:04.842000 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:04.841968 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b9dhk" event={"ID":"9802e15d-32ce-4ca0-b336-18b6ef0326ee","Type":"ContainerStarted","Data":"afa3f622b26a16ba62cb3e5a6721baf9e20a1354abacb4995e460518259b3ad6"} Jul 10 14:13:07.858226 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:07.858187 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-n97h4" event={"ID":"e37f911d-4d6f-47f6-93c7-bca3f3690909","Type":"ContainerStarted","Data":"33f21c788224e82cbef12cf2473f0fb2ba053cbc04f701e35fe6f48c619d593a"} Jul 10 14:13:07.858662 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:07.858341 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-n97h4" Jul 10 14:13:07.875096 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:07.875048 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-n97h4" podStartSLOduration=1.885898447 podStartE2EDuration="4.875030267s" totalImagesPullingTime="2.98913182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:13:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:13:07.874025564 +0000 UTC m=+270.817597906" watchObservedRunningTime="2026-07-10 14:13:07.875030267 +0000 UTC m=+270.818602607" Jul 10 14:13:08.864343 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:08.864241 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b9dhk" event={"ID":"9802e15d-32ce-4ca0-b336-18b6ef0326ee","Type":"ContainerStarted","Data":"83e51d2371266c6da679e70af498e45c23243f1084a6a5313411207f1f0857b3"} Jul 10 14:13:08.864685 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:08.864499 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b9dhk" Jul 10 14:13:08.880564 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:08.880522 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b9dhk" podStartSLOduration=1.494130465 podStartE2EDuration="5.880507593s" totalImagesPullingTime="4.386377128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:13:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:13:08.879350407 +0000 UTC m=+271.822922745" watchObservedRunningTime="2026-07-10 14:13:08.880507593 +0000 UTC m=+271.824079993" Jul 10 14:13:10.820738 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:10.820708 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-gz6kn" Jul 10 14:13:10.823611 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:10.823588 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-x2z8r" Jul 10 14:13:37.507181 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:37.507147 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6z8gc_72c7722f-6a58-4230-a5f4-9c440b6887ea/ovn-acl-logging/0.log" Jul 10 14:13:37.511624 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:37.511600 2581 kubelet.go:1648] "Image garbage collection succeeded" Jul 10 14:13:37.512700 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:37.512345 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6z8gc_72c7722f-6a58-4230-a5f4-9c440b6887ea/ovn-acl-logging/0.log" Jul 10 14:13:38.869655 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:38.869625 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-n97h4" Jul 10 14:13:39.871287 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:39.871254 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b9dhk" Jul 10 14:13:53.380371 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:53.380338 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qgk9b"] Jul 10 14:13:53.382934 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:53.382908 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qgk9b" Jul 10 14:13:53.385614 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:53.385593 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-767xf\"" Jul 10 14:13:53.385851 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:53.385836 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 10 14:13:53.385970 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:53.385930 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 10 14:13:53.392209 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:53.392187 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qgk9b"] Jul 10 14:13:53.480682 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:53.480649 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8mpb\" (UniqueName: \"kubernetes.io/projected/ba217023-5ec8-4c31-a33f-93eb8d56e5eb-kube-api-access-n8mpb\") pod \"kuadrant-operator-catalog-qgk9b\" (UID: \"ba217023-5ec8-4c31-a33f-93eb8d56e5eb\") " pod="kuadrant-system/kuadrant-operator-catalog-qgk9b" Jul 10 14:13:53.581532 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:53.581500 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8mpb\" (UniqueName: \"kubernetes.io/projected/ba217023-5ec8-4c31-a33f-93eb8d56e5eb-kube-api-access-n8mpb\") pod \"kuadrant-operator-catalog-qgk9b\" (UID: \"ba217023-5ec8-4c31-a33f-93eb8d56e5eb\") " pod="kuadrant-system/kuadrant-operator-catalog-qgk9b" Jul 10 14:13:53.589372 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:53.589344 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8mpb\" (UniqueName: \"kubernetes.io/projected/ba217023-5ec8-4c31-a33f-93eb8d56e5eb-kube-api-access-n8mpb\") pod \"kuadrant-operator-catalog-qgk9b\" (UID: \"ba217023-5ec8-4c31-a33f-93eb8d56e5eb\") " pod="kuadrant-system/kuadrant-operator-catalog-qgk9b" Jul 10 14:13:53.694951 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:53.694867 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qgk9b" Jul 10 14:13:53.749172 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:53.749144 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qgk9b"] Jul 10 14:13:53.825484 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:53.825455 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qgk9b"] Jul 10 14:13:53.827387 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:13:53.827356 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba217023_5ec8_4c31_a33f_93eb8d56e5eb.slice/crio-c94ba2c9f9fdefda9bc28bdca2b792f4729de57ec61e6e1aa746fa48c81d0cae WatchSource:0}: Error finding container c94ba2c9f9fdefda9bc28bdca2b792f4729de57ec61e6e1aa746fa48c81d0cae: Status 404 returned error can't find the container with id c94ba2c9f9fdefda9bc28bdca2b792f4729de57ec61e6e1aa746fa48c81d0cae Jul 10 14:13:53.828786 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:53.828770 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 14:13:53.959180 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:53.959110 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mxwp9"] Jul 10 14:13:53.962002 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:53.961987 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mxwp9" Jul 10 14:13:53.971513 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:53.971491 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mxwp9"] Jul 10 14:13:54.075959 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:54.075931 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qgk9b" event={"ID":"ba217023-5ec8-4c31-a33f-93eb8d56e5eb","Type":"ContainerStarted","Data":"c94ba2c9f9fdefda9bc28bdca2b792f4729de57ec61e6e1aa746fa48c81d0cae"} Jul 10 14:13:54.085250 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:54.085227 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cp48\" (UniqueName: \"kubernetes.io/projected/130a58b7-d2f9-42d8-be4e-d2b437bd72b3-kube-api-access-9cp48\") pod \"kuadrant-operator-catalog-mxwp9\" (UID: \"130a58b7-d2f9-42d8-be4e-d2b437bd72b3\") " pod="kuadrant-system/kuadrant-operator-catalog-mxwp9" Jul 10 14:13:54.186011 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:54.185982 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cp48\" (UniqueName: \"kubernetes.io/projected/130a58b7-d2f9-42d8-be4e-d2b437bd72b3-kube-api-access-9cp48\") pod \"kuadrant-operator-catalog-mxwp9\" (UID: \"130a58b7-d2f9-42d8-be4e-d2b437bd72b3\") " pod="kuadrant-system/kuadrant-operator-catalog-mxwp9" Jul 10 14:13:54.193943 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:54.193910 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cp48\" (UniqueName: \"kubernetes.io/projected/130a58b7-d2f9-42d8-be4e-d2b437bd72b3-kube-api-access-9cp48\") pod \"kuadrant-operator-catalog-mxwp9\" (UID: \"130a58b7-d2f9-42d8-be4e-d2b437bd72b3\") " pod="kuadrant-system/kuadrant-operator-catalog-mxwp9" Jul 10 14:13:54.272639 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:54.272551 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mxwp9" Jul 10 14:13:54.402089 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:54.402060 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mxwp9"] Jul 10 14:13:54.403819 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:13:54.403789 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod130a58b7_d2f9_42d8_be4e_d2b437bd72b3.slice/crio-f28477caf0974b23b02bb1500aa97d2cdff8e5c664210d839877f411011237b8 WatchSource:0}: Error finding container f28477caf0974b23b02bb1500aa97d2cdff8e5c664210d839877f411011237b8: Status 404 returned error can't find the container with id f28477caf0974b23b02bb1500aa97d2cdff8e5c664210d839877f411011237b8 Jul 10 14:13:55.083610 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:55.083578 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mxwp9" event={"ID":"130a58b7-d2f9-42d8-be4e-d2b437bd72b3","Type":"ContainerStarted","Data":"f28477caf0974b23b02bb1500aa97d2cdff8e5c664210d839877f411011237b8"} Jul 10 14:13:57.097209 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:57.097165 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qgk9b" event={"ID":"ba217023-5ec8-4c31-a33f-93eb8d56e5eb","Type":"ContainerStarted","Data":"1f7ccc75a6b6642c2d4568e33298f637e1b1e1160116ba31d5d7cad5357aa9c8"} Jul 10 14:13:57.097209 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:57.097202 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-qgk9b" podUID="ba217023-5ec8-4c31-a33f-93eb8d56e5eb" containerName="registry-server" containerID="cri-o://1f7ccc75a6b6642c2d4568e33298f637e1b1e1160116ba31d5d7cad5357aa9c8" gracePeriod=2 Jul 10 14:13:57.098845 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:57.098815 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mxwp9" event={"ID":"130a58b7-d2f9-42d8-be4e-d2b437bd72b3","Type":"ContainerStarted","Data":"f5b30fa7f594679a26324aa3a47f442ab50e43d8bcfc2c730d913f70ad7ac8dc"} Jul 10 14:13:57.114270 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:57.114223 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-qgk9b" podStartSLOduration=1.420462401 podStartE2EDuration="4.114206825s" totalImagesPullingTime="2.693744424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:13:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:13:57.113758289 +0000 UTC m=+320.057330629" watchObservedRunningTime="2026-07-10 14:13:57.114206825 +0000 UTC m=+320.057779167" Jul 10 14:13:57.131059 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:57.131019 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-mxwp9" podStartSLOduration=2.010494784 podStartE2EDuration="4.131003678s" totalImagesPullingTime="2.120508894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:13:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:13:57.130464158 +0000 UTC m=+320.074036500" watchObservedRunningTime="2026-07-10 14:13:57.131003678 +0000 UTC m=+320.074576020" Jul 10 14:13:57.337115 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:57.337093 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qgk9b" Jul 10 14:13:57.418178 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:57.418087 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8mpb\" (UniqueName: \"kubernetes.io/projected/ba217023-5ec8-4c31-a33f-93eb8d56e5eb-kube-api-access-n8mpb\") pod \"ba217023-5ec8-4c31-a33f-93eb8d56e5eb\" (UID: \"ba217023-5ec8-4c31-a33f-93eb8d56e5eb\") " Jul 10 14:13:57.420198 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:57.420176 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba217023-5ec8-4c31-a33f-93eb8d56e5eb-kube-api-access-n8mpb" (OuterVolumeSpecName: "kube-api-access-n8mpb") pod "ba217023-5ec8-4c31-a33f-93eb8d56e5eb" (UID: "ba217023-5ec8-4c31-a33f-93eb8d56e5eb"). InnerVolumeSpecName "kube-api-access-n8mpb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:13:57.518942 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:57.518906 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8mpb\" (UniqueName: \"kubernetes.io/projected/ba217023-5ec8-4c31-a33f-93eb8d56e5eb-kube-api-access-n8mpb\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:13:58.104418 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:58.104381 2581 generic.go:356] "Generic (PLEG): container finished" podID="ba217023-5ec8-4c31-a33f-93eb8d56e5eb" containerID="1f7ccc75a6b6642c2d4568e33298f637e1b1e1160116ba31d5d7cad5357aa9c8" exitCode=0 Jul 10 14:13:58.104893 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:58.104423 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qgk9b" Jul 10 14:13:58.104893 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:58.104472 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qgk9b" event={"ID":"ba217023-5ec8-4c31-a33f-93eb8d56e5eb","Type":"ContainerDied","Data":"1f7ccc75a6b6642c2d4568e33298f637e1b1e1160116ba31d5d7cad5357aa9c8"} Jul 10 14:13:58.104893 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:58.104563 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qgk9b" event={"ID":"ba217023-5ec8-4c31-a33f-93eb8d56e5eb","Type":"ContainerDied","Data":"c94ba2c9f9fdefda9bc28bdca2b792f4729de57ec61e6e1aa746fa48c81d0cae"} Jul 10 14:13:58.104893 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:58.104594 2581 scope.go:117] "RemoveContainer" containerID="1f7ccc75a6b6642c2d4568e33298f637e1b1e1160116ba31d5d7cad5357aa9c8" Jul 10 14:13:58.113188 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:58.113158 2581 scope.go:117] "RemoveContainer" containerID="1f7ccc75a6b6642c2d4568e33298f637e1b1e1160116ba31d5d7cad5357aa9c8" Jul 10 14:13:58.113482 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:13:58.113466 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f7ccc75a6b6642c2d4568e33298f637e1b1e1160116ba31d5d7cad5357aa9c8\": container with ID starting with 1f7ccc75a6b6642c2d4568e33298f637e1b1e1160116ba31d5d7cad5357aa9c8 not found: ID does not exist" containerID="1f7ccc75a6b6642c2d4568e33298f637e1b1e1160116ba31d5d7cad5357aa9c8" Jul 10 14:13:58.113540 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:58.113488 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f7ccc75a6b6642c2d4568e33298f637e1b1e1160116ba31d5d7cad5357aa9c8"} err="failed to get container status \"1f7ccc75a6b6642c2d4568e33298f637e1b1e1160116ba31d5d7cad5357aa9c8\": rpc error: code = NotFound desc = could not find container \"1f7ccc75a6b6642c2d4568e33298f637e1b1e1160116ba31d5d7cad5357aa9c8\": container with ID starting with 1f7ccc75a6b6642c2d4568e33298f637e1b1e1160116ba31d5d7cad5357aa9c8 not found: ID does not exist" Jul 10 14:13:58.121118 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:58.121098 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qgk9b"] Jul 10 14:13:58.125271 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:58.125250 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qgk9b"] Jul 10 14:13:59.643915 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:13:59.643887 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba217023-5ec8-4c31-a33f-93eb8d56e5eb" path="/var/lib/kubelet/pods/ba217023-5ec8-4c31-a33f-93eb8d56e5eb/volumes" Jul 10 14:14:04.273021 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:04.272974 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-mxwp9" Jul 10 14:14:04.273497 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:04.273057 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-mxwp9" Jul 10 14:14:04.295371 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:04.295348 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-mxwp9" Jul 10 14:14:05.160755 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:05.160729 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-mxwp9" Jul 10 14:14:08.996471 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:08.996433 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fr7zb"] Jul 10 14:14:08.996883 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:08.996803 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba217023-5ec8-4c31-a33f-93eb8d56e5eb" containerName="registry-server" Jul 10 14:14:08.996883 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:08.996814 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba217023-5ec8-4c31-a33f-93eb8d56e5eb" containerName="registry-server" Jul 10 14:14:08.996883 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:08.996865 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba217023-5ec8-4c31-a33f-93eb8d56e5eb" containerName="registry-server" Jul 10 14:14:09.000092 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:09.000074 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fr7zb" Jul 10 14:14:09.003024 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:09.003005 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-62cqs\"" Jul 10 14:14:09.008765 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:09.008740 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fr7zb"] Jul 10 14:14:09.120817 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:09.120778 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/344f748f-8403-4ced-9c0a-3db6e352e084-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fr7zb\" (UID: \"344f748f-8403-4ced-9c0a-3db6e352e084\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fr7zb" Jul 10 14:14:09.120985 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:09.120826 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/344f748f-8403-4ced-9c0a-3db6e352e084-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fr7zb\" (UID: \"344f748f-8403-4ced-9c0a-3db6e352e084\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fr7zb" Jul 10 14:14:09.120985 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:09.120870 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmbxf\" (UniqueName: \"kubernetes.io/projected/344f748f-8403-4ced-9c0a-3db6e352e084-kube-api-access-mmbxf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fr7zb\" (UID: \"344f748f-8403-4ced-9c0a-3db6e352e084\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fr7zb" Jul 10 14:14:09.221659 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:09.221621 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmbxf\" (UniqueName: \"kubernetes.io/projected/344f748f-8403-4ced-9c0a-3db6e352e084-kube-api-access-mmbxf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fr7zb\" (UID: \"344f748f-8403-4ced-9c0a-3db6e352e084\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fr7zb" Jul 10 14:14:09.221821 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:09.221697 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/344f748f-8403-4ced-9c0a-3db6e352e084-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fr7zb\" (UID: \"344f748f-8403-4ced-9c0a-3db6e352e084\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fr7zb" Jul 10 14:14:09.221821 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:09.221726 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/344f748f-8403-4ced-9c0a-3db6e352e084-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fr7zb\" (UID: \"344f748f-8403-4ced-9c0a-3db6e352e084\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fr7zb" Jul 10 14:14:09.222152 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:09.222132 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/344f748f-8403-4ced-9c0a-3db6e352e084-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fr7zb\" (UID: \"344f748f-8403-4ced-9c0a-3db6e352e084\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fr7zb" Jul 10 14:14:09.222188 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:09.222144 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/344f748f-8403-4ced-9c0a-3db6e352e084-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fr7zb\" (UID: \"344f748f-8403-4ced-9c0a-3db6e352e084\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fr7zb" Jul 10 14:14:09.230205 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:09.230177 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmbxf\" (UniqueName: \"kubernetes.io/projected/344f748f-8403-4ced-9c0a-3db6e352e084-kube-api-access-mmbxf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fr7zb\" (UID: \"344f748f-8403-4ced-9c0a-3db6e352e084\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fr7zb" Jul 10 14:14:09.309907 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:09.309880 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fr7zb" Jul 10 14:14:09.398833 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:09.398807 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x7vf5"] Jul 10 14:14:09.402392 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:09.402371 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x7vf5" Jul 10 14:14:09.410465 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:09.410403 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x7vf5"] Jul 10 14:14:09.442199 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:09.442175 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fr7zb"] Jul 10 14:14:09.443812 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:14:09.443779 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod344f748f_8403_4ced_9c0a_3db6e352e084.slice/crio-6ecbf2b22f98941f8217b72134e67cd750cde527084d11db66e61aade6aac46c WatchSource:0}: Error finding container 6ecbf2b22f98941f8217b72134e67cd750cde527084d11db66e61aade6aac46c: Status 404 returned error can't find the container with id 6ecbf2b22f98941f8217b72134e67cd750cde527084d11db66e61aade6aac46c Jul 10 14:14:09.523665 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:09.523631 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxsgb\" (UniqueName: \"kubernetes.io/projected/b978efc0-653a-45da-9ea5-a7abfcfc3460-kube-api-access-kxsgb\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x7vf5\" (UID: \"b978efc0-653a-45da-9ea5-a7abfcfc3460\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x7vf5" Jul 10 14:14:09.523815 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:09.523678 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b978efc0-653a-45da-9ea5-a7abfcfc3460-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x7vf5\" (UID: \"b978efc0-653a-45da-9ea5-a7abfcfc3460\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x7vf5" Jul 10 14:14:09.523815 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:09.523745 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b978efc0-653a-45da-9ea5-a7abfcfc3460-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x7vf5\" (UID: \"b978efc0-653a-45da-9ea5-a7abfcfc3460\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x7vf5" Jul 10 14:14:09.624773 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:09.624653 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxsgb\" (UniqueName: \"kubernetes.io/projected/b978efc0-653a-45da-9ea5-a7abfcfc3460-kube-api-access-kxsgb\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x7vf5\" (UID: \"b978efc0-653a-45da-9ea5-a7abfcfc3460\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x7vf5" Jul 10 14:14:09.624773 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:09.624700 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b978efc0-653a-45da-9ea5-a7abfcfc3460-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x7vf5\" (UID: \"b978efc0-653a-45da-9ea5-a7abfcfc3460\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x7vf5" Jul 10 14:14:09.624773 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:09.624734 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b978efc0-653a-45da-9ea5-a7abfcfc3460-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x7vf5\" (UID: \"b978efc0-653a-45da-9ea5-a7abfcfc3460\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x7vf5" Jul 10 14:14:09.625137 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:09.625116 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b978efc0-653a-45da-9ea5-a7abfcfc3460-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x7vf5\" (UID: \"b978efc0-653a-45da-9ea5-a7abfcfc3460\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x7vf5" Jul 10 14:14:09.625175 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:09.625128 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b978efc0-653a-45da-9ea5-a7abfcfc3460-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x7vf5\" (UID: \"b978efc0-653a-45da-9ea5-a7abfcfc3460\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x7vf5" Jul 10 14:14:09.633731 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:09.633699 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxsgb\" (UniqueName: \"kubernetes.io/projected/b978efc0-653a-45da-9ea5-a7abfcfc3460-kube-api-access-kxsgb\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x7vf5\" (UID: \"b978efc0-653a-45da-9ea5-a7abfcfc3460\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x7vf5" Jul 10 14:14:09.714609 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:09.714572 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x7vf5" Jul 10 14:14:09.795659 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:09.795630 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz"] Jul 10 14:14:09.799928 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:09.799906 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz" Jul 10 14:14:09.809572 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:09.809548 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz"] Jul 10 14:14:09.846846 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:09.846822 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x7vf5"] Jul 10 14:14:09.848338 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:14:09.848298 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb978efc0_653a_45da_9ea5_a7abfcfc3460.slice/crio-6670d1a31e2ef229a134d64f793273a8102adc8f94f9c72f492651e46dcd3666 WatchSource:0}: Error finding container 6670d1a31e2ef229a134d64f793273a8102adc8f94f9c72f492651e46dcd3666: Status 404 returned error can't find the container with id 6670d1a31e2ef229a134d64f793273a8102adc8f94f9c72f492651e46dcd3666 Jul 10 14:14:09.927503 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:09.927472 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwlcb\" (UniqueName: \"kubernetes.io/projected/44189322-d87a-4b6d-877d-a7d4fa6f5a9e-kube-api-access-nwlcb\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz\" (UID: \"44189322-d87a-4b6d-877d-a7d4fa6f5a9e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz" Jul 10 14:14:09.927666 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:09.927524 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44189322-d87a-4b6d-877d-a7d4fa6f5a9e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz\" (UID: \"44189322-d87a-4b6d-877d-a7d4fa6f5a9e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz" Jul 10 14:14:09.927666 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:09.927545 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44189322-d87a-4b6d-877d-a7d4fa6f5a9e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz\" (UID: \"44189322-d87a-4b6d-877d-a7d4fa6f5a9e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz" Jul 10 14:14:10.029027 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:10.028998 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwlcb\" (UniqueName: \"kubernetes.io/projected/44189322-d87a-4b6d-877d-a7d4fa6f5a9e-kube-api-access-nwlcb\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz\" (UID: \"44189322-d87a-4b6d-877d-a7d4fa6f5a9e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz" Jul 10 14:14:10.029441 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:10.029041 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44189322-d87a-4b6d-877d-a7d4fa6f5a9e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz\" (UID: \"44189322-d87a-4b6d-877d-a7d4fa6f5a9e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz" Jul 10 14:14:10.029441 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:10.029059 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44189322-d87a-4b6d-877d-a7d4fa6f5a9e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz\" (UID: \"44189322-d87a-4b6d-877d-a7d4fa6f5a9e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz" Jul 10 14:14:10.029441 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:10.029409 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44189322-d87a-4b6d-877d-a7d4fa6f5a9e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz\" (UID: \"44189322-d87a-4b6d-877d-a7d4fa6f5a9e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz" Jul 10 14:14:10.029441 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:10.029438 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44189322-d87a-4b6d-877d-a7d4fa6f5a9e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz\" (UID: \"44189322-d87a-4b6d-877d-a7d4fa6f5a9e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz" Jul 10 14:14:10.037939 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:10.037919 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwlcb\" (UniqueName: \"kubernetes.io/projected/44189322-d87a-4b6d-877d-a7d4fa6f5a9e-kube-api-access-nwlcb\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz\" (UID: \"44189322-d87a-4b6d-877d-a7d4fa6f5a9e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz" Jul 10 14:14:10.111747 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:10.111714 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz" Jul 10 14:14:10.165735 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:10.165703 2581 generic.go:356] "Generic (PLEG): container finished" podID="344f748f-8403-4ced-9c0a-3db6e352e084" containerID="ad18b38a15227cc3d20c6f5ef794535d0f075e7b61784666eda285dc74926f16" exitCode=0 Jul 10 14:14:10.165861 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:10.165787 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fr7zb" event={"ID":"344f748f-8403-4ced-9c0a-3db6e352e084","Type":"ContainerDied","Data":"ad18b38a15227cc3d20c6f5ef794535d0f075e7b61784666eda285dc74926f16"} Jul 10 14:14:10.165861 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:10.165851 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fr7zb" event={"ID":"344f748f-8403-4ced-9c0a-3db6e352e084","Type":"ContainerStarted","Data":"6ecbf2b22f98941f8217b72134e67cd750cde527084d11db66e61aade6aac46c"} Jul 10 14:14:10.169602 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:10.169429 2581 generic.go:356] "Generic (PLEG): container finished" podID="b978efc0-653a-45da-9ea5-a7abfcfc3460" containerID="fa5790ff5b692033aaf37bae33daf6976fd82bb3363057e696dd1e8069c89ec6" exitCode=0 Jul 10 14:14:10.169602 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:10.169464 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x7vf5" event={"ID":"b978efc0-653a-45da-9ea5-a7abfcfc3460","Type":"ContainerDied","Data":"fa5790ff5b692033aaf37bae33daf6976fd82bb3363057e696dd1e8069c89ec6"} Jul 10 14:14:10.169602 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:10.169541 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x7vf5" event={"ID":"b978efc0-653a-45da-9ea5-a7abfcfc3460","Type":"ContainerStarted","Data":"6670d1a31e2ef229a134d64f793273a8102adc8f94f9c72f492651e46dcd3666"} Jul 10 14:14:10.197784 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:10.197750 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mb2z9"] Jul 10 14:14:10.205469 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:10.205447 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mb2z9" Jul 10 14:14:10.210250 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:10.210222 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mb2z9"] Jul 10 14:14:10.251853 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:10.251826 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz"] Jul 10 14:14:10.253755 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:14:10.253732 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44189322_d87a_4b6d_877d_a7d4fa6f5a9e.slice/crio-0f9c51e3707e1f2ae6dc97c0edac33a563b0b197353038f0e0c3a6e36f2da7a6 WatchSource:0}: Error finding container 0f9c51e3707e1f2ae6dc97c0edac33a563b0b197353038f0e0c3a6e36f2da7a6: Status 404 returned error can't find the container with id 0f9c51e3707e1f2ae6dc97c0edac33a563b0b197353038f0e0c3a6e36f2da7a6 Jul 10 14:14:10.331541 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:10.331498 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/693b7200-525e-494e-b879-919d214f0272-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mb2z9\" (UID: \"693b7200-525e-494e-b879-919d214f0272\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mb2z9" Jul 10 14:14:10.331746 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:10.331729 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/693b7200-525e-494e-b879-919d214f0272-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mb2z9\" (UID: \"693b7200-525e-494e-b879-919d214f0272\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mb2z9" Jul 10 14:14:10.331806 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:10.331789 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qcdb\" (UniqueName: \"kubernetes.io/projected/693b7200-525e-494e-b879-919d214f0272-kube-api-access-5qcdb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mb2z9\" (UID: \"693b7200-525e-494e-b879-919d214f0272\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mb2z9" Jul 10 14:14:10.432310 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:10.432236 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/693b7200-525e-494e-b879-919d214f0272-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mb2z9\" (UID: \"693b7200-525e-494e-b879-919d214f0272\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mb2z9" Jul 10 14:14:10.432310 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:10.432280 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qcdb\" (UniqueName: \"kubernetes.io/projected/693b7200-525e-494e-b879-919d214f0272-kube-api-access-5qcdb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mb2z9\" (UID: \"693b7200-525e-494e-b879-919d214f0272\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mb2z9" Jul 10 14:14:10.432543 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:10.432370 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/693b7200-525e-494e-b879-919d214f0272-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mb2z9\" (UID: \"693b7200-525e-494e-b879-919d214f0272\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mb2z9" Jul 10 14:14:10.432751 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:10.432714 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/693b7200-525e-494e-b879-919d214f0272-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mb2z9\" (UID: \"693b7200-525e-494e-b879-919d214f0272\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mb2z9" Jul 10 14:14:10.432826 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:10.432758 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/693b7200-525e-494e-b879-919d214f0272-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mb2z9\" (UID: \"693b7200-525e-494e-b879-919d214f0272\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mb2z9" Jul 10 14:14:10.441373 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:10.441352 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qcdb\" (UniqueName: \"kubernetes.io/projected/693b7200-525e-494e-b879-919d214f0272-kube-api-access-5qcdb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mb2z9\" (UID: \"693b7200-525e-494e-b879-919d214f0272\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mb2z9" Jul 10 14:14:10.519204 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:10.519178 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mb2z9" Jul 10 14:14:10.645108 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:10.645077 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mb2z9"] Jul 10 14:14:10.648160 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:14:10.648130 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod693b7200_525e_494e_b879_919d214f0272.slice/crio-dee23afc8d6977173948860853d820da4c39ade49414847040e696134fc3e022 WatchSource:0}: Error finding container dee23afc8d6977173948860853d820da4c39ade49414847040e696134fc3e022: Status 404 returned error can't find the container with id dee23afc8d6977173948860853d820da4c39ade49414847040e696134fc3e022 Jul 10 14:14:11.176404 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:11.176371 2581 generic.go:356] "Generic (PLEG): container finished" podID="693b7200-525e-494e-b879-919d214f0272" containerID="efc4855be887af41312d7e7cc4a507fee15afc07f750a97cd2a0cc7e1d3e84c4" exitCode=0 Jul 10 14:14:11.176836 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:11.176454 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mb2z9" event={"ID":"693b7200-525e-494e-b879-919d214f0272","Type":"ContainerDied","Data":"efc4855be887af41312d7e7cc4a507fee15afc07f750a97cd2a0cc7e1d3e84c4"} Jul 10 14:14:11.176836 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:11.176516 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mb2z9" event={"ID":"693b7200-525e-494e-b879-919d214f0272","Type":"ContainerStarted","Data":"dee23afc8d6977173948860853d820da4c39ade49414847040e696134fc3e022"} Jul 10 14:14:11.178553 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:11.178510 2581 generic.go:356] "Generic (PLEG): container finished" podID="b978efc0-653a-45da-9ea5-a7abfcfc3460" containerID="0db825a4c857216bb32d1009d241c609d05a952fa0eb46964a84f524c186551c" exitCode=0 Jul 10 14:14:11.178676 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:11.178596 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x7vf5" event={"ID":"b978efc0-653a-45da-9ea5-a7abfcfc3460","Type":"ContainerDied","Data":"0db825a4c857216bb32d1009d241c609d05a952fa0eb46964a84f524c186551c"} Jul 10 14:14:11.180274 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:11.180249 2581 generic.go:356] "Generic (PLEG): container finished" podID="44189322-d87a-4b6d-877d-a7d4fa6f5a9e" containerID="ae02db6d680007e48823505502290c49f5ab988c028c2cc866104c24aec963bc" exitCode=0 Jul 10 14:14:11.180429 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:11.180351 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz" event={"ID":"44189322-d87a-4b6d-877d-a7d4fa6f5a9e","Type":"ContainerDied","Data":"ae02db6d680007e48823505502290c49f5ab988c028c2cc866104c24aec963bc"} Jul 10 14:14:11.180429 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:11.180398 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz" event={"ID":"44189322-d87a-4b6d-877d-a7d4fa6f5a9e","Type":"ContainerStarted","Data":"0f9c51e3707e1f2ae6dc97c0edac33a563b0b197353038f0e0c3a6e36f2da7a6"} Jul 10 14:14:12.188836 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:12.188803 2581 generic.go:356] "Generic (PLEG): container finished" podID="b978efc0-653a-45da-9ea5-a7abfcfc3460" containerID="7d69b23b57a930ad4160d44954e0eab8b4f7913ca358763500ff86235641d413" exitCode=0 Jul 10 14:14:12.189362 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:12.188870 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x7vf5" event={"ID":"b978efc0-653a-45da-9ea5-a7abfcfc3460","Type":"ContainerDied","Data":"7d69b23b57a930ad4160d44954e0eab8b4f7913ca358763500ff86235641d413"} Jul 10 14:14:12.191053 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:12.191027 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz" event={"ID":"44189322-d87a-4b6d-877d-a7d4fa6f5a9e","Type":"ContainerStarted","Data":"e86f58ec544948beec83d4f50e63caa9a80c5e341de0addf7be1f88555d36446"} Jul 10 14:14:12.193121 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:12.193101 2581 generic.go:356] "Generic (PLEG): container finished" podID="344f748f-8403-4ced-9c0a-3db6e352e084" containerID="085a73dfda572c18f42acebc5b33c79948369941993692a153ab348c2fe41415" exitCode=0 Jul 10 14:14:12.193219 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:12.193144 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fr7zb" event={"ID":"344f748f-8403-4ced-9c0a-3db6e352e084","Type":"ContainerDied","Data":"085a73dfda572c18f42acebc5b33c79948369941993692a153ab348c2fe41415"} Jul 10 14:14:13.199959 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:13.199923 2581 generic.go:356] "Generic (PLEG): container finished" podID="693b7200-525e-494e-b879-919d214f0272" containerID="5392eaa292db8ada0de4624b1e1f11aa26e8fa812907d5fc8ce862788f425167" exitCode=0 Jul 10 14:14:13.200364 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:13.200006 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mb2z9" event={"ID":"693b7200-525e-494e-b879-919d214f0272","Type":"ContainerDied","Data":"5392eaa292db8ada0de4624b1e1f11aa26e8fa812907d5fc8ce862788f425167"} Jul 10 14:14:13.201884 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:13.201862 2581 generic.go:356] "Generic (PLEG): container finished" podID="44189322-d87a-4b6d-877d-a7d4fa6f5a9e" containerID="e86f58ec544948beec83d4f50e63caa9a80c5e341de0addf7be1f88555d36446" exitCode=0 Jul 10 14:14:13.201977 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:13.201936 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz" event={"ID":"44189322-d87a-4b6d-877d-a7d4fa6f5a9e","Type":"ContainerDied","Data":"e86f58ec544948beec83d4f50e63caa9a80c5e341de0addf7be1f88555d36446"} Jul 10 14:14:13.204198 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:13.204182 2581 generic.go:356] "Generic (PLEG): container finished" podID="344f748f-8403-4ced-9c0a-3db6e352e084" containerID="dcc64e841f18189ae96a0eb685c9839dc4afc665cb85c7adc7500950d1fe8268" exitCode=0 Jul 10 14:14:13.204277 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:13.204259 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fr7zb" event={"ID":"344f748f-8403-4ced-9c0a-3db6e352e084","Type":"ContainerDied","Data":"dcc64e841f18189ae96a0eb685c9839dc4afc665cb85c7adc7500950d1fe8268"} Jul 10 14:14:13.359898 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:13.359872 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x7vf5" Jul 10 14:14:13.456279 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:13.456197 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b978efc0-653a-45da-9ea5-a7abfcfc3460-util\") pod \"b978efc0-653a-45da-9ea5-a7abfcfc3460\" (UID: \"b978efc0-653a-45da-9ea5-a7abfcfc3460\") " Jul 10 14:14:13.456279 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:13.456266 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b978efc0-653a-45da-9ea5-a7abfcfc3460-bundle\") pod \"b978efc0-653a-45da-9ea5-a7abfcfc3460\" (UID: \"b978efc0-653a-45da-9ea5-a7abfcfc3460\") " Jul 10 14:14:13.456506 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:13.456341 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxsgb\" (UniqueName: \"kubernetes.io/projected/b978efc0-653a-45da-9ea5-a7abfcfc3460-kube-api-access-kxsgb\") pod \"b978efc0-653a-45da-9ea5-a7abfcfc3460\" (UID: \"b978efc0-653a-45da-9ea5-a7abfcfc3460\") " Jul 10 14:14:13.456755 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:13.456734 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b978efc0-653a-45da-9ea5-a7abfcfc3460-bundle" (OuterVolumeSpecName: "bundle") pod "b978efc0-653a-45da-9ea5-a7abfcfc3460" (UID: "b978efc0-653a-45da-9ea5-a7abfcfc3460"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:14:13.458367 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:13.458341 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b978efc0-653a-45da-9ea5-a7abfcfc3460-kube-api-access-kxsgb" (OuterVolumeSpecName: "kube-api-access-kxsgb") pod "b978efc0-653a-45da-9ea5-a7abfcfc3460" (UID: "b978efc0-653a-45da-9ea5-a7abfcfc3460"). InnerVolumeSpecName "kube-api-access-kxsgb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:14:13.461463 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:13.461440 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b978efc0-653a-45da-9ea5-a7abfcfc3460-util" (OuterVolumeSpecName: "util") pod "b978efc0-653a-45da-9ea5-a7abfcfc3460" (UID: "b978efc0-653a-45da-9ea5-a7abfcfc3460"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:14:13.557942 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:13.557914 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b978efc0-653a-45da-9ea5-a7abfcfc3460-util\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:14:13.557942 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:13.557940 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b978efc0-653a-45da-9ea5-a7abfcfc3460-bundle\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:14:13.557942 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:13.557949 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxsgb\" (UniqueName: \"kubernetes.io/projected/b978efc0-653a-45da-9ea5-a7abfcfc3460-kube-api-access-kxsgb\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:14:14.211487 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:14.211452 2581 generic.go:356] "Generic (PLEG): container finished" podID="693b7200-525e-494e-b879-919d214f0272" containerID="b0852a8a1e8b44fa7a6d76b3ef673b201d7c84bebab5f2a2aec12842be5a036f" exitCode=0 Jul 10 14:14:14.211921 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:14.211533 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mb2z9" event={"ID":"693b7200-525e-494e-b879-919d214f0272","Type":"ContainerDied","Data":"b0852a8a1e8b44fa7a6d76b3ef673b201d7c84bebab5f2a2aec12842be5a036f"} Jul 10 14:14:14.213342 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:14.213303 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x7vf5" Jul 10 14:14:14.213342 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:14.213310 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x7vf5" event={"ID":"b978efc0-653a-45da-9ea5-a7abfcfc3460","Type":"ContainerDied","Data":"6670d1a31e2ef229a134d64f793273a8102adc8f94f9c72f492651e46dcd3666"} Jul 10 14:14:14.213492 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:14.213361 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6670d1a31e2ef229a134d64f793273a8102adc8f94f9c72f492651e46dcd3666" Jul 10 14:14:14.215347 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:14.215305 2581 generic.go:356] "Generic (PLEG): container finished" podID="44189322-d87a-4b6d-877d-a7d4fa6f5a9e" containerID="b89b736d31bafd2011498641c49203998a276dd7bf5ced42826ca109a5ffe654" exitCode=0 Jul 10 14:14:14.215465 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:14.215353 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz" event={"ID":"44189322-d87a-4b6d-877d-a7d4fa6f5a9e","Type":"ContainerDied","Data":"b89b736d31bafd2011498641c49203998a276dd7bf5ced42826ca109a5ffe654"} Jul 10 14:14:14.336151 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:14.336125 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fr7zb" Jul 10 14:14:14.463675 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:14.463572 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmbxf\" (UniqueName: \"kubernetes.io/projected/344f748f-8403-4ced-9c0a-3db6e352e084-kube-api-access-mmbxf\") pod \"344f748f-8403-4ced-9c0a-3db6e352e084\" (UID: \"344f748f-8403-4ced-9c0a-3db6e352e084\") " Jul 10 14:14:14.463675 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:14.463635 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/344f748f-8403-4ced-9c0a-3db6e352e084-bundle\") pod \"344f748f-8403-4ced-9c0a-3db6e352e084\" (UID: \"344f748f-8403-4ced-9c0a-3db6e352e084\") " Jul 10 14:14:14.463904 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:14.463680 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/344f748f-8403-4ced-9c0a-3db6e352e084-util\") pod \"344f748f-8403-4ced-9c0a-3db6e352e084\" (UID: \"344f748f-8403-4ced-9c0a-3db6e352e084\") " Jul 10 14:14:14.464307 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:14.464272 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/344f748f-8403-4ced-9c0a-3db6e352e084-bundle" (OuterVolumeSpecName: "bundle") pod "344f748f-8403-4ced-9c0a-3db6e352e084" (UID: "344f748f-8403-4ced-9c0a-3db6e352e084"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:14:14.465782 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:14.465750 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/344f748f-8403-4ced-9c0a-3db6e352e084-kube-api-access-mmbxf" (OuterVolumeSpecName: "kube-api-access-mmbxf") pod "344f748f-8403-4ced-9c0a-3db6e352e084" (UID: "344f748f-8403-4ced-9c0a-3db6e352e084"). InnerVolumeSpecName "kube-api-access-mmbxf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:14:14.469469 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:14.469443 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/344f748f-8403-4ced-9c0a-3db6e352e084-util" (OuterVolumeSpecName: "util") pod "344f748f-8403-4ced-9c0a-3db6e352e084" (UID: "344f748f-8403-4ced-9c0a-3db6e352e084"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:14:14.565045 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:14.565006 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmbxf\" (UniqueName: \"kubernetes.io/projected/344f748f-8403-4ced-9c0a-3db6e352e084-kube-api-access-mmbxf\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:14:14.565045 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:14.565037 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/344f748f-8403-4ced-9c0a-3db6e352e084-bundle\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:14:14.565045 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:14.565046 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/344f748f-8403-4ced-9c0a-3db6e352e084-util\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:14:15.221887 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:15.221862 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fr7zb" Jul 10 14:14:15.222296 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:15.221898 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fr7zb" event={"ID":"344f748f-8403-4ced-9c0a-3db6e352e084","Type":"ContainerDied","Data":"6ecbf2b22f98941f8217b72134e67cd750cde527084d11db66e61aade6aac46c"} Jul 10 14:14:15.222296 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:15.221952 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6ecbf2b22f98941f8217b72134e67cd750cde527084d11db66e61aade6aac46c" Jul 10 14:14:15.352900 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:15.352876 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mb2z9" Jul 10 14:14:15.382423 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:15.382401 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz" Jul 10 14:14:15.472486 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:15.472415 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/693b7200-525e-494e-b879-919d214f0272-bundle\") pod \"693b7200-525e-494e-b879-919d214f0272\" (UID: \"693b7200-525e-494e-b879-919d214f0272\") " Jul 10 14:14:15.472486 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:15.472468 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwlcb\" (UniqueName: \"kubernetes.io/projected/44189322-d87a-4b6d-877d-a7d4fa6f5a9e-kube-api-access-nwlcb\") pod \"44189322-d87a-4b6d-877d-a7d4fa6f5a9e\" (UID: \"44189322-d87a-4b6d-877d-a7d4fa6f5a9e\") " Jul 10 14:14:15.472647 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:15.472510 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qcdb\" (UniqueName: \"kubernetes.io/projected/693b7200-525e-494e-b879-919d214f0272-kube-api-access-5qcdb\") pod \"693b7200-525e-494e-b879-919d214f0272\" (UID: \"693b7200-525e-494e-b879-919d214f0272\") " Jul 10 14:14:15.472647 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:15.472549 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/693b7200-525e-494e-b879-919d214f0272-util\") pod \"693b7200-525e-494e-b879-919d214f0272\" (UID: \"693b7200-525e-494e-b879-919d214f0272\") " Jul 10 14:14:15.472647 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:15.472585 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44189322-d87a-4b6d-877d-a7d4fa6f5a9e-util\") pod \"44189322-d87a-4b6d-877d-a7d4fa6f5a9e\" (UID: \"44189322-d87a-4b6d-877d-a7d4fa6f5a9e\") " Jul 10 14:14:15.472770 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:15.472669 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44189322-d87a-4b6d-877d-a7d4fa6f5a9e-bundle\") pod \"44189322-d87a-4b6d-877d-a7d4fa6f5a9e\" (UID: \"44189322-d87a-4b6d-877d-a7d4fa6f5a9e\") " Jul 10 14:14:15.472770 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:15.472720 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/693b7200-525e-494e-b879-919d214f0272-bundle" (OuterVolumeSpecName: "bundle") pod "693b7200-525e-494e-b879-919d214f0272" (UID: "693b7200-525e-494e-b879-919d214f0272"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:14:15.472958 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:15.472922 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/693b7200-525e-494e-b879-919d214f0272-bundle\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:14:15.473567 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:15.473529 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44189322-d87a-4b6d-877d-a7d4fa6f5a9e-bundle" (OuterVolumeSpecName: "bundle") pod "44189322-d87a-4b6d-877d-a7d4fa6f5a9e" (UID: "44189322-d87a-4b6d-877d-a7d4fa6f5a9e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:14:15.474652 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:15.474632 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44189322-d87a-4b6d-877d-a7d4fa6f5a9e-kube-api-access-nwlcb" (OuterVolumeSpecName: "kube-api-access-nwlcb") pod "44189322-d87a-4b6d-877d-a7d4fa6f5a9e" (UID: "44189322-d87a-4b6d-877d-a7d4fa6f5a9e"). InnerVolumeSpecName "kube-api-access-nwlcb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:14:15.474759 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:15.474739 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/693b7200-525e-494e-b879-919d214f0272-kube-api-access-5qcdb" (OuterVolumeSpecName: "kube-api-access-5qcdb") pod "693b7200-525e-494e-b879-919d214f0272" (UID: "693b7200-525e-494e-b879-919d214f0272"). InnerVolumeSpecName "kube-api-access-5qcdb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:14:15.478775 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:15.478749 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44189322-d87a-4b6d-877d-a7d4fa6f5a9e-util" (OuterVolumeSpecName: "util") pod "44189322-d87a-4b6d-877d-a7d4fa6f5a9e" (UID: "44189322-d87a-4b6d-877d-a7d4fa6f5a9e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:14:15.478846 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:15.478767 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/693b7200-525e-494e-b879-919d214f0272-util" (OuterVolumeSpecName: "util") pod "693b7200-525e-494e-b879-919d214f0272" (UID: "693b7200-525e-494e-b879-919d214f0272"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:14:15.574337 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:15.574286 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwlcb\" (UniqueName: \"kubernetes.io/projected/44189322-d87a-4b6d-877d-a7d4fa6f5a9e-kube-api-access-nwlcb\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:14:15.574337 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:15.574314 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qcdb\" (UniqueName: \"kubernetes.io/projected/693b7200-525e-494e-b879-919d214f0272-kube-api-access-5qcdb\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:14:15.574494 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:15.574344 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/693b7200-525e-494e-b879-919d214f0272-util\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:14:15.574494 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:15.574355 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44189322-d87a-4b6d-877d-a7d4fa6f5a9e-util\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:14:15.574494 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:15.574367 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44189322-d87a-4b6d-877d-a7d4fa6f5a9e-bundle\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:14:16.228180 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:16.228149 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mb2z9" Jul 10 14:14:16.228180 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:16.228174 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mb2z9" event={"ID":"693b7200-525e-494e-b879-919d214f0272","Type":"ContainerDied","Data":"dee23afc8d6977173948860853d820da4c39ade49414847040e696134fc3e022"} Jul 10 14:14:16.228719 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:16.228225 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dee23afc8d6977173948860853d820da4c39ade49414847040e696134fc3e022" Jul 10 14:14:16.230082 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:16.230033 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz" event={"ID":"44189322-d87a-4b6d-877d-a7d4fa6f5a9e","Type":"ContainerDied","Data":"0f9c51e3707e1f2ae6dc97c0edac33a563b0b197353038f0e0c3a6e36f2da7a6"} Jul 10 14:14:16.230082 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:16.230078 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f9c51e3707e1f2ae6dc97c0edac33a563b0b197353038f0e0c3a6e36f2da7a6" Jul 10 14:14:16.230258 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:16.230092 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz" Jul 10 14:14:25.630178 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:25.630140 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9w57g"] Jul 10 14:14:25.630577 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:25.630486 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44189322-d87a-4b6d-877d-a7d4fa6f5a9e" containerName="pull" Jul 10 14:14:25.630577 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:25.630498 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="44189322-d87a-4b6d-877d-a7d4fa6f5a9e" containerName="pull" Jul 10 14:14:25.630577 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:25.630512 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b978efc0-653a-45da-9ea5-a7abfcfc3460" containerName="pull" Jul 10 14:14:25.630577 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:25.630517 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b978efc0-653a-45da-9ea5-a7abfcfc3460" containerName="pull" Jul 10 14:14:25.630577 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:25.630524 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="693b7200-525e-494e-b879-919d214f0272" containerName="pull" Jul 10 14:14:25.630577 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:25.630530 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="693b7200-525e-494e-b879-919d214f0272" containerName="pull" Jul 10 14:14:25.630577 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:25.630537 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="344f748f-8403-4ced-9c0a-3db6e352e084" containerName="extract" Jul 10 14:14:25.630577 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:25.630542 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="344f748f-8403-4ced-9c0a-3db6e352e084" containerName="extract" Jul 10 14:14:25.630577 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:25.630551 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b978efc0-653a-45da-9ea5-a7abfcfc3460" containerName="util" Jul 10 14:14:25.630577 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:25.630556 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b978efc0-653a-45da-9ea5-a7abfcfc3460" containerName="util" Jul 10 14:14:25.630577 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:25.630573 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="344f748f-8403-4ced-9c0a-3db6e352e084" containerName="util" Jul 10 14:14:25.630577 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:25.630578 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="344f748f-8403-4ced-9c0a-3db6e352e084" containerName="util" Jul 10 14:14:25.630577 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:25.630585 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="344f748f-8403-4ced-9c0a-3db6e352e084" containerName="pull" Jul 10 14:14:25.630995 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:25.630591 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="344f748f-8403-4ced-9c0a-3db6e352e084" containerName="pull" Jul 10 14:14:25.630995 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:25.630605 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44189322-d87a-4b6d-877d-a7d4fa6f5a9e" containerName="util" Jul 10 14:14:25.630995 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:25.630610 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="44189322-d87a-4b6d-877d-a7d4fa6f5a9e" containerName="util" Jul 10 14:14:25.630995 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:25.630616 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b978efc0-653a-45da-9ea5-a7abfcfc3460" containerName="extract" Jul 10 14:14:25.630995 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:25.630620 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b978efc0-653a-45da-9ea5-a7abfcfc3460" containerName="extract" Jul 10 14:14:25.630995 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:25.630626 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44189322-d87a-4b6d-877d-a7d4fa6f5a9e" containerName="extract" Jul 10 14:14:25.630995 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:25.630631 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="44189322-d87a-4b6d-877d-a7d4fa6f5a9e" containerName="extract" Jul 10 14:14:25.630995 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:25.630638 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="693b7200-525e-494e-b879-919d214f0272" containerName="util" Jul 10 14:14:25.630995 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:25.630644 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="693b7200-525e-494e-b879-919d214f0272" containerName="util" Jul 10 14:14:25.630995 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:25.630651 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="693b7200-525e-494e-b879-919d214f0272" containerName="extract" Jul 10 14:14:25.630995 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:25.630655 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="693b7200-525e-494e-b879-919d214f0272" containerName="extract" Jul 10 14:14:25.630995 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:25.630706 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="344f748f-8403-4ced-9c0a-3db6e352e084" containerName="extract" Jul 10 14:14:25.630995 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:25.630716 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="693b7200-525e-494e-b879-919d214f0272" containerName="extract" Jul 10 14:14:25.630995 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:25.630724 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b978efc0-653a-45da-9ea5-a7abfcfc3460" containerName="extract" Jul 10 14:14:25.630995 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:25.630729 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="44189322-d87a-4b6d-877d-a7d4fa6f5a9e" containerName="extract" Jul 10 14:14:25.635027 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:25.635002 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9w57g" Jul 10 14:14:25.637762 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:25.637744 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-dt6f8\"" Jul 10 14:14:25.649729 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:25.649706 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9w57g"] Jul 10 14:14:25.760001 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:25.759967 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twlmk\" (UniqueName: \"kubernetes.io/projected/31cc8545-2568-4cdd-907b-9d9a16f4a064-kube-api-access-twlmk\") pod \"authorino-operator-75cc8d5cb7-9w57g\" (UID: \"31cc8545-2568-4cdd-907b-9d9a16f4a064\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9w57g" Jul 10 14:14:25.860391 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:25.860358 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twlmk\" (UniqueName: \"kubernetes.io/projected/31cc8545-2568-4cdd-907b-9d9a16f4a064-kube-api-access-twlmk\") pod \"authorino-operator-75cc8d5cb7-9w57g\" (UID: \"31cc8545-2568-4cdd-907b-9d9a16f4a064\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9w57g" Jul 10 14:14:25.872341 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:25.870075 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twlmk\" (UniqueName: \"kubernetes.io/projected/31cc8545-2568-4cdd-907b-9d9a16f4a064-kube-api-access-twlmk\") pod \"authorino-operator-75cc8d5cb7-9w57g\" (UID: \"31cc8545-2568-4cdd-907b-9d9a16f4a064\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9w57g" Jul 10 14:14:25.949979 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:25.949883 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9w57g" Jul 10 14:14:26.094241 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:26.094208 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9w57g"] Jul 10 14:14:26.097473 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:14:26.097446 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31cc8545_2568_4cdd_907b_9d9a16f4a064.slice/crio-41bb3eadba5f7379cc09923ff8d53bd7b0ec0134e9a0296e322bd5e9fce3fb20 WatchSource:0}: Error finding container 41bb3eadba5f7379cc09923ff8d53bd7b0ec0134e9a0296e322bd5e9fce3fb20: Status 404 returned error can't find the container with id 41bb3eadba5f7379cc09923ff8d53bd7b0ec0134e9a0296e322bd5e9fce3fb20 Jul 10 14:14:26.285967 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:26.285934 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9w57g" event={"ID":"31cc8545-2568-4cdd-907b-9d9a16f4a064","Type":"ContainerStarted","Data":"41bb3eadba5f7379cc09923ff8d53bd7b0ec0134e9a0296e322bd5e9fce3fb20"} Jul 10 14:14:28.897104 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:28.897008 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-rwpzx"] Jul 10 14:14:28.901026 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:28.900998 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rwpzx" Jul 10 14:14:28.903764 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:28.903735 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-kllln\"" Jul 10 14:14:28.903946 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:28.903783 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 10 14:14:28.913125 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:28.912818 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-rwpzx"] Jul 10 14:14:28.986594 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:28.986547 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5v2j\" (UniqueName: \"kubernetes.io/projected/6b954612-5642-4869-8659-533e2de64ce8-kube-api-access-q5v2j\") pod \"dns-operator-controller-manager-864dd78c4c-rwpzx\" (UID: \"6b954612-5642-4869-8659-533e2de64ce8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rwpzx" Jul 10 14:14:29.089283 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:29.089253 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5v2j\" (UniqueName: \"kubernetes.io/projected/6b954612-5642-4869-8659-533e2de64ce8-kube-api-access-q5v2j\") pod \"dns-operator-controller-manager-864dd78c4c-rwpzx\" (UID: \"6b954612-5642-4869-8659-533e2de64ce8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rwpzx" Jul 10 14:14:29.100437 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:29.100417 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5v2j\" (UniqueName: \"kubernetes.io/projected/6b954612-5642-4869-8659-533e2de64ce8-kube-api-access-q5v2j\") pod \"dns-operator-controller-manager-864dd78c4c-rwpzx\" (UID: \"6b954612-5642-4869-8659-533e2de64ce8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rwpzx" Jul 10 14:14:29.217239 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:29.217160 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rwpzx" Jul 10 14:14:29.306371 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:29.305679 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9w57g" event={"ID":"31cc8545-2568-4cdd-907b-9d9a16f4a064","Type":"ContainerStarted","Data":"c401e1f8c16430bcc617fec8ea58a6cfbca3c237f343ab09a4d00bd70de4772d"} Jul 10 14:14:29.306371 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:29.305756 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9w57g" Jul 10 14:14:29.325283 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:29.325236 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9w57g" podStartSLOduration=1.407850807 podStartE2EDuration="4.325210995s" totalImagesPullingTime="2.917360188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:14:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:14:29.324124623 +0000 UTC m=+352.267696963" watchObservedRunningTime="2026-07-10 14:14:29.325210995 +0000 UTC m=+352.268783335" Jul 10 14:14:29.358436 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:29.358411 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-rwpzx"] Jul 10 14:14:29.359932 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:14:29.359904 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b954612_5642_4869_8659_533e2de64ce8.slice/crio-8b0df5539da6981ad69d638603fa6a55c79b5c659e95e570ec06b337c2689c29 WatchSource:0}: Error finding container 8b0df5539da6981ad69d638603fa6a55c79b5c659e95e570ec06b337c2689c29: Status 404 returned error can't find the container with id 8b0df5539da6981ad69d638603fa6a55c79b5c659e95e570ec06b337c2689c29 Jul 10 14:14:30.312213 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:30.312177 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rwpzx" event={"ID":"6b954612-5642-4869-8659-533e2de64ce8","Type":"ContainerStarted","Data":"8b0df5539da6981ad69d638603fa6a55c79b5c659e95e570ec06b337c2689c29"} Jul 10 14:14:32.323796 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:32.323762 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rwpzx" event={"ID":"6b954612-5642-4869-8659-533e2de64ce8","Type":"ContainerStarted","Data":"2c3fffb44e46cb756c1b99f73efdd471886db8e9b17167592f5559a9e212300d"} Jul 10 14:14:32.324241 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:32.323852 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rwpzx" Jul 10 14:14:32.346913 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:32.346848 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rwpzx" podStartSLOduration=2.318168019 podStartE2EDuration="4.346829793s" totalImagesPullingTime="2.028661774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:14:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:14:32.346199831 +0000 UTC m=+355.289772181" watchObservedRunningTime="2026-07-10 14:14:32.346829793 +0000 UTC m=+355.290402237" Jul 10 14:14:40.314780 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:40.314750 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9w57g" Jul 10 14:14:43.331151 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:43.331118 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rwpzx" Jul 10 14:14:45.249846 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:45.249811 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d894544f4-tkcfj"] Jul 10 14:14:45.254826 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:45.254805 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d894544f4-tkcfj" Jul 10 14:14:45.269863 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:45.269833 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d894544f4-tkcfj"] Jul 10 14:14:45.310852 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:45.310812 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6274fa70-c705-4fb9-b3c7-a370c57cbcfc-trusted-ca-bundle\") pod \"console-d894544f4-tkcfj\" (UID: \"6274fa70-c705-4fb9-b3c7-a370c57cbcfc\") " pod="openshift-console/console-d894544f4-tkcfj" Jul 10 14:14:45.310852 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:45.310849 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqxl7\" (UniqueName: \"kubernetes.io/projected/6274fa70-c705-4fb9-b3c7-a370c57cbcfc-kube-api-access-fqxl7\") pod \"console-d894544f4-tkcfj\" (UID: \"6274fa70-c705-4fb9-b3c7-a370c57cbcfc\") " pod="openshift-console/console-d894544f4-tkcfj" Jul 10 14:14:45.311058 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:45.310886 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6274fa70-c705-4fb9-b3c7-a370c57cbcfc-console-serving-cert\") pod \"console-d894544f4-tkcfj\" (UID: \"6274fa70-c705-4fb9-b3c7-a370c57cbcfc\") " pod="openshift-console/console-d894544f4-tkcfj" Jul 10 14:14:45.311058 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:45.310913 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6274fa70-c705-4fb9-b3c7-a370c57cbcfc-service-ca\") pod \"console-d894544f4-tkcfj\" (UID: \"6274fa70-c705-4fb9-b3c7-a370c57cbcfc\") " pod="openshift-console/console-d894544f4-tkcfj" Jul 10 14:14:45.311058 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:45.310933 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6274fa70-c705-4fb9-b3c7-a370c57cbcfc-oauth-serving-cert\") pod \"console-d894544f4-tkcfj\" (UID: \"6274fa70-c705-4fb9-b3c7-a370c57cbcfc\") " pod="openshift-console/console-d894544f4-tkcfj" Jul 10 14:14:45.311058 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:45.311001 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6274fa70-c705-4fb9-b3c7-a370c57cbcfc-console-oauth-config\") pod \"console-d894544f4-tkcfj\" (UID: \"6274fa70-c705-4fb9-b3c7-a370c57cbcfc\") " pod="openshift-console/console-d894544f4-tkcfj" Jul 10 14:14:45.311058 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:45.311049 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6274fa70-c705-4fb9-b3c7-a370c57cbcfc-console-config\") pod \"console-d894544f4-tkcfj\" (UID: \"6274fa70-c705-4fb9-b3c7-a370c57cbcfc\") " pod="openshift-console/console-d894544f4-tkcfj" Jul 10 14:14:45.411876 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:45.411839 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6274fa70-c705-4fb9-b3c7-a370c57cbcfc-console-config\") pod \"console-d894544f4-tkcfj\" (UID: \"6274fa70-c705-4fb9-b3c7-a370c57cbcfc\") " pod="openshift-console/console-d894544f4-tkcfj" Jul 10 14:14:45.412070 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:45.411897 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6274fa70-c705-4fb9-b3c7-a370c57cbcfc-trusted-ca-bundle\") pod \"console-d894544f4-tkcfj\" (UID: \"6274fa70-c705-4fb9-b3c7-a370c57cbcfc\") " pod="openshift-console/console-d894544f4-tkcfj" Jul 10 14:14:45.412070 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:45.411917 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqxl7\" (UniqueName: \"kubernetes.io/projected/6274fa70-c705-4fb9-b3c7-a370c57cbcfc-kube-api-access-fqxl7\") pod \"console-d894544f4-tkcfj\" (UID: \"6274fa70-c705-4fb9-b3c7-a370c57cbcfc\") " pod="openshift-console/console-d894544f4-tkcfj" Jul 10 14:14:45.412070 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:45.411963 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6274fa70-c705-4fb9-b3c7-a370c57cbcfc-console-serving-cert\") pod \"console-d894544f4-tkcfj\" (UID: \"6274fa70-c705-4fb9-b3c7-a370c57cbcfc\") " pod="openshift-console/console-d894544f4-tkcfj" Jul 10 14:14:45.412070 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:45.411984 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6274fa70-c705-4fb9-b3c7-a370c57cbcfc-service-ca\") pod \"console-d894544f4-tkcfj\" (UID: \"6274fa70-c705-4fb9-b3c7-a370c57cbcfc\") " pod="openshift-console/console-d894544f4-tkcfj" Jul 10 14:14:45.412070 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:45.412009 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6274fa70-c705-4fb9-b3c7-a370c57cbcfc-oauth-serving-cert\") pod \"console-d894544f4-tkcfj\" (UID: \"6274fa70-c705-4fb9-b3c7-a370c57cbcfc\") " pod="openshift-console/console-d894544f4-tkcfj" Jul 10 14:14:45.412070 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:45.412035 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6274fa70-c705-4fb9-b3c7-a370c57cbcfc-console-oauth-config\") pod \"console-d894544f4-tkcfj\" (UID: \"6274fa70-c705-4fb9-b3c7-a370c57cbcfc\") " pod="openshift-console/console-d894544f4-tkcfj" Jul 10 14:14:45.412788 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:45.412763 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6274fa70-c705-4fb9-b3c7-a370c57cbcfc-oauth-serving-cert\") pod \"console-d894544f4-tkcfj\" (UID: \"6274fa70-c705-4fb9-b3c7-a370c57cbcfc\") " pod="openshift-console/console-d894544f4-tkcfj" Jul 10 14:14:45.412881 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:45.412768 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6274fa70-c705-4fb9-b3c7-a370c57cbcfc-console-config\") pod \"console-d894544f4-tkcfj\" (UID: \"6274fa70-c705-4fb9-b3c7-a370c57cbcfc\") " pod="openshift-console/console-d894544f4-tkcfj" Jul 10 14:14:45.412881 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:45.412832 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6274fa70-c705-4fb9-b3c7-a370c57cbcfc-trusted-ca-bundle\") pod \"console-d894544f4-tkcfj\" (UID: \"6274fa70-c705-4fb9-b3c7-a370c57cbcfc\") " pod="openshift-console/console-d894544f4-tkcfj" Jul 10 14:14:45.412881 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:45.412872 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6274fa70-c705-4fb9-b3c7-a370c57cbcfc-service-ca\") pod \"console-d894544f4-tkcfj\" (UID: \"6274fa70-c705-4fb9-b3c7-a370c57cbcfc\") " pod="openshift-console/console-d894544f4-tkcfj" Jul 10 14:14:45.414639 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:45.414619 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6274fa70-c705-4fb9-b3c7-a370c57cbcfc-console-serving-cert\") pod \"console-d894544f4-tkcfj\" (UID: \"6274fa70-c705-4fb9-b3c7-a370c57cbcfc\") " pod="openshift-console/console-d894544f4-tkcfj" Jul 10 14:14:45.414717 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:45.414702 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6274fa70-c705-4fb9-b3c7-a370c57cbcfc-console-oauth-config\") pod \"console-d894544f4-tkcfj\" (UID: \"6274fa70-c705-4fb9-b3c7-a370c57cbcfc\") " pod="openshift-console/console-d894544f4-tkcfj" Jul 10 14:14:45.419816 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:45.419792 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqxl7\" (UniqueName: \"kubernetes.io/projected/6274fa70-c705-4fb9-b3c7-a370c57cbcfc-kube-api-access-fqxl7\") pod \"console-d894544f4-tkcfj\" (UID: \"6274fa70-c705-4fb9-b3c7-a370c57cbcfc\") " pod="openshift-console/console-d894544f4-tkcfj" Jul 10 14:14:45.564831 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:45.564799 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d894544f4-tkcfj" Jul 10 14:14:45.698291 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:45.698263 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d894544f4-tkcfj"] Jul 10 14:14:45.699720 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:14:45.699694 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6274fa70_c705_4fb9_b3c7_a370c57cbcfc.slice/crio-7e49901034d6449a6155ed53a21921682849c7476ff5fc5fa874b4997e320b2a WatchSource:0}: Error finding container 7e49901034d6449a6155ed53a21921682849c7476ff5fc5fa874b4997e320b2a: Status 404 returned error can't find the container with id 7e49901034d6449a6155ed53a21921682849c7476ff5fc5fa874b4997e320b2a Jul 10 14:14:46.393395 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:46.393354 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d894544f4-tkcfj" event={"ID":"6274fa70-c705-4fb9-b3c7-a370c57cbcfc","Type":"ContainerStarted","Data":"bd965c2b83ab017febe61bac8785c8e8f9ca38d59cb87110a5e5c241e0e38a57"} Jul 10 14:14:46.393752 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:46.393417 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d894544f4-tkcfj" event={"ID":"6274fa70-c705-4fb9-b3c7-a370c57cbcfc","Type":"ContainerStarted","Data":"7e49901034d6449a6155ed53a21921682849c7476ff5fc5fa874b4997e320b2a"} Jul 10 14:14:46.415452 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:46.415403 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d894544f4-tkcfj" podStartSLOduration=1.415386623 podStartE2EDuration="1.415386623s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:14:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:14:46.413567012 +0000 UTC m=+369.357139352" watchObservedRunningTime="2026-07-10 14:14:46.415386623 +0000 UTC m=+369.358958962" Jul 10 14:14:55.565160 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:55.565123 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d894544f4-tkcfj" Jul 10 14:14:55.565606 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:55.565180 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d894544f4-tkcfj" Jul 10 14:14:55.570060 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:55.570040 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d894544f4-tkcfj" Jul 10 14:14:56.447160 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:56.447135 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d894544f4-tkcfj" Jul 10 14:14:56.500534 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:14:56.500501 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59985bb565-775x4"] Jul 10 14:15:21.523386 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:21.523313 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-59985bb565-775x4" podUID="8bf29380-e778-4274-bb82-744156dd0ee5" containerName="console" containerID="cri-o://59bbc90ab3035daa2d87668fffecd1f9ddd949edc659b3ad0b873dccbbd78654" gracePeriod=15 Jul 10 14:15:21.770399 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:21.770378 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59985bb565-775x4" Jul 10 14:15:21.929732 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:21.929701 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8bf29380-e778-4274-bb82-744156dd0ee5-console-config\") pod \"8bf29380-e778-4274-bb82-744156dd0ee5\" (UID: \"8bf29380-e778-4274-bb82-744156dd0ee5\") " Jul 10 14:15:21.929917 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:21.929746 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sff4s\" (UniqueName: \"kubernetes.io/projected/8bf29380-e778-4274-bb82-744156dd0ee5-kube-api-access-sff4s\") pod \"8bf29380-e778-4274-bb82-744156dd0ee5\" (UID: \"8bf29380-e778-4274-bb82-744156dd0ee5\") " Jul 10 14:15:21.929917 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:21.929767 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8bf29380-e778-4274-bb82-744156dd0ee5-console-serving-cert\") pod \"8bf29380-e778-4274-bb82-744156dd0ee5\" (UID: \"8bf29380-e778-4274-bb82-744156dd0ee5\") " Jul 10 14:15:21.929917 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:21.929794 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bf29380-e778-4274-bb82-744156dd0ee5-trusted-ca-bundle\") pod \"8bf29380-e778-4274-bb82-744156dd0ee5\" (UID: \"8bf29380-e778-4274-bb82-744156dd0ee5\") " Jul 10 14:15:21.929917 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:21.929813 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8bf29380-e778-4274-bb82-744156dd0ee5-oauth-serving-cert\") pod \"8bf29380-e778-4274-bb82-744156dd0ee5\" (UID: \"8bf29380-e778-4274-bb82-744156dd0ee5\") " Jul 10 14:15:21.929917 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:21.929847 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8bf29380-e778-4274-bb82-744156dd0ee5-console-oauth-config\") pod \"8bf29380-e778-4274-bb82-744156dd0ee5\" (UID: \"8bf29380-e778-4274-bb82-744156dd0ee5\") " Jul 10 14:15:21.929917 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:21.929892 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8bf29380-e778-4274-bb82-744156dd0ee5-service-ca\") pod \"8bf29380-e778-4274-bb82-744156dd0ee5\" (UID: \"8bf29380-e778-4274-bb82-744156dd0ee5\") " Jul 10 14:15:21.930261 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:21.930234 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bf29380-e778-4274-bb82-744156dd0ee5-console-config" (OuterVolumeSpecName: "console-config") pod "8bf29380-e778-4274-bb82-744156dd0ee5" (UID: "8bf29380-e778-4274-bb82-744156dd0ee5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:15:21.930370 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:21.930288 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bf29380-e778-4274-bb82-744156dd0ee5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8bf29380-e778-4274-bb82-744156dd0ee5" (UID: "8bf29380-e778-4274-bb82-744156dd0ee5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:15:21.930370 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:21.930300 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bf29380-e778-4274-bb82-744156dd0ee5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8bf29380-e778-4274-bb82-744156dd0ee5" (UID: "8bf29380-e778-4274-bb82-744156dd0ee5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:15:21.930461 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:21.930371 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bf29380-e778-4274-bb82-744156dd0ee5-service-ca" (OuterVolumeSpecName: "service-ca") pod "8bf29380-e778-4274-bb82-744156dd0ee5" (UID: "8bf29380-e778-4274-bb82-744156dd0ee5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:15:21.931980 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:21.931953 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bf29380-e778-4274-bb82-744156dd0ee5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8bf29380-e778-4274-bb82-744156dd0ee5" (UID: "8bf29380-e778-4274-bb82-744156dd0ee5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:15:21.932081 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:21.932008 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bf29380-e778-4274-bb82-744156dd0ee5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8bf29380-e778-4274-bb82-744156dd0ee5" (UID: "8bf29380-e778-4274-bb82-744156dd0ee5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:15:21.932081 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:21.932013 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bf29380-e778-4274-bb82-744156dd0ee5-kube-api-access-sff4s" (OuterVolumeSpecName: "kube-api-access-sff4s") pod "8bf29380-e778-4274-bb82-744156dd0ee5" (UID: "8bf29380-e778-4274-bb82-744156dd0ee5"). InnerVolumeSpecName "kube-api-access-sff4s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:15:22.030510 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:22.030485 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8bf29380-e778-4274-bb82-744156dd0ee5-console-config\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:15:22.030510 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:22.030510 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sff4s\" (UniqueName: \"kubernetes.io/projected/8bf29380-e778-4274-bb82-744156dd0ee5-kube-api-access-sff4s\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:15:22.030690 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:22.030519 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8bf29380-e778-4274-bb82-744156dd0ee5-console-serving-cert\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:15:22.030690 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:22.030527 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bf29380-e778-4274-bb82-744156dd0ee5-trusted-ca-bundle\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:15:22.030690 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:22.030537 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8bf29380-e778-4274-bb82-744156dd0ee5-oauth-serving-cert\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:15:22.030690 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:22.030545 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8bf29380-e778-4274-bb82-744156dd0ee5-console-oauth-config\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:15:22.030690 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:22.030560 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8bf29380-e778-4274-bb82-744156dd0ee5-service-ca\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:15:22.579164 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:22.579128 2581 generic.go:356] "Generic (PLEG): container finished" podID="8bf29380-e778-4274-bb82-744156dd0ee5" containerID="59bbc90ab3035daa2d87668fffecd1f9ddd949edc659b3ad0b873dccbbd78654" exitCode=0 Jul 10 14:15:22.579576 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:22.579170 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59985bb565-775x4" Jul 10 14:15:22.579576 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:22.579206 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59985bb565-775x4" event={"ID":"8bf29380-e778-4274-bb82-744156dd0ee5","Type":"ContainerDied","Data":"59bbc90ab3035daa2d87668fffecd1f9ddd949edc659b3ad0b873dccbbd78654"} Jul 10 14:15:22.579576 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:22.579258 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59985bb565-775x4" event={"ID":"8bf29380-e778-4274-bb82-744156dd0ee5","Type":"ContainerDied","Data":"648ae7fd86f0265c32ca6a6241e8beca0b30d0508d5cbd54594b8fa042798ae5"} Jul 10 14:15:22.579576 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:22.579281 2581 scope.go:117] "RemoveContainer" containerID="59bbc90ab3035daa2d87668fffecd1f9ddd949edc659b3ad0b873dccbbd78654" Jul 10 14:15:22.588544 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:22.588529 2581 scope.go:117] "RemoveContainer" containerID="59bbc90ab3035daa2d87668fffecd1f9ddd949edc659b3ad0b873dccbbd78654" Jul 10 14:15:22.588795 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:15:22.588778 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59bbc90ab3035daa2d87668fffecd1f9ddd949edc659b3ad0b873dccbbd78654\": container with ID starting with 59bbc90ab3035daa2d87668fffecd1f9ddd949edc659b3ad0b873dccbbd78654 not found: ID does not exist" containerID="59bbc90ab3035daa2d87668fffecd1f9ddd949edc659b3ad0b873dccbbd78654" Jul 10 14:15:22.588839 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:22.588805 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59bbc90ab3035daa2d87668fffecd1f9ddd949edc659b3ad0b873dccbbd78654"} err="failed to get container status \"59bbc90ab3035daa2d87668fffecd1f9ddd949edc659b3ad0b873dccbbd78654\": rpc error: code = NotFound desc = could not find container \"59bbc90ab3035daa2d87668fffecd1f9ddd949edc659b3ad0b873dccbbd78654\": container with ID starting with 59bbc90ab3035daa2d87668fffecd1f9ddd949edc659b3ad0b873dccbbd78654 not found: ID does not exist" Jul 10 14:15:22.600675 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:22.600654 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59985bb565-775x4"] Jul 10 14:15:22.604849 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:22.604830 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59985bb565-775x4"] Jul 10 14:15:23.643947 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:23.643918 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bf29380-e778-4274-bb82-744156dd0ee5" path="/var/lib/kubelet/pods/8bf29380-e778-4274-bb82-744156dd0ee5/volumes" Jul 10 14:15:52.787750 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:52.787714 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nstgg"] Jul 10 14:15:52.788188 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:52.788128 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bf29380-e778-4274-bb82-744156dd0ee5" containerName="console" Jul 10 14:15:52.788188 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:52.788142 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bf29380-e778-4274-bb82-744156dd0ee5" containerName="console" Jul 10 14:15:52.788258 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:52.788203 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bf29380-e778-4274-bb82-744156dd0ee5" containerName="console" Jul 10 14:15:52.790898 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:52.790884 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-nstgg" Jul 10 14:15:52.793740 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:52.793720 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-62cqs\"" Jul 10 14:15:52.793879 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:52.793864 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 10 14:15:52.801004 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:52.800983 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nstgg"] Jul 10 14:15:52.881130 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:52.881097 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nstgg"] Jul 10 14:15:52.889967 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:52.889941 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e495b648-f691-4cce-8985-c2c5520d8839-config-file\") pod \"limitador-limitador-64c94fd64f-nstgg\" (UID: \"e495b648-f691-4cce-8985-c2c5520d8839\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nstgg" Jul 10 14:15:52.890142 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:52.890019 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l55mx\" (UniqueName: \"kubernetes.io/projected/e495b648-f691-4cce-8985-c2c5520d8839-kube-api-access-l55mx\") pod \"limitador-limitador-64c94fd64f-nstgg\" (UID: \"e495b648-f691-4cce-8985-c2c5520d8839\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nstgg" Jul 10 14:15:52.990726 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:52.990690 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e495b648-f691-4cce-8985-c2c5520d8839-config-file\") pod \"limitador-limitador-64c94fd64f-nstgg\" (UID: \"e495b648-f691-4cce-8985-c2c5520d8839\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nstgg" Jul 10 14:15:52.990889 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:52.990757 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l55mx\" (UniqueName: \"kubernetes.io/projected/e495b648-f691-4cce-8985-c2c5520d8839-kube-api-access-l55mx\") pod \"limitador-limitador-64c94fd64f-nstgg\" (UID: \"e495b648-f691-4cce-8985-c2c5520d8839\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nstgg" Jul 10 14:15:52.991438 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:52.991411 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e495b648-f691-4cce-8985-c2c5520d8839-config-file\") pod \"limitador-limitador-64c94fd64f-nstgg\" (UID: \"e495b648-f691-4cce-8985-c2c5520d8839\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nstgg" Jul 10 14:15:53.000890 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:53.000865 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l55mx\" (UniqueName: \"kubernetes.io/projected/e495b648-f691-4cce-8985-c2c5520d8839-kube-api-access-l55mx\") pod \"limitador-limitador-64c94fd64f-nstgg\" (UID: \"e495b648-f691-4cce-8985-c2c5520d8839\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nstgg" Jul 10 14:15:53.101654 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:53.101565 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-nstgg" Jul 10 14:15:53.161012 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:53.160976 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:15:53.163947 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:53.163922 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-dv7s5" Jul 10 14:15:53.173379 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:53.173275 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:15:53.206480 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:53.206437 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:15:53.237724 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:53.237702 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nstgg"] Jul 10 14:15:53.239401 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:15:53.239375 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode495b648_f691_4cce_8985_c2c5520d8839.slice/crio-9de6ee060d3e18cb459372efae8e4ca55f713a99478816283fe699f82db041ff WatchSource:0}: Error finding container 9de6ee060d3e18cb459372efae8e4ca55f713a99478816283fe699f82db041ff: Status 404 returned error can't find the container with id 9de6ee060d3e18cb459372efae8e4ca55f713a99478816283fe699f82db041ff Jul 10 14:15:53.293383 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:53.293355 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g6kj\" (UniqueName: \"kubernetes.io/projected/e5d090f2-b54c-4f98-8b9b-6538e0eb8b3f-kube-api-access-2g6kj\") pod \"limitador-limitador-54d6d988d5-dv7s5\" (UID: \"e5d090f2-b54c-4f98-8b9b-6538e0eb8b3f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dv7s5" Jul 10 14:15:53.293495 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:53.293409 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5d090f2-b54c-4f98-8b9b-6538e0eb8b3f-config-file\") pod \"limitador-limitador-54d6d988d5-dv7s5\" (UID: \"e5d090f2-b54c-4f98-8b9b-6538e0eb8b3f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dv7s5" Jul 10 14:15:53.394680 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:53.394617 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5d090f2-b54c-4f98-8b9b-6538e0eb8b3f-config-file\") pod \"limitador-limitador-54d6d988d5-dv7s5\" (UID: \"e5d090f2-b54c-4f98-8b9b-6538e0eb8b3f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dv7s5" Jul 10 14:15:53.394779 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:53.394692 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2g6kj\" (UniqueName: \"kubernetes.io/projected/e5d090f2-b54c-4f98-8b9b-6538e0eb8b3f-kube-api-access-2g6kj\") pod \"limitador-limitador-54d6d988d5-dv7s5\" (UID: \"e5d090f2-b54c-4f98-8b9b-6538e0eb8b3f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dv7s5" Jul 10 14:15:53.395301 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:53.395283 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5d090f2-b54c-4f98-8b9b-6538e0eb8b3f-config-file\") pod \"limitador-limitador-54d6d988d5-dv7s5\" (UID: \"e5d090f2-b54c-4f98-8b9b-6538e0eb8b3f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dv7s5" Jul 10 14:15:53.403126 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:53.403108 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g6kj\" (UniqueName: \"kubernetes.io/projected/e5d090f2-b54c-4f98-8b9b-6538e0eb8b3f-kube-api-access-2g6kj\") pod \"limitador-limitador-54d6d988d5-dv7s5\" (UID: \"e5d090f2-b54c-4f98-8b9b-6538e0eb8b3f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dv7s5" Jul 10 14:15:53.476453 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:53.476430 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-dv7s5" Jul 10 14:15:53.612652 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:53.612630 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:15:53.614637 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:15:53.614611 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5d090f2_b54c_4f98_8b9b_6538e0eb8b3f.slice/crio-4fb55e9f829592a2e5cc4dd93f3c529a0cd491048c5d46c5bf1b64c412d600dc WatchSource:0}: Error finding container 4fb55e9f829592a2e5cc4dd93f3c529a0cd491048c5d46c5bf1b64c412d600dc: Status 404 returned error can't find the container with id 4fb55e9f829592a2e5cc4dd93f3c529a0cd491048c5d46c5bf1b64c412d600dc Jul 10 14:15:53.731812 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:53.731735 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-nstgg" event={"ID":"e495b648-f691-4cce-8985-c2c5520d8839","Type":"ContainerStarted","Data":"9de6ee060d3e18cb459372efae8e4ca55f713a99478816283fe699f82db041ff"} Jul 10 14:15:53.732939 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:53.732916 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-dv7s5" event={"ID":"e5d090f2-b54c-4f98-8b9b-6538e0eb8b3f","Type":"ContainerStarted","Data":"4fb55e9f829592a2e5cc4dd93f3c529a0cd491048c5d46c5bf1b64c412d600dc"} Jul 10 14:15:56.754686 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:56.754596 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-dv7s5" event={"ID":"e5d090f2-b54c-4f98-8b9b-6538e0eb8b3f","Type":"ContainerStarted","Data":"70758037d55736cd0ebce1b486e9f623e7174e2fed317e139cc4b6a543b48613"} Jul 10 14:15:56.754686 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:56.754657 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-dv7s5" Jul 10 14:15:56.756048 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:56.756025 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-nstgg" event={"ID":"e495b648-f691-4cce-8985-c2c5520d8839","Type":"ContainerStarted","Data":"9830ddfdbe812bc66678ea1ee6d73344c96ffed9b77969f1a4b2c43572a85194"} Jul 10 14:15:56.756157 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:56.756083 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-nstgg" Jul 10 14:15:56.773726 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:56.773680 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-dv7s5" podStartSLOduration=0.972394548 podStartE2EDuration="3.773661115s" totalImagesPullingTime="2.801266567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:15:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:15:56.771338702 +0000 UTC m=+439.714911046" watchObservedRunningTime="2026-07-10 14:15:56.773661115 +0000 UTC m=+439.717233455" Jul 10 14:15:56.788656 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:15:56.788614 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-nstgg" podStartSLOduration=1.6019366819999998 podStartE2EDuration="4.788599021s" totalImagesPullingTime="3.186662339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:15:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:15:56.78729755 +0000 UTC m=+439.730869927" watchObservedRunningTime="2026-07-10 14:15:56.788599021 +0000 UTC m=+439.732171415" Jul 10 14:16:07.762273 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:07.762196 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-nstgg" Jul 10 14:16:07.762273 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:07.762266 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-dv7s5" Jul 10 14:16:07.826583 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:07.826548 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nstgg"] Jul 10 14:16:07.826743 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:07.826706 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-nstgg" podUID="e495b648-f691-4cce-8985-c2c5520d8839" containerName="limitador" containerID="cri-o://9830ddfdbe812bc66678ea1ee6d73344c96ffed9b77969f1a4b2c43572a85194" gracePeriod=30 Jul 10 14:16:08.369096 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:08.369073 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-nstgg" Jul 10 14:16:08.527819 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:08.527742 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l55mx\" (UniqueName: \"kubernetes.io/projected/e495b648-f691-4cce-8985-c2c5520d8839-kube-api-access-l55mx\") pod \"e495b648-f691-4cce-8985-c2c5520d8839\" (UID: \"e495b648-f691-4cce-8985-c2c5520d8839\") " Jul 10 14:16:08.527981 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:08.527856 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e495b648-f691-4cce-8985-c2c5520d8839-config-file\") pod \"e495b648-f691-4cce-8985-c2c5520d8839\" (UID: \"e495b648-f691-4cce-8985-c2c5520d8839\") " Jul 10 14:16:08.528244 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:08.528222 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e495b648-f691-4cce-8985-c2c5520d8839-config-file" (OuterVolumeSpecName: "config-file") pod "e495b648-f691-4cce-8985-c2c5520d8839" (UID: "e495b648-f691-4cce-8985-c2c5520d8839"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:16:08.529790 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:08.529771 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e495b648-f691-4cce-8985-c2c5520d8839-kube-api-access-l55mx" (OuterVolumeSpecName: "kube-api-access-l55mx") pod "e495b648-f691-4cce-8985-c2c5520d8839" (UID: "e495b648-f691-4cce-8985-c2c5520d8839"). InnerVolumeSpecName "kube-api-access-l55mx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:16:08.628442 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:08.628411 2581 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e495b648-f691-4cce-8985-c2c5520d8839-config-file\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:16:08.628442 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:08.628437 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l55mx\" (UniqueName: \"kubernetes.io/projected/e495b648-f691-4cce-8985-c2c5520d8839-kube-api-access-l55mx\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:16:08.822194 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:08.822161 2581 generic.go:356] "Generic (PLEG): container finished" podID="e495b648-f691-4cce-8985-c2c5520d8839" containerID="9830ddfdbe812bc66678ea1ee6d73344c96ffed9b77969f1a4b2c43572a85194" exitCode=0 Jul 10 14:16:08.822657 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:08.822211 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-nstgg" Jul 10 14:16:08.822657 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:08.822250 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-nstgg" event={"ID":"e495b648-f691-4cce-8985-c2c5520d8839","Type":"ContainerDied","Data":"9830ddfdbe812bc66678ea1ee6d73344c96ffed9b77969f1a4b2c43572a85194"} Jul 10 14:16:08.822657 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:08.822301 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-nstgg" event={"ID":"e495b648-f691-4cce-8985-c2c5520d8839","Type":"ContainerDied","Data":"9de6ee060d3e18cb459372efae8e4ca55f713a99478816283fe699f82db041ff"} Jul 10 14:16:08.822657 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:08.822335 2581 scope.go:117] "RemoveContainer" containerID="9830ddfdbe812bc66678ea1ee6d73344c96ffed9b77969f1a4b2c43572a85194" Jul 10 14:16:08.831567 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:08.831382 2581 scope.go:117] "RemoveContainer" containerID="9830ddfdbe812bc66678ea1ee6d73344c96ffed9b77969f1a4b2c43572a85194" Jul 10 14:16:08.831617 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:16:08.831599 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9830ddfdbe812bc66678ea1ee6d73344c96ffed9b77969f1a4b2c43572a85194\": container with ID starting with 9830ddfdbe812bc66678ea1ee6d73344c96ffed9b77969f1a4b2c43572a85194 not found: ID does not exist" containerID="9830ddfdbe812bc66678ea1ee6d73344c96ffed9b77969f1a4b2c43572a85194" Jul 10 14:16:08.831654 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:08.831619 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9830ddfdbe812bc66678ea1ee6d73344c96ffed9b77969f1a4b2c43572a85194"} err="failed to get container status \"9830ddfdbe812bc66678ea1ee6d73344c96ffed9b77969f1a4b2c43572a85194\": rpc error: code = NotFound desc = could not find container \"9830ddfdbe812bc66678ea1ee6d73344c96ffed9b77969f1a4b2c43572a85194\": container with ID starting with 9830ddfdbe812bc66678ea1ee6d73344c96ffed9b77969f1a4b2c43572a85194 not found: ID does not exist" Jul 10 14:16:08.843742 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:08.843721 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nstgg"] Jul 10 14:16:08.845736 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:08.845718 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nstgg"] Jul 10 14:16:09.644080 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:09.644050 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e495b648-f691-4cce-8985-c2c5520d8839" path="/var/lib/kubelet/pods/e495b648-f691-4cce-8985-c2c5520d8839/volumes" Jul 10 14:16:27.341346 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:27.341305 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-994845476-lm9c7"] Jul 10 14:16:27.341718 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:27.341706 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e495b648-f691-4cce-8985-c2c5520d8839" containerName="limitador" Jul 10 14:16:27.341769 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:27.341719 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e495b648-f691-4cce-8985-c2c5520d8839" containerName="limitador" Jul 10 14:16:27.341805 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:27.341792 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e495b648-f691-4cce-8985-c2c5520d8839" containerName="limitador" Jul 10 14:16:27.348517 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:27.347084 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-994845476-lm9c7" Jul 10 14:16:27.351430 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:27.351414 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 10 14:16:27.351538 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:27.351418 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-cmfx9\"" Jul 10 14:16:27.357233 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:27.357212 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-994845476-lm9c7"] Jul 10 14:16:27.385612 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:27.385586 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d7ebffd3-009b-41cc-ae21-2486c6bb0714-tls-cert\") pod \"authorino-994845476-lm9c7\" (UID: \"d7ebffd3-009b-41cc-ae21-2486c6bb0714\") " pod="kuadrant-system/authorino-994845476-lm9c7" Jul 10 14:16:27.385708 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:27.385623 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95vgb\" (UniqueName: \"kubernetes.io/projected/d7ebffd3-009b-41cc-ae21-2486c6bb0714-kube-api-access-95vgb\") pod \"authorino-994845476-lm9c7\" (UID: \"d7ebffd3-009b-41cc-ae21-2486c6bb0714\") " pod="kuadrant-system/authorino-994845476-lm9c7" Jul 10 14:16:27.486710 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:27.486682 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d7ebffd3-009b-41cc-ae21-2486c6bb0714-tls-cert\") pod \"authorino-994845476-lm9c7\" (UID: \"d7ebffd3-009b-41cc-ae21-2486c6bb0714\") " pod="kuadrant-system/authorino-994845476-lm9c7" Jul 10 14:16:27.486822 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:27.486726 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95vgb\" (UniqueName: \"kubernetes.io/projected/d7ebffd3-009b-41cc-ae21-2486c6bb0714-kube-api-access-95vgb\") pod \"authorino-994845476-lm9c7\" (UID: \"d7ebffd3-009b-41cc-ae21-2486c6bb0714\") " pod="kuadrant-system/authorino-994845476-lm9c7" Jul 10 14:16:27.489009 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:27.488989 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d7ebffd3-009b-41cc-ae21-2486c6bb0714-tls-cert\") pod \"authorino-994845476-lm9c7\" (UID: \"d7ebffd3-009b-41cc-ae21-2486c6bb0714\") " pod="kuadrant-system/authorino-994845476-lm9c7" Jul 10 14:16:27.495009 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:27.494990 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95vgb\" (UniqueName: \"kubernetes.io/projected/d7ebffd3-009b-41cc-ae21-2486c6bb0714-kube-api-access-95vgb\") pod \"authorino-994845476-lm9c7\" (UID: \"d7ebffd3-009b-41cc-ae21-2486c6bb0714\") " pod="kuadrant-system/authorino-994845476-lm9c7" Jul 10 14:16:27.657557 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:27.657477 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-994845476-lm9c7" Jul 10 14:16:27.783919 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:27.783897 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-994845476-lm9c7"] Jul 10 14:16:27.785980 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:16:27.785951 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7ebffd3_009b_41cc_ae21_2486c6bb0714.slice/crio-e28840f0f83792f4ccc08a6cd8ca330d3f9b02134d09c1f82adb41b2bffdf5a7 WatchSource:0}: Error finding container e28840f0f83792f4ccc08a6cd8ca330d3f9b02134d09c1f82adb41b2bffdf5a7: Status 404 returned error can't find the container with id e28840f0f83792f4ccc08a6cd8ca330d3f9b02134d09c1f82adb41b2bffdf5a7 Jul 10 14:16:27.919745 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:27.919663 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-994845476-lm9c7" event={"ID":"d7ebffd3-009b-41cc-ae21-2486c6bb0714","Type":"ContainerStarted","Data":"e28840f0f83792f4ccc08a6cd8ca330d3f9b02134d09c1f82adb41b2bffdf5a7"} Jul 10 14:16:31.953138 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:31.953075 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-994845476-lm9c7" event={"ID":"d7ebffd3-009b-41cc-ae21-2486c6bb0714","Type":"ContainerStarted","Data":"fa5b71e0d1c3471c959497006c6c9bf5411aeb4a8e19bcd3ddce1b5fbb21d16b"} Jul 10 14:16:31.971969 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:31.971921 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-994845476-lm9c7" podStartSLOduration=1.36861658 podStartE2EDuration="4.971908889s" totalImagesPullingTime="3.603292309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:16:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:16:31.969944766 +0000 UTC m=+474.913517098" watchObservedRunningTime="2026-07-10 14:16:31.971908889 +0000 UTC m=+474.915481230" Jul 10 14:16:36.716511 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:36.716474 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8c58bf8c5-qxcrr"] Jul 10 14:16:36.719039 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:36.719020 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c58bf8c5-qxcrr" Jul 10 14:16:36.721659 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:36.721635 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 10 14:16:36.721772 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:36.721637 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6dh45\"" Jul 10 14:16:36.721772 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:36.721642 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 10 14:16:36.730483 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:36.730461 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8c58bf8c5-qxcrr"] Jul 10 14:16:36.767527 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:36.767506 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s722\" (UniqueName: \"kubernetes.io/projected/3c466f06-7706-440f-b482-6b509164ac3b-kube-api-access-2s722\") pod \"maas-controller-8c58bf8c5-qxcrr\" (UID: \"3c466f06-7706-440f-b482-6b509164ac3b\") " pod="opendatahub/maas-controller-8c58bf8c5-qxcrr" Jul 10 14:16:36.767638 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:36.767563 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3c466f06-7706-440f-b482-6b509164ac3b-webhook-cert\") pod \"maas-controller-8c58bf8c5-qxcrr\" (UID: \"3c466f06-7706-440f-b482-6b509164ac3b\") " pod="opendatahub/maas-controller-8c58bf8c5-qxcrr" Jul 10 14:16:36.867954 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:36.867926 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3c466f06-7706-440f-b482-6b509164ac3b-webhook-cert\") pod \"maas-controller-8c58bf8c5-qxcrr\" (UID: \"3c466f06-7706-440f-b482-6b509164ac3b\") " pod="opendatahub/maas-controller-8c58bf8c5-qxcrr" Jul 10 14:16:36.868099 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:36.868011 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s722\" (UniqueName: \"kubernetes.io/projected/3c466f06-7706-440f-b482-6b509164ac3b-kube-api-access-2s722\") pod \"maas-controller-8c58bf8c5-qxcrr\" (UID: \"3c466f06-7706-440f-b482-6b509164ac3b\") " pod="opendatahub/maas-controller-8c58bf8c5-qxcrr" Jul 10 14:16:36.870172 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:36.870147 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3c466f06-7706-440f-b482-6b509164ac3b-webhook-cert\") pod \"maas-controller-8c58bf8c5-qxcrr\" (UID: \"3c466f06-7706-440f-b482-6b509164ac3b\") " pod="opendatahub/maas-controller-8c58bf8c5-qxcrr" Jul 10 14:16:36.876850 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:36.876831 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s722\" (UniqueName: \"kubernetes.io/projected/3c466f06-7706-440f-b482-6b509164ac3b-kube-api-access-2s722\") pod \"maas-controller-8c58bf8c5-qxcrr\" (UID: \"3c466f06-7706-440f-b482-6b509164ac3b\") " pod="opendatahub/maas-controller-8c58bf8c5-qxcrr" Jul 10 14:16:37.029852 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:37.029774 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c58bf8c5-qxcrr" Jul 10 14:16:37.168473 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:37.168452 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8c58bf8c5-qxcrr"] Jul 10 14:16:37.170700 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:16:37.170668 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c466f06_7706_440f_b482_6b509164ac3b.slice/crio-24b80aa9e0f51c7655ba20a14b352793664b932779e8184352c4e1c5a808ed2b WatchSource:0}: Error finding container 24b80aa9e0f51c7655ba20a14b352793664b932779e8184352c4e1c5a808ed2b: Status 404 returned error can't find the container with id 24b80aa9e0f51c7655ba20a14b352793664b932779e8184352c4e1c5a808ed2b Jul 10 14:16:37.991878 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:37.991791 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c58bf8c5-qxcrr" event={"ID":"3c466f06-7706-440f-b482-6b509164ac3b","Type":"ContainerStarted","Data":"24b80aa9e0f51c7655ba20a14b352793664b932779e8184352c4e1c5a808ed2b"} Jul 10 14:16:39.280891 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:39.280867 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 10 14:16:40.005173 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:40.005135 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c58bf8c5-qxcrr" event={"ID":"3c466f06-7706-440f-b482-6b509164ac3b","Type":"ContainerStarted","Data":"9c9a31648c889fe6fd9473fc8e4565e99d9e10c2cef13ce7fa2c7da91f2ad370"} Jul 10 14:16:40.005387 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:40.005264 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8c58bf8c5-qxcrr" Jul 10 14:16:40.031297 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:40.031248 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8c58bf8c5-qxcrr" podStartSLOduration=1.92530847 podStartE2EDuration="4.031233001s" totalImagesPullingTime="2.105924531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:16:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:16:40.029524413 +0000 UTC m=+482.973096754" watchObservedRunningTime="2026-07-10 14:16:40.031233001 +0000 UTC m=+482.974805342" Jul 10 14:16:51.015436 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:16:51.015404 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8c58bf8c5-qxcrr" Jul 10 14:17:10.858390 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:10.858362 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-ddqvd"] Jul 10 14:17:10.863272 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:10.863253 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-ddqvd" Jul 10 14:17:10.865657 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:10.865636 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-dlfml\"" Jul 10 14:17:10.865790 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:10.865729 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 10 14:17:10.872624 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:10.872603 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-ddqvd"] Jul 10 14:17:10.939096 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:10.939062 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:17:10.952083 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:10.952057 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/725d5a61-b5c5-4294-823f-9033040308a7-plugins-config-volume\") pod \"payload-pre-processing-7964457696-ddqvd\" (UID: \"725d5a61-b5c5-4294-823f-9033040308a7\") " pod="openshift-ingress/payload-pre-processing-7964457696-ddqvd" Jul 10 14:17:10.952225 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:10.952206 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2252k\" (UniqueName: \"kubernetes.io/projected/725d5a61-b5c5-4294-823f-9033040308a7-kube-api-access-2252k\") pod \"payload-pre-processing-7964457696-ddqvd\" (UID: \"725d5a61-b5c5-4294-823f-9033040308a7\") " pod="openshift-ingress/payload-pre-processing-7964457696-ddqvd" Jul 10 14:17:11.053416 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:11.053379 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2252k\" (UniqueName: \"kubernetes.io/projected/725d5a61-b5c5-4294-823f-9033040308a7-kube-api-access-2252k\") pod \"payload-pre-processing-7964457696-ddqvd\" (UID: \"725d5a61-b5c5-4294-823f-9033040308a7\") " pod="openshift-ingress/payload-pre-processing-7964457696-ddqvd" Jul 10 14:17:11.053416 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:11.053423 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/725d5a61-b5c5-4294-823f-9033040308a7-plugins-config-volume\") pod \"payload-pre-processing-7964457696-ddqvd\" (UID: \"725d5a61-b5c5-4294-823f-9033040308a7\") " pod="openshift-ingress/payload-pre-processing-7964457696-ddqvd" Jul 10 14:17:11.054050 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:11.054031 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/725d5a61-b5c5-4294-823f-9033040308a7-plugins-config-volume\") pod \"payload-pre-processing-7964457696-ddqvd\" (UID: \"725d5a61-b5c5-4294-823f-9033040308a7\") " pod="openshift-ingress/payload-pre-processing-7964457696-ddqvd" Jul 10 14:17:11.062749 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:11.062715 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2252k\" (UniqueName: \"kubernetes.io/projected/725d5a61-b5c5-4294-823f-9033040308a7-kube-api-access-2252k\") pod \"payload-pre-processing-7964457696-ddqvd\" (UID: \"725d5a61-b5c5-4294-823f-9033040308a7\") " pod="openshift-ingress/payload-pre-processing-7964457696-ddqvd" Jul 10 14:17:11.175345 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:11.175233 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-ddqvd" Jul 10 14:17:11.303393 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:11.303362 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-ddqvd"] Jul 10 14:17:11.304824 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:17:11.304802 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod725d5a61_b5c5_4294_823f_9033040308a7.slice/crio-6e1707892834845c9523642e366109ac0afa13f760a169737daa520ac32214b1 WatchSource:0}: Error finding container 6e1707892834845c9523642e366109ac0afa13f760a169737daa520ac32214b1: Status 404 returned error can't find the container with id 6e1707892834845c9523642e366109ac0afa13f760a169737daa520ac32214b1 Jul 10 14:17:12.170846 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:12.170814 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-ddqvd" event={"ID":"725d5a61-b5c5-4294-823f-9033040308a7","Type":"ContainerStarted","Data":"6e1707892834845c9523642e366109ac0afa13f760a169737daa520ac32214b1"} Jul 10 14:17:13.177667 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:13.177628 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-ddqvd" event={"ID":"725d5a61-b5c5-4294-823f-9033040308a7","Type":"ContainerStarted","Data":"581997f63c43a0fcf1da9e38310a16b4042bb342eb77f5be19e76c3db2c9aacb"} Jul 10 14:17:13.178041 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:13.177779 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-ddqvd" Jul 10 14:17:13.194062 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:13.194017 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-ddqvd" podStartSLOduration=1.8275982819999999 podStartE2EDuration="3.194003035s" totalImagesPullingTime="1.366404753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:17:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:17:13.192870464 +0000 UTC m=+516.136442803" watchObservedRunningTime="2026-07-10 14:17:13.194003035 +0000 UTC m=+516.137575373" Jul 10 14:17:24.185437 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:24.185405 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-ddqvd" Jul 10 14:17:29.576028 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:29.575949 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:17:37.456907 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:37.456873 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-xc9ps"] Jul 10 14:17:37.460096 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:37.460077 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xc9ps" Jul 10 14:17:37.464261 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:37.464237 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 10 14:17:37.464418 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:37.464237 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 10 14:17:37.464418 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:37.464281 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 10 14:17:37.464418 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:37.464246 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8rsbh\"" Jul 10 14:17:37.472185 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:37.472162 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-xc9ps"] Jul 10 14:17:37.577805 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:37.577775 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sg5p\" (UniqueName: \"kubernetes.io/projected/d55d32c0-ffe4-4447-8d97-708ffae25a0b-kube-api-access-9sg5p\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xc9ps\" (UID: \"d55d32c0-ffe4-4447-8d97-708ffae25a0b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xc9ps" Jul 10 14:17:37.578004 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:37.577812 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d55d32c0-ffe4-4447-8d97-708ffae25a0b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xc9ps\" (UID: \"d55d32c0-ffe4-4447-8d97-708ffae25a0b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xc9ps" Jul 10 14:17:37.578004 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:37.577836 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d55d32c0-ffe4-4447-8d97-708ffae25a0b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xc9ps\" (UID: \"d55d32c0-ffe4-4447-8d97-708ffae25a0b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xc9ps" Jul 10 14:17:37.578004 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:37.577884 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d55d32c0-ffe4-4447-8d97-708ffae25a0b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xc9ps\" (UID: \"d55d32c0-ffe4-4447-8d97-708ffae25a0b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xc9ps" Jul 10 14:17:37.578004 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:37.577963 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d55d32c0-ffe4-4447-8d97-708ffae25a0b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xc9ps\" (UID: \"d55d32c0-ffe4-4447-8d97-708ffae25a0b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xc9ps" Jul 10 14:17:37.578004 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:37.577992 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d55d32c0-ffe4-4447-8d97-708ffae25a0b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xc9ps\" (UID: \"d55d32c0-ffe4-4447-8d97-708ffae25a0b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xc9ps" Jul 10 14:17:37.678370 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:37.678340 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d55d32c0-ffe4-4447-8d97-708ffae25a0b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xc9ps\" (UID: \"d55d32c0-ffe4-4447-8d97-708ffae25a0b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xc9ps" Jul 10 14:17:37.678807 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:37.678399 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sg5p\" (UniqueName: \"kubernetes.io/projected/d55d32c0-ffe4-4447-8d97-708ffae25a0b-kube-api-access-9sg5p\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xc9ps\" (UID: \"d55d32c0-ffe4-4447-8d97-708ffae25a0b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xc9ps" Jul 10 14:17:37.678807 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:37.678439 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d55d32c0-ffe4-4447-8d97-708ffae25a0b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xc9ps\" (UID: \"d55d32c0-ffe4-4447-8d97-708ffae25a0b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xc9ps" Jul 10 14:17:37.678807 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:37.678473 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d55d32c0-ffe4-4447-8d97-708ffae25a0b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xc9ps\" (UID: \"d55d32c0-ffe4-4447-8d97-708ffae25a0b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xc9ps" Jul 10 14:17:37.678807 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:37.678504 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d55d32c0-ffe4-4447-8d97-708ffae25a0b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xc9ps\" (UID: \"d55d32c0-ffe4-4447-8d97-708ffae25a0b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xc9ps" Jul 10 14:17:37.678807 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:37.678544 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d55d32c0-ffe4-4447-8d97-708ffae25a0b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xc9ps\" (UID: \"d55d32c0-ffe4-4447-8d97-708ffae25a0b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xc9ps" Jul 10 14:17:37.679219 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:37.679045 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d55d32c0-ffe4-4447-8d97-708ffae25a0b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xc9ps\" (UID: \"d55d32c0-ffe4-4447-8d97-708ffae25a0b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xc9ps" Jul 10 14:17:37.679219 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:37.679061 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d55d32c0-ffe4-4447-8d97-708ffae25a0b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xc9ps\" (UID: \"d55d32c0-ffe4-4447-8d97-708ffae25a0b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xc9ps" Jul 10 14:17:37.679352 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:37.679244 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d55d32c0-ffe4-4447-8d97-708ffae25a0b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xc9ps\" (UID: \"d55d32c0-ffe4-4447-8d97-708ffae25a0b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xc9ps" Jul 10 14:17:37.680778 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:37.680747 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d55d32c0-ffe4-4447-8d97-708ffae25a0b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xc9ps\" (UID: \"d55d32c0-ffe4-4447-8d97-708ffae25a0b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xc9ps" Jul 10 14:17:37.681144 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:37.681123 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d55d32c0-ffe4-4447-8d97-708ffae25a0b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xc9ps\" (UID: \"d55d32c0-ffe4-4447-8d97-708ffae25a0b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xc9ps" Jul 10 14:17:37.686377 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:37.686358 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sg5p\" (UniqueName: \"kubernetes.io/projected/d55d32c0-ffe4-4447-8d97-708ffae25a0b-kube-api-access-9sg5p\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xc9ps\" (UID: \"d55d32c0-ffe4-4447-8d97-708ffae25a0b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xc9ps" Jul 10 14:17:37.777511 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:37.777430 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xc9ps" Jul 10 14:17:37.905690 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:37.905667 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-xc9ps"] Jul 10 14:17:37.907758 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:17:37.907733 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd55d32c0_ffe4_4447_8d97_708ffae25a0b.slice/crio-5fcc49c3b7e2a0d5e22c01638e025f99f28b1d109648db12053a9bc6083fb987 WatchSource:0}: Error finding container 5fcc49c3b7e2a0d5e22c01638e025f99f28b1d109648db12053a9bc6083fb987: Status 404 returned error can't find the container with id 5fcc49c3b7e2a0d5e22c01638e025f99f28b1d109648db12053a9bc6083fb987 Jul 10 14:17:38.312700 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:38.312662 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xc9ps" event={"ID":"d55d32c0-ffe4-4447-8d97-708ffae25a0b","Type":"ContainerStarted","Data":"5fcc49c3b7e2a0d5e22c01638e025f99f28b1d109648db12053a9bc6083fb987"} Jul 10 14:17:38.374583 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:38.374550 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:17:39.319818 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:39.319734 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xc9ps" event={"ID":"d55d32c0-ffe4-4447-8d97-708ffae25a0b","Type":"ContainerStarted","Data":"7fe454ad3c8a866544554efba7d45b848436beb2dddfef920535d10a36001e34"} Jul 10 14:17:39.338221 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:39.338166 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xc9ps" podStartSLOduration=1.20353176 podStartE2EDuration="2.338150311s" totalImagesPullingTime="1.134618551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:17:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:17:39.336083885 +0000 UTC m=+542.279656237" watchObservedRunningTime="2026-07-10 14:17:39.338150311 +0000 UTC m=+542.281722650" Jul 10 14:17:47.778036 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:47.778000 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xc9ps" Jul 10 14:17:47.778553 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:47.778074 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xc9ps" Jul 10 14:17:47.790471 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:47.790445 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xc9ps" Jul 10 14:17:48.376220 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:48.376192 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xc9ps" Jul 10 14:17:53.793441 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:53.793403 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:17:57.882331 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:17:57.882281 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:18:06.758524 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:18:06.758488 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5sb46"] Jul 10 14:18:06.761705 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:18:06.761689 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5sb46" Jul 10 14:18:06.764313 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:18:06.764289 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 10 14:18:06.771632 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:18:06.771607 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5sb46"] Jul 10 14:18:06.833375 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:18:06.833342 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8efa381b-c882-4854-929b-18e2c7427c31-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5sb46\" (UID: \"8efa381b-c882-4854-929b-18e2c7427c31\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5sb46" Jul 10 14:18:06.833375 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:18:06.833378 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8efa381b-c882-4854-929b-18e2c7427c31-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5sb46\" (UID: \"8efa381b-c882-4854-929b-18e2c7427c31\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5sb46" Jul 10 14:18:06.833564 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:18:06.833406 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkhss\" (UniqueName: \"kubernetes.io/projected/8efa381b-c882-4854-929b-18e2c7427c31-kube-api-access-gkhss\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5sb46\" (UID: \"8efa381b-c882-4854-929b-18e2c7427c31\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5sb46" Jul 10 14:18:06.833564 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:18:06.833493 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8efa381b-c882-4854-929b-18e2c7427c31-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5sb46\" (UID: \"8efa381b-c882-4854-929b-18e2c7427c31\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5sb46" Jul 10 14:18:06.833564 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:18:06.833549 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8efa381b-c882-4854-929b-18e2c7427c31-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5sb46\" (UID: \"8efa381b-c882-4854-929b-18e2c7427c31\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5sb46" Jul 10 14:18:06.833693 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:18:06.833581 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8efa381b-c882-4854-929b-18e2c7427c31-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5sb46\" (UID: \"8efa381b-c882-4854-929b-18e2c7427c31\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5sb46" Jul 10 14:18:06.934802 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:18:06.934766 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8efa381b-c882-4854-929b-18e2c7427c31-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5sb46\" (UID: \"8efa381b-c882-4854-929b-18e2c7427c31\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5sb46" Jul 10 14:18:06.934802 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:18:06.934804 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8efa381b-c882-4854-929b-18e2c7427c31-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5sb46\" (UID: \"8efa381b-c882-4854-929b-18e2c7427c31\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5sb46" Jul 10 14:18:06.935063 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:18:06.934828 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkhss\" (UniqueName: \"kubernetes.io/projected/8efa381b-c882-4854-929b-18e2c7427c31-kube-api-access-gkhss\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5sb46\" (UID: \"8efa381b-c882-4854-929b-18e2c7427c31\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5sb46" Jul 10 14:18:06.935063 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:18:06.934863 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8efa381b-c882-4854-929b-18e2c7427c31-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5sb46\" (UID: \"8efa381b-c882-4854-929b-18e2c7427c31\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5sb46" Jul 10 14:18:06.935063 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:18:06.934913 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8efa381b-c882-4854-929b-18e2c7427c31-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5sb46\" (UID: \"8efa381b-c882-4854-929b-18e2c7427c31\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5sb46" Jul 10 14:18:06.935063 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:18:06.934944 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8efa381b-c882-4854-929b-18e2c7427c31-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5sb46\" (UID: \"8efa381b-c882-4854-929b-18e2c7427c31\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5sb46" Jul 10 14:18:06.935328 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:18:06.935303 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8efa381b-c882-4854-929b-18e2c7427c31-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5sb46\" (UID: \"8efa381b-c882-4854-929b-18e2c7427c31\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5sb46" Jul 10 14:18:06.935481 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:18:06.935396 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8efa381b-c882-4854-929b-18e2c7427c31-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5sb46\" (UID: \"8efa381b-c882-4854-929b-18e2c7427c31\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5sb46" Jul 10 14:18:06.935481 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:18:06.935418 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8efa381b-c882-4854-929b-18e2c7427c31-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5sb46\" (UID: \"8efa381b-c882-4854-929b-18e2c7427c31\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5sb46" Jul 10 14:18:06.937136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:18:06.937113 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8efa381b-c882-4854-929b-18e2c7427c31-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5sb46\" (UID: \"8efa381b-c882-4854-929b-18e2c7427c31\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5sb46" Jul 10 14:18:06.937308 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:18:06.937290 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8efa381b-c882-4854-929b-18e2c7427c31-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5sb46\" (UID: \"8efa381b-c882-4854-929b-18e2c7427c31\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5sb46" Jul 10 14:18:06.945873 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:18:06.945851 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkhss\" (UniqueName: \"kubernetes.io/projected/8efa381b-c882-4854-929b-18e2c7427c31-kube-api-access-gkhss\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5sb46\" (UID: \"8efa381b-c882-4854-929b-18e2c7427c31\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5sb46" Jul 10 14:18:07.073149 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:18:07.073113 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5sb46" Jul 10 14:18:07.210136 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:18:07.210108 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5sb46"] Jul 10 14:18:07.211746 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:18:07.211721 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8efa381b_c882_4854_929b_18e2c7427c31.slice/crio-bf3e372c82d1be8a765c8cc46eb44aaefeb69ff93fba4dcc96264f177e95bd82 WatchSource:0}: Error finding container bf3e372c82d1be8a765c8cc46eb44aaefeb69ff93fba4dcc96264f177e95bd82: Status 404 returned error can't find the container with id bf3e372c82d1be8a765c8cc46eb44aaefeb69ff93fba4dcc96264f177e95bd82 Jul 10 14:18:07.466729 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:18:07.466641 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5sb46" event={"ID":"8efa381b-c882-4854-929b-18e2c7427c31","Type":"ContainerStarted","Data":"bf3e372c82d1be8a765c8cc46eb44aaefeb69ff93fba4dcc96264f177e95bd82"} Jul 10 14:18:08.473083 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:18:08.473042 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5sb46" event={"ID":"8efa381b-c882-4854-929b-18e2c7427c31","Type":"ContainerStarted","Data":"ac87d72de118fc80e31342a0cc1e70902b77d17a957a13990f6eba8639367648"} Jul 10 14:18:08.490953 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:18:08.490902 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5sb46" podStartSLOduration=2.222218071 podStartE2EDuration="2.490886015s" totalImagesPullingTime="268.667944ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:18:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:18:08.48942391 +0000 UTC m=+571.432996251" watchObservedRunningTime="2026-07-10 14:18:08.490886015 +0000 UTC m=+571.434458354" Jul 10 14:18:08.881624 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:18:08.881594 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:18:17.074184 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:18:17.074141 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5sb46" Jul 10 14:18:17.074646 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:18:17.074208 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5sb46" Jul 10 14:18:17.086766 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:18:17.086744 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5sb46" Jul 10 14:18:17.530221 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:18:17.530143 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5sb46" Jul 10 14:18:18.383155 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:18:18.383122 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:18:37.545744 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:18:37.545716 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6z8gc_72c7722f-6a58-4230-a5f4-9c440b6887ea/ovn-acl-logging/0.log" Jul 10 14:18:37.547953 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:18:37.547928 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6z8gc_72c7722f-6a58-4230-a5f4-9c440b6887ea/ovn-acl-logging/0.log" Jul 10 14:19:07.726743 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:19:07.726510 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-994845476-lm9c7"] Jul 10 14:19:07.728162 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:19:07.726740 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-994845476-lm9c7" podUID="d7ebffd3-009b-41cc-ae21-2486c6bb0714" containerName="authorino" containerID="cri-o://fa5b71e0d1c3471c959497006c6c9bf5411aeb4a8e19bcd3ddce1b5fbb21d16b" gracePeriod=30 Jul 10 14:19:07.974916 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:19:07.974889 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-994845476-lm9c7" Jul 10 14:19:08.079757 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:19:08.079730 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95vgb\" (UniqueName: \"kubernetes.io/projected/d7ebffd3-009b-41cc-ae21-2486c6bb0714-kube-api-access-95vgb\") pod \"d7ebffd3-009b-41cc-ae21-2486c6bb0714\" (UID: \"d7ebffd3-009b-41cc-ae21-2486c6bb0714\") " Jul 10 14:19:08.079921 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:19:08.079794 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d7ebffd3-009b-41cc-ae21-2486c6bb0714-tls-cert\") pod \"d7ebffd3-009b-41cc-ae21-2486c6bb0714\" (UID: \"d7ebffd3-009b-41cc-ae21-2486c6bb0714\") " Jul 10 14:19:08.081779 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:19:08.081753 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7ebffd3-009b-41cc-ae21-2486c6bb0714-kube-api-access-95vgb" (OuterVolumeSpecName: "kube-api-access-95vgb") pod "d7ebffd3-009b-41cc-ae21-2486c6bb0714" (UID: "d7ebffd3-009b-41cc-ae21-2486c6bb0714"). InnerVolumeSpecName "kube-api-access-95vgb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:19:08.089981 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:19:08.089958 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7ebffd3-009b-41cc-ae21-2486c6bb0714-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "d7ebffd3-009b-41cc-ae21-2486c6bb0714" (UID: "d7ebffd3-009b-41cc-ae21-2486c6bb0714"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:19:08.181196 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:19:08.181172 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95vgb\" (UniqueName: \"kubernetes.io/projected/d7ebffd3-009b-41cc-ae21-2486c6bb0714-kube-api-access-95vgb\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:19:08.181196 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:19:08.181194 2581 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d7ebffd3-009b-41cc-ae21-2486c6bb0714-tls-cert\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:19:08.795284 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:19:08.795254 2581 generic.go:356] "Generic (PLEG): container finished" podID="d7ebffd3-009b-41cc-ae21-2486c6bb0714" containerID="fa5b71e0d1c3471c959497006c6c9bf5411aeb4a8e19bcd3ddce1b5fbb21d16b" exitCode=0 Jul 10 14:19:08.795807 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:19:08.795295 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-994845476-lm9c7" Jul 10 14:19:08.795807 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:19:08.795342 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-994845476-lm9c7" event={"ID":"d7ebffd3-009b-41cc-ae21-2486c6bb0714","Type":"ContainerDied","Data":"fa5b71e0d1c3471c959497006c6c9bf5411aeb4a8e19bcd3ddce1b5fbb21d16b"} Jul 10 14:19:08.795807 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:19:08.795382 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-994845476-lm9c7" event={"ID":"d7ebffd3-009b-41cc-ae21-2486c6bb0714","Type":"ContainerDied","Data":"e28840f0f83792f4ccc08a6cd8ca330d3f9b02134d09c1f82adb41b2bffdf5a7"} Jul 10 14:19:08.795807 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:19:08.795398 2581 scope.go:117] "RemoveContainer" containerID="fa5b71e0d1c3471c959497006c6c9bf5411aeb4a8e19bcd3ddce1b5fbb21d16b" Jul 10 14:19:08.804988 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:19:08.804970 2581 scope.go:117] "RemoveContainer" containerID="fa5b71e0d1c3471c959497006c6c9bf5411aeb4a8e19bcd3ddce1b5fbb21d16b" Jul 10 14:19:08.805263 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:19:08.805245 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa5b71e0d1c3471c959497006c6c9bf5411aeb4a8e19bcd3ddce1b5fbb21d16b\": container with ID starting with fa5b71e0d1c3471c959497006c6c9bf5411aeb4a8e19bcd3ddce1b5fbb21d16b not found: ID does not exist" containerID="fa5b71e0d1c3471c959497006c6c9bf5411aeb4a8e19bcd3ddce1b5fbb21d16b" Jul 10 14:19:08.805303 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:19:08.805274 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa5b71e0d1c3471c959497006c6c9bf5411aeb4a8e19bcd3ddce1b5fbb21d16b"} err="failed to get container status \"fa5b71e0d1c3471c959497006c6c9bf5411aeb4a8e19bcd3ddce1b5fbb21d16b\": rpc error: code = NotFound desc = could not find container \"fa5b71e0d1c3471c959497006c6c9bf5411aeb4a8e19bcd3ddce1b5fbb21d16b\": container with ID starting with fa5b71e0d1c3471c959497006c6c9bf5411aeb4a8e19bcd3ddce1b5fbb21d16b not found: ID does not exist" Jul 10 14:19:08.819441 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:19:08.819414 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-994845476-lm9c7"] Jul 10 14:19:08.823597 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:19:08.823573 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-994845476-lm9c7"] Jul 10 14:19:09.643705 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:19:09.643673 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7ebffd3-009b-41cc-ae21-2486c6bb0714" path="/var/lib/kubelet/pods/d7ebffd3-009b-41cc-ae21-2486c6bb0714/volumes" Jul 10 14:19:48.193767 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:19:48.193728 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:19:58.330787 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:19:58.330753 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:20:09.993466 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:09.993432 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:20:17.784531 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:17.784497 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:20:28.789489 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:28.789457 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:20:31.097055 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:31.097019 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8c58bf8c5-qxcrr"] Jul 10 14:20:31.097460 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:31.097255 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-8c58bf8c5-qxcrr" podUID="3c466f06-7706-440f-b482-6b509164ac3b" containerName="manager" containerID="cri-o://9c9a31648c889fe6fd9473fc8e4565e99d9e10c2cef13ce7fa2c7da91f2ad370" gracePeriod=30 Jul 10 14:20:31.226828 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:31.226797 2581 generic.go:356] "Generic (PLEG): container finished" podID="3c466f06-7706-440f-b482-6b509164ac3b" containerID="9c9a31648c889fe6fd9473fc8e4565e99d9e10c2cef13ce7fa2c7da91f2ad370" exitCode=0 Jul 10 14:20:31.226969 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:31.226866 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c58bf8c5-qxcrr" event={"ID":"3c466f06-7706-440f-b482-6b509164ac3b","Type":"ContainerDied","Data":"9c9a31648c889fe6fd9473fc8e4565e99d9e10c2cef13ce7fa2c7da91f2ad370"} Jul 10 14:20:31.346884 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:31.346845 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c58bf8c5-qxcrr" Jul 10 14:20:31.495039 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:31.494960 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3c466f06-7706-440f-b482-6b509164ac3b-webhook-cert\") pod \"3c466f06-7706-440f-b482-6b509164ac3b\" (UID: \"3c466f06-7706-440f-b482-6b509164ac3b\") " Jul 10 14:20:31.495039 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:31.495033 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2s722\" (UniqueName: \"kubernetes.io/projected/3c466f06-7706-440f-b482-6b509164ac3b-kube-api-access-2s722\") pod \"3c466f06-7706-440f-b482-6b509164ac3b\" (UID: \"3c466f06-7706-440f-b482-6b509164ac3b\") " Jul 10 14:20:31.497134 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:31.497097 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c466f06-7706-440f-b482-6b509164ac3b-kube-api-access-2s722" (OuterVolumeSpecName: "kube-api-access-2s722") pod "3c466f06-7706-440f-b482-6b509164ac3b" (UID: "3c466f06-7706-440f-b482-6b509164ac3b"). InnerVolumeSpecName "kube-api-access-2s722". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:20:31.497134 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:31.497122 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c466f06-7706-440f-b482-6b509164ac3b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "3c466f06-7706-440f-b482-6b509164ac3b" (UID: "3c466f06-7706-440f-b482-6b509164ac3b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:20:31.596004 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:31.595973 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2s722\" (UniqueName: \"kubernetes.io/projected/3c466f06-7706-440f-b482-6b509164ac3b-kube-api-access-2s722\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:20:31.596004 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:31.595999 2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3c466f06-7706-440f-b482-6b509164ac3b-webhook-cert\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:20:32.232983 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:32.232959 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c58bf8c5-qxcrr" Jul 10 14:20:32.233393 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:32.232957 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c58bf8c5-qxcrr" event={"ID":"3c466f06-7706-440f-b482-6b509164ac3b","Type":"ContainerDied","Data":"24b80aa9e0f51c7655ba20a14b352793664b932779e8184352c4e1c5a808ed2b"} Jul 10 14:20:32.233393 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:32.233092 2581 scope.go:117] "RemoveContainer" containerID="9c9a31648c889fe6fd9473fc8e4565e99d9e10c2cef13ce7fa2c7da91f2ad370" Jul 10 14:20:32.255182 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:32.255152 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8c58bf8c5-qxcrr"] Jul 10 14:20:32.258807 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:32.258787 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8c58bf8c5-qxcrr"] Jul 10 14:20:33.046171 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:33.046139 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8c58bf8c5-jz4wb"] Jul 10 14:20:33.046537 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:33.046525 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7ebffd3-009b-41cc-ae21-2486c6bb0714" containerName="authorino" Jul 10 14:20:33.046595 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:33.046538 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7ebffd3-009b-41cc-ae21-2486c6bb0714" containerName="authorino" Jul 10 14:20:33.046595 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:33.046553 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c466f06-7706-440f-b482-6b509164ac3b" containerName="manager" Jul 10 14:20:33.046595 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:33.046561 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c466f06-7706-440f-b482-6b509164ac3b" containerName="manager" Jul 10 14:20:33.046699 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:33.046630 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c466f06-7706-440f-b482-6b509164ac3b" containerName="manager" Jul 10 14:20:33.046699 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:33.046639 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7ebffd3-009b-41cc-ae21-2486c6bb0714" containerName="authorino" Jul 10 14:20:33.049477 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:33.049452 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c58bf8c5-jz4wb" Jul 10 14:20:33.054877 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:33.054838 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 10 14:20:33.054877 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:33.054865 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 10 14:20:33.054877 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:33.054839 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6dh45\"" Jul 10 14:20:33.064216 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:33.064183 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8c58bf8c5-jz4wb"] Jul 10 14:20:33.210797 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:33.210755 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fdb1524b-8045-42e4-8692-11549beb1cd6-webhook-cert\") pod \"maas-controller-8c58bf8c5-jz4wb\" (UID: \"fdb1524b-8045-42e4-8692-11549beb1cd6\") " pod="opendatahub/maas-controller-8c58bf8c5-jz4wb" Jul 10 14:20:33.210963 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:33.210817 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45m7p\" (UniqueName: \"kubernetes.io/projected/fdb1524b-8045-42e4-8692-11549beb1cd6-kube-api-access-45m7p\") pod \"maas-controller-8c58bf8c5-jz4wb\" (UID: \"fdb1524b-8045-42e4-8692-11549beb1cd6\") " pod="opendatahub/maas-controller-8c58bf8c5-jz4wb" Jul 10 14:20:33.311456 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:33.311380 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fdb1524b-8045-42e4-8692-11549beb1cd6-webhook-cert\") pod \"maas-controller-8c58bf8c5-jz4wb\" (UID: \"fdb1524b-8045-42e4-8692-11549beb1cd6\") " pod="opendatahub/maas-controller-8c58bf8c5-jz4wb" Jul 10 14:20:33.311456 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:33.311425 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45m7p\" (UniqueName: \"kubernetes.io/projected/fdb1524b-8045-42e4-8692-11549beb1cd6-kube-api-access-45m7p\") pod \"maas-controller-8c58bf8c5-jz4wb\" (UID: \"fdb1524b-8045-42e4-8692-11549beb1cd6\") " pod="opendatahub/maas-controller-8c58bf8c5-jz4wb" Jul 10 14:20:33.313702 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:33.313685 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fdb1524b-8045-42e4-8692-11549beb1cd6-webhook-cert\") pod \"maas-controller-8c58bf8c5-jz4wb\" (UID: \"fdb1524b-8045-42e4-8692-11549beb1cd6\") " pod="opendatahub/maas-controller-8c58bf8c5-jz4wb" Jul 10 14:20:33.321816 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:33.321796 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45m7p\" (UniqueName: \"kubernetes.io/projected/fdb1524b-8045-42e4-8692-11549beb1cd6-kube-api-access-45m7p\") pod \"maas-controller-8c58bf8c5-jz4wb\" (UID: \"fdb1524b-8045-42e4-8692-11549beb1cd6\") " pod="opendatahub/maas-controller-8c58bf8c5-jz4wb" Jul 10 14:20:33.359426 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:33.359402 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c58bf8c5-jz4wb" Jul 10 14:20:33.495860 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:20:33.495822 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdb1524b_8045_42e4_8692_11549beb1cd6.slice/crio-07991d6b0af54549fc750a254a4725574957ba459c9d993c852a27bf62863714 WatchSource:0}: Error finding container 07991d6b0af54549fc750a254a4725574957ba459c9d993c852a27bf62863714: Status 404 returned error can't find the container with id 07991d6b0af54549fc750a254a4725574957ba459c9d993c852a27bf62863714 Jul 10 14:20:33.496758 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:33.496736 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8c58bf8c5-jz4wb"] Jul 10 14:20:33.497268 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:33.497252 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 14:20:33.646561 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:33.646479 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c466f06-7706-440f-b482-6b509164ac3b" path="/var/lib/kubelet/pods/3c466f06-7706-440f-b482-6b509164ac3b/volumes" Jul 10 14:20:34.245864 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:34.245773 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c58bf8c5-jz4wb" event={"ID":"fdb1524b-8045-42e4-8692-11549beb1cd6","Type":"ContainerStarted","Data":"342aae91629c59499aecab4a21166a80b466bd7170b4435e64933d18dbef9e88"} Jul 10 14:20:34.245864 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:34.245831 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c58bf8c5-jz4wb" event={"ID":"fdb1524b-8045-42e4-8692-11549beb1cd6","Type":"ContainerStarted","Data":"07991d6b0af54549fc750a254a4725574957ba459c9d993c852a27bf62863714"} Jul 10 14:20:34.245864 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:34.245857 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8c58bf8c5-jz4wb" Jul 10 14:20:34.279459 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:34.275198 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8c58bf8c5-jz4wb" podStartSLOduration=0.805192233 podStartE2EDuration="1.275179545s" totalImagesPullingTime="469.987312ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:20:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:20:34.273252249 +0000 UTC m=+717.216824590" watchObservedRunningTime="2026-07-10 14:20:34.275179545 +0000 UTC m=+717.218751886" Jul 10 14:20:45.258457 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:20:45.258427 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8c58bf8c5-jz4wb" Jul 10 14:21:40.081750 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:21:40.081707 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:21:49.379410 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:21:49.379375 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:21:58.881239 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:21:58.881158 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:22:04.483404 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:22:04.483374 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:22:16.290471 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:22:16.290437 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:22:27.587063 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:22:27.587023 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:22:38.387778 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:22:38.387744 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:22:47.992218 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:22:47.992183 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:23:10.378463 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:23:10.378431 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:23:21.982153 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:23:21.982123 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:23:37.585375 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:23:37.585298 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6z8gc_72c7722f-6a58-4230-a5f4-9c440b6887ea/ovn-acl-logging/0.log" Jul 10 14:23:37.585788 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:23:37.585301 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6z8gc_72c7722f-6a58-4230-a5f4-9c440b6887ea/ovn-acl-logging/0.log" Jul 10 14:23:46.386602 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:23:46.386568 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:23:57.796181 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:23:57.796151 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:24:13.390826 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:24:13.390792 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:24:22.787062 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:24:22.787026 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:24:32.483558 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:24:32.483525 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:24:41.977140 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:24:41.977105 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:24:51.681226 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:24:51.681192 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:26:39.676509 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:26:39.676478 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:26:51.987453 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:26:51.987419 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:27:01.192559 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:27:01.192520 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:27:10.480898 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:27:10.480864 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:27:28.183391 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:27:28.183356 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:27:37.583544 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:27:37.583510 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:27:49.789625 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:27:49.789588 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:27:58.282048 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:27:58.282015 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:28:09.305637 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:28:09.305564 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:28:37.622433 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:28:37.622400 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6z8gc_72c7722f-6a58-4230-a5f4-9c440b6887ea/ovn-acl-logging/0.log" Jul 10 14:28:37.624297 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:28:37.624278 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6z8gc_72c7722f-6a58-4230-a5f4-9c440b6887ea/ovn-acl-logging/0.log" Jul 10 14:28:46.695705 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:28:46.695671 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:28:56.388479 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:28:56.388443 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:29:06.787788 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:29:06.787758 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:29:16.702558 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:29:16.702521 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:29:25.905568 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:29:25.905534 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:29:37.707971 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:29:37.707876 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:29:47.962308 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:29:47.962274 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:29:58.117287 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:29:58.117247 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:30:00.179495 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:30:00.179460 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728230-mb86d"] Jul 10 14:30:00.183019 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:30:00.183003 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728230-mb86d" Jul 10 14:30:00.194235 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:30:00.194217 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w96jd\"" Jul 10 14:30:00.203155 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:30:00.203139 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728230-mb86d" Jul 10 14:30:00.240750 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:30:00.240721 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728230-mb86d"] Jul 10 14:30:00.350484 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:30:00.350441 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18812b24_2edc_48c1_a2d0_8e740cddb01e.slice/crio-d71e8970c11229b0e16cf61d567ae979099330ef99a4814815cde690296e359d WatchSource:0}: Error finding container d71e8970c11229b0e16cf61d567ae979099330ef99a4814815cde690296e359d: Status 404 returned error can't find the container with id d71e8970c11229b0e16cf61d567ae979099330ef99a4814815cde690296e359d Jul 10 14:30:00.352290 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:30:00.352267 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728230-mb86d"] Jul 10 14:30:00.352382 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:30:00.352287 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 14:30:01.247112 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:30:01.247073 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728230-mb86d" event={"ID":"18812b24-2edc-48c1-a2d0-8e740cddb01e","Type":"ContainerStarted","Data":"d71e8970c11229b0e16cf61d567ae979099330ef99a4814815cde690296e359d"} Jul 10 14:30:03.259659 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:30:03.259625 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728230-mb86d" event={"ID":"18812b24-2edc-48c1-a2d0-8e740cddb01e","Type":"ContainerStarted","Data":"225bced027cfa7f6621596ec8740600a02268fc7f5df09f5203c3623f8b3a8e6"} Jul 10 14:30:03.281392 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:30:03.281346 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728230-mb86d" podStartSLOduration=1.44552546 podStartE2EDuration="3.281330032s" totalImagesPullingTime="1.835804572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:30:03.278743807 +0000 UTC m=+1286.222316137" watchObservedRunningTime="2026-07-10 14:30:03.281330032 +0000 UTC m=+1286.224902380" Jul 10 14:30:05.709699 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:30:05.709667 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:30:17.152730 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:30:17.152694 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:30:28.018920 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:30:28.018886 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:30:38.387877 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:30:38.387827 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:30:50.414761 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:30:50.414725 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:31:00.016062 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:31:00.015978 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728230-mb86d"] Jul 10 14:31:00.016535 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:31:00.016207 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728230-mb86d" podUID="18812b24-2edc-48c1-a2d0-8e740cddb01e" containerName="cleanup" containerID="cri-o://225bced027cfa7f6621596ec8740600a02268fc7f5df09f5203c3623f8b3a8e6" gracePeriod=30 Jul 10 14:31:05.171419 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:31:05.171388 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:31:14.397360 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:31:14.397313 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:31:26.278004 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:31:26.277969 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:31:30.207531 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:31:30.207507 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728230-mb86d" Jul 10 14:31:30.729988 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:31:30.729954 2581 generic.go:356] "Generic (PLEG): container finished" podID="18812b24-2edc-48c1-a2d0-8e740cddb01e" containerID="225bced027cfa7f6621596ec8740600a02268fc7f5df09f5203c3623f8b3a8e6" exitCode=137 Jul 10 14:31:30.729988 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:31:30.729992 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728230-mb86d" Jul 10 14:31:30.730222 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:31:30.730008 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728230-mb86d" event={"ID":"18812b24-2edc-48c1-a2d0-8e740cddb01e","Type":"ContainerDied","Data":"225bced027cfa7f6621596ec8740600a02268fc7f5df09f5203c3623f8b3a8e6"} Jul 10 14:31:30.730222 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:31:30.730061 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728230-mb86d" event={"ID":"18812b24-2edc-48c1-a2d0-8e740cddb01e","Type":"ContainerDied","Data":"d71e8970c11229b0e16cf61d567ae979099330ef99a4814815cde690296e359d"} Jul 10 14:31:30.730222 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:31:30.730090 2581 scope.go:117] "RemoveContainer" containerID="225bced027cfa7f6621596ec8740600a02268fc7f5df09f5203c3623f8b3a8e6" Jul 10 14:31:30.738975 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:31:30.738957 2581 scope.go:117] "RemoveContainer" containerID="225bced027cfa7f6621596ec8740600a02268fc7f5df09f5203c3623f8b3a8e6" Jul 10 14:31:30.739228 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:31:30.739209 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"225bced027cfa7f6621596ec8740600a02268fc7f5df09f5203c3623f8b3a8e6\": container with ID starting with 225bced027cfa7f6621596ec8740600a02268fc7f5df09f5203c3623f8b3a8e6 not found: ID does not exist" containerID="225bced027cfa7f6621596ec8740600a02268fc7f5df09f5203c3623f8b3a8e6" Jul 10 14:31:30.739298 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:31:30.739236 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"225bced027cfa7f6621596ec8740600a02268fc7f5df09f5203c3623f8b3a8e6"} err="failed to get container status \"225bced027cfa7f6621596ec8740600a02268fc7f5df09f5203c3623f8b3a8e6\": rpc error: code = NotFound desc = could not find container \"225bced027cfa7f6621596ec8740600a02268fc7f5df09f5203c3623f8b3a8e6\": container with ID starting with 225bced027cfa7f6621596ec8740600a02268fc7f5df09f5203c3623f8b3a8e6 not found: ID does not exist" Jul 10 14:31:30.752839 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:31:30.752812 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728230-mb86d"] Jul 10 14:31:30.758969 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:31:30.758950 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728230-mb86d"] Jul 10 14:31:31.644162 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:31:31.644128 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18812b24-2edc-48c1-a2d0-8e740cddb01e" path="/var/lib/kubelet/pods/18812b24-2edc-48c1-a2d0-8e740cddb01e/volumes" Jul 10 14:31:43.491067 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:31:43.491032 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:31:56.297783 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:31:56.297751 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:32:09.915497 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:32:09.915463 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:32:23.312341 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:32:23.309702 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:32:31.889686 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:32:31.889601 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:32:41.985114 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:32:41.985071 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:33:37.665376 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:33:37.665347 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6z8gc_72c7722f-6a58-4230-a5f4-9c440b6887ea/ovn-acl-logging/0.log" Jul 10 14:33:37.666360 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:33:37.666337 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6z8gc_72c7722f-6a58-4230-a5f4-9c440b6887ea/ovn-acl-logging/0.log" Jul 10 14:34:52.101729 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:34:52.101695 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:35:00.000926 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:35:00.000892 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:35:15.882127 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:35:15.882092 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:35:27.195646 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:35:27.195611 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:36:00.388360 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:36:00.388264 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:36:12.630275 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:36:12.630235 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:36:28.700254 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:36:28.700216 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:36:42.038589 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:36:42.038556 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:37:25.585463 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:37:25.585428 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:38:33.474779 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:38:33.474700 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:38:37.699169 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:38:37.699140 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6z8gc_72c7722f-6a58-4230-a5f4-9c440b6887ea/ovn-acl-logging/0.log" Jul 10 14:38:37.702785 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:38:37.702766 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6z8gc_72c7722f-6a58-4230-a5f4-9c440b6887ea/ovn-acl-logging/0.log" Jul 10 14:38:44.207743 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:38:44.207701 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:38:52.296433 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:38:52.296397 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:39:23.988419 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:39:23.988389 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:39:43.177421 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:39:43.177380 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:40:25.205428 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:25.205395 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:40:38.495012 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.494979 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc"] Jul 10 14:40:38.495460 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.495440 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18812b24-2edc-48c1-a2d0-8e740cddb01e" containerName="cleanup" Jul 10 14:40:38.495534 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.495463 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="18812b24-2edc-48c1-a2d0-8e740cddb01e" containerName="cleanup" Jul 10 14:40:38.495622 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.495610 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="18812b24-2edc-48c1-a2d0-8e740cddb01e" containerName="cleanup" Jul 10 14:40:38.499058 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.499034 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:40:38.502114 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.502095 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-8bc503-openshift-default-dockercfg-wp4b9\"" Jul 10 14:40:38.515389 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.515368 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc"] Jul 10 14:40:38.603312 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.603158 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk772\" (UniqueName: \"kubernetes.io/projected/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-kube-api-access-pk772\") pod \"e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc\" (UID: \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\") " pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:40:38.603526 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.603390 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-istiod-ca-cert\") pod \"e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc\" (UID: \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\") " pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:40:38.603526 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.603514 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-workload-certs\") pod \"e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc\" (UID: \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\") " pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:40:38.603654 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.603558 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-istio-data\") pod \"e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc\" (UID: \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\") " pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:40:38.603654 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.603602 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-istio-envoy\") pod \"e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc\" (UID: \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\") " pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:40:38.603770 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.603701 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-istio-token\") pod \"e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc\" (UID: \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\") " pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:40:38.603826 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.603776 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-workload-socket\") pod \"e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc\" (UID: \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\") " pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:40:38.603826 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.603796 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-istio-podinfo\") pod \"e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc\" (UID: \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\") " pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:40:38.603934 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.603905 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-credential-socket\") pod \"e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc\" (UID: \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\") " pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:40:38.705033 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.704989 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-workload-certs\") pod \"e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc\" (UID: \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\") " pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:40:38.705033 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.705023 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-istio-data\") pod \"e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc\" (UID: \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\") " pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:40:38.705033 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.705042 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-istio-envoy\") pod \"e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc\" (UID: \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\") " pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:40:38.705406 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.705057 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-istio-token\") pod \"e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc\" (UID: \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\") " pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:40:38.705406 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.705104 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-workload-socket\") pod \"e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc\" (UID: \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\") " pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:40:38.705406 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.705128 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-istio-podinfo\") pod \"e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc\" (UID: \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\") " pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:40:38.705601 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.705397 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-credential-socket\") pod \"e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc\" (UID: \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\") " pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:40:38.705601 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.705462 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-istio-data\") pod \"e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc\" (UID: \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\") " pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:40:38.705601 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.705475 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk772\" (UniqueName: \"kubernetes.io/projected/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-kube-api-access-pk772\") pod \"e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc\" (UID: \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\") " pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:40:38.705601 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.705592 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-istiod-ca-cert\") pod \"e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc\" (UID: \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\") " pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:40:38.705830 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.705647 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-workload-certs\") pod \"e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc\" (UID: \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\") " pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:40:38.705830 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.705787 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-workload-socket\") pod \"e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc\" (UID: \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\") " pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:40:38.705941 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.705855 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-credential-socket\") pod \"e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc\" (UID: \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\") " pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:40:38.706205 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.706187 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-istiod-ca-cert\") pod \"e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc\" (UID: \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\") " pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:40:38.707913 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.707881 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-istio-envoy\") pod \"e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc\" (UID: \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\") " pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:40:38.708076 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.708059 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-istio-podinfo\") pod \"e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc\" (UID: \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\") " pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:40:38.716362 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.716344 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-istio-token\") pod \"e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc\" (UID: \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\") " pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:40:38.721147 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.721129 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk772\" (UniqueName: \"kubernetes.io/projected/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-kube-api-access-pk772\") pod \"e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc\" (UID: \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\") " pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:40:38.809697 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.809670 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:40:38.955588 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.955563 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc"] Jul 10 14:40:38.956965 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:40:38.956935 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c7e2ee3_6b21_4bf9_ae77_ca0184bed3c4.slice/crio-b276070ef1296b69bd44f389a09dbc77e824c0597c4bcdfe95e1b76ff7fbf2de WatchSource:0}: Error finding container b276070ef1296b69bd44f389a09dbc77e824c0597c4bcdfe95e1b76ff7fbf2de: Status 404 returned error can't find the container with id b276070ef1296b69bd44f389a09dbc77e824c0597c4bcdfe95e1b76ff7fbf2de Jul 10 14:40:38.958937 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:38.958917 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 14:40:39.634036 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:39.633999 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" event={"ID":"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4","Type":"ContainerStarted","Data":"b276070ef1296b69bd44f389a09dbc77e824c0597c4bcdfe95e1b76ff7fbf2de"} Jul 10 14:40:40.403520 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:40.403480 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:40:41.476734 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:41.476701 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:40:41.476981 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:41.476776 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:40:41.476981 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:41.476806 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:40:41.648637 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:41.648603 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" event={"ID":"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4","Type":"ContainerStarted","Data":"f5de58258fba91d90c0cace6c5566f1547e50f23eae1472cd799edb6b4f6f186"} Jul 10 14:40:41.674049 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:41.674000 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" podStartSLOduration=1.156711861 podStartE2EDuration="3.673985292s" totalImagesPullingTime="2.517273431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:40:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:40:41.670960502 +0000 UTC m=+1924.614532842" watchObservedRunningTime="2026-07-10 14:40:41.673985292 +0000 UTC m=+1924.617557632" Jul 10 14:40:41.810229 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:41.810191 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:40:42.815723 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:42.815689 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:40:43.659888 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:43.659851 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:40:43.660999 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:43.660979 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:40:55.325824 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:55.325782 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:40:55.729895 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:55.729807 2581 generic.go:356] "Generic (PLEG): container finished" podID="2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4" containerID="f5de58258fba91d90c0cace6c5566f1547e50f23eae1472cd799edb6b4f6f186" exitCode=0 Jul 10 14:40:55.729895 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:55.729848 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" event={"ID":"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4","Type":"ContainerDied","Data":"f5de58258fba91d90c0cace6c5566f1547e50f23eae1472cd799edb6b4f6f186"} Jul 10 14:40:55.730257 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:55.730242 2581 scope.go:117] "RemoveContainer" containerID="f5de58258fba91d90c0cace6c5566f1547e50f23eae1472cd799edb6b4f6f186" Jul 10 14:40:55.732424 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:55.732391 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:40:55.732505 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:55.732456 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:40:55.732505 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:55.732489 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:40:56.736828 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:56.736797 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" event={"ID":"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4","Type":"ContainerStarted","Data":"16186798af40e9b1cf7478802ca35d5c6e75d6c6d892318ffcfaced8acd568cd"} Jul 10 14:40:56.810643 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:56.810600 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:40:56.811952 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:56.811920 2581 patch_prober.go:28] interesting pod/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 10 14:40:56.812102 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:56.811986 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" podUID="2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 10 14:40:57.810514 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:57.810473 2581 patch_prober.go:28] interesting pod/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 10 14:40:57.811084 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:57.810540 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" podUID="2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 10 14:40:58.660273 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:58.660218 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:40:58.810450 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:58.810408 2581 patch_prober.go:28] interesting pod/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 10 14:40:58.810647 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:58.810476 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" podUID="2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 10 14:40:59.810924 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:59.810886 2581 patch_prober.go:28] interesting pod/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 10 14:40:59.811537 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:40:59.811505 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" podUID="2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 10 14:41:00.815389 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:00.815362 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:41:00.816347 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:00.816307 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:41:09.486238 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:09.486207 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:41:11.195778 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:11.195750 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc"] Jul 10 14:41:11.196191 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:11.195930 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" podUID="2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4" containerName="istio-proxy" containerID="cri-o://16186798af40e9b1cf7478802ca35d5c6e75d6c6d892318ffcfaced8acd568cd" gracePeriod=30 Jul 10 14:41:15.817798 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:15.817759 2581 patch_prober.go:28] interesting pod/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 10 14:41:15.818178 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:15.817827 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" podUID="2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 14:41:16.457138 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.457068 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:41:16.543227 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.543183 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pk772\" (UniqueName: \"kubernetes.io/projected/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-kube-api-access-pk772\") pod \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\" (UID: \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\") " Jul 10 14:41:16.543430 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.543247 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-istio-token\") pod \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\" (UID: \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\") " Jul 10 14:41:16.543430 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.543270 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-workload-socket\") pod \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\" (UID: \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\") " Jul 10 14:41:16.543430 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.543289 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-istio-envoy\") pod \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\" (UID: \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\") " Jul 10 14:41:16.543430 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.543379 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-istio-data\") pod \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\" (UID: \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\") " Jul 10 14:41:16.543430 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.543398 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-workload-certs\") pod \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\" (UID: \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\") " Jul 10 14:41:16.543430 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.543416 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-credential-socket\") pod \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\" (UID: \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\") " Jul 10 14:41:16.543760 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.543449 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-istiod-ca-cert\") pod \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\" (UID: \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\") " Jul 10 14:41:16.543760 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.543474 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-istio-podinfo\") pod \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\" (UID: \"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4\") " Jul 10 14:41:16.543760 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.543572 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4" (UID: "2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:41:16.543926 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.543796 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-workload-socket\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:41:16.543926 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.543815 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4" (UID: "2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:41:16.544035 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.543975 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4" (UID: "2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:41:16.544100 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.544054 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4" (UID: "2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:41:16.544356 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.544336 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-istio-data" (OuterVolumeSpecName: "istio-data") pod "2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4" (UID: "2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:41:16.545633 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.545611 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4" (UID: "2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 14:41:16.545727 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.545633 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4" (UID: "2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:41:16.545909 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.545885 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-istio-token" (OuterVolumeSpecName: "istio-token") pod "2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4" (UID: "2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:41:16.545909 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.545901 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-kube-api-access-pk772" (OuterVolumeSpecName: "kube-api-access-pk772") pod "2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4" (UID: "2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4"). InnerVolumeSpecName "kube-api-access-pk772". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:41:16.644974 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.644930 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-istio-data\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:41:16.644974 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.644964 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-workload-certs\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:41:16.644974 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.644976 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-credential-socket\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:41:16.645285 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.644988 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-istiod-ca-cert\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:41:16.645285 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.645000 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-istio-podinfo\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:41:16.645285 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.645012 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pk772\" (UniqueName: \"kubernetes.io/projected/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-kube-api-access-pk772\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:41:16.645285 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.645022 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-istio-token\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:41:16.645285 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.645030 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4-istio-envoy\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:41:16.843207 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.843170 2581 generic.go:356] "Generic (PLEG): container finished" podID="2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4" containerID="16186798af40e9b1cf7478802ca35d5c6e75d6c6d892318ffcfaced8acd568cd" exitCode=0 Jul 10 14:41:16.843638 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.843223 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" Jul 10 14:41:16.843638 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.843260 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" event={"ID":"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4","Type":"ContainerDied","Data":"16186798af40e9b1cf7478802ca35d5c6e75d6c6d892318ffcfaced8acd568cd"} Jul 10 14:41:16.843638 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.843314 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc" event={"ID":"2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4","Type":"ContainerDied","Data":"b276070ef1296b69bd44f389a09dbc77e824c0597c4bcdfe95e1b76ff7fbf2de"} Jul 10 14:41:16.843638 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.843357 2581 scope.go:117] "RemoveContainer" containerID="16186798af40e9b1cf7478802ca35d5c6e75d6c6d892318ffcfaced8acd568cd" Jul 10 14:41:16.853547 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.853526 2581 scope.go:117] "RemoveContainer" containerID="f5de58258fba91d90c0cace6c5566f1547e50f23eae1472cd799edb6b4f6f186" Jul 10 14:41:16.861710 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.861692 2581 scope.go:117] "RemoveContainer" containerID="16186798af40e9b1cf7478802ca35d5c6e75d6c6d892318ffcfaced8acd568cd" Jul 10 14:41:16.861964 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:41:16.861943 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16186798af40e9b1cf7478802ca35d5c6e75d6c6d892318ffcfaced8acd568cd\": container with ID starting with 16186798af40e9b1cf7478802ca35d5c6e75d6c6d892318ffcfaced8acd568cd not found: ID does not exist" containerID="16186798af40e9b1cf7478802ca35d5c6e75d6c6d892318ffcfaced8acd568cd" Jul 10 14:41:16.862010 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.861973 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16186798af40e9b1cf7478802ca35d5c6e75d6c6d892318ffcfaced8acd568cd"} err="failed to get container status \"16186798af40e9b1cf7478802ca35d5c6e75d6c6d892318ffcfaced8acd568cd\": rpc error: code = NotFound desc = could not find container \"16186798af40e9b1cf7478802ca35d5c6e75d6c6d892318ffcfaced8acd568cd\": container with ID starting with 16186798af40e9b1cf7478802ca35d5c6e75d6c6d892318ffcfaced8acd568cd not found: ID does not exist" Jul 10 14:41:16.862010 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.861989 2581 scope.go:117] "RemoveContainer" containerID="f5de58258fba91d90c0cace6c5566f1547e50f23eae1472cd799edb6b4f6f186" Jul 10 14:41:16.862223 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:41:16.862207 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5de58258fba91d90c0cace6c5566f1547e50f23eae1472cd799edb6b4f6f186\": container with ID starting with f5de58258fba91d90c0cace6c5566f1547e50f23eae1472cd799edb6b4f6f186 not found: ID does not exist" containerID="f5de58258fba91d90c0cace6c5566f1547e50f23eae1472cd799edb6b4f6f186" Jul 10 14:41:16.862264 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.862231 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5de58258fba91d90c0cace6c5566f1547e50f23eae1472cd799edb6b4f6f186"} err="failed to get container status \"f5de58258fba91d90c0cace6c5566f1547e50f23eae1472cd799edb6b4f6f186\": rpc error: code = NotFound desc = could not find container \"f5de58258fba91d90c0cace6c5566f1547e50f23eae1472cd799edb6b4f6f186\": container with ID starting with f5de58258fba91d90c0cace6c5566f1547e50f23eae1472cd799edb6b4f6f186 not found: ID does not exist" Jul 10 14:41:16.867427 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.867402 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc"] Jul 10 14:41:16.872262 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:16.872242 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-8bc503-openshift-default-789c678f67-dh8cc"] Jul 10 14:41:17.645499 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:17.645467 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4" path="/var/lib/kubelet/pods/2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4/volumes" Jul 10 14:41:20.680167 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.680130 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz"] Jul 10 14:41:20.680626 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.680599 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4" containerName="istio-proxy" Jul 10 14:41:20.680626 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.680617 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4" containerName="istio-proxy" Jul 10 14:41:20.680744 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.680630 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4" containerName="istio-proxy" Jul 10 14:41:20.680744 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.680639 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4" containerName="istio-proxy" Jul 10 14:41:20.680744 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.680731 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4" containerName="istio-proxy" Jul 10 14:41:20.680841 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.680746 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c7e2ee3-6b21-4bf9-ae77-ca0184bed3c4" containerName="istio-proxy" Jul 10 14:41:20.685083 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.685064 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:20.688508 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.688489 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-feed7a-openshift-default-dockercfg-mvqln\"" Jul 10 14:41:20.695626 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.695606 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz"] Jul 10 14:41:20.778464 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.778429 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrhpl\" (UniqueName: \"kubernetes.io/projected/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-kube-api-access-vrhpl\") pod \"e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz\" (UID: \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\") " pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:20.778464 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.778468 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-credential-socket\") pod \"e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz\" (UID: \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\") " pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:20.778667 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.778486 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-workload-certs\") pod \"e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz\" (UID: \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\") " pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:20.778667 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.778509 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-istio-token\") pod \"e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz\" (UID: \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\") " pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:20.778667 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.778532 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-istio-data\") pod \"e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz\" (UID: \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\") " pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:20.778667 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.778556 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-workload-socket\") pod \"e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz\" (UID: \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\") " pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:20.778667 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.778577 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-istio-podinfo\") pod \"e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz\" (UID: \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\") " pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:20.778667 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.778624 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-istio-envoy\") pod \"e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz\" (UID: \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\") " pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:20.778667 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.778664 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-istiod-ca-cert\") pod \"e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz\" (UID: \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\") " pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:20.879618 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.879584 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-istiod-ca-cert\") pod \"e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz\" (UID: \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\") " pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:20.879800 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.879638 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrhpl\" (UniqueName: \"kubernetes.io/projected/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-kube-api-access-vrhpl\") pod \"e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz\" (UID: \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\") " pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:20.879800 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.879672 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-credential-socket\") pod \"e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz\" (UID: \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\") " pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:20.879800 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.879693 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-workload-certs\") pod \"e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz\" (UID: \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\") " pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:20.879800 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.879716 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-istio-token\") pod \"e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz\" (UID: \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\") " pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:20.879800 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.879741 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-istio-data\") pod \"e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz\" (UID: \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\") " pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:20.879800 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.879780 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-workload-socket\") pod \"e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz\" (UID: \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\") " pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:20.880121 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.879813 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-istio-podinfo\") pod \"e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz\" (UID: \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\") " pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:20.880121 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.879877 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-istio-envoy\") pod \"e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz\" (UID: \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\") " pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:20.880226 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.880169 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-istio-data\") pod \"e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz\" (UID: \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\") " pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:20.880284 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.880236 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-workload-socket\") pod \"e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz\" (UID: \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\") " pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:20.880397 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.880368 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-credential-socket\") pod \"e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz\" (UID: \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\") " pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:20.880397 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.880383 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-istiod-ca-cert\") pod \"e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz\" (UID: \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\") " pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:20.880552 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.880404 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-workload-certs\") pod \"e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz\" (UID: \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\") " pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:20.882262 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.882200 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-istio-envoy\") pod \"e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz\" (UID: \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\") " pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:20.882501 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.882482 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-istio-podinfo\") pod \"e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz\" (UID: \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\") " pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:20.892777 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.889710 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrhpl\" (UniqueName: \"kubernetes.io/projected/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-kube-api-access-vrhpl\") pod \"e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz\" (UID: \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\") " pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:20.892777 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.889895 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-istio-token\") pod \"e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz\" (UID: \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\") " pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:20.995936 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:20.995869 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:21.080630 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:21.080152 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:41:21.132885 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:21.132857 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz"] Jul 10 14:41:21.134398 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:41:21.134374 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c170e37_05f7_43b4_a089_0fc5de0e3cd5.slice/crio-2ccb8b4df385f597d565c67e863d8ce12883509e96be861463e4b6db25e049f6 WatchSource:0}: Error finding container 2ccb8b4df385f597d565c67e863d8ce12883509e96be861463e4b6db25e049f6: Status 404 returned error can't find the container with id 2ccb8b4df385f597d565c67e863d8ce12883509e96be861463e4b6db25e049f6 Jul 10 14:41:21.136919 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:21.136887 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:41:21.137014 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:21.136963 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:41:21.137077 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:21.137010 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:41:21.871531 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:21.871494 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" event={"ID":"0c170e37-05f7-43b4-a089-0fc5de0e3cd5","Type":"ContainerStarted","Data":"91c7d74a55f7cc7ce5cb0ee65f7aea20e2666ed56c89049106285b79a7360f0c"} Jul 10 14:41:21.871965 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:21.871549 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" event={"ID":"0c170e37-05f7-43b4-a089-0fc5de0e3cd5","Type":"ContainerStarted","Data":"2ccb8b4df385f597d565c67e863d8ce12883509e96be861463e4b6db25e049f6"} Jul 10 14:41:21.897690 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:21.897639 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" podStartSLOduration=1.897622849 podStartE2EDuration="1.897622849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:41:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:41:21.895006 +0000 UTC m=+1964.838578340" watchObservedRunningTime="2026-07-10 14:41:21.897622849 +0000 UTC m=+1964.841195186" Jul 10 14:41:21.996675 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:21.996640 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:23.001296 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:23.001264 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:23.882401 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:23.882368 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:23.883168 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:23.883146 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:29.879980 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:29.879894 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:41:37.962611 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:37.962576 2581 generic.go:356] "Generic (PLEG): container finished" podID="0c170e37-05f7-43b4-a089-0fc5de0e3cd5" containerID="91c7d74a55f7cc7ce5cb0ee65f7aea20e2666ed56c89049106285b79a7360f0c" exitCode=0 Jul 10 14:41:37.962611 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:37.962596 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" event={"ID":"0c170e37-05f7-43b4-a089-0fc5de0e3cd5","Type":"ContainerDied","Data":"91c7d74a55f7cc7ce5cb0ee65f7aea20e2666ed56c89049106285b79a7360f0c"} Jul 10 14:41:37.963189 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:37.963092 2581 scope.go:117] "RemoveContainer" containerID="91c7d74a55f7cc7ce5cb0ee65f7aea20e2666ed56c89049106285b79a7360f0c" Jul 10 14:41:37.964123 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:37.964100 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:41:37.964214 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:37.964163 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:41:37.964214 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:37.964197 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:41:38.882327 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:38.882280 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:38.969666 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:38.969635 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" event={"ID":"0c170e37-05f7-43b4-a089-0fc5de0e3cd5","Type":"ContainerStarted","Data":"4e65e6a1bd4dcc3747c6f5e9bf500357c03e30b6c3ec840d5bd021f472a2e8bb"} Jul 10 14:41:38.996895 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:38.996861 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:39.998191 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:39.998147 2581 patch_prober.go:28] interesting pod/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 10 14:41:39.998748 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:39.998228 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" podUID="0c170e37-05f7-43b4-a089-0fc5de0e3cd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 10 14:41:40.996923 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:40.996886 2581 patch_prober.go:28] interesting pod/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 10 14:41:40.997147 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:40.996953 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" podUID="0c170e37-05f7-43b4-a089-0fc5de0e3cd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 10 14:41:41.997152 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:41.997115 2581 patch_prober.go:28] interesting pod/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 10 14:41:41.997796 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:41.997761 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" podUID="0c170e37-05f7-43b4-a089-0fc5de0e3cd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 10 14:41:43.001008 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:43.000977 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:43.001540 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:43.001257 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:43.002043 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:43.002021 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:41:51.380187 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:41:51.380152 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:42:29.831750 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:42:29.831718 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:42:45.788492 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:42:45.788459 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:43:04.693605 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:43:04.693522 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:43:18.181666 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:43:18.181632 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:43:34.787510 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:43:34.787475 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:43:37.734338 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:43:37.734303 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6z8gc_72c7722f-6a58-4230-a5f4-9c440b6887ea/ovn-acl-logging/0.log" Jul 10 14:43:37.740544 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:43:37.740525 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6z8gc_72c7722f-6a58-4230-a5f4-9c440b6887ea/ovn-acl-logging/0.log" Jul 10 14:43:52.989974 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:43:52.989938 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:44:11.382236 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:44:11.382203 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:44:28.883729 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:44:28.883648 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:44:44.472624 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:44:44.472590 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:45:00.160588 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:45:00.160546 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728245-cmxmt"] Jul 10 14:45:00.164153 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:45:00.164131 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9e5d79-29728245-xh7xx"] Jul 10 14:45:00.164300 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:45:00.164241 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728245-cmxmt" Jul 10 14:45:00.167393 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:45:00.167376 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-feed7a-29728245-d7g5h"] Jul 10 14:45:00.167513 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:45:00.167494 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9e5d79-29728245-xh7xx" Jul 10 14:45:00.167753 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:45:00.167734 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w96jd\"" Jul 10 14:45:00.170440 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:45:00.170423 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-feed7a-29728245-d7g5h" Jul 10 14:45:00.175274 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:45:00.175252 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728245-cmxmt"] Jul 10 14:45:00.176653 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:45:00.176637 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728245-cmxmt" Jul 10 14:45:00.184642 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:45:00.184626 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9e5d79-29728245-xh7xx" Jul 10 14:45:00.196472 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:45:00.196446 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-feed7a-29728245-d7g5h"] Jul 10 14:45:00.196592 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:45:00.196507 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9e5d79-29728245-xh7xx"] Jul 10 14:45:00.213193 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:45:00.213169 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-feed7a-29728245-d7g5h" Jul 10 14:45:00.359409 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:45:00.359370 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728245-cmxmt"] Jul 10 14:45:00.364817 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:45:00.364783 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb670816d_c226_4b7c_b82f_bc24ae6b7a02.slice/crio-ba01875ea3550d03d25e7e91e4abe96c5f6c46ac24324d13285c0df70f9783d6 WatchSource:0}: Error finding container ba01875ea3550d03d25e7e91e4abe96c5f6c46ac24324d13285c0df70f9783d6: Status 404 returned error can't find the container with id ba01875ea3550d03d25e7e91e4abe96c5f6c46ac24324d13285c0df70f9783d6 Jul 10 14:45:00.573044 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:45:00.573013 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9e5d79-29728245-xh7xx"] Jul 10 14:45:00.575249 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:45:00.575221 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7a1a340_aaaf_4d38_8090_12aca2854048.slice/crio-ec95f0bb911d7619843d88884343956b5325fe8f93b3769b0081fdf29aa9d291 WatchSource:0}: Error finding container ec95f0bb911d7619843d88884343956b5325fe8f93b3769b0081fdf29aa9d291: Status 404 returned error can't find the container with id ec95f0bb911d7619843d88884343956b5325fe8f93b3769b0081fdf29aa9d291 Jul 10 14:45:00.609486 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:45:00.609466 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-feed7a-29728245-d7g5h"] Jul 10 14:45:00.611487 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:45:00.611462 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96f9854d_a7b5_4afd_80cc_b946d53c5e9a.slice/crio-beee5f223187ac01974ac9699d967766ee0bd45a5ceba56973fb6ed1ea4287a4 WatchSource:0}: Error finding container beee5f223187ac01974ac9699d967766ee0bd45a5ceba56973fb6ed1ea4287a4: Status 404 returned error can't find the container with id beee5f223187ac01974ac9699d967766ee0bd45a5ceba56973fb6ed1ea4287a4 Jul 10 14:45:01.067657 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:45:01.067619 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9e5d79-29728245-xh7xx" event={"ID":"f7a1a340-aaaf-4d38-8090-12aca2854048","Type":"ContainerStarted","Data":"546e067a8c9ec58184e736276e6f2e139f35a5ad284169354f6589ee6cd4f092"} Jul 10 14:45:01.067825 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:45:01.067680 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9e5d79-29728245-xh7xx" event={"ID":"f7a1a340-aaaf-4d38-8090-12aca2854048","Type":"ContainerStarted","Data":"ec95f0bb911d7619843d88884343956b5325fe8f93b3769b0081fdf29aa9d291"} Jul 10 14:45:01.069116 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:45:01.069084 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728245-cmxmt" event={"ID":"b670816d-c226-4b7c-b82f-bc24ae6b7a02","Type":"ContainerStarted","Data":"585730e0de341fd2bd0e16fe725d5e05649da29e5393fc89dcf361b4c3cb2b08"} Jul 10 14:45:01.069254 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:45:01.069133 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728245-cmxmt" event={"ID":"b670816d-c226-4b7c-b82f-bc24ae6b7a02","Type":"ContainerStarted","Data":"ba01875ea3550d03d25e7e91e4abe96c5f6c46ac24324d13285c0df70f9783d6"} Jul 10 14:45:01.070507 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:45:01.070484 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-feed7a-29728245-d7g5h" event={"ID":"96f9854d-a7b5-4afd-80cc-b946d53c5e9a","Type":"ContainerStarted","Data":"63901931d735101fdb4eefa31c772db58b47996ace370cf004f528dbd1978f53"} Jul 10 14:45:01.070612 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:45:01.070523 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-feed7a-29728245-d7g5h" event={"ID":"96f9854d-a7b5-4afd-80cc-b946d53c5e9a","Type":"ContainerStarted","Data":"beee5f223187ac01974ac9699d967766ee0bd45a5ceba56973fb6ed1ea4287a4"} Jul 10 14:45:01.089348 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:45:01.089291 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9e5d79-29728245-xh7xx" podStartSLOduration=1.089275338 podStartE2EDuration="1.089275338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:45:01.088236089 +0000 UTC m=+2184.031808430" watchObservedRunningTime="2026-07-10 14:45:01.089275338 +0000 UTC m=+2184.032847728" Jul 10 14:45:01.107346 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:45:01.107288 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-feed7a-29728245-d7g5h" podStartSLOduration=1.107276358 podStartE2EDuration="1.107276358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:45:01.106420109 +0000 UTC m=+2184.049992450" watchObservedRunningTime="2026-07-10 14:45:01.107276358 +0000 UTC m=+2184.050848698" Jul 10 14:45:01.124233 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:45:01.124190 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728245-cmxmt" podStartSLOduration=1.124177425 podStartE2EDuration="1.124177425s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:45:01.122157977 +0000 UTC m=+2184.065730316" watchObservedRunningTime="2026-07-10 14:45:01.124177425 +0000 UTC m=+2184.067749791" Jul 10 14:45:16.582649 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:45:16.582615 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:45:43.790377 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:45:43.790345 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:46:00.014042 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:00.013949 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-feed7a-29728245-d7g5h"] Jul 10 14:46:00.014636 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:00.014178 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-feed7a-29728245-d7g5h" podUID="96f9854d-a7b5-4afd-80cc-b946d53c5e9a" containerName="cleanup" containerID="cri-o://63901931d735101fdb4eefa31c772db58b47996ace370cf004f528dbd1978f53" gracePeriod=30 Jul 10 14:46:00.016646 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:00.016620 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9e5d79-29728245-xh7xx"] Jul 10 14:46:00.016815 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:00.016795 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9e5d79-29728245-xh7xx" podUID="f7a1a340-aaaf-4d38-8090-12aca2854048" containerName="cleanup" containerID="cri-o://546e067a8c9ec58184e736276e6f2e139f35a5ad284169354f6589ee6cd4f092" gracePeriod=30 Jul 10 14:46:00.018704 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:00.018683 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728245-cmxmt"] Jul 10 14:46:00.018870 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:00.018850 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728245-cmxmt" podUID="b670816d-c226-4b7c-b82f-bc24ae6b7a02" containerName="cleanup" containerID="cri-o://585730e0de341fd2bd0e16fe725d5e05649da29e5393fc89dcf361b4c3cb2b08" gracePeriod=30 Jul 10 14:46:00.783608 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:00.783574 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:46:13.383446 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:13.383411 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:46:26.087826 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:26.087789 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:46:30.245157 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:30.245130 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-feed7a-29728245-d7g5h" Jul 10 14:46:30.248623 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:30.248604 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728245-cmxmt" Jul 10 14:46:30.264043 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:30.264012 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9e5d79-29728245-xh7xx" Jul 10 14:46:30.555598 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:30.555567 2581 generic.go:356] "Generic (PLEG): container finished" podID="f7a1a340-aaaf-4d38-8090-12aca2854048" containerID="546e067a8c9ec58184e736276e6f2e139f35a5ad284169354f6589ee6cd4f092" exitCode=137 Jul 10 14:46:30.555821 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:30.555625 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9e5d79-29728245-xh7xx" Jul 10 14:46:30.555821 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:30.555639 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9e5d79-29728245-xh7xx" event={"ID":"f7a1a340-aaaf-4d38-8090-12aca2854048","Type":"ContainerDied","Data":"546e067a8c9ec58184e736276e6f2e139f35a5ad284169354f6589ee6cd4f092"} Jul 10 14:46:30.555821 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:30.555688 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9e5d79-29728245-xh7xx" event={"ID":"f7a1a340-aaaf-4d38-8090-12aca2854048","Type":"ContainerDied","Data":"ec95f0bb911d7619843d88884343956b5325fe8f93b3769b0081fdf29aa9d291"} Jul 10 14:46:30.555821 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:30.555716 2581 scope.go:117] "RemoveContainer" containerID="546e067a8c9ec58184e736276e6f2e139f35a5ad284169354f6589ee6cd4f092" Jul 10 14:46:30.556843 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:30.556822 2581 generic.go:356] "Generic (PLEG): container finished" podID="b670816d-c226-4b7c-b82f-bc24ae6b7a02" containerID="585730e0de341fd2bd0e16fe725d5e05649da29e5393fc89dcf361b4c3cb2b08" exitCode=137 Jul 10 14:46:30.556920 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:30.556874 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728245-cmxmt" Jul 10 14:46:30.556979 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:30.556916 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728245-cmxmt" event={"ID":"b670816d-c226-4b7c-b82f-bc24ae6b7a02","Type":"ContainerDied","Data":"585730e0de341fd2bd0e16fe725d5e05649da29e5393fc89dcf361b4c3cb2b08"} Jul 10 14:46:30.556979 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:30.556962 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728245-cmxmt" event={"ID":"b670816d-c226-4b7c-b82f-bc24ae6b7a02","Type":"ContainerDied","Data":"ba01875ea3550d03d25e7e91e4abe96c5f6c46ac24324d13285c0df70f9783d6"} Jul 10 14:46:30.563468 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:30.561048 2581 generic.go:356] "Generic (PLEG): container finished" podID="96f9854d-a7b5-4afd-80cc-b946d53c5e9a" containerID="63901931d735101fdb4eefa31c772db58b47996ace370cf004f528dbd1978f53" exitCode=137 Jul 10 14:46:30.563468 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:30.561174 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-feed7a-29728245-d7g5h" event={"ID":"96f9854d-a7b5-4afd-80cc-b946d53c5e9a","Type":"ContainerDied","Data":"63901931d735101fdb4eefa31c772db58b47996ace370cf004f528dbd1978f53"} Jul 10 14:46:30.563468 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:30.561243 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-feed7a-29728245-d7g5h" event={"ID":"96f9854d-a7b5-4afd-80cc-b946d53c5e9a","Type":"ContainerDied","Data":"beee5f223187ac01974ac9699d967766ee0bd45a5ceba56973fb6ed1ea4287a4"} Jul 10 14:46:30.563468 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:30.561379 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-feed7a-29728245-d7g5h" Jul 10 14:46:30.575518 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:30.575500 2581 scope.go:117] "RemoveContainer" containerID="546e067a8c9ec58184e736276e6f2e139f35a5ad284169354f6589ee6cd4f092" Jul 10 14:46:30.575810 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:46:30.575792 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"546e067a8c9ec58184e736276e6f2e139f35a5ad284169354f6589ee6cd4f092\": container with ID starting with 546e067a8c9ec58184e736276e6f2e139f35a5ad284169354f6589ee6cd4f092 not found: ID does not exist" containerID="546e067a8c9ec58184e736276e6f2e139f35a5ad284169354f6589ee6cd4f092" Jul 10 14:46:30.575865 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:30.575818 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"546e067a8c9ec58184e736276e6f2e139f35a5ad284169354f6589ee6cd4f092"} err="failed to get container status \"546e067a8c9ec58184e736276e6f2e139f35a5ad284169354f6589ee6cd4f092\": rpc error: code = NotFound desc = could not find container \"546e067a8c9ec58184e736276e6f2e139f35a5ad284169354f6589ee6cd4f092\": container with ID starting with 546e067a8c9ec58184e736276e6f2e139f35a5ad284169354f6589ee6cd4f092 not found: ID does not exist" Jul 10 14:46:30.575865 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:30.575836 2581 scope.go:117] "RemoveContainer" containerID="585730e0de341fd2bd0e16fe725d5e05649da29e5393fc89dcf361b4c3cb2b08" Jul 10 14:46:30.585253 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:30.585236 2581 scope.go:117] "RemoveContainer" containerID="585730e0de341fd2bd0e16fe725d5e05649da29e5393fc89dcf361b4c3cb2b08" Jul 10 14:46:30.585408 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:30.585382 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728245-cmxmt"] Jul 10 14:46:30.585564 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:46:30.585544 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"585730e0de341fd2bd0e16fe725d5e05649da29e5393fc89dcf361b4c3cb2b08\": container with ID starting with 585730e0de341fd2bd0e16fe725d5e05649da29e5393fc89dcf361b4c3cb2b08 not found: ID does not exist" containerID="585730e0de341fd2bd0e16fe725d5e05649da29e5393fc89dcf361b4c3cb2b08" Jul 10 14:46:30.585627 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:30.585582 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"585730e0de341fd2bd0e16fe725d5e05649da29e5393fc89dcf361b4c3cb2b08"} err="failed to get container status \"585730e0de341fd2bd0e16fe725d5e05649da29e5393fc89dcf361b4c3cb2b08\": rpc error: code = NotFound desc = could not find container \"585730e0de341fd2bd0e16fe725d5e05649da29e5393fc89dcf361b4c3cb2b08\": container with ID starting with 585730e0de341fd2bd0e16fe725d5e05649da29e5393fc89dcf361b4c3cb2b08 not found: ID does not exist" Jul 10 14:46:30.585627 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:30.585600 2581 scope.go:117] "RemoveContainer" containerID="63901931d735101fdb4eefa31c772db58b47996ace370cf004f528dbd1978f53" Jul 10 14:46:30.588105 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:30.588084 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728245-cmxmt"] Jul 10 14:46:30.594102 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:30.594086 2581 scope.go:117] "RemoveContainer" containerID="63901931d735101fdb4eefa31c772db58b47996ace370cf004f528dbd1978f53" Jul 10 14:46:30.594384 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:46:30.594366 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63901931d735101fdb4eefa31c772db58b47996ace370cf004f528dbd1978f53\": container with ID starting with 63901931d735101fdb4eefa31c772db58b47996ace370cf004f528dbd1978f53 not found: ID does not exist" containerID="63901931d735101fdb4eefa31c772db58b47996ace370cf004f528dbd1978f53" Jul 10 14:46:30.594458 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:30.594388 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63901931d735101fdb4eefa31c772db58b47996ace370cf004f528dbd1978f53"} err="failed to get container status \"63901931d735101fdb4eefa31c772db58b47996ace370cf004f528dbd1978f53\": rpc error: code = NotFound desc = could not find container \"63901931d735101fdb4eefa31c772db58b47996ace370cf004f528dbd1978f53\": container with ID starting with 63901931d735101fdb4eefa31c772db58b47996ace370cf004f528dbd1978f53 not found: ID does not exist" Jul 10 14:46:30.597696 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:30.597676 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9e5d79-29728245-xh7xx"] Jul 10 14:46:30.605237 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:30.605211 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-9e5d79-29728245-xh7xx"] Jul 10 14:46:30.616164 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:30.616143 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-feed7a-29728245-d7g5h"] Jul 10 14:46:30.620162 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:30.620139 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-feed7a-29728245-d7g5h"] Jul 10 14:46:31.644282 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:31.644244 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96f9854d-a7b5-4afd-80cc-b946d53c5e9a" path="/var/lib/kubelet/pods/96f9854d-a7b5-4afd-80cc-b946d53c5e9a/volumes" Jul 10 14:46:31.644756 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:31.644525 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b670816d-c226-4b7c-b82f-bc24ae6b7a02" path="/var/lib/kubelet/pods/b670816d-c226-4b7c-b82f-bc24ae6b7a02/volumes" Jul 10 14:46:31.644756 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:31.644716 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7a1a340-aaaf-4d38-8090-12aca2854048" path="/var/lib/kubelet/pods/f7a1a340-aaaf-4d38-8090-12aca2854048/volumes" Jul 10 14:46:43.888710 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:46:43.888678 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:47:04.391852 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:04.391816 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:47:22.289149 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:22.289112 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:47:29.003480 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:29.003406 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7532-140685328279344"] Jul 10 14:47:29.003851 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:29.003822 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96f9854d-a7b5-4afd-80cc-b946d53c5e9a" containerName="cleanup" Jul 10 14:47:29.003851 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:29.003834 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="96f9854d-a7b5-4afd-80cc-b946d53c5e9a" containerName="cleanup" Jul 10 14:47:29.003851 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:29.003845 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b670816d-c226-4b7c-b82f-bc24ae6b7a02" containerName="cleanup" Jul 10 14:47:29.003851 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:29.003850 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b670816d-c226-4b7c-b82f-bc24ae6b7a02" containerName="cleanup" Jul 10 14:47:29.003994 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:29.003860 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7a1a340-aaaf-4d38-8090-12aca2854048" containerName="cleanup" Jul 10 14:47:29.003994 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:29.003866 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7a1a340-aaaf-4d38-8090-12aca2854048" containerName="cleanup" Jul 10 14:47:29.003994 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:29.003925 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7a1a340-aaaf-4d38-8090-12aca2854048" containerName="cleanup" Jul 10 14:47:29.003994 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:29.003932 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="96f9854d-a7b5-4afd-80cc-b946d53c5e9a" containerName="cleanup" Jul 10 14:47:29.003994 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:29.003939 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b670816d-c226-4b7c-b82f-bc24ae6b7a02" containerName="cleanup" Jul 10 14:47:29.007116 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:29.007098 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7532-140685328279344" Jul 10 14:47:29.009969 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:29.009947 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-c2rwz\"" Jul 10 14:47:29.015840 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:29.015816 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7532-140685328279344"] Jul 10 14:47:29.140728 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:29.140692 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zglwf\" (UniqueName: \"kubernetes.io/projected/a77ddf17-7270-4dd3-98dd-81df2f20ec98-kube-api-access-zglwf\") pod \"test-curl-7532-140685328279344\" (UID: \"a77ddf17-7270-4dd3-98dd-81df2f20ec98\") " pod="openshift-ingress/test-curl-7532-140685328279344" Jul 10 14:47:29.241655 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:29.241623 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zglwf\" (UniqueName: \"kubernetes.io/projected/a77ddf17-7270-4dd3-98dd-81df2f20ec98-kube-api-access-zglwf\") pod \"test-curl-7532-140685328279344\" (UID: \"a77ddf17-7270-4dd3-98dd-81df2f20ec98\") " pod="openshift-ingress/test-curl-7532-140685328279344" Jul 10 14:47:29.250593 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:29.250569 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zglwf\" (UniqueName: \"kubernetes.io/projected/a77ddf17-7270-4dd3-98dd-81df2f20ec98-kube-api-access-zglwf\") pod \"test-curl-7532-140685328279344\" (UID: \"a77ddf17-7270-4dd3-98dd-81df2f20ec98\") " pod="openshift-ingress/test-curl-7532-140685328279344" Jul 10 14:47:29.316671 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:29.316639 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7532-140685328279344" Jul 10 14:47:29.447343 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:29.447301 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7532-140685328279344"] Jul 10 14:47:29.448798 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:47:29.448764 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda77ddf17_7270_4dd3_98dd_81df2f20ec98.slice/crio-d86663ef5be4e163bd67e86970d8c799f214ec1bf864e978e165baa78a7d11e4 WatchSource:0}: Error finding container d86663ef5be4e163bd67e86970d8c799f214ec1bf864e978e165baa78a7d11e4: Status 404 returned error can't find the container with id d86663ef5be4e163bd67e86970d8c799f214ec1bf864e978e165baa78a7d11e4 Jul 10 14:47:29.450203 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:29.450183 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 14:47:29.875886 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:29.875848 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7532-140685328279344" event={"ID":"a77ddf17-7270-4dd3-98dd-81df2f20ec98","Type":"ContainerStarted","Data":"d86663ef5be4e163bd67e86970d8c799f214ec1bf864e978e165baa78a7d11e4"} Jul 10 14:47:30.883385 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:30.883350 2581 generic.go:356] "Generic (PLEG): container finished" podID="a77ddf17-7270-4dd3-98dd-81df2f20ec98" containerID="e006c079c50b9267d76964ed303b3c393652d1e473a7bfdd77c67144a54b3e3f" exitCode=0 Jul 10 14:47:30.883753 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:30.883403 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7532-140685328279344" event={"ID":"a77ddf17-7270-4dd3-98dd-81df2f20ec98","Type":"ContainerDied","Data":"e006c079c50b9267d76964ed303b3c393652d1e473a7bfdd77c67144a54b3e3f"} Jul 10 14:47:32.024309 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:32.024285 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7532-140685328279344" Jul 10 14:47:32.075517 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:32.075489 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7532-140685328279344_a77ddf17-7270-4dd3-98dd-81df2f20ec98/test-curl-7532-140685328279344/0.log" Jul 10 14:47:32.114640 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:32.114611 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7532-140685328279344"] Jul 10 14:47:32.122372 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:32.122346 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7532-140685328279344"] Jul 10 14:47:32.167508 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:32.167449 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zglwf\" (UniqueName: \"kubernetes.io/projected/a77ddf17-7270-4dd3-98dd-81df2f20ec98-kube-api-access-zglwf\") pod \"a77ddf17-7270-4dd3-98dd-81df2f20ec98\" (UID: \"a77ddf17-7270-4dd3-98dd-81df2f20ec98\") " Jul 10 14:47:32.169464 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:32.169438 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a77ddf17-7270-4dd3-98dd-81df2f20ec98-kube-api-access-zglwf" (OuterVolumeSpecName: "kube-api-access-zglwf") pod "a77ddf17-7270-4dd3-98dd-81df2f20ec98" (UID: "a77ddf17-7270-4dd3-98dd-81df2f20ec98"). InnerVolumeSpecName "kube-api-access-zglwf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:47:32.264225 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:32.264191 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7532-140685328280112"] Jul 10 14:47:32.264664 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:32.264646 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a77ddf17-7270-4dd3-98dd-81df2f20ec98" containerName="test-curl-7532-140685328279344" Jul 10 14:47:32.264664 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:32.264665 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a77ddf17-7270-4dd3-98dd-81df2f20ec98" containerName="test-curl-7532-140685328279344" Jul 10 14:47:32.264801 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:32.264775 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a77ddf17-7270-4dd3-98dd-81df2f20ec98" containerName="test-curl-7532-140685328279344" Jul 10 14:47:32.267807 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:32.267787 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7532-140685328280112" Jul 10 14:47:32.268171 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:32.268154 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zglwf\" (UniqueName: \"kubernetes.io/projected/a77ddf17-7270-4dd3-98dd-81df2f20ec98-kube-api-access-zglwf\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:47:32.287377 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:32.287355 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7532-140685328280112"] Jul 10 14:47:32.369425 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:32.369401 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9lb4\" (UniqueName: \"kubernetes.io/projected/4c619342-73c9-4e37-9c58-a64d36e4355e-kube-api-access-m9lb4\") pod \"test-curl-7532-140685328280112\" (UID: \"4c619342-73c9-4e37-9c58-a64d36e4355e\") " pod="openshift-ingress/test-curl-7532-140685328280112" Jul 10 14:47:32.470167 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:32.470093 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9lb4\" (UniqueName: \"kubernetes.io/projected/4c619342-73c9-4e37-9c58-a64d36e4355e-kube-api-access-m9lb4\") pod \"test-curl-7532-140685328280112\" (UID: \"4c619342-73c9-4e37-9c58-a64d36e4355e\") " pod="openshift-ingress/test-curl-7532-140685328280112" Jul 10 14:47:32.479616 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:32.479598 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9lb4\" (UniqueName: \"kubernetes.io/projected/4c619342-73c9-4e37-9c58-a64d36e4355e-kube-api-access-m9lb4\") pod \"test-curl-7532-140685328280112\" (UID: \"4c619342-73c9-4e37-9c58-a64d36e4355e\") " pod="openshift-ingress/test-curl-7532-140685328280112" Jul 10 14:47:32.577105 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:32.577076 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7532-140685328280112" Jul 10 14:47:32.714552 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:32.714521 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7532-140685328280112"] Jul 10 14:47:32.715574 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:47:32.715550 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c619342_73c9_4e37_9c58_a64d36e4355e.slice/crio-5a99b658a66af582ee50003252aea6e623aded800b5fac597fa83fe922cb9d46 WatchSource:0}: Error finding container 5a99b658a66af582ee50003252aea6e623aded800b5fac597fa83fe922cb9d46: Status 404 returned error can't find the container with id 5a99b658a66af582ee50003252aea6e623aded800b5fac597fa83fe922cb9d46 Jul 10 14:47:32.894828 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:32.894798 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7532-140685328279344" Jul 10 14:47:32.895004 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:32.894844 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d86663ef5be4e163bd67e86970d8c799f214ec1bf864e978e165baa78a7d11e4" Jul 10 14:47:32.896123 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:32.896099 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7532-140685328280112" event={"ID":"4c619342-73c9-4e37-9c58-a64d36e4355e","Type":"ContainerStarted","Data":"5a99b658a66af582ee50003252aea6e623aded800b5fac597fa83fe922cb9d46"} Jul 10 14:47:32.905605 ip-10-0-142-2 kubenswrapper[2581]: E0710 14:47:32.905580 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7532-140685328279344\" is forbidden: User \"system:node:ip-10-0-142-2.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-142-2.ec2.internal' and this object" podUID="a77ddf17-7270-4dd3-98dd-81df2f20ec98" pod="openshift-ingress/test-curl-7532-140685328279344" Jul 10 14:47:33.644113 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:33.644085 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a77ddf17-7270-4dd3-98dd-81df2f20ec98" path="/var/lib/kubelet/pods/a77ddf17-7270-4dd3-98dd-81df2f20ec98/volumes" Jul 10 14:47:33.903478 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:33.903391 2581 generic.go:356] "Generic (PLEG): container finished" podID="4c619342-73c9-4e37-9c58-a64d36e4355e" containerID="492a3391114fb6f91dc9519913beaf928ee687c7559cb7b9a711750d72d2c3b8" exitCode=0 Jul 10 14:47:33.903631 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:33.903479 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7532-140685328280112" event={"ID":"4c619342-73c9-4e37-9c58-a64d36e4355e","Type":"ContainerDied","Data":"492a3391114fb6f91dc9519913beaf928ee687c7559cb7b9a711750d72d2c3b8"} Jul 10 14:47:35.050285 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:35.050266 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7532-140685328280112" Jul 10 14:47:35.074663 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:35.074644 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7532-140685328280112_4c619342-73c9-4e37-9c58-a64d36e4355e/test-curl-7532-140685328280112/0.log" Jul 10 14:47:35.104040 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:35.104019 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7532-140685328280112"] Jul 10 14:47:35.109599 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:35.109577 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7532-140685328280112"] Jul 10 14:47:35.191259 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:35.191232 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9lb4\" (UniqueName: \"kubernetes.io/projected/4c619342-73c9-4e37-9c58-a64d36e4355e-kube-api-access-m9lb4\") pod \"4c619342-73c9-4e37-9c58-a64d36e4355e\" (UID: \"4c619342-73c9-4e37-9c58-a64d36e4355e\") " Jul 10 14:47:35.193124 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:35.193101 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c619342-73c9-4e37-9c58-a64d36e4355e-kube-api-access-m9lb4" (OuterVolumeSpecName: "kube-api-access-m9lb4") pod "4c619342-73c9-4e37-9c58-a64d36e4355e" (UID: "4c619342-73c9-4e37-9c58-a64d36e4355e"). InnerVolumeSpecName "kube-api-access-m9lb4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:47:35.281604 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:35.281523 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7532-140685334677664"] Jul 10 14:47:35.281959 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:35.281946 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c619342-73c9-4e37-9c58-a64d36e4355e" containerName="test-curl-7532-140685328280112" Jul 10 14:47:35.281959 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:35.281961 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c619342-73c9-4e37-9c58-a64d36e4355e" containerName="test-curl-7532-140685328280112" Jul 10 14:47:35.282050 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:35.282027 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c619342-73c9-4e37-9c58-a64d36e4355e" containerName="test-curl-7532-140685328280112" Jul 10 14:47:35.285008 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:35.284993 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7532-140685334677664" Jul 10 14:47:35.292561 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:35.292536 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9lb4\" (UniqueName: \"kubernetes.io/projected/4c619342-73c9-4e37-9c58-a64d36e4355e-kube-api-access-m9lb4\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:47:35.294571 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:35.294546 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7532-140685334677664"] Jul 10 14:47:35.393529 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:35.393499 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dblmw\" (UniqueName: \"kubernetes.io/projected/06d50713-d3a7-4ee7-9abf-90ebc9263b3b-kube-api-access-dblmw\") pod \"test-curl-7532-140685334677664\" (UID: \"06d50713-d3a7-4ee7-9abf-90ebc9263b3b\") " pod="openshift-ingress/test-curl-7532-140685334677664" Jul 10 14:47:35.494246 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:35.494211 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dblmw\" (UniqueName: \"kubernetes.io/projected/06d50713-d3a7-4ee7-9abf-90ebc9263b3b-kube-api-access-dblmw\") pod \"test-curl-7532-140685334677664\" (UID: \"06d50713-d3a7-4ee7-9abf-90ebc9263b3b\") " pod="openshift-ingress/test-curl-7532-140685334677664" Jul 10 14:47:35.503532 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:35.503504 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dblmw\" (UniqueName: \"kubernetes.io/projected/06d50713-d3a7-4ee7-9abf-90ebc9263b3b-kube-api-access-dblmw\") pod \"test-curl-7532-140685334677664\" (UID: \"06d50713-d3a7-4ee7-9abf-90ebc9263b3b\") " pod="openshift-ingress/test-curl-7532-140685334677664" Jul 10 14:47:35.594153 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:35.594126 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7532-140685334677664" Jul 10 14:47:35.647545 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:35.647103 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c619342-73c9-4e37-9c58-a64d36e4355e" path="/var/lib/kubelet/pods/4c619342-73c9-4e37-9c58-a64d36e4355e/volumes" Jul 10 14:47:35.729121 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:35.729092 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7532-140685334677664"] Jul 10 14:47:35.730756 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:47:35.730726 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod06d50713_d3a7_4ee7_9abf_90ebc9263b3b.slice/crio-3ccb419567fd3a9231b4791ae2a33788da2931c67b253cfcc8f6c968b00438a5 WatchSource:0}: Error finding container 3ccb419567fd3a9231b4791ae2a33788da2931c67b253cfcc8f6c968b00438a5: Status 404 returned error can't find the container with id 3ccb419567fd3a9231b4791ae2a33788da2931c67b253cfcc8f6c968b00438a5 Jul 10 14:47:35.915064 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:35.914990 2581 scope.go:117] "RemoveContainer" containerID="492a3391114fb6f91dc9519913beaf928ee687c7559cb7b9a711750d72d2c3b8" Jul 10 14:47:35.915215 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:35.914987 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7532-140685328280112" Jul 10 14:47:35.916311 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:35.916240 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7532-140685334677664" event={"ID":"06d50713-d3a7-4ee7-9abf-90ebc9263b3b","Type":"ContainerStarted","Data":"3ccb419567fd3a9231b4791ae2a33788da2931c67b253cfcc8f6c968b00438a5"} Jul 10 14:47:36.924080 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:36.924046 2581 generic.go:356] "Generic (PLEG): container finished" podID="06d50713-d3a7-4ee7-9abf-90ebc9263b3b" containerID="9a91572a9b0e38b10a0992f44b3771cc66e52653fd8caadc1676bcb09e89a399" exitCode=0 Jul 10 14:47:36.924485 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:36.924121 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7532-140685334677664" event={"ID":"06d50713-d3a7-4ee7-9abf-90ebc9263b3b","Type":"ContainerDied","Data":"9a91572a9b0e38b10a0992f44b3771cc66e52653fd8caadc1676bcb09e89a399"} Jul 10 14:47:38.080724 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:38.080699 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7532-140685334677664" Jul 10 14:47:38.103388 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:38.103298 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7532-140685334677664_06d50713-d3a7-4ee7-9abf-90ebc9263b3b/test-curl-7532-140685334677664/0.log" Jul 10 14:47:38.133311 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:38.133281 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7532-140685334677664"] Jul 10 14:47:38.136090 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:38.136066 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7532-140685334677664"] Jul 10 14:47:38.217813 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:38.217780 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dblmw\" (UniqueName: \"kubernetes.io/projected/06d50713-d3a7-4ee7-9abf-90ebc9263b3b-kube-api-access-dblmw\") pod \"06d50713-d3a7-4ee7-9abf-90ebc9263b3b\" (UID: \"06d50713-d3a7-4ee7-9abf-90ebc9263b3b\") " Jul 10 14:47:38.220063 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:38.220033 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06d50713-d3a7-4ee7-9abf-90ebc9263b3b-kube-api-access-dblmw" (OuterVolumeSpecName: "kube-api-access-dblmw") pod "06d50713-d3a7-4ee7-9abf-90ebc9263b3b" (UID: "06d50713-d3a7-4ee7-9abf-90ebc9263b3b"). InnerVolumeSpecName "kube-api-access-dblmw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:47:38.264531 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:38.264503 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7532-140685334677664"] Jul 10 14:47:38.264906 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:38.264892 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06d50713-d3a7-4ee7-9abf-90ebc9263b3b" containerName="test-curl-7532-140685334677664" Jul 10 14:47:38.264952 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:38.264908 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="06d50713-d3a7-4ee7-9abf-90ebc9263b3b" containerName="test-curl-7532-140685334677664" Jul 10 14:47:38.264991 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:38.264975 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="06d50713-d3a7-4ee7-9abf-90ebc9263b3b" containerName="test-curl-7532-140685334677664" Jul 10 14:47:38.267863 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:38.267849 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7532-140685334677664" Jul 10 14:47:38.274747 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:38.274709 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7532-140685334677664"] Jul 10 14:47:38.318866 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:38.318833 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dblmw\" (UniqueName: \"kubernetes.io/projected/06d50713-d3a7-4ee7-9abf-90ebc9263b3b-kube-api-access-dblmw\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:47:38.420384 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:38.420267 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkg57\" (UniqueName: \"kubernetes.io/projected/c0f80573-1f2f-4c7b-8f64-d6c1178e229d-kube-api-access-rkg57\") pod \"test-curl-7532-140685334677664\" (UID: \"c0f80573-1f2f-4c7b-8f64-d6c1178e229d\") " pod="openshift-ingress/test-curl-7532-140685334677664" Jul 10 14:47:38.521088 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:38.521054 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkg57\" (UniqueName: \"kubernetes.io/projected/c0f80573-1f2f-4c7b-8f64-d6c1178e229d-kube-api-access-rkg57\") pod \"test-curl-7532-140685334677664\" (UID: \"c0f80573-1f2f-4c7b-8f64-d6c1178e229d\") " pod="openshift-ingress/test-curl-7532-140685334677664" Jul 10 14:47:38.529979 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:38.529951 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkg57\" (UniqueName: \"kubernetes.io/projected/c0f80573-1f2f-4c7b-8f64-d6c1178e229d-kube-api-access-rkg57\") pod \"test-curl-7532-140685334677664\" (UID: \"c0f80573-1f2f-4c7b-8f64-d6c1178e229d\") " pod="openshift-ingress/test-curl-7532-140685334677664" Jul 10 14:47:38.578122 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:38.578096 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7532-140685334677664" Jul 10 14:47:38.707035 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:38.707005 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7532-140685334677664"] Jul 10 14:47:38.708474 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:47:38.708447 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc0f80573_1f2f_4c7b_8f64_d6c1178e229d.slice/crio-c2aba8c683475d6e5095e1ff33702702c4ae4bb529117c27d5e7ae4c41a8e2e6 WatchSource:0}: Error finding container c2aba8c683475d6e5095e1ff33702702c4ae4bb529117c27d5e7ae4c41a8e2e6: Status 404 returned error can't find the container with id c2aba8c683475d6e5095e1ff33702702c4ae4bb529117c27d5e7ae4c41a8e2e6 Jul 10 14:47:38.935704 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:38.935680 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7532-140685334677664" Jul 10 14:47:38.935832 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:38.935721 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3ccb419567fd3a9231b4791ae2a33788da2931c67b253cfcc8f6c968b00438a5" Jul 10 14:47:38.937008 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:38.936984 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7532-140685334677664" event={"ID":"c0f80573-1f2f-4c7b-8f64-d6c1178e229d","Type":"ContainerStarted","Data":"c2aba8c683475d6e5095e1ff33702702c4ae4bb529117c27d5e7ae4c41a8e2e6"} Jul 10 14:47:38.947413 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:38.947388 2581 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="openshift-ingress/test-curl-7532-140685334677664" oldPodUID="06d50713-d3a7-4ee7-9abf-90ebc9263b3b" podUID="c0f80573-1f2f-4c7b-8f64-d6c1178e229d" Jul 10 14:47:39.644531 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:39.644494 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06d50713-d3a7-4ee7-9abf-90ebc9263b3b" path="/var/lib/kubelet/pods/06d50713-d3a7-4ee7-9abf-90ebc9263b3b/volumes" Jul 10 14:47:39.947022 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:39.946925 2581 generic.go:356] "Generic (PLEG): container finished" podID="c0f80573-1f2f-4c7b-8f64-d6c1178e229d" containerID="f36ac87ccf1fb5416047d8539a4a66e2c8ec5a05c87ebacebae0cbe0135f464e" exitCode=0 Jul 10 14:47:39.947022 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:39.946998 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7532-140685334677664" event={"ID":"c0f80573-1f2f-4c7b-8f64-d6c1178e229d","Type":"ContainerDied","Data":"f36ac87ccf1fb5416047d8539a4a66e2c8ec5a05c87ebacebae0cbe0135f464e"} Jul 10 14:47:40.313130 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:40.313101 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:47:41.093598 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:41.093575 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7532-140685334677664" Jul 10 14:47:41.116085 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:41.116054 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7532-140685334677664_c0f80573-1f2f-4c7b-8f64-d6c1178e229d/test-curl-7532-140685334677664/0.log" Jul 10 14:47:41.142919 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:41.142893 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7532-140685334677664"] Jul 10 14:47:41.147996 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:41.147976 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7532-140685334677664"] Jul 10 14:47:41.243288 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:41.243210 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkg57\" (UniqueName: \"kubernetes.io/projected/c0f80573-1f2f-4c7b-8f64-d6c1178e229d-kube-api-access-rkg57\") pod \"c0f80573-1f2f-4c7b-8f64-d6c1178e229d\" (UID: \"c0f80573-1f2f-4c7b-8f64-d6c1178e229d\") " Jul 10 14:47:41.245186 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:41.245157 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0f80573-1f2f-4c7b-8f64-d6c1178e229d-kube-api-access-rkg57" (OuterVolumeSpecName: "kube-api-access-rkg57") pod "c0f80573-1f2f-4c7b-8f64-d6c1178e229d" (UID: "c0f80573-1f2f-4c7b-8f64-d6c1178e229d"). InnerVolumeSpecName "kube-api-access-rkg57". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:47:41.277550 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:41.277526 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7532-140685334678672"] Jul 10 14:47:41.277909 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:41.277897 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0f80573-1f2f-4c7b-8f64-d6c1178e229d" containerName="test-curl-7532-140685334677664" Jul 10 14:47:41.277947 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:41.277910 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0f80573-1f2f-4c7b-8f64-d6c1178e229d" containerName="test-curl-7532-140685334677664" Jul 10 14:47:41.277989 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:41.277967 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0f80573-1f2f-4c7b-8f64-d6c1178e229d" containerName="test-curl-7532-140685334677664" Jul 10 14:47:41.280931 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:41.280913 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7532-140685334678672" Jul 10 14:47:41.287990 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:41.287966 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7532-140685334678672"] Jul 10 14:47:41.344725 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:41.344696 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dckrx\" (UniqueName: \"kubernetes.io/projected/e6caa09d-12b3-416e-9983-fe35614e0750-kube-api-access-dckrx\") pod \"test-curl-7532-140685334678672\" (UID: \"e6caa09d-12b3-416e-9983-fe35614e0750\") " pod="openshift-ingress/test-curl-7532-140685334678672" Jul 10 14:47:41.344859 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:41.344840 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkg57\" (UniqueName: \"kubernetes.io/projected/c0f80573-1f2f-4c7b-8f64-d6c1178e229d-kube-api-access-rkg57\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:47:41.446033 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:41.445986 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dckrx\" (UniqueName: \"kubernetes.io/projected/e6caa09d-12b3-416e-9983-fe35614e0750-kube-api-access-dckrx\") pod \"test-curl-7532-140685334678672\" (UID: \"e6caa09d-12b3-416e-9983-fe35614e0750\") " pod="openshift-ingress/test-curl-7532-140685334678672" Jul 10 14:47:41.454594 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:41.454561 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dckrx\" (UniqueName: \"kubernetes.io/projected/e6caa09d-12b3-416e-9983-fe35614e0750-kube-api-access-dckrx\") pod \"test-curl-7532-140685334678672\" (UID: \"e6caa09d-12b3-416e-9983-fe35614e0750\") " pod="openshift-ingress/test-curl-7532-140685334678672" Jul 10 14:47:41.590785 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:41.590761 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7532-140685334678672" Jul 10 14:47:41.646855 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:41.646824 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0f80573-1f2f-4c7b-8f64-d6c1178e229d" path="/var/lib/kubelet/pods/c0f80573-1f2f-4c7b-8f64-d6c1178e229d/volumes" Jul 10 14:47:41.719236 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:41.719209 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7532-140685334678672"] Jul 10 14:47:41.720303 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:47:41.720274 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode6caa09d_12b3_416e_9983_fe35614e0750.slice/crio-ef8cfa3fb9fe7d93013fbf33d76d48d27cfa44f2f845bec9e141bb27b31b9be1 WatchSource:0}: Error finding container ef8cfa3fb9fe7d93013fbf33d76d48d27cfa44f2f845bec9e141bb27b31b9be1: Status 404 returned error can't find the container with id ef8cfa3fb9fe7d93013fbf33d76d48d27cfa44f2f845bec9e141bb27b31b9be1 Jul 10 14:47:41.960057 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:41.959965 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7532-140685334678672" event={"ID":"e6caa09d-12b3-416e-9983-fe35614e0750","Type":"ContainerStarted","Data":"ef8cfa3fb9fe7d93013fbf33d76d48d27cfa44f2f845bec9e141bb27b31b9be1"} Jul 10 14:47:41.961137 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:41.961106 2581 scope.go:117] "RemoveContainer" containerID="f36ac87ccf1fb5416047d8539a4a66e2c8ec5a05c87ebacebae0cbe0135f464e" Jul 10 14:47:41.961137 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:41.961123 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7532-140685334677664" Jul 10 14:47:42.969242 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:42.969202 2581 generic.go:356] "Generic (PLEG): container finished" podID="e6caa09d-12b3-416e-9983-fe35614e0750" containerID="8b99a535c797d7b2334aff8a008c2f342de48643379cf1c86dadfaba64033e78" exitCode=0 Jul 10 14:47:42.969636 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:42.969239 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7532-140685334678672" event={"ID":"e6caa09d-12b3-416e-9983-fe35614e0750","Type":"ContainerDied","Data":"8b99a535c797d7b2334aff8a008c2f342de48643379cf1c86dadfaba64033e78"} Jul 10 14:47:44.121843 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:44.121818 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7532-140685334678672" Jul 10 14:47:44.144751 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:44.144717 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7532-140685334678672_e6caa09d-12b3-416e-9983-fe35614e0750/test-curl-7532-140685334678672/0.log" Jul 10 14:47:44.171187 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:44.171159 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7532-140685334678672"] Jul 10 14:47:44.175420 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:44.175395 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7532-140685334678672"] Jul 10 14:47:44.270101 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:44.270027 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dckrx\" (UniqueName: \"kubernetes.io/projected/e6caa09d-12b3-416e-9983-fe35614e0750-kube-api-access-dckrx\") pod \"e6caa09d-12b3-416e-9983-fe35614e0750\" (UID: \"e6caa09d-12b3-416e-9983-fe35614e0750\") " Jul 10 14:47:44.272033 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:44.272000 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6caa09d-12b3-416e-9983-fe35614e0750-kube-api-access-dckrx" (OuterVolumeSpecName: "kube-api-access-dckrx") pod "e6caa09d-12b3-416e-9983-fe35614e0750" (UID: "e6caa09d-12b3-416e-9983-fe35614e0750"). InnerVolumeSpecName "kube-api-access-dckrx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:47:44.308603 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:44.308573 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7532-140685334678672"] Jul 10 14:47:44.308994 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:44.308982 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6caa09d-12b3-416e-9983-fe35614e0750" containerName="test-curl-7532-140685334678672" Jul 10 14:47:44.309037 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:44.308996 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6caa09d-12b3-416e-9983-fe35614e0750" containerName="test-curl-7532-140685334678672" Jul 10 14:47:44.309068 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:44.309061 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6caa09d-12b3-416e-9983-fe35614e0750" containerName="test-curl-7532-140685334678672" Jul 10 14:47:44.311950 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:44.311934 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7532-140685334678672" Jul 10 14:47:44.322138 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:44.322114 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7532-140685334678672"] Jul 10 14:47:44.371179 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:44.371156 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dckrx\" (UniqueName: \"kubernetes.io/projected/e6caa09d-12b3-416e-9983-fe35614e0750-kube-api-access-dckrx\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:47:44.472475 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:44.472428 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m6dn\" (UniqueName: \"kubernetes.io/projected/b726c9e3-21f0-4b02-9040-489eb4eb1821-kube-api-access-6m6dn\") pod \"test-curl-7532-140685334678672\" (UID: \"b726c9e3-21f0-4b02-9040-489eb4eb1821\") " pod="openshift-ingress/test-curl-7532-140685334678672" Jul 10 14:47:44.573315 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:44.573287 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m6dn\" (UniqueName: \"kubernetes.io/projected/b726c9e3-21f0-4b02-9040-489eb4eb1821-kube-api-access-6m6dn\") pod \"test-curl-7532-140685334678672\" (UID: \"b726c9e3-21f0-4b02-9040-489eb4eb1821\") " pod="openshift-ingress/test-curl-7532-140685334678672" Jul 10 14:47:44.581873 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:44.581843 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m6dn\" (UniqueName: \"kubernetes.io/projected/b726c9e3-21f0-4b02-9040-489eb4eb1821-kube-api-access-6m6dn\") pod \"test-curl-7532-140685334678672\" (UID: \"b726c9e3-21f0-4b02-9040-489eb4eb1821\") " pod="openshift-ingress/test-curl-7532-140685334678672" Jul 10 14:47:44.621309 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:44.621272 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7532-140685334678672" Jul 10 14:47:44.752604 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:44.752577 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7532-140685334678672"] Jul 10 14:47:44.753789 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:47:44.753766 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb726c9e3_21f0_4b02_9040_489eb4eb1821.slice/crio-b21db43aeee9e25e826be0f2c148e22348bf52f6c55e7a7c113cb4181fb0d4a9 WatchSource:0}: Error finding container b21db43aeee9e25e826be0f2c148e22348bf52f6c55e7a7c113cb4181fb0d4a9: Status 404 returned error can't find the container with id b21db43aeee9e25e826be0f2c148e22348bf52f6c55e7a7c113cb4181fb0d4a9 Jul 10 14:47:44.981960 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:44.981885 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7532-140685334678672" Jul 10 14:47:44.981960 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:44.981912 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef8cfa3fb9fe7d93013fbf33d76d48d27cfa44f2f845bec9e141bb27b31b9be1" Jul 10 14:47:44.983140 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:44.983115 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7532-140685334678672" event={"ID":"b726c9e3-21f0-4b02-9040-489eb4eb1821","Type":"ContainerStarted","Data":"b21db43aeee9e25e826be0f2c148e22348bf52f6c55e7a7c113cb4181fb0d4a9"} Jul 10 14:47:44.993357 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:44.993335 2581 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="openshift-ingress/test-curl-7532-140685334678672" oldPodUID="e6caa09d-12b3-416e-9983-fe35614e0750" podUID="b726c9e3-21f0-4b02-9040-489eb4eb1821" Jul 10 14:47:45.643935 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:45.643903 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6caa09d-12b3-416e-9983-fe35614e0750" path="/var/lib/kubelet/pods/e6caa09d-12b3-416e-9983-fe35614e0750/volumes" Jul 10 14:47:45.989793 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:45.989702 2581 generic.go:356] "Generic (PLEG): container finished" podID="b726c9e3-21f0-4b02-9040-489eb4eb1821" containerID="81b9c709fb52c10abe4ab6faeedf6d3b364959106d9cc55f303e445122f1ceda" exitCode=0 Jul 10 14:47:45.989793 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:45.989760 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7532-140685334678672" event={"ID":"b726c9e3-21f0-4b02-9040-489eb4eb1821","Type":"ContainerDied","Data":"81b9c709fb52c10abe4ab6faeedf6d3b364959106d9cc55f303e445122f1ceda"} Jul 10 14:47:47.134438 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:47.134415 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7532-140685334678672" Jul 10 14:47:47.168425 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:47.168404 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7532-140685334678672_b726c9e3-21f0-4b02-9040-489eb4eb1821/test-curl-7532-140685334678672/0.log" Jul 10 14:47:47.219952 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:47.219926 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7532-140685334678672"] Jul 10 14:47:47.222202 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:47.222179 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7532-140685334678672"] Jul 10 14:47:47.299002 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:47.298978 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6m6dn\" (UniqueName: \"kubernetes.io/projected/b726c9e3-21f0-4b02-9040-489eb4eb1821-kube-api-access-6m6dn\") pod \"b726c9e3-21f0-4b02-9040-489eb4eb1821\" (UID: \"b726c9e3-21f0-4b02-9040-489eb4eb1821\") " Jul 10 14:47:47.300957 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:47.300936 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b726c9e3-21f0-4b02-9040-489eb4eb1821-kube-api-access-6m6dn" (OuterVolumeSpecName: "kube-api-access-6m6dn") pod "b726c9e3-21f0-4b02-9040-489eb4eb1821" (UID: "b726c9e3-21f0-4b02-9040-489eb4eb1821"). InnerVolumeSpecName "kube-api-access-6m6dn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:47:47.399542 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:47.399509 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6m6dn\" (UniqueName: \"kubernetes.io/projected/b726c9e3-21f0-4b02-9040-489eb4eb1821-kube-api-access-6m6dn\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:47:47.643822 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:47.643729 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b726c9e3-21f0-4b02-9040-489eb4eb1821" path="/var/lib/kubelet/pods/b726c9e3-21f0-4b02-9040-489eb4eb1821/volumes" Jul 10 14:47:48.001881 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:48.001795 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7532-140685334678672" Jul 10 14:47:48.001881 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:48.001846 2581 scope.go:117] "RemoveContainer" containerID="81b9c709fb52c10abe4ab6faeedf6d3b364959106d9cc55f303e445122f1ceda" Jul 10 14:47:54.419544 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:47:54.419440 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:48:01.882365 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:01.882331 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz"] Jul 10 14:48:01.882758 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:01.882582 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" podUID="0c170e37-05f7-43b4-a089-0fc5de0e3cd5" containerName="istio-proxy" containerID="cri-o://4e65e6a1bd4dcc3747c6f5e9bf500357c03e30b6c3ec840d5bd021f472a2e8bb" gracePeriod=30 Jul 10 14:48:04.583349 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:04.583304 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dv7s5"] Jul 10 14:48:07.114971 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:07.114940 2581 generic.go:356] "Generic (PLEG): container finished" podID="0c170e37-05f7-43b4-a089-0fc5de0e3cd5" containerID="4e65e6a1bd4dcc3747c6f5e9bf500357c03e30b6c3ec840d5bd021f472a2e8bb" exitCode=0 Jul 10 14:48:07.115359 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:07.115024 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" event={"ID":"0c170e37-05f7-43b4-a089-0fc5de0e3cd5","Type":"ContainerDied","Data":"4e65e6a1bd4dcc3747c6f5e9bf500357c03e30b6c3ec840d5bd021f472a2e8bb"} Jul 10 14:48:07.115359 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:07.115086 2581 scope.go:117] "RemoveContainer" containerID="91c7d74a55f7cc7ce5cb0ee65f7aea20e2666ed56c89049106285b79a7360f0c" Jul 10 14:48:07.136151 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:07.136131 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:48:07.172212 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:07.172140 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-istio-data\") pod \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\" (UID: \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\") " Jul 10 14:48:07.172212 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:07.172177 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-istiod-ca-cert\") pod \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\" (UID: \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\") " Jul 10 14:48:07.172436 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:07.172214 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-workload-socket\") pod \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\" (UID: \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\") " Jul 10 14:48:07.172436 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:07.172233 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-istio-podinfo\") pod \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\" (UID: \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\") " Jul 10 14:48:07.172436 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:07.172253 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-istio-token\") pod \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\" (UID: \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\") " Jul 10 14:48:07.172436 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:07.172274 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-istio-envoy\") pod \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\" (UID: \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\") " Jul 10 14:48:07.172436 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:07.172313 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-workload-certs\") pod \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\" (UID: \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\") " Jul 10 14:48:07.172707 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:07.172481 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrhpl\" (UniqueName: \"kubernetes.io/projected/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-kube-api-access-vrhpl\") pod \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\" (UID: \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\") " Jul 10 14:48:07.172707 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:07.172523 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-credential-socket\") pod \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\" (UID: \"0c170e37-05f7-43b4-a089-0fc5de0e3cd5\") " Jul 10 14:48:07.172707 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:07.172548 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0c170e37-05f7-43b4-a089-0fc5de0e3cd5" (UID: "0c170e37-05f7-43b4-a089-0fc5de0e3cd5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:48:07.172707 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:07.172669 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0c170e37-05f7-43b4-a089-0fc5de0e3cd5" (UID: "0c170e37-05f7-43b4-a089-0fc5de0e3cd5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:48:07.172929 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:07.172885 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0c170e37-05f7-43b4-a089-0fc5de0e3cd5" (UID: "0c170e37-05f7-43b4-a089-0fc5de0e3cd5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:48:07.172929 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:07.172908 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0c170e37-05f7-43b4-a089-0fc5de0e3cd5" (UID: "0c170e37-05f7-43b4-a089-0fc5de0e3cd5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:48:07.173036 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:07.173018 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-istio-data" (OuterVolumeSpecName: "istio-data") pod "0c170e37-05f7-43b4-a089-0fc5de0e3cd5" (UID: "0c170e37-05f7-43b4-a089-0fc5de0e3cd5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:48:07.173092 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:07.173023 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-istiod-ca-cert\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:48:07.173092 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:07.173075 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-workload-socket\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:48:07.173199 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:07.173123 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-workload-certs\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:48:07.173199 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:07.173139 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-credential-socket\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:48:07.174859 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:07.174833 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-kube-api-access-vrhpl" (OuterVolumeSpecName: "kube-api-access-vrhpl") pod "0c170e37-05f7-43b4-a089-0fc5de0e3cd5" (UID: "0c170e37-05f7-43b4-a089-0fc5de0e3cd5"). InnerVolumeSpecName "kube-api-access-vrhpl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:48:07.175023 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:07.174983 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0c170e37-05f7-43b4-a089-0fc5de0e3cd5" (UID: "0c170e37-05f7-43b4-a089-0fc5de0e3cd5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:48:07.175124 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:07.175066 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-istio-token" (OuterVolumeSpecName: "istio-token") pod "0c170e37-05f7-43b4-a089-0fc5de0e3cd5" (UID: "0c170e37-05f7-43b4-a089-0fc5de0e3cd5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:48:07.175124 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:07.175081 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0c170e37-05f7-43b4-a089-0fc5de0e3cd5" (UID: "0c170e37-05f7-43b4-a089-0fc5de0e3cd5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 14:48:07.274092 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:07.274053 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrhpl\" (UniqueName: \"kubernetes.io/projected/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-kube-api-access-vrhpl\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:48:07.274092 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:07.274085 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-istio-data\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:48:07.274092 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:07.274097 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-istio-podinfo\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:48:07.274364 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:07.274108 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-istio-token\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:48:07.274364 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:07.274120 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c170e37-05f7-43b4-a089-0fc5de0e3cd5-istio-envoy\") on node \"ip-10-0-142-2.ec2.internal\" DevicePath \"\"" Jul 10 14:48:07.591292 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:07.591258 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-n97h4_e37f911d-4d6f-47f6-93c7-bca3f3690909/manager/0.log" Jul 10 14:48:07.717965 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:07.717932 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-b9dhk_9802e15d-32ce-4ca0-b336-18b6ef0326ee/manager/0.log" Jul 10 14:48:07.840393 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:07.840362 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8c58bf8c5-jz4wb_fdb1524b-8045-42e4-8692-11549beb1cd6/manager/0.log" Jul 10 14:48:07.974103 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:07.974033 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-x2z8r_dc1a3bb6-e954-444e-8990-0269c46bea25/server/0.log" Jul 10 14:48:08.094877 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:08.094847 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-gz6kn_1632c406-6c81-445d-93cf-d70679c60fd8/manager/0.log" Jul 10 14:48:08.121839 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:08.121809 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" event={"ID":"0c170e37-05f7-43b4-a089-0fc5de0e3cd5","Type":"ContainerDied","Data":"2ccb8b4df385f597d565c67e863d8ce12883509e96be861463e4b6db25e049f6"} Jul 10 14:48:08.122229 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:08.121859 2581 scope.go:117] "RemoveContainer" containerID="4e65e6a1bd4dcc3747c6f5e9bf500357c03e30b6c3ec840d5bd021f472a2e8bb" Jul 10 14:48:08.122229 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:08.121821 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz" Jul 10 14:48:08.165592 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:08.165563 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz"] Jul 10 14:48:08.183931 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:08.183906 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-feed7a-openshift-default-6599ccf-zfprz"] Jul 10 14:48:08.513370 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:08.513343 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d47b746d6-tsr5v_4b06d174-3822-402d-9f16-1eafe43c807d/copy-manifests/0.log" Jul 10 14:48:08.521503 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:08.521476 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d47b746d6-tsr5v_4b06d174-3822-402d-9f16-1eafe43c807d/manager/0.log" Jul 10 14:48:09.643930 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:09.643898 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c170e37-05f7-43b4-a089-0fc5de0e3cd5" path="/var/lib/kubelet/pods/0c170e37-05f7-43b4-a089-0fc5de0e3cd5/volumes" Jul 10 14:48:09.813803 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:09.813778 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mb2z9_693b7200-525e-494e-b879-919d214f0272/extract/0.log" Jul 10 14:48:09.822720 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:09.822698 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mb2z9_693b7200-525e-494e-b879-919d214f0272/util/0.log" Jul 10 14:48:09.831556 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:09.831539 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mb2z9_693b7200-525e-494e-b879-919d214f0272/pull/0.log" Jul 10 14:48:09.949772 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:09.949711 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x7vf5_b978efc0-653a-45da-9ea5-a7abfcfc3460/util/0.log" Jul 10 14:48:09.957739 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:09.957720 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x7vf5_b978efc0-653a-45da-9ea5-a7abfcfc3460/pull/0.log" Jul 10 14:48:09.965693 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:09.965676 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x7vf5_b978efc0-653a-45da-9ea5-a7abfcfc3460/extract/0.log" Jul 10 14:48:10.085207 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:10.085179 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz_44189322-d87a-4b6d-877d-a7d4fa6f5a9e/util/0.log" Jul 10 14:48:10.092467 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:10.092445 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz_44189322-d87a-4b6d-877d-a7d4fa6f5a9e/pull/0.log" Jul 10 14:48:10.099512 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:10.099495 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz_44189322-d87a-4b6d-877d-a7d4fa6f5a9e/extract/0.log" Jul 10 14:48:10.230164 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:10.230106 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fr7zb_344f748f-8403-4ced-9c0a-3db6e352e084/util/0.log" Jul 10 14:48:10.240992 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:10.240976 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fr7zb_344f748f-8403-4ced-9c0a-3db6e352e084/pull/0.log" Jul 10 14:48:10.248235 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:10.248217 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fr7zb_344f748f-8403-4ced-9c0a-3db6e352e084/extract/0.log" Jul 10 14:48:10.510673 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:10.510601 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-9w57g_31cc8545-2568-4cdd-907b-9d9a16f4a064/manager/0.log" Jul 10 14:48:10.634953 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:10.634922 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-rwpzx_6b954612-5642-4869-8659-533e2de64ce8/manager/0.log" Jul 10 14:48:10.882665 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:10.882638 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-mxwp9_130a58b7-d2f9-42d8-be4e-d2b437bd72b3/registry-server/0.log" Jul 10 14:48:11.167142 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:11.167060 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-dv7s5_e5d090f2-b54c-4f98-8b9b-6538e0eb8b3f/limitador/0.log" Jul 10 14:48:11.815742 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:11.815712 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-dfk2z_7f00d450-51ca-48e4-941a-36e605a06edf/discovery/0.log" Jul 10 14:48:12.057157 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:12.057129 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8545bb46c8-pplx9_06574f2a-a8f5-447d-b436-1445ac3e4c03/kube-auth-proxy/0.log" Jul 10 14:48:12.331863 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:12.331837 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-ddqvd_725d5a61-b5c5-4294-823f-9033040308a7/payload-pre-processing/0.log" Jul 10 14:48:13.060781 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:13.060756 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-xc9ps_d55d32c0-ffe4-4447-8d97-708ffae25a0b/main/0.log" Jul 10 14:48:13.415390 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:13.415292 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-5sb46_8efa381b-c882-4854-929b-18e2c7427c31/main/0.log" Jul 10 14:48:17.618543 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:17.618512 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hrtpc/must-gather-58fcb"] Jul 10 14:48:17.618940 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:17.618897 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c170e37-05f7-43b4-a089-0fc5de0e3cd5" containerName="istio-proxy" Jul 10 14:48:17.618940 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:17.618909 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c170e37-05f7-43b4-a089-0fc5de0e3cd5" containerName="istio-proxy" Jul 10 14:48:17.618940 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:17.618929 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b726c9e3-21f0-4b02-9040-489eb4eb1821" containerName="test-curl-7532-140685334678672" Jul 10 14:48:17.618940 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:17.618935 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b726c9e3-21f0-4b02-9040-489eb4eb1821" containerName="test-curl-7532-140685334678672" Jul 10 14:48:17.619071 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:17.618992 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c170e37-05f7-43b4-a089-0fc5de0e3cd5" containerName="istio-proxy" Jul 10 14:48:17.619071 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:17.619001 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b726c9e3-21f0-4b02-9040-489eb4eb1821" containerName="test-curl-7532-140685334678672" Jul 10 14:48:17.619071 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:17.619052 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c170e37-05f7-43b4-a089-0fc5de0e3cd5" containerName="istio-proxy" Jul 10 14:48:17.619071 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:17.619057 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c170e37-05f7-43b4-a089-0fc5de0e3cd5" containerName="istio-proxy" Jul 10 14:48:17.619240 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:17.619124 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c170e37-05f7-43b4-a089-0fc5de0e3cd5" containerName="istio-proxy" Jul 10 14:48:17.622408 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:17.622387 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hrtpc/must-gather-58fcb" Jul 10 14:48:17.625839 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:17.625821 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hrtpc\"/\"openshift-service-ca.crt\"" Jul 10 14:48:17.626967 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:17.626941 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hrtpc\"/\"default-dockercfg-sf26v\"" Jul 10 14:48:17.627067 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:17.626949 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hrtpc\"/\"kube-root-ca.crt\"" Jul 10 14:48:17.634210 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:17.634176 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hrtpc/must-gather-58fcb"] Jul 10 14:48:17.759754 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:17.759711 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s29zx\" (UniqueName: \"kubernetes.io/projected/e2a50403-c1af-465e-a5fd-9e001004f76f-kube-api-access-s29zx\") pod \"must-gather-58fcb\" (UID: \"e2a50403-c1af-465e-a5fd-9e001004f76f\") " pod="openshift-must-gather-hrtpc/must-gather-58fcb" Jul 10 14:48:17.760070 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:17.760043 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e2a50403-c1af-465e-a5fd-9e001004f76f-must-gather-output\") pod \"must-gather-58fcb\" (UID: \"e2a50403-c1af-465e-a5fd-9e001004f76f\") " pod="openshift-must-gather-hrtpc/must-gather-58fcb" Jul 10 14:48:17.861439 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:17.861407 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e2a50403-c1af-465e-a5fd-9e001004f76f-must-gather-output\") pod \"must-gather-58fcb\" (UID: \"e2a50403-c1af-465e-a5fd-9e001004f76f\") " pod="openshift-must-gather-hrtpc/must-gather-58fcb" Jul 10 14:48:17.861606 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:17.861516 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s29zx\" (UniqueName: \"kubernetes.io/projected/e2a50403-c1af-465e-a5fd-9e001004f76f-kube-api-access-s29zx\") pod \"must-gather-58fcb\" (UID: \"e2a50403-c1af-465e-a5fd-9e001004f76f\") " pod="openshift-must-gather-hrtpc/must-gather-58fcb" Jul 10 14:48:17.861751 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:17.861731 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e2a50403-c1af-465e-a5fd-9e001004f76f-must-gather-output\") pod \"must-gather-58fcb\" (UID: \"e2a50403-c1af-465e-a5fd-9e001004f76f\") " pod="openshift-must-gather-hrtpc/must-gather-58fcb" Jul 10 14:48:17.870403 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:17.870307 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s29zx\" (UniqueName: \"kubernetes.io/projected/e2a50403-c1af-465e-a5fd-9e001004f76f-kube-api-access-s29zx\") pod \"must-gather-58fcb\" (UID: \"e2a50403-c1af-465e-a5fd-9e001004f76f\") " pod="openshift-must-gather-hrtpc/must-gather-58fcb" Jul 10 14:48:17.932242 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:17.932213 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hrtpc/must-gather-58fcb" Jul 10 14:48:18.066562 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:18.066537 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hrtpc/must-gather-58fcb"] Jul 10 14:48:18.068619 ip-10-0-142-2 kubenswrapper[2581]: W0710 14:48:18.068589 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode2a50403_c1af_465e_a5fd_9e001004f76f.slice/crio-bbccb96474a975cc5174f9cd47691ed1c51cf23f25345cc025efcd06ead9658b WatchSource:0}: Error finding container bbccb96474a975cc5174f9cd47691ed1c51cf23f25345cc025efcd06ead9658b: Status 404 returned error can't find the container with id bbccb96474a975cc5174f9cd47691ed1c51cf23f25345cc025efcd06ead9658b Jul 10 14:48:18.183292 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:18.183219 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hrtpc/must-gather-58fcb" event={"ID":"e2a50403-c1af-465e-a5fd-9e001004f76f","Type":"ContainerStarted","Data":"bbccb96474a975cc5174f9cd47691ed1c51cf23f25345cc025efcd06ead9658b"} Jul 10 14:48:19.193763 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:19.193670 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hrtpc/must-gather-58fcb" event={"ID":"e2a50403-c1af-465e-a5fd-9e001004f76f","Type":"ContainerStarted","Data":"6635ef36b6892ca1a07e2bf7d6707bc28d9bfa6bdd5b3ca0466687b33de6acae"} Jul 10 14:48:19.193763 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:19.193719 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hrtpc/must-gather-58fcb" event={"ID":"e2a50403-c1af-465e-a5fd-9e001004f76f","Type":"ContainerStarted","Data":"fa6a0c5b7d2a8b8b4ae854471e343dc9f426192cefeeb2edd2bc5002a7183a53"} Jul 10 14:48:19.211269 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:19.211220 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hrtpc/must-gather-58fcb" podStartSLOduration=1.4703744859999999 podStartE2EDuration="2.211205507s" totalImagesPullingTime="740.831021ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:48:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:48:19.210194333 +0000 UTC m=+2382.153766675" watchObservedRunningTime="2026-07-10 14:48:19.211205507 +0000 UTC m=+2382.154777828" Jul 10 14:48:20.613447 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:20.613413 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fd8lf_f3bf8565-febc-4cfa-8d86-11e5aeb3b516/global-pull-secret-syncer/0.log" Jul 10 14:48:20.745225 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:20.745192 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wlgmc_e9439b8d-1e36-423c-94c3-484c91f4708f/konnectivity-agent/0.log" Jul 10 14:48:20.789990 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:20.789958 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-2.ec2.internal_021b8c0c3b56b2050943ce01eeb73db5/haproxy/0.log" Jul 10 14:48:25.633546 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:25.633458 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mb2z9_693b7200-525e-494e-b879-919d214f0272/extract/0.log" Jul 10 14:48:25.657692 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:25.657667 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mb2z9_693b7200-525e-494e-b879-919d214f0272/util/0.log" Jul 10 14:48:25.695099 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:25.695068 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mb2z9_693b7200-525e-494e-b879-919d214f0272/pull/0.log" Jul 10 14:48:25.725712 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:25.725684 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x7vf5_b978efc0-653a-45da-9ea5-a7abfcfc3460/extract/0.log" Jul 10 14:48:25.752406 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:25.752263 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x7vf5_b978efc0-653a-45da-9ea5-a7abfcfc3460/util/0.log" Jul 10 14:48:25.778828 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:25.778707 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x7vf5_b978efc0-653a-45da-9ea5-a7abfcfc3460/pull/0.log" Jul 10 14:48:25.809757 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:25.809717 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz_44189322-d87a-4b6d-877d-a7d4fa6f5a9e/extract/0.log" Jul 10 14:48:25.833033 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:25.832988 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz_44189322-d87a-4b6d-877d-a7d4fa6f5a9e/util/0.log" Jul 10 14:48:25.859426 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:25.859375 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z84jz_44189322-d87a-4b6d-877d-a7d4fa6f5a9e/pull/0.log" Jul 10 14:48:25.893744 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:25.893642 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fr7zb_344f748f-8403-4ced-9c0a-3db6e352e084/extract/0.log" Jul 10 14:48:25.917253 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:25.917216 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fr7zb_344f748f-8403-4ced-9c0a-3db6e352e084/util/0.log" Jul 10 14:48:25.942731 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:25.942705 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fr7zb_344f748f-8403-4ced-9c0a-3db6e352e084/pull/0.log" Jul 10 14:48:26.265805 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:26.265724 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-9w57g_31cc8545-2568-4cdd-907b-9d9a16f4a064/manager/0.log" Jul 10 14:48:26.300516 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:26.300483 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-rwpzx_6b954612-5642-4869-8659-533e2de64ce8/manager/0.log" Jul 10 14:48:26.384081 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:26.384039 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-mxwp9_130a58b7-d2f9-42d8-be4e-d2b437bd72b3/registry-server/0.log" Jul 10 14:48:26.587694 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:26.587669 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-dv7s5_e5d090f2-b54c-4f98-8b9b-6538e0eb8b3f/limitador/0.log" Jul 10 14:48:28.363475 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:28.363418 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_208f5dfa-a108-4ceb-bc36-e7eb285acaa2/alertmanager/0.log" Jul 10 14:48:28.391357 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:28.391305 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_208f5dfa-a108-4ceb-bc36-e7eb285acaa2/config-reloader/0.log" Jul 10 14:48:28.418851 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:28.418823 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_208f5dfa-a108-4ceb-bc36-e7eb285acaa2/kube-rbac-proxy-web/0.log" Jul 10 14:48:28.442939 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:28.442905 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_208f5dfa-a108-4ceb-bc36-e7eb285acaa2/kube-rbac-proxy/0.log" Jul 10 14:48:28.470757 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:28.470671 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_208f5dfa-a108-4ceb-bc36-e7eb285acaa2/kube-rbac-proxy-metric/0.log" Jul 10 14:48:28.508269 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:28.508233 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_208f5dfa-a108-4ceb-bc36-e7eb285acaa2/prom-label-proxy/0.log" Jul 10 14:48:28.544405 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:28.544373 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_208f5dfa-a108-4ceb-bc36-e7eb285acaa2/init-config-reloader/0.log" Jul 10 14:48:28.625122 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:28.625081 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-zkpxn_7382bc84-f403-4e1e-b1d0-5e0f76009aa0/kube-state-metrics/0.log" Jul 10 14:48:28.647586 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:28.647558 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-zkpxn_7382bc84-f403-4e1e-b1d0-5e0f76009aa0/kube-rbac-proxy-main/0.log" Jul 10 14:48:28.670843 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:28.670811 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-zkpxn_7382bc84-f403-4e1e-b1d0-5e0f76009aa0/kube-rbac-proxy-self/0.log" Jul 10 14:48:28.833936 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:28.833904 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8p52j_9a337a14-c834-4363-868b-ee4330013be7/node-exporter/0.log" Jul 10 14:48:28.867659 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:28.867621 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8p52j_9a337a14-c834-4363-868b-ee4330013be7/kube-rbac-proxy/0.log" Jul 10 14:48:28.892574 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:28.892545 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8p52j_9a337a14-c834-4363-868b-ee4330013be7/init-textfile/0.log" Jul 10 14:48:28.997525 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:28.997489 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-dfqm6_f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c/kube-rbac-proxy-main/0.log" Jul 10 14:48:29.022785 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:29.022752 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-dfqm6_f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c/kube-rbac-proxy-self/0.log" Jul 10 14:48:29.045831 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:29.045804 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-dfqm6_f5b8e4cb-586c-4df6-83c7-4a46f6ca1d3c/openshift-state-metrics/0.log" Jul 10 14:48:30.515279 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:30.515233 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hrtpc/perf-node-gather-daemonset-mfd82"] Jul 10 14:48:30.527034 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:30.526999 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-mfd82" Jul 10 14:48:30.530749 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:30.530721 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hrtpc/perf-node-gather-daemonset-mfd82"] Jul 10 14:48:30.599699 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:30.599625 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe89167c-fc9d-480e-9270-fc451ab19842-sys\") pod \"perf-node-gather-daemonset-mfd82\" (UID: \"fe89167c-fc9d-480e-9270-fc451ab19842\") " pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-mfd82" Jul 10 14:48:30.599699 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:30.599668 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fe89167c-fc9d-480e-9270-fc451ab19842-lib-modules\") pod \"perf-node-gather-daemonset-mfd82\" (UID: \"fe89167c-fc9d-480e-9270-fc451ab19842\") " pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-mfd82" Jul 10 14:48:30.599952 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:30.599747 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ks5x\" (UniqueName: \"kubernetes.io/projected/fe89167c-fc9d-480e-9270-fc451ab19842-kube-api-access-9ks5x\") pod \"perf-node-gather-daemonset-mfd82\" (UID: \"fe89167c-fc9d-480e-9270-fc451ab19842\") " pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-mfd82" Jul 10 14:48:30.599952 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:30.599787 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fe89167c-fc9d-480e-9270-fc451ab19842-proc\") pod \"perf-node-gather-daemonset-mfd82\" (UID: \"fe89167c-fc9d-480e-9270-fc451ab19842\") " pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-mfd82" Jul 10 14:48:30.599952 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:30.599816 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fe89167c-fc9d-480e-9270-fc451ab19842-podres\") pod \"perf-node-gather-daemonset-mfd82\" (UID: \"fe89167c-fc9d-480e-9270-fc451ab19842\") " pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-mfd82" Jul 10 14:48:30.700957 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:30.700904 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe89167c-fc9d-480e-9270-fc451ab19842-sys\") pod \"perf-node-gather-daemonset-mfd82\" (UID: \"fe89167c-fc9d-480e-9270-fc451ab19842\") " pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-mfd82" Jul 10 14:48:30.701375 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:30.701353 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fe89167c-fc9d-480e-9270-fc451ab19842-lib-modules\") pod \"perf-node-gather-daemonset-mfd82\" (UID: \"fe89167c-fc9d-480e-9270-fc451ab19842\") " pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-mfd82" Jul 10 14:48:30.701783 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:30.701270 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe89167c-fc9d-480e-9270-fc451ab19842-sys\") pod \"perf-node-gather-daemonset-mfd82\" (UID: \"fe89167c-fc9d-480e-9270-fc451ab19842\") " pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-mfd82" Jul 10 14:48:30.701936 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:30.701665 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fe89167c-fc9d-480e-9270-fc451ab19842-lib-modules\") pod \"perf-node-gather-daemonset-mfd82\" (UID: \"fe89167c-fc9d-480e-9270-fc451ab19842\") " pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-mfd82" Jul 10 14:48:30.702114 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:30.702089 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ks5x\" (UniqueName: \"kubernetes.io/projected/fe89167c-fc9d-480e-9270-fc451ab19842-kube-api-access-9ks5x\") pod \"perf-node-gather-daemonset-mfd82\" (UID: \"fe89167c-fc9d-480e-9270-fc451ab19842\") " pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-mfd82" Jul 10 14:48:30.702682 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:30.702662 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fe89167c-fc9d-480e-9270-fc451ab19842-proc\") pod \"perf-node-gather-daemonset-mfd82\" (UID: \"fe89167c-fc9d-480e-9270-fc451ab19842\") " pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-mfd82" Jul 10 14:48:30.702963 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:30.702939 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fe89167c-fc9d-480e-9270-fc451ab19842-podres\") pod \"perf-node-gather-daemonset-mfd82\" (UID: \"fe89167c-fc9d-480e-9270-fc451ab19842\") " pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-mfd82" Jul 10 14:48:30.703285 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:30.702865 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fe89167c-fc9d-480e-9270-fc451ab19842-proc\") pod \"perf-node-gather-daemonset-mfd82\" (UID: \"fe89167c-fc9d-480e-9270-fc451ab19842\") " pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-mfd82" Jul 10 14:48:30.703426 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:30.703157 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fe89167c-fc9d-480e-9270-fc451ab19842-podres\") pod \"perf-node-gather-daemonset-mfd82\" (UID: \"fe89167c-fc9d-480e-9270-fc451ab19842\") " pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-mfd82" Jul 10 14:48:30.712153 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:30.712133 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ks5x\" (UniqueName: \"kubernetes.io/projected/fe89167c-fc9d-480e-9270-fc451ab19842-kube-api-access-9ks5x\") pod \"perf-node-gather-daemonset-mfd82\" (UID: \"fe89167c-fc9d-480e-9270-fc451ab19842\") " pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-mfd82" Jul 10 14:48:30.846075 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:30.846043 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-mfd82" Jul 10 14:48:31.037843 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:31.037796 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hrtpc/perf-node-gather-daemonset-mfd82"] Jul 10 14:48:31.296220 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:31.296176 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-mfd82" event={"ID":"fe89167c-fc9d-480e-9270-fc451ab19842","Type":"ContainerStarted","Data":"06c938f982e10618567612beb3c485bb59b8bec03ac0d53e203ed59c2f2fbfb8"} Jul 10 14:48:31.296434 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:31.296248 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-mfd82" event={"ID":"fe89167c-fc9d-480e-9270-fc451ab19842","Type":"ContainerStarted","Data":"97982543ad70903b56de6c5803a074754970167fd53746b853019155785c93c3"} Jul 10 14:48:31.296434 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:31.296367 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-mfd82" Jul 10 14:48:31.314998 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:31.314914 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-mfd82" podStartSLOduration=1.314891028 podStartE2EDuration="1.314891028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:48:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:48:31.313753504 +0000 UTC m=+2394.257325860" watchObservedRunningTime="2026-07-10 14:48:31.314891028 +0000 UTC m=+2394.258463368" Jul 10 14:48:31.812055 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:31.812030 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-d894544f4-tkcfj_6274fa70-c705-4fb9-b3c7-a370c57cbcfc/console/0.log" Jul 10 14:48:33.694030 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:33.694004 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ncp26_1086446b-6b80-40ba-bfd9-76e9b68fb565/dns/0.log" Jul 10 14:48:33.726418 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:33.726385 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ncp26_1086446b-6b80-40ba-bfd9-76e9b68fb565/kube-rbac-proxy/0.log" Jul 10 14:48:33.822588 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:33.822559 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t65gv_40d27be5-4ac9-4d9b-9b56-79bad16fed0d/dns-node-resolver/0.log" Jul 10 14:48:34.470891 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:34.470851 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-76bbfc4bc5-qgv94_86fd7c6f-09db-48e0-b418-df64a19efa2c/registry/0.log" Jul 10 14:48:34.615988 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:34.615957 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xtp2b_88b0cb5c-d33e-42a2-a4cb-cf4ac90259bd/node-ca/0.log" Jul 10 14:48:35.894374 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:35.894338 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-dfk2z_7f00d450-51ca-48e4-941a-36e605a06edf/discovery/0.log" Jul 10 14:48:35.961531 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:35.961503 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8545bb46c8-pplx9_06574f2a-a8f5-447d-b436-1445ac3e4c03/kube-auth-proxy/0.log" Jul 10 14:48:36.084594 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:36.084560 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-ddqvd_725d5a61-b5c5-4294-823f-9033040308a7/payload-pre-processing/0.log" Jul 10 14:48:36.873262 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:36.873231 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gm82q_30a00187-297f-459c-8c9c-b584bdfac8b7/serve-healthcheck-canary/0.log" Jul 10 14:48:37.317787 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:37.317763 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-mfd82" Jul 10 14:48:37.473653 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:37.473612 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7nhb9_a201eda6-6bb2-4ffd-a3ba-b02e648aad99/kube-rbac-proxy/0.log" Jul 10 14:48:37.500613 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:37.500580 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7nhb9_a201eda6-6bb2-4ffd-a3ba-b02e648aad99/exporter/0.log" Jul 10 14:48:37.528100 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:37.528069 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7nhb9_a201eda6-6bb2-4ffd-a3ba-b02e648aad99/extractor/0.log" Jul 10 14:48:37.813371 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:37.812057 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6z8gc_72c7722f-6a58-4230-a5f4-9c440b6887ea/ovn-acl-logging/0.log" Jul 10 14:48:37.814506 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:37.814476 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6z8gc_72c7722f-6a58-4230-a5f4-9c440b6887ea/ovn-acl-logging/0.log" Jul 10 14:48:40.239780 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:40.239677 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-n97h4_e37f911d-4d6f-47f6-93c7-bca3f3690909/manager/0.log" Jul 10 14:48:40.415366 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:40.414205 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-b9dhk_9802e15d-32ce-4ca0-b336-18b6ef0326ee/manager/0.log" Jul 10 14:48:40.531243 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:40.531168 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8c58bf8c5-jz4wb_fdb1524b-8045-42e4-8692-11549beb1cd6/manager/0.log" Jul 10 14:48:40.584873 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:40.584839 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-x2z8r_dc1a3bb6-e954-444e-8990-0269c46bea25/server/0.log" Jul 10 14:48:40.713753 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:40.713723 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-gz6kn_1632c406-6c81-445d-93cf-d70679c60fd8/manager/0.log" Jul 10 14:48:41.001507 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:41.001471 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-dfk2z_7f00d450-51ca-48e4-941a-36e605a06edf/discovery/0.log" Jul 10 14:48:41.023618 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:41.023578 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d47b746d6-tsr5v_4b06d174-3822-402d-9f16-1eafe43c807d/manager/0.log" Jul 10 14:48:41.029190 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:41.029168 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8545bb46c8-pplx9_06574f2a-a8f5-447d-b436-1445ac3e4c03/kube-auth-proxy/0.log" Jul 10 14:48:41.049603 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:41.049575 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d47b746d6-tsr5v_4b06d174-3822-402d-9f16-1eafe43c807d/copy-manifests/0.log" Jul 10 14:48:41.136527 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:41.136492 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-ddqvd_725d5a61-b5c5-4294-823f-9033040308a7/payload-pre-processing/0.log" Jul 10 14:48:42.583863 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:42.583829 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-dfk2z_7f00d450-51ca-48e4-941a-36e605a06edf/discovery/0.log" Jul 10 14:48:42.617956 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:42.617931 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8545bb46c8-pplx9_06574f2a-a8f5-447d-b436-1445ac3e4c03/kube-auth-proxy/0.log" Jul 10 14:48:42.721651 ip-10-0-142-2 kubenswrapper[2581]: I0710 14:48:42.721622 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-ddqvd_725d5a61-b5c5-4294-823f-9033040308a7/payload-pre-processing/0.log"