Jul 16 11:08:10.838518 ip-10-0-139-2 systemd[1]: Starting Kubernetes Kubelet... Jul 16 11:08:11.165359 ip-10-0-139-2 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 11:08:11.165359 ip-10-0-139-2 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 16 11:08:11.165359 ip-10-0-139-2 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 11:08:11.165359 ip-10-0-139-2 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 16 11:08:11.165359 ip-10-0-139-2 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 11:08:11.166957 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.166861 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 16 11:08:11.171406 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171392 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 11:08:11.171406 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171405 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 11:08:11.171478 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171408 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 11:08:11.171478 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171411 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 11:08:11.171478 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171414 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 11:08:11.171478 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171430 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 11:08:11.171478 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171434 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 11:08:11.171478 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171442 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 11:08:11.171478 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171445 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 11:08:11.171478 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171447 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 11:08:11.171478 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171450 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 11:08:11.171478 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171453 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 11:08:11.171478 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171455 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 11:08:11.171478 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171460 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 11:08:11.171478 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171464 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 11:08:11.171478 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171466 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 11:08:11.171478 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171471 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 11:08:11.171478 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171474 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 11:08:11.171478 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171477 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 11:08:11.171478 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171480 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 11:08:11.171478 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171482 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 11:08:11.171909 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171485 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 11:08:11.171909 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171488 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 16 11:08:11.171909 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171491 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 11:08:11.171909 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171494 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 11:08:11.171909 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171496 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 11:08:11.171909 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171499 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 11:08:11.171909 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171501 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 11:08:11.171909 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171504 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 11:08:11.171909 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171506 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 11:08:11.171909 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171509 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 11:08:11.171909 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171511 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 11:08:11.171909 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171514 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 11:08:11.171909 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171516 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 11:08:11.171909 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171519 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 11:08:11.171909 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171521 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 11:08:11.171909 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171524 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 11:08:11.171909 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171526 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 11:08:11.171909 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171529 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 11:08:11.171909 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171531 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 11:08:11.171909 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171534 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 11:08:11.171909 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171536 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 11:08:11.172451 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171538 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 11:08:11.172451 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171541 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 11:08:11.172451 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171543 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 11:08:11.172451 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171545 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 11:08:11.172451 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171548 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 11:08:11.172451 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171550 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 11:08:11.172451 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171553 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 11:08:11.172451 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171555 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 11:08:11.172451 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171557 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 11:08:11.172451 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171560 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 11:08:11.172451 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171562 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 11:08:11.172451 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171565 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 11:08:11.172451 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171569 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 11:08:11.172451 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171572 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 11:08:11.172451 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171575 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 11:08:11.172451 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171577 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 11:08:11.172451 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171580 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 11:08:11.172451 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171582 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 11:08:11.172451 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171584 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 11:08:11.172451 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171587 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 11:08:11.172914 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171589 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 11:08:11.172914 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171592 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 11:08:11.172914 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171594 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 11:08:11.172914 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171597 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 11:08:11.172914 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171599 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 11:08:11.172914 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171602 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 11:08:11.172914 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171604 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 11:08:11.172914 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171608 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 11:08:11.172914 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171611 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 11:08:11.172914 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171617 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 11:08:11.172914 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171620 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 11:08:11.172914 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171622 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 11:08:11.172914 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171625 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 11:08:11.172914 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171628 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 11:08:11.172914 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171631 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 11:08:11.172914 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171633 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 11:08:11.172914 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171636 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 11:08:11.172914 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171638 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 11:08:11.172914 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171641 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 11:08:11.173370 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171643 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 11:08:11.173370 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171646 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 11:08:11.173370 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171649 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 11:08:11.173370 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171652 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 11:08:11.173370 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171655 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 11:08:11.173370 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171658 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 11:08:11.173370 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171660 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 11:08:11.173370 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171663 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 11:08:11.173370 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171665 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 11:08:11.173370 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171668 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 11:08:11.173370 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171670 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 11:08:11.173370 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171673 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 11:08:11.173370 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171675 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 11:08:11.173370 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171678 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 11:08:11.173370 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171681 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 11:08:11.173370 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171683 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 11:08:11.173370 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171685 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 11:08:11.173370 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.171688 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 11:08:11.173370 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172344 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 11:08:11.173370 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172350 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 11:08:11.173861 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172353 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 11:08:11.173861 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172356 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 11:08:11.173861 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172358 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 11:08:11.173861 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172361 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 11:08:11.173861 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172364 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 16 11:08:11.173861 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172367 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 11:08:11.173861 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172369 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 11:08:11.173861 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172372 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 11:08:11.173861 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172374 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 11:08:11.173861 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172377 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 11:08:11.173861 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172379 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 11:08:11.173861 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172382 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 11:08:11.173861 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172385 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 11:08:11.173861 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172387 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 11:08:11.173861 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172390 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 11:08:11.173861 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172393 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 11:08:11.173861 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172395 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 11:08:11.173861 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172400 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 11:08:11.173861 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172402 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 11:08:11.173861 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172405 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 11:08:11.174386 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172407 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 11:08:11.174386 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172410 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 11:08:11.174386 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172413 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 11:08:11.174386 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172415 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 11:08:11.174386 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172418 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 11:08:11.174386 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172420 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 11:08:11.174386 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172423 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 11:08:11.174386 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172427 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 11:08:11.174386 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172431 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 11:08:11.174386 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172434 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 11:08:11.174386 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172436 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 11:08:11.174386 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172439 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 11:08:11.174386 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172442 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 11:08:11.174386 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172445 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 11:08:11.174386 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172448 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 11:08:11.174386 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172450 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 11:08:11.174386 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172454 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 11:08:11.174386 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172457 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 11:08:11.174386 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172460 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 11:08:11.174842 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172462 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 11:08:11.174842 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172465 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 11:08:11.174842 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172468 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 11:08:11.174842 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172470 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 11:08:11.174842 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172473 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 11:08:11.174842 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172476 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 11:08:11.174842 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172478 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 11:08:11.174842 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172481 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 11:08:11.174842 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172483 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 11:08:11.174842 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172486 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 11:08:11.174842 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172488 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 11:08:11.174842 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172491 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 11:08:11.174842 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172493 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 11:08:11.174842 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172496 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 11:08:11.174842 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172498 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 11:08:11.174842 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172502 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 11:08:11.174842 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172506 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 11:08:11.174842 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172509 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 11:08:11.174842 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172511 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 11:08:11.174842 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172514 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 11:08:11.175323 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172516 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 11:08:11.175323 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172519 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 11:08:11.175323 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172521 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 11:08:11.175323 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172524 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 11:08:11.175323 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172526 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 11:08:11.175323 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172529 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 11:08:11.175323 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172531 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 11:08:11.175323 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172534 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 11:08:11.175323 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172536 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 11:08:11.175323 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172539 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 11:08:11.175323 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172542 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 11:08:11.175323 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172546 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 11:08:11.175323 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172550 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 11:08:11.175323 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172553 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 11:08:11.175323 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172556 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 11:08:11.175323 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172559 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 11:08:11.175323 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172563 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 11:08:11.175323 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172566 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 11:08:11.175323 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172569 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 11:08:11.175323 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172572 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 11:08:11.175814 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172575 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 11:08:11.175814 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172578 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 11:08:11.175814 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172581 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 11:08:11.175814 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172584 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 11:08:11.175814 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172587 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 11:08:11.175814 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172589 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 11:08:11.175814 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172592 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 11:08:11.175814 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172596 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 11:08:11.175814 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172599 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 11:08:11.175814 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172601 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 11:08:11.175814 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172604 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 11:08:11.175814 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172607 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 11:08:11.175814 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172609 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 11:08:11.175814 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172612 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 11:08:11.175814 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172615 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 11:08:11.175814 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172617 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 11:08:11.175814 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172620 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 11:08:11.175814 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.172623 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 11:08:11.175814 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173000 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 11:08:11.175814 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173005 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 11:08:11.176310 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173009 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 11:08:11.176310 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173012 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 11:08:11.176310 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173015 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 11:08:11.176310 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173018 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 11:08:11.176310 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173021 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 11:08:11.176310 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173023 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 11:08:11.176310 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173026 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 11:08:11.176310 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173028 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 11:08:11.176310 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173031 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 11:08:11.176310 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173034 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 11:08:11.176310 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173037 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 11:08:11.176310 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173039 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 11:08:11.176310 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173043 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 11:08:11.176310 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173047 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 11:08:11.176310 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173050 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 11:08:11.176310 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173053 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 11:08:11.176310 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173056 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 11:08:11.176310 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173058 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 11:08:11.176310 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173061 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 11:08:11.176762 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173064 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 11:08:11.176762 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173066 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 11:08:11.176762 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173069 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 11:08:11.176762 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173071 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 11:08:11.176762 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173074 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 11:08:11.176762 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173077 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 11:08:11.176762 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173079 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 11:08:11.176762 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173081 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 11:08:11.176762 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173084 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 11:08:11.176762 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173086 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 11:08:11.176762 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173089 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 11:08:11.176762 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173091 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 11:08:11.176762 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173094 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 11:08:11.176762 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173097 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 11:08:11.176762 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173100 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 11:08:11.176762 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173103 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 11:08:11.176762 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173107 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 11:08:11.176762 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173109 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 11:08:11.176762 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173112 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 11:08:11.176762 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173115 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 11:08:11.177301 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173117 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 11:08:11.177301 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173121 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 11:08:11.177301 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173123 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 11:08:11.177301 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173126 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 11:08:11.177301 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173128 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 11:08:11.177301 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173131 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 11:08:11.177301 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173133 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 11:08:11.177301 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173136 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 11:08:11.177301 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173138 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 11:08:11.177301 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173140 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 11:08:11.177301 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173143 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 11:08:11.177301 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173145 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 11:08:11.177301 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173148 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 11:08:11.177301 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173152 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 11:08:11.177301 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173154 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 11:08:11.177301 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173156 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 11:08:11.177301 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173159 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 11:08:11.177301 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173162 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 11:08:11.177301 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173164 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 11:08:11.177301 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173166 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 11:08:11.177793 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173169 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 16 11:08:11.177793 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173172 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 11:08:11.177793 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173174 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 11:08:11.177793 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173177 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 11:08:11.177793 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173180 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 11:08:11.177793 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173183 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 11:08:11.177793 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173185 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 11:08:11.177793 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173188 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 11:08:11.177793 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173190 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 11:08:11.177793 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173193 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 11:08:11.177793 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173196 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 11:08:11.177793 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173198 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 11:08:11.177793 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173201 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 11:08:11.177793 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173203 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 11:08:11.177793 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173206 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 11:08:11.177793 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173210 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 11:08:11.177793 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173213 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 11:08:11.177793 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173216 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 11:08:11.177793 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173219 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 11:08:11.178256 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173221 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 11:08:11.178256 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173224 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 11:08:11.178256 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173226 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 11:08:11.178256 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173228 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 11:08:11.178256 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173245 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 11:08:11.178256 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173247 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 11:08:11.178256 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173250 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 11:08:11.178256 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173252 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 11:08:11.178256 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173255 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 11:08:11.178256 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173258 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 11:08:11.178256 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173260 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 11:08:11.178256 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173263 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 11:08:11.178256 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173265 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 11:08:11.178256 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173267 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 11:08:11.178256 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173270 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 11:08:11.178256 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173273 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 11:08:11.178256 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173277 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 11:08:11.178256 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173280 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 11:08:11.178256 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173282 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 11:08:11.178256 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173340 2559 flags.go:64] FLAG: --address="0.0.0.0" Jul 16 11:08:11.178256 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173347 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 16 11:08:11.178756 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173354 2559 flags.go:64] FLAG: --anonymous-auth="true" Jul 16 11:08:11.178756 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173358 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 16 11:08:11.178756 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173364 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 16 11:08:11.178756 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173369 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 16 11:08:11.178756 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173375 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 16 11:08:11.178756 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173382 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 16 11:08:11.178756 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173387 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 16 11:08:11.178756 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173390 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 16 11:08:11.178756 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173393 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 16 11:08:11.178756 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173396 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 16 11:08:11.178756 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173399 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 16 11:08:11.178756 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173403 2559 flags.go:64] FLAG: --cgroup-root="" Jul 16 11:08:11.178756 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173405 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 16 11:08:11.178756 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173408 2559 flags.go:64] FLAG: --client-ca-file="" Jul 16 11:08:11.178756 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173411 2559 flags.go:64] FLAG: --cloud-provider="external" Jul 16 11:08:11.178756 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173414 2559 flags.go:64] FLAG: --cluster-dns="[]" Jul 16 11:08:11.178756 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173418 2559 flags.go:64] FLAG: --cluster-domain="" Jul 16 11:08:11.178756 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173420 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 16 11:08:11.178756 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173423 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 16 11:08:11.178756 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173427 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 16 11:08:11.178756 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173430 2559 flags.go:64] FLAG: --container-log-max-files="5" Jul 16 11:08:11.178756 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173434 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 16 11:08:11.178756 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173437 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 16 11:08:11.179302 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173440 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 16 11:08:11.179302 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173443 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 16 11:08:11.179302 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173446 2559 flags.go:64] FLAG: --contention-profiling="false" Jul 16 11:08:11.179302 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173448 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 16 11:08:11.179302 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173453 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 16 11:08:11.179302 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173456 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 16 11:08:11.179302 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173460 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 16 11:08:11.179302 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173464 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 16 11:08:11.179302 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173467 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 16 11:08:11.179302 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173469 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 16 11:08:11.179302 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173472 2559 flags.go:64] FLAG: --enable-load-reader="false" Jul 16 11:08:11.179302 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173475 2559 flags.go:64] FLAG: --enable-server="true" Jul 16 11:08:11.179302 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173479 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 16 11:08:11.179302 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173483 2559 flags.go:64] FLAG: --event-burst="100" Jul 16 11:08:11.179302 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173486 2559 flags.go:64] FLAG: --event-qps="50" Jul 16 11:08:11.179302 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173489 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 16 11:08:11.179302 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173491 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 16 11:08:11.179302 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173494 2559 flags.go:64] FLAG: --eviction-hard="" Jul 16 11:08:11.179302 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173498 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 16 11:08:11.179302 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173500 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 16 11:08:11.179302 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173503 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 16 11:08:11.179302 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173506 2559 flags.go:64] FLAG: --eviction-soft="" Jul 16 11:08:11.179302 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173509 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 16 11:08:11.179302 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173512 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 16 11:08:11.179302 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173514 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 16 11:08:11.179968 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173517 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jul 16 11:08:11.179968 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173520 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 16 11:08:11.179968 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173523 2559 flags.go:64] FLAG: --fail-swap-on="true" Jul 16 11:08:11.179968 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173525 2559 flags.go:64] FLAG: --feature-gates="" Jul 16 11:08:11.179968 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173529 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jul 16 11:08:11.179968 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173532 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 16 11:08:11.179968 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173534 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 16 11:08:11.179968 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173537 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 16 11:08:11.179968 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173540 2559 flags.go:64] FLAG: --healthz-port="10248" Jul 16 11:08:11.179968 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173543 2559 flags.go:64] FLAG: --help="false" Jul 16 11:08:11.179968 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173546 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-139-2.ec2.internal" Jul 16 11:08:11.179968 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173550 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 16 11:08:11.179968 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173553 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jul 16 11:08:11.179968 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173559 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 16 11:08:11.179968 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173562 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 16 11:08:11.179968 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173566 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 16 11:08:11.179968 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173568 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 16 11:08:11.179968 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173571 2559 flags.go:64] FLAG: --image-service-endpoint="" Jul 16 11:08:11.179968 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173573 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 16 11:08:11.179968 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173576 2559 flags.go:64] FLAG: --kube-api-burst="100" Jul 16 11:08:11.179968 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173580 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 16 11:08:11.179968 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173583 2559 flags.go:64] FLAG: --kube-api-qps="50" Jul 16 11:08:11.179968 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173586 2559 flags.go:64] FLAG: --kube-reserved="" Jul 16 11:08:11.179968 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173588 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 16 11:08:11.180574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173591 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 16 11:08:11.180574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173594 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jul 16 11:08:11.180574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173597 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 16 11:08:11.180574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173600 2559 flags.go:64] FLAG: --lock-file="" Jul 16 11:08:11.180574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173602 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 16 11:08:11.180574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173605 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 16 11:08:11.180574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173608 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 16 11:08:11.180574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173613 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jul 16 11:08:11.180574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173616 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 16 11:08:11.180574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173619 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jul 16 11:08:11.180574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173622 2559 flags.go:64] FLAG: --logging-format="text" Jul 16 11:08:11.180574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173625 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 16 11:08:11.180574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173628 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 16 11:08:11.180574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173631 2559 flags.go:64] FLAG: --manifest-url="" Jul 16 11:08:11.180574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173633 2559 flags.go:64] FLAG: --manifest-url-header="" Jul 16 11:08:11.180574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173637 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 16 11:08:11.180574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173640 2559 flags.go:64] FLAG: --max-open-files="1000000" Jul 16 11:08:11.180574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173644 2559 flags.go:64] FLAG: --max-pods="110" Jul 16 11:08:11.180574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173646 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 16 11:08:11.180574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173654 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 16 11:08:11.180574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173656 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jul 16 11:08:11.180574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173660 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 16 11:08:11.180574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173663 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 16 11:08:11.180574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173666 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 16 11:08:11.180574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173669 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 16 11:08:11.181162 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173675 2559 flags.go:64] FLAG: --node-status-max-images="50" Jul 16 11:08:11.181162 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173678 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 16 11:08:11.181162 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173681 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jul 16 11:08:11.181162 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173684 2559 flags.go:64] FLAG: --pod-cidr="" Jul 16 11:08:11.181162 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173687 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 16 11:08:11.181162 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173693 2559 flags.go:64] FLAG: --pod-manifest-path="" Jul 16 11:08:11.181162 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173696 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jul 16 11:08:11.181162 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173698 2559 flags.go:64] FLAG: --pods-per-core="0" Jul 16 11:08:11.181162 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173701 2559 flags.go:64] FLAG: --port="10250" Jul 16 11:08:11.181162 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173704 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 16 11:08:11.181162 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173707 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-063646819a6a17c99" Jul 16 11:08:11.181162 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173710 2559 flags.go:64] FLAG: --qos-reserved="" Jul 16 11:08:11.181162 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173713 2559 flags.go:64] FLAG: --read-only-port="10255" Jul 16 11:08:11.181162 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173716 2559 flags.go:64] FLAG: --register-node="true" Jul 16 11:08:11.181162 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173719 2559 flags.go:64] FLAG: --register-with-taints="" Jul 16 11:08:11.181162 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173722 2559 flags.go:64] FLAG: --registry-burst="10" Jul 16 11:08:11.181162 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173725 2559 flags.go:64] FLAG: --registry-qps="5" Jul 16 11:08:11.181162 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173727 2559 flags.go:64] FLAG: --reserved-cpus="" Jul 16 11:08:11.181162 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173730 2559 flags.go:64] FLAG: --reserved-memory="" Jul 16 11:08:11.181162 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173733 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 16 11:08:11.181162 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173736 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 16 11:08:11.181162 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173739 2559 flags.go:64] FLAG: --rotate-certificates="false" Jul 16 11:08:11.181162 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173742 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 16 11:08:11.181162 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173744 2559 flags.go:64] FLAG: --runonce="false" Jul 16 11:08:11.181162 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173747 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 16 11:08:11.181757 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173750 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 16 11:08:11.181757 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173754 2559 flags.go:64] FLAG: --seccomp-default="false" Jul 16 11:08:11.181757 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173757 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 16 11:08:11.181757 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173760 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 16 11:08:11.181757 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173764 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 16 11:08:11.181757 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173767 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 16 11:08:11.181757 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173770 2559 flags.go:64] FLAG: --storage-driver-password="root" Jul 16 11:08:11.181757 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173773 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jul 16 11:08:11.181757 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173775 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jul 16 11:08:11.181757 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173778 2559 flags.go:64] FLAG: --storage-driver-user="root" Jul 16 11:08:11.181757 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173781 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 16 11:08:11.181757 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173784 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 16 11:08:11.181757 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173787 2559 flags.go:64] FLAG: --system-cgroups="" Jul 16 11:08:11.181757 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173790 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 16 11:08:11.181757 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173795 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 16 11:08:11.181757 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173798 2559 flags.go:64] FLAG: --tls-cert-file="" Jul 16 11:08:11.181757 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173800 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 16 11:08:11.181757 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173804 2559 flags.go:64] FLAG: --tls-min-version="" Jul 16 11:08:11.181757 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173807 2559 flags.go:64] FLAG: --tls-private-key-file="" Jul 16 11:08:11.181757 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173809 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jul 16 11:08:11.181757 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173812 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 16 11:08:11.181757 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173815 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jul 16 11:08:11.181757 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173818 2559 flags.go:64] FLAG: --v="2" Jul 16 11:08:11.181757 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173821 2559 flags.go:64] FLAG: --version="false" Jul 16 11:08:11.181757 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173825 2559 flags.go:64] FLAG: --vmodule="" Jul 16 11:08:11.182376 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173828 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 16 11:08:11.182376 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.173831 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 16 11:08:11.182376 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173949 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 11:08:11.182376 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173953 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 11:08:11.182376 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173956 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 11:08:11.182376 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173959 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 11:08:11.182376 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173961 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 11:08:11.182376 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173963 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 11:08:11.182376 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173967 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 11:08:11.182376 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173969 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 11:08:11.182376 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173972 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 11:08:11.182376 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173976 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 11:08:11.182376 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173979 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 11:08:11.182376 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173981 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 11:08:11.182376 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173984 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 11:08:11.182376 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173986 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 11:08:11.182376 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173989 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 11:08:11.182376 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173991 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 11:08:11.182376 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173994 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 11:08:11.182376 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.173997 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 11:08:11.182850 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174000 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 11:08:11.182850 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174002 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 11:08:11.182850 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174005 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 11:08:11.182850 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174007 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 11:08:11.182850 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174010 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 11:08:11.182850 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174012 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 11:08:11.182850 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174015 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 11:08:11.182850 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174018 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 11:08:11.182850 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174020 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 11:08:11.182850 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174022 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 11:08:11.182850 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174025 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 11:08:11.182850 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174027 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 11:08:11.182850 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174030 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 11:08:11.182850 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174032 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 11:08:11.182850 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174035 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 11:08:11.182850 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174037 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 11:08:11.182850 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174040 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 11:08:11.182850 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174042 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 11:08:11.182850 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174045 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 11:08:11.182850 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174047 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 11:08:11.183374 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174051 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 11:08:11.183374 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174055 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 11:08:11.183374 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174058 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 11:08:11.183374 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174062 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 11:08:11.183374 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174065 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 11:08:11.183374 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174069 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 11:08:11.183374 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174072 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 11:08:11.183374 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174075 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 11:08:11.183374 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174077 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 11:08:11.183374 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174080 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 11:08:11.183374 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174082 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 11:08:11.183374 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174085 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 11:08:11.183374 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174088 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 11:08:11.183374 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174090 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 11:08:11.183374 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174093 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 11:08:11.183374 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174095 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 11:08:11.183374 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174098 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 11:08:11.183374 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174100 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 11:08:11.183374 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174103 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 11:08:11.183836 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174105 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 11:08:11.183836 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174108 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 11:08:11.183836 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174110 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 11:08:11.183836 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174113 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 11:08:11.183836 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174115 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 11:08:11.183836 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174118 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 11:08:11.183836 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174120 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 11:08:11.183836 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174123 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 11:08:11.183836 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174125 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 11:08:11.183836 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174128 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 11:08:11.183836 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174130 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 11:08:11.183836 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174133 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 11:08:11.183836 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174136 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 11:08:11.183836 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174138 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 11:08:11.183836 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174141 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 11:08:11.183836 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174144 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 11:08:11.183836 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174148 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 11:08:11.183836 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174152 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 11:08:11.183836 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174154 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 11:08:11.184311 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174157 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 11:08:11.184311 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174160 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 11:08:11.184311 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174162 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 11:08:11.184311 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174165 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 11:08:11.184311 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174167 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 11:08:11.184311 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174169 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 11:08:11.184311 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174172 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 11:08:11.184311 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174174 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 11:08:11.184311 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174177 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 11:08:11.184311 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174180 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 16 11:08:11.184311 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174182 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 11:08:11.184311 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174185 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 11:08:11.184311 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174187 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 11:08:11.184311 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174191 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 11:08:11.184311 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174193 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 11:08:11.184311 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174196 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 11:08:11.184311 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174198 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 11:08:11.184311 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174201 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 11:08:11.184311 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174203 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 11:08:11.184311 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174206 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 11:08:11.184787 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174208 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 11:08:11.184787 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174211 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 11:08:11.184787 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.174213 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 11:08:11.184787 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.174857 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 11:08:11.184787 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.180853 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 16 11:08:11.184787 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.180868 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 16 11:08:11.184787 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.180886 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 16 11:08:11.184787 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.180895 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 16 11:08:11.184787 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.180949 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 11:08:11.184787 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.180954 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 11:08:11.184787 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.180957 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 11:08:11.184787 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.180961 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 11:08:11.184787 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.180964 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 11:08:11.184787 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.180968 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 11:08:11.184787 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.180971 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 16 11:08:11.185150 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.180973 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 11:08:11.185150 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.180976 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 11:08:11.185150 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.180979 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 11:08:11.185150 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.180982 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 11:08:11.185150 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.180985 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 11:08:11.185150 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.180987 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 11:08:11.185150 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.180990 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 11:08:11.185150 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.180993 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 11:08:11.185150 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.180995 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 11:08:11.185150 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.180998 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 11:08:11.185150 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181000 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 11:08:11.185150 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181003 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 11:08:11.185150 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181005 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 11:08:11.185150 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181008 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 11:08:11.185150 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181010 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 11:08:11.185150 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181013 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 11:08:11.185150 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181015 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 11:08:11.185150 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181018 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 11:08:11.185150 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181021 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 11:08:11.185150 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181023 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 11:08:11.185630 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181026 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 11:08:11.185630 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181029 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 11:08:11.185630 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181033 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 11:08:11.185630 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181036 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 11:08:11.185630 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181038 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 11:08:11.185630 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181040 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 11:08:11.185630 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181043 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 11:08:11.185630 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181045 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 11:08:11.185630 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181048 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 11:08:11.185630 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181050 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 11:08:11.185630 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181053 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 11:08:11.185630 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181055 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 11:08:11.185630 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181059 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 11:08:11.185630 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181061 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 11:08:11.185630 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181064 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 11:08:11.185630 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181067 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 11:08:11.185630 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181069 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 11:08:11.185630 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181071 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 11:08:11.185630 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181074 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 11:08:11.186076 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181076 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 11:08:11.186076 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181079 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 11:08:11.186076 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181081 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 11:08:11.186076 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181084 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 11:08:11.186076 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181086 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 11:08:11.186076 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181089 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 11:08:11.186076 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181092 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 11:08:11.186076 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181094 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 11:08:11.186076 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181096 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 11:08:11.186076 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181099 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 11:08:11.186076 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181101 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 11:08:11.186076 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181104 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 11:08:11.186076 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181107 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 11:08:11.186076 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181109 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 11:08:11.186076 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181112 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 11:08:11.186076 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181114 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 11:08:11.186076 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181118 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 11:08:11.186076 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181120 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 11:08:11.186076 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181123 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 11:08:11.186535 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181126 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 11:08:11.186535 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181130 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 11:08:11.186535 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181133 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 11:08:11.186535 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181137 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 11:08:11.186535 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181141 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 11:08:11.186535 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181144 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 11:08:11.186535 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181146 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 11:08:11.186535 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181149 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 11:08:11.186535 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181152 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 11:08:11.186535 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181154 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 11:08:11.186535 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181157 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 11:08:11.186535 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181159 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 11:08:11.186535 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181162 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 11:08:11.186535 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181164 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 11:08:11.186535 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181167 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 11:08:11.186535 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181170 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 11:08:11.186535 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181172 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 11:08:11.186535 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181175 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 11:08:11.186535 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181178 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 11:08:11.186972 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181181 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 11:08:11.186972 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181183 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 11:08:11.186972 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181186 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 11:08:11.186972 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181188 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 11:08:11.186972 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181191 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 11:08:11.186972 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181193 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 11:08:11.186972 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181195 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 11:08:11.186972 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181198 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 11:08:11.186972 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181201 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 11:08:11.186972 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181203 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 11:08:11.186972 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181206 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 11:08:11.186972 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181210 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 11:08:11.186972 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181213 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 11:08:11.186972 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181216 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 11:08:11.186972 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181219 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 11:08:11.187354 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.181225 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 11:08:11.187354 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181346 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 11:08:11.187354 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181351 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 11:08:11.187354 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181353 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 11:08:11.187354 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181356 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 11:08:11.187354 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181359 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 11:08:11.187354 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181362 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 11:08:11.187354 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181365 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 11:08:11.187354 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181367 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 11:08:11.187354 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181370 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 11:08:11.187354 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181373 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 11:08:11.187354 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181375 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 11:08:11.187354 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181378 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 11:08:11.187354 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181380 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 11:08:11.187354 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181383 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 11:08:11.187946 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181385 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 11:08:11.187946 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181388 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 11:08:11.187946 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181390 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 11:08:11.187946 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181393 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 11:08:11.187946 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181396 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 11:08:11.187946 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181400 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 11:08:11.187946 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181403 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 11:08:11.187946 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181407 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 11:08:11.187946 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181410 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 11:08:11.187946 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181413 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 11:08:11.187946 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181416 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 11:08:11.187946 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181419 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 11:08:11.187946 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181422 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 11:08:11.187946 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181424 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 11:08:11.187946 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181427 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 11:08:11.187946 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181431 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 11:08:11.187946 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181434 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 11:08:11.187946 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181437 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 11:08:11.187946 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181439 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 11:08:11.189012 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181442 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 11:08:11.189012 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181444 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 11:08:11.189012 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181447 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 11:08:11.189012 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181449 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 11:08:11.189012 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181451 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 11:08:11.189012 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181454 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 16 11:08:11.189012 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181457 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 11:08:11.189012 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181459 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 11:08:11.189012 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181462 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 11:08:11.189012 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181464 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 11:08:11.189012 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181467 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 11:08:11.189012 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181469 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 11:08:11.189012 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181472 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 11:08:11.189012 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181474 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 11:08:11.189012 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181477 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 11:08:11.189012 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181479 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 11:08:11.189012 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181482 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 11:08:11.189012 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181484 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 11:08:11.189012 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181487 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 11:08:11.189012 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181490 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 11:08:11.189012 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181493 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 11:08:11.189552 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181495 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 11:08:11.189552 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181498 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 11:08:11.189552 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181500 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 11:08:11.189552 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181502 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 11:08:11.189552 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181505 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 11:08:11.189552 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181507 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 11:08:11.189552 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181510 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 11:08:11.189552 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181516 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 11:08:11.189552 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181519 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 11:08:11.189552 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181522 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 11:08:11.189552 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181524 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 11:08:11.189552 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181526 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 11:08:11.189552 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181529 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 11:08:11.189552 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181531 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 11:08:11.189552 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181534 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 11:08:11.189552 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181536 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 11:08:11.189552 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181539 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 11:08:11.189552 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181541 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 11:08:11.189552 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181544 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 11:08:11.189552 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181546 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 11:08:11.190029 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181548 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 11:08:11.190029 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181551 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 11:08:11.190029 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181553 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 11:08:11.190029 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181556 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 11:08:11.190029 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181558 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 11:08:11.190029 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181561 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 11:08:11.190029 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181563 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 11:08:11.190029 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181566 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 11:08:11.190029 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181568 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 11:08:11.190029 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181571 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 11:08:11.190029 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181573 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 11:08:11.190029 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181576 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 11:08:11.190029 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181578 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 11:08:11.190029 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181581 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 11:08:11.190029 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181583 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 11:08:11.190029 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181587 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 11:08:11.190029 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181591 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 11:08:11.190029 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181593 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 11:08:11.190029 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181597 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 11:08:11.190505 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181599 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 11:08:11.190505 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181603 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 11:08:11.190505 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181605 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 11:08:11.190505 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181608 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 11:08:11.190505 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181611 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 11:08:11.190505 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:11.181613 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 11:08:11.190505 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.181618 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 11:08:11.190505 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.181708 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jul 16 11:08:11.190505 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.183669 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 16 11:08:11.190505 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.184834 2559 server.go:1019] "Starting client certificate rotation" Jul 16 11:08:11.190505 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.184938 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 11:08:11.190505 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.184974 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 11:08:11.190505 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.189709 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 11:08:11.193335 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:11.193319 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 11:08:12.510287 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.510030 2559 log.go:25] "Validated CRI v1 runtime API" Jul 16 11:08:12.512595 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.512581 2559 log.go:25] "Validated CRI v1 image API" Jul 16 11:08:12.513404 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.513390 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 16 11:08:12.516974 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.516954 2559 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9303dc8b-8e9e-4613-beb9-4dc7bddfd8af:/dev/nvme0n1p4 d5dddfa7-a35c-44a1-aa59-85a59cc3826f:/dev/nvme0n1p3] Jul 16 11:08:12.517056 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.516972 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 16 11:08:12.521038 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.520937 2559 manager.go:216] Machine: {Timestamp:2026-07-16 11:08:12.520448854 +0000 UTC m=+0.272706640 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3117715 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a6517c2096523f80161dd34b2d35b SystemUUID:ec2a6517-c209-6523-f801-61dd34b2d35b BootID:8a5ea55b-4234-4d73-9144-41601b3056e2 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:90:94:b2:25:23 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:90:94:b2:25:23 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:17:0b:d8:1a:17 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 16 11:08:12.521038 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.521024 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 16 11:08:12.521185 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.521109 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 16 11:08:12.523780 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.523752 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 16 11:08:12.523906 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.523781 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-2.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 16 11:08:12.525019 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.525009 2559 topology_manager.go:138] "Creating topology manager with none policy" Jul 16 11:08:12.525053 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.525021 2559 container_manager_linux.go:309] "Creating device plugin manager" Jul 16 11:08:12.525053 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.525028 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 11:08:12.525708 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.525695 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 11:08:12.526945 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.526935 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 16 11:08:12.527990 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.527975 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 11:08:12.531162 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.531150 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 16 11:08:12.531282 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.531272 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 16 11:08:12.531324 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.531300 2559 kubelet.go:486] "Attempting to sync node with API server" Jul 16 11:08:12.531324 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.531309 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 16 11:08:12.531324 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.531320 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 16 11:08:12.531438 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.531330 2559 kubelet.go:398] "Adding apiserver pod source" Jul 16 11:08:12.531438 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.531339 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 16 11:08:12.531702 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.531689 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 11:08:12.531734 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.531713 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 11:08:12.533645 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.533620 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 16 11:08:12.535477 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.535464 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 16 11:08:12.535544 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.535493 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 16 11:08:12.535693 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.535681 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 16 11:08:12.535736 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.535703 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 16 11:08:12.535736 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.535712 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 16 11:08:12.535736 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.535720 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 16 11:08:12.535736 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.535731 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 16 11:08:12.535888 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.535740 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 16 11:08:12.536195 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.536184 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 16 11:08:12.536195 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.536193 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 16 11:08:12.536263 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.536200 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 16 11:08:12.536263 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.536207 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 16 11:08:12.536263 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.536221 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 16 11:08:12.536263 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.536228 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 16 11:08:12.537026 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.537017 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 16 11:08:12.537063 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.537027 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 16 11:08:12.541036 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.541010 2559 server.go:1268] "Started kubelet" Jul 16 11:08:12.541162 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.541106 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 16 11:08:12.541255 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.541164 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 16 11:08:12.541255 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.541192 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 16 11:08:12.541872 ip-10-0-139-2 systemd[1]: Started Kubernetes Kubelet. Jul 16 11:08:12.542756 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.542727 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 16 11:08:12.544081 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.544054 2559 server.go:310] "Adding debug handlers to kubelet server" Jul 16 11:08:12.544417 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.544394 2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-2.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 16 11:08:12.544524 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:12.544461 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 16 11:08:12.544942 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:12.544905 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-2.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 16 11:08:12.547772 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:12.547754 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 16 11:08:12.549022 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:12.548187 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-2.ec2.internal.18c2c087f41fbea1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-2.ec2.internal,UID:ip-10-0-139-2.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-2.ec2.internal,},FirstTimestamp:2026-07-16 11:08:12.540976801 +0000 UTC m=+0.293234587,LastTimestamp:2026-07-16 11:08:12.540976801 +0000 UTC m=+0.293234587,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-2.ec2.internal,}" Jul 16 11:08:12.550039 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.550021 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 16 11:08:12.550147 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.550041 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 16 11:08:12.550147 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:12.550113 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-2.ec2.internal\" not found" Jul 16 11:08:12.550658 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.550595 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 16 11:08:12.550658 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.550610 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 16 11:08:12.550658 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.550596 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 16 11:08:12.550816 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.550729 2559 reconstruct.go:97] "Volume reconstruction finished" Jul 16 11:08:12.550816 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.550739 2559 reconciler.go:29] "Reconciler: start to sync state" Jul 16 11:08:12.550954 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.550940 2559 factory.go:55] Registering systemd factory Jul 16 11:08:12.551006 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.550956 2559 factory.go:223] Registration of the systemd container factory successfully Jul 16 11:08:12.551142 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.551125 2559 factory.go:153] Registering CRI-O factory Jul 16 11:08:12.551142 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.551142 2559 factory.go:223] Registration of the crio container factory successfully Jul 16 11:08:12.551269 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.551192 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 16 11:08:12.551269 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.551215 2559 factory.go:103] Registering Raw factory Jul 16 11:08:12.551269 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.551240 2559 manager.go:1196] Started watching for new ooms in manager Jul 16 11:08:12.551616 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.551602 2559 manager.go:349] Starting recovery of all containers Jul 16 11:08:12.558542 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:12.558514 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 16 11:08:12.558655 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:12.558577 2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-2.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 16 11:08:12.561666 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.561651 2559 manager.go:354] Recovery completed Jul 16 11:08:12.566243 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.566231 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 11:08:12.568502 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.568479 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasSufficientMemory" Jul 16 11:08:12.568562 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.568511 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 11:08:12.568562 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.568526 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasSufficientPID" Jul 16 11:08:12.569012 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.569000 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 16 11:08:12.569063 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.569011 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 16 11:08:12.569063 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.569029 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 16 11:08:12.569147 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.569068 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 11:08:12.570017 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.569824 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasSufficientMemory" Jul 16 11:08:12.570123 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.570051 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 11:08:12.570123 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.570069 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasSufficientPID" Jul 16 11:08:12.570505 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:12.570404 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-2.ec2.internal.18c2c087f5c3b75f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-2.ec2.internal,UID:ip-10-0-139-2.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-2.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-2.ec2.internal,},FirstTimestamp:2026-07-16 11:08:12.568500063 +0000 UTC m=+0.320757849,LastTimestamp:2026-07-16 11:08:12.568500063 +0000 UTC m=+0.320757849,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-2.ec2.internal,}" Jul 16 11:08:12.572764 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.572750 2559 policy_none.go:49] "None policy: Start" Jul 16 11:08:12.572764 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.572767 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 16 11:08:12.572875 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.572777 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 16 11:08:12.574325 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.574308 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xlwqc" Jul 16 11:08:12.574784 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.574774 2559 policy_none.go:47] "Start" Jul 16 11:08:12.580347 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:12.580205 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-2.ec2.internal.18c2c087f5c3fc92 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-2.ec2.internal,UID:ip-10-0-139-2.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-2.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-2.ec2.internal,},FirstTimestamp:2026-07-16 11:08:12.568517778 +0000 UTC m=+0.320775569,LastTimestamp:2026-07-16 11:08:12.568517778 +0000 UTC m=+0.320775569,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-2.ec2.internal,}" Jul 16 11:08:12.581449 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.581430 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xlwqc" Jul 16 11:08:12.616160 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.616146 2559 manager.go:337] "Starting Device Plugin manager" Jul 16 11:08:12.616219 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:12.616172 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 16 11:08:12.616219 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.616181 2559 server.go:87] "Starting device plugin registration server" Jul 16 11:08:12.616407 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.616392 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 16 11:08:12.616503 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.616410 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 16 11:08:12.616503 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.616487 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 16 11:08:12.616644 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.616557 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 16 11:08:12.616644 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.616566 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 16 11:08:12.617098 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:12.617077 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 16 11:08:12.617159 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:12.617131 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-2.ec2.internal\" not found" Jul 16 11:08:12.643092 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.643071 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 16 11:08:12.652535 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.644160 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 16 11:08:12.652535 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.644190 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 16 11:08:12.652535 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.644207 2559 kubelet.go:2448] "Starting kubelet main sync loop" Jul 16 11:08:12.652535 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:12.644234 2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 16 11:08:12.652535 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.647128 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 11:08:12.717150 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.717130 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 11:08:12.717874 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.717861 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasSufficientMemory" Jul 16 11:08:12.717933 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.717887 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 11:08:12.717933 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.717903 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasSufficientPID" Jul 16 11:08:12.717933 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.717928 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-2.ec2.internal" Jul 16 11:08:12.727226 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.727183 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-2.ec2.internal" Jul 16 11:08:12.727226 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:12.727203 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-2.ec2.internal\": node \"ip-10-0-139-2.ec2.internal\" not found" Jul 16 11:08:12.744887 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.744868 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-2.ec2.internal"] Jul 16 11:08:12.744953 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.744918 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 11:08:12.745624 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.745611 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasSufficientMemory" Jul 16 11:08:12.745695 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.745654 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 11:08:12.745695 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.745670 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasSufficientPID" Jul 16 11:08:12.747108 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:12.747093 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-2.ec2.internal\" not found" Jul 16 11:08:12.747926 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.747914 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 11:08:12.748050 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.748034 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal" Jul 16 11:08:12.748106 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.748063 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 11:08:12.748581 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.748565 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasSufficientMemory" Jul 16 11:08:12.748667 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.748594 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 11:08:12.748667 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.748610 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasSufficientPID" Jul 16 11:08:12.748667 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.748570 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasSufficientMemory" Jul 16 11:08:12.748771 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.748678 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 11:08:12.748771 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.748697 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasSufficientPID" Jul 16 11:08:12.750897 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.750880 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-2.ec2.internal" Jul 16 11:08:12.750959 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.750913 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 11:08:12.751039 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.751018 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2117623a2f66363e5ef1cf2e000664e9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal\" (UID: \"2117623a2f66363e5ef1cf2e000664e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal" Jul 16 11:08:12.751133 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.751051 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2117623a2f66363e5ef1cf2e000664e9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal\" (UID: \"2117623a2f66363e5ef1cf2e000664e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal" Jul 16 11:08:12.751133 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.751073 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2de947f41f16a38a13007d8ee00ccad0-config\") pod \"kube-apiserver-proxy-ip-10-0-139-2.ec2.internal\" (UID: \"2de947f41f16a38a13007d8ee00ccad0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-2.ec2.internal" Jul 16 11:08:12.751572 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.751556 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasSufficientMemory" Jul 16 11:08:12.751655 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.751581 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 11:08:12.751655 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.751590 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasSufficientPID" Jul 16 11:08:12.776186 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:12.776171 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-2.ec2.internal\" not found" node="ip-10-0-139-2.ec2.internal" Jul 16 11:08:12.780337 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:12.780312 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-2.ec2.internal\" not found" node="ip-10-0-139-2.ec2.internal" Jul 16 11:08:12.848150 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:12.848131 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-2.ec2.internal\" not found" Jul 16 11:08:12.851387 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.851371 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2117623a2f66363e5ef1cf2e000664e9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal\" (UID: \"2117623a2f66363e5ef1cf2e000664e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal" Jul 16 11:08:12.851458 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.851393 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2de947f41f16a38a13007d8ee00ccad0-config\") pod \"kube-apiserver-proxy-ip-10-0-139-2.ec2.internal\" (UID: \"2de947f41f16a38a13007d8ee00ccad0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-2.ec2.internal" Jul 16 11:08:12.851458 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.851410 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2117623a2f66363e5ef1cf2e000664e9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal\" (UID: \"2117623a2f66363e5ef1cf2e000664e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal" Jul 16 11:08:12.851458 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.851443 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2117623a2f66363e5ef1cf2e000664e9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal\" (UID: \"2117623a2f66363e5ef1cf2e000664e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal" Jul 16 11:08:12.851589 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.851472 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2117623a2f66363e5ef1cf2e000664e9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal\" (UID: \"2117623a2f66363e5ef1cf2e000664e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal" Jul 16 11:08:12.851589 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:12.851511 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2de947f41f16a38a13007d8ee00ccad0-config\") pod \"kube-apiserver-proxy-ip-10-0-139-2.ec2.internal\" (UID: \"2de947f41f16a38a13007d8ee00ccad0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-2.ec2.internal" Jul 16 11:08:12.948573 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:12.948544 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-2.ec2.internal\" not found" Jul 16 11:08:13.049371 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:13.049194 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-2.ec2.internal\" not found" Jul 16 11:08:13.078587 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:13.078570 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal" Jul 16 11:08:13.083905 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:13.083437 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-2.ec2.internal" Jul 16 11:08:13.149511 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:13.149491 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-2.ec2.internal\" not found" Jul 16 11:08:13.249914 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:13.249889 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-2.ec2.internal\" not found" Jul 16 11:08:13.350402 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:13.350334 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-2.ec2.internal\" not found" Jul 16 11:08:13.450760 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:13.450730 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-2.ec2.internal\" not found" Jul 16 11:08:13.495085 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:13.495052 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 16 11:08:13.495533 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:13.495221 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 11:08:13.550999 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:13.550975 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-2.ec2.internal\" not found" Jul 16 11:08:13.585779 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:13.585741 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 11:03:12 +0000 UTC" deadline="2028-03-12 06:05:06.602375919 +0000 UTC" Jul 16 11:08:13.585779 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:13.585780 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14514h56m53.016602261s" Jul 16 11:08:13.596887 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:13.596867 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 11:08:13.598153 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:13.598138 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasSufficientMemory" Jul 16 11:08:13.598218 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:13.598170 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 11:08:13.598218 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:13.598183 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeHasSufficientPID" Jul 16 11:08:13.614817 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:13.614801 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 11:08:13.631618 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:13.631594 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 11:08:13.651510 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:13.651492 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-2.ec2.internal\" not found" Jul 16 11:08:13.722334 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:13.722309 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2117623a2f66363e5ef1cf2e000664e9.slice/crio-614baa1b7a30e2f505617d0720487d0dcb0b14809d6b3b321c1859e71f7dc2a7 WatchSource:0}: Error finding container 614baa1b7a30e2f505617d0720487d0dcb0b14809d6b3b321c1859e71f7dc2a7: Status 404 returned error can't find the container with id 614baa1b7a30e2f505617d0720487d0dcb0b14809d6b3b321c1859e71f7dc2a7 Jul 16 11:08:13.724579 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:13.724557 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2de947f41f16a38a13007d8ee00ccad0.slice/crio-74a6ed38fad28ebe4168865a04035120fb2b04a55a6b229e09c833eb59f33bb8 WatchSource:0}: Error finding container 74a6ed38fad28ebe4168865a04035120fb2b04a55a6b229e09c833eb59f33bb8: Status 404 returned error can't find the container with id 74a6ed38fad28ebe4168865a04035120fb2b04a55a6b229e09c833eb59f33bb8 Jul 16 11:08:13.727800 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:13.727786 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 11:08:13.749973 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:13.749952 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 11:08:13.750939 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:13.750926 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal" Jul 16 11:08:13.762859 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:13.762843 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 11:08:13.763627 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:13.763615 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-2.ec2.internal" Jul 16 11:08:13.769485 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:13.769467 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 11:08:14.532888 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.532860 2559 apiserver.go:52] "Watching apiserver" Jul 16 11:08:14.538605 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.538577 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 16 11:08:14.539551 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.539519 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-xcw4r","openshift-network-operator/iptables-alerter-f27nt","openshift-ovn-kubernetes/ovnkube-node-jdfpt","kube-system/global-pull-secret-syncer-krgqh","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fs7g","openshift-cluster-node-tuning-operator/tuned-5zgqb","openshift-dns/node-resolver-czbrz","openshift-image-registry/node-ca-tds89","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal","openshift-multus/network-metrics-daemon-vdpj9","kube-system/konnectivity-agent-xvstb","kube-system/kube-apiserver-proxy-ip-10-0-139-2.ec2.internal","openshift-multus/multus-additional-cni-plugins-8g6m2","openshift-multus/multus-jq7z4"] Jul 16 11:08:14.542382 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.542351 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdpj9" Jul 16 11:08:14.542475 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:14.542439 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdpj9" podUID="3934cfdb-5ad2-4c13-8649-8a06c0c0e504" Jul 16 11:08:14.544502 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.544482 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f27nt" Jul 16 11:08:14.546423 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.546398 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pkpwc\"" Jul 16 11:08:14.546523 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.546449 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 16 11:08:14.547096 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.546757 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 16 11:08:14.547096 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.546758 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 16 11:08:14.547422 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.547394 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.550078 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.549308 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mdkpw\"" Jul 16 11:08:14.550078 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.549448 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 16 11:08:14.550078 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.549669 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 16 11:08:14.550078 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.549760 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 16 11:08:14.550078 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.549764 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 16 11:08:14.550078 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.549854 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 16 11:08:14.550078 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.549993 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcw4r" Jul 16 11:08:14.550078 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:14.550059 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcw4r" podUID="148edf32-8cc4-4684-b3a7-063d497b0a53" Jul 16 11:08:14.550561 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.550143 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 16 11:08:14.550561 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.550244 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 16 11:08:14.552273 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.552254 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fs7g" Jul 16 11:08:14.555587 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.554276 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kxxcz\"" Jul 16 11:08:14.555587 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.555401 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 16 11:08:14.555587 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.555521 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 16 11:08:14.555942 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.555707 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 16 11:08:14.556811 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.556257 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.558303 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.558284 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 16 11:08:14.558391 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.558351 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-p2hxt\"" Jul 16 11:08:14.558469 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.558405 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 16 11:08:14.559270 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.559236 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf497\" (UniqueName: \"kubernetes.io/projected/5b54a94d-9649-41e3-960d-a9e1b848a519-kube-api-access-qf497\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.559357 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.559297 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3edabd60-32ec-4c7e-9d42-add8aa605248-etc-selinux\") pod \"aws-ebs-csi-driver-node-4fs7g\" (UID: \"3edabd60-32ec-4c7e-9d42-add8aa605248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fs7g" Jul 16 11:08:14.559357 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.559323 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/abb9ec8c-7e56-4b55-ac40-c8743f6316d8-host-slash\") pod \"iptables-alerter-f27nt\" (UID: \"abb9ec8c-7e56-4b55-ac40-c8743f6316d8\") " pod="openshift-network-operator/iptables-alerter-f27nt" Jul 16 11:08:14.559357 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.559346 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-host-run-netns\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.559508 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.559401 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-etc-openvswitch\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.559508 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.559457 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-host-cni-bin\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.559508 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.559483 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sf8t\" (UniqueName: \"kubernetes.io/projected/abb9ec8c-7e56-4b55-ac40-c8743f6316d8-kube-api-access-5sf8t\") pod \"iptables-alerter-f27nt\" (UID: \"abb9ec8c-7e56-4b55-ac40-c8743f6316d8\") " pod="openshift-network-operator/iptables-alerter-f27nt" Jul 16 11:08:14.559679 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.559508 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-systemd-units\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.559679 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.559531 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-var-lib-openvswitch\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.559679 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.559554 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-host-cni-netd\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.559679 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.559576 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rznn\" (UniqueName: \"kubernetes.io/projected/148edf32-8cc4-4684-b3a7-063d497b0a53-kube-api-access-4rznn\") pod \"network-check-target-xcw4r\" (UID: \"148edf32-8cc4-4684-b3a7-063d497b0a53\") " pod="openshift-network-diagnostics/network-check-target-xcw4r" Jul 16 11:08:14.559679 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.559616 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3edabd60-32ec-4c7e-9d42-add8aa605248-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4fs7g\" (UID: \"3edabd60-32ec-4c7e-9d42-add8aa605248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fs7g" Jul 16 11:08:14.559679 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.559664 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3edabd60-32ec-4c7e-9d42-add8aa605248-registration-dir\") pod \"aws-ebs-csi-driver-node-4fs7g\" (UID: \"3edabd60-32ec-4c7e-9d42-add8aa605248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fs7g" Jul 16 11:08:14.559989 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.559692 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3edabd60-32ec-4c7e-9d42-add8aa605248-device-dir\") pod \"aws-ebs-csi-driver-node-4fs7g\" (UID: \"3edabd60-32ec-4c7e-9d42-add8aa605248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fs7g" Jul 16 11:08:14.559989 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.559716 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.559989 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.559751 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3934cfdb-5ad2-4c13-8649-8a06c0c0e504-metrics-certs\") pod \"network-metrics-daemon-vdpj9\" (UID: \"3934cfdb-5ad2-4c13-8649-8a06c0c0e504\") " pod="openshift-multus/network-metrics-daemon-vdpj9" Jul 16 11:08:14.559989 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.559784 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/abb9ec8c-7e56-4b55-ac40-c8743f6316d8-iptables-alerter-script\") pod \"iptables-alerter-f27nt\" (UID: \"abb9ec8c-7e56-4b55-ac40-c8743f6316d8\") " pod="openshift-network-operator/iptables-alerter-f27nt" Jul 16 11:08:14.559989 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.559807 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-run-systemd\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.559989 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.559830 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-run-openvswitch\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.559989 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.559864 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-node-log\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.559989 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.559900 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3edabd60-32ec-4c7e-9d42-add8aa605248-socket-dir\") pod \"aws-ebs-csi-driver-node-4fs7g\" (UID: \"3edabd60-32ec-4c7e-9d42-add8aa605248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fs7g" Jul 16 11:08:14.559989 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.559960 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-host-slash\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.560392 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.559992 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5b54a94d-9649-41e3-960d-a9e1b848a519-ovnkube-script-lib\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.560392 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.560013 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-log-socket\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.560392 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.560041 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wdfm\" (UniqueName: \"kubernetes.io/projected/3edabd60-32ec-4c7e-9d42-add8aa605248-kube-api-access-6wdfm\") pod \"aws-ebs-csi-driver-node-4fs7g\" (UID: \"3edabd60-32ec-4c7e-9d42-add8aa605248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fs7g" Jul 16 11:08:14.560392 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.560058 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krgqh" Jul 16 11:08:14.560392 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.560070 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5b54a94d-9649-41e3-960d-a9e1b848a519-ovnkube-config\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.560392 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:14.560113 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krgqh" podUID="6355a8cf-05e9-476a-9fbb-ee2612316853" Jul 16 11:08:14.560392 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.560111 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b54a94d-9649-41e3-960d-a9e1b848a519-ovn-node-metrics-cert\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.560392 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.560154 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3edabd60-32ec-4c7e-9d42-add8aa605248-sys-fs\") pod \"aws-ebs-csi-driver-node-4fs7g\" (UID: \"3edabd60-32ec-4c7e-9d42-add8aa605248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fs7g" Jul 16 11:08:14.560392 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.560186 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfkxw\" (UniqueName: \"kubernetes.io/projected/3934cfdb-5ad2-4c13-8649-8a06c0c0e504-kube-api-access-rfkxw\") pod \"network-metrics-daemon-vdpj9\" (UID: \"3934cfdb-5ad2-4c13-8649-8a06c0c0e504\") " pod="openshift-multus/network-metrics-daemon-vdpj9" Jul 16 11:08:14.560392 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.560210 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-host-kubelet\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.560392 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.560243 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-run-ovn\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.560392 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.560268 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-host-run-ovn-kubernetes\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.560392 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.560296 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5b54a94d-9649-41e3-960d-a9e1b848a519-env-overrides\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.562530 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.562508 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tds89" Jul 16 11:08:14.564949 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.564936 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 16 11:08:14.566090 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.565392 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-czbrz" Jul 16 11:08:14.566090 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.565812 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 16 11:08:14.566090 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.565929 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-f2ddm\"" Jul 16 11:08:14.566090 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.565980 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 11:08:14.566765 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.566053 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 16 11:08:14.567388 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.567145 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 16 11:08:14.567476 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.567398 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-szdqr\"" Jul 16 11:08:14.567731 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.567606 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 16 11:08:14.568499 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.568481 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xvstb" Jul 16 11:08:14.570727 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.570708 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 16 11:08:14.570853 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.570724 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 16 11:08:14.570948 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.570932 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jxmcr\"" Jul 16 11:08:14.571131 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.571109 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8g6m2" Jul 16 11:08:14.572889 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.572869 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.572991 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.572973 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m6rlw\"" Jul 16 11:08:14.573204 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.573184 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 16 11:08:14.573410 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.573393 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 16 11:08:14.573503 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.573488 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 16 11:08:14.573740 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.573579 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 16 11:08:14.573916 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.573902 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 16 11:08:14.574824 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.574809 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 16 11:08:14.575188 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.575172 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fvlq9\"" Jul 16 11:08:14.576385 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.576364 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 11:08:14.584704 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.584687 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lnq44" Jul 16 11:08:14.592751 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.592705 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lnq44" Jul 16 11:08:14.649330 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.649289 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal" event={"ID":"2117623a2f66363e5ef1cf2e000664e9","Type":"ContainerStarted","Data":"614baa1b7a30e2f505617d0720487d0dcb0b14809d6b3b321c1859e71f7dc2a7"} Jul 16 11:08:14.650879 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.650851 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-2.ec2.internal" event={"ID":"2de947f41f16a38a13007d8ee00ccad0","Type":"ContainerStarted","Data":"74a6ed38fad28ebe4168865a04035120fb2b04a55a6b229e09c833eb59f33bb8"} Jul 16 11:08:14.651682 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.651652 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 16 11:08:14.660935 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.660748 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b50845d1-6a5b-402f-a515-193795eed10a-etc-sysconfig\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.660935 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.660783 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ssqn\" (UniqueName: \"kubernetes.io/projected/3e746f24-46d2-45b8-8849-fe3581b88b89-kube-api-access-8ssqn\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.660935 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.660808 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4c1563e-b235-48ed-9aef-75e88f6b4b34-system-cni-dir\") pod \"multus-additional-cni-plugins-8g6m2\" (UID: \"a4c1563e-b235-48ed-9aef-75e88f6b4b34\") " pod="openshift-multus/multus-additional-cni-plugins-8g6m2" Jul 16 11:08:14.660935 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.660840 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5b54a94d-9649-41e3-960d-a9e1b848a519-ovnkube-config\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.660935 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.660898 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3edabd60-32ec-4c7e-9d42-add8aa605248-sys-fs\") pod \"aws-ebs-csi-driver-node-4fs7g\" (UID: \"3edabd60-32ec-4c7e-9d42-add8aa605248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fs7g" Jul 16 11:08:14.661232 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.660996 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/443181d2-b76d-4141-8165-b658caa2328a-agent-certs\") pod \"konnectivity-agent-xvstb\" (UID: \"443181d2-b76d-4141-8165-b658caa2328a\") " pod="kube-system/konnectivity-agent-xvstb" Jul 16 11:08:14.661232 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661006 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3edabd60-32ec-4c7e-9d42-add8aa605248-sys-fs\") pod \"aws-ebs-csi-driver-node-4fs7g\" (UID: \"3edabd60-32ec-4c7e-9d42-add8aa605248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fs7g" Jul 16 11:08:14.661232 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661038 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3e746f24-46d2-45b8-8849-fe3581b88b89-cni-binary-copy\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.661232 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661062 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7444f424-775b-4cb1-b13a-eeb72471a42a-tmp-dir\") pod \"node-resolver-czbrz\" (UID: \"7444f424-775b-4cb1-b13a-eeb72471a42a\") " pod="openshift-dns/node-resolver-czbrz" Jul 16 11:08:14.661232 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661087 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqbch\" (UniqueName: \"kubernetes.io/projected/7444f424-775b-4cb1-b13a-eeb72471a42a-kube-api-access-xqbch\") pod \"node-resolver-czbrz\" (UID: \"7444f424-775b-4cb1-b13a-eeb72471a42a\") " pod="openshift-dns/node-resolver-czbrz" Jul 16 11:08:14.661232 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661115 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-host-kubelet\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.661232 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661138 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5b54a94d-9649-41e3-960d-a9e1b848a519-env-overrides\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.661232 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661161 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-etc-kubernetes\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.661232 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661184 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4c1563e-b235-48ed-9aef-75e88f6b4b34-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8g6m2\" (UID: \"a4c1563e-b235-48ed-9aef-75e88f6b4b34\") " pod="openshift-multus/multus-additional-cni-plugins-8g6m2" Jul 16 11:08:14.661232 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661207 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-host-run-netns\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.661232 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661223 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-host-kubelet\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.661777 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661231 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-etc-openvswitch\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.661777 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661291 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-host-run-netns\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.661777 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661289 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-host-var-lib-cni-bin\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.661777 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661323 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-var-lib-openvswitch\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.661777 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661339 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rznn\" (UniqueName: \"kubernetes.io/projected/148edf32-8cc4-4684-b3a7-063d497b0a53-kube-api-access-4rznn\") pod \"network-check-target-xcw4r\" (UID: \"148edf32-8cc4-4684-b3a7-063d497b0a53\") " pod="openshift-network-diagnostics/network-check-target-xcw4r" Jul 16 11:08:14.661777 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661359 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3edabd60-32ec-4c7e-9d42-add8aa605248-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4fs7g\" (UID: \"3edabd60-32ec-4c7e-9d42-add8aa605248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fs7g" Jul 16 11:08:14.661777 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661384 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3edabd60-32ec-4c7e-9d42-add8aa605248-registration-dir\") pod \"aws-ebs-csi-driver-node-4fs7g\" (UID: \"3edabd60-32ec-4c7e-9d42-add8aa605248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fs7g" Jul 16 11:08:14.661777 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661389 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-etc-openvswitch\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.661777 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661406 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3edabd60-32ec-4c7e-9d42-add8aa605248-device-dir\") pod \"aws-ebs-csi-driver-node-4fs7g\" (UID: \"3edabd60-32ec-4c7e-9d42-add8aa605248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fs7g" Jul 16 11:08:14.661777 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661407 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5b54a94d-9649-41e3-960d-a9e1b848a519-ovnkube-config\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.661777 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661406 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-var-lib-openvswitch\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.661777 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661435 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2080a1e9-bedc-4011-803a-6fda7f7e39e0-host\") pod \"node-ca-tds89\" (UID: \"2080a1e9-bedc-4011-803a-6fda7f7e39e0\") " pod="openshift-image-registry/node-ca-tds89" Jul 16 11:08:14.661777 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661469 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3edabd60-32ec-4c7e-9d42-add8aa605248-device-dir\") pod \"aws-ebs-csi-driver-node-4fs7g\" (UID: \"3edabd60-32ec-4c7e-9d42-add8aa605248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fs7g" Jul 16 11:08:14.661777 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661481 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3edabd60-32ec-4c7e-9d42-add8aa605248-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4fs7g\" (UID: \"3edabd60-32ec-4c7e-9d42-add8aa605248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fs7g" Jul 16 11:08:14.661777 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661463 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a4c1563e-b235-48ed-9aef-75e88f6b4b34-os-release\") pod \"multus-additional-cni-plugins-8g6m2\" (UID: \"a4c1563e-b235-48ed-9aef-75e88f6b4b34\") " pod="openshift-multus/multus-additional-cni-plugins-8g6m2" Jul 16 11:08:14.661777 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661521 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-cnibin\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.661777 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661523 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3edabd60-32ec-4c7e-9d42-add8aa605248-registration-dir\") pod \"aws-ebs-csi-driver-node-4fs7g\" (UID: \"3edabd60-32ec-4c7e-9d42-add8aa605248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fs7g" Jul 16 11:08:14.662620 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661547 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4c1563e-b235-48ed-9aef-75e88f6b4b34-cnibin\") pod \"multus-additional-cni-plugins-8g6m2\" (UID: \"a4c1563e-b235-48ed-9aef-75e88f6b4b34\") " pod="openshift-multus/multus-additional-cni-plugins-8g6m2" Jul 16 11:08:14.662620 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661573 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8z2q\" (UniqueName: \"kubernetes.io/projected/a4c1563e-b235-48ed-9aef-75e88f6b4b34-kube-api-access-t8z2q\") pod \"multus-additional-cni-plugins-8g6m2\" (UID: \"a4c1563e-b235-48ed-9aef-75e88f6b4b34\") " pod="openshift-multus/multus-additional-cni-plugins-8g6m2" Jul 16 11:08:14.662620 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661587 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5b54a94d-9649-41e3-960d-a9e1b848a519-env-overrides\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.662620 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661607 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/abb9ec8c-7e56-4b55-ac40-c8743f6316d8-iptables-alerter-script\") pod \"iptables-alerter-f27nt\" (UID: \"abb9ec8c-7e56-4b55-ac40-c8743f6316d8\") " pod="openshift-network-operator/iptables-alerter-f27nt" Jul 16 11:08:14.662620 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661674 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-run-openvswitch\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.662620 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661703 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b50845d1-6a5b-402f-a515-193795eed10a-sys\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.662620 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661757 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5vkk\" (UniqueName: \"kubernetes.io/projected/b50845d1-6a5b-402f-a515-193795eed10a-kube-api-access-z5vkk\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.662620 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661781 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-run-openvswitch\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.662620 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661783 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/443181d2-b76d-4141-8165-b658caa2328a-konnectivity-ca\") pod \"konnectivity-agent-xvstb\" (UID: \"443181d2-b76d-4141-8165-b658caa2328a\") " pod="kube-system/konnectivity-agent-xvstb" Jul 16 11:08:14.662620 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661833 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-multus-conf-dir\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.662620 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661863 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2080a1e9-bedc-4011-803a-6fda7f7e39e0-serviceca\") pod \"node-ca-tds89\" (UID: \"2080a1e9-bedc-4011-803a-6fda7f7e39e0\") " pod="openshift-image-registry/node-ca-tds89" Jul 16 11:08:14.662620 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661897 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmpb9\" (UniqueName: \"kubernetes.io/projected/2080a1e9-bedc-4011-803a-6fda7f7e39e0-kube-api-access-qmpb9\") pod \"node-ca-tds89\" (UID: \"2080a1e9-bedc-4011-803a-6fda7f7e39e0\") " pod="openshift-image-registry/node-ca-tds89" Jul 16 11:08:14.662620 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661931 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b50845d1-6a5b-402f-a515-193795eed10a-etc-modprobe-d\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.662620 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661957 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b50845d1-6a5b-402f-a515-193795eed10a-etc-kubernetes\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.662620 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.661983 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b50845d1-6a5b-402f-a515-193795eed10a-etc-tuned\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.662620 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662006 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-host-run-k8s-cni-cncf-io\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.662620 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662028 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-host-run-netns\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.663461 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662049 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-host-run-multus-certs\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.663461 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662089 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-log-socket\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.663461 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662105 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/abb9ec8c-7e56-4b55-ac40-c8743f6316d8-iptables-alerter-script\") pod \"iptables-alerter-f27nt\" (UID: \"abb9ec8c-7e56-4b55-ac40-c8743f6316d8\") " pod="openshift-network-operator/iptables-alerter-f27nt" Jul 16 11:08:14.663461 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662115 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wdfm\" (UniqueName: \"kubernetes.io/projected/3edabd60-32ec-4c7e-9d42-add8aa605248-kube-api-access-6wdfm\") pod \"aws-ebs-csi-driver-node-4fs7g\" (UID: \"3edabd60-32ec-4c7e-9d42-add8aa605248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fs7g" Jul 16 11:08:14.663461 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662139 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b50845d1-6a5b-402f-a515-193795eed10a-lib-modules\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.663461 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662161 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b50845d1-6a5b-402f-a515-193795eed10a-tmp\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.663461 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662210 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-log-socket\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.663461 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662246 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-host-var-lib-kubelet\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.663461 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662283 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3e746f24-46d2-45b8-8849-fe3581b88b89-multus-daemon-config\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.663461 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662310 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b54a94d-9649-41e3-960d-a9e1b848a519-ovn-node-metrics-cert\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.663461 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662332 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-system-cni-dir\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.663461 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662355 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4c1563e-b235-48ed-9aef-75e88f6b4b34-cni-binary-copy\") pod \"multus-additional-cni-plugins-8g6m2\" (UID: \"a4c1563e-b235-48ed-9aef-75e88f6b4b34\") " pod="openshift-multus/multus-additional-cni-plugins-8g6m2" Jul 16 11:08:14.663461 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662378 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfkxw\" (UniqueName: \"kubernetes.io/projected/3934cfdb-5ad2-4c13-8649-8a06c0c0e504-kube-api-access-rfkxw\") pod \"network-metrics-daemon-vdpj9\" (UID: \"3934cfdb-5ad2-4c13-8649-8a06c0c0e504\") " pod="openshift-multus/network-metrics-daemon-vdpj9" Jul 16 11:08:14.663461 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662412 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-run-ovn\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.663461 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662474 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-host-run-ovn-kubernetes\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.663461 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662501 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf497\" (UniqueName: \"kubernetes.io/projected/5b54a94d-9649-41e3-960d-a9e1b848a519-kube-api-access-qf497\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.663461 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662526 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3edabd60-32ec-4c7e-9d42-add8aa605248-etc-selinux\") pod \"aws-ebs-csi-driver-node-4fs7g\" (UID: \"3edabd60-32ec-4c7e-9d42-add8aa605248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fs7g" Jul 16 11:08:14.664321 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662566 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-multus-socket-dir-parent\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.664321 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662572 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-host-run-ovn-kubernetes\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.664321 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662593 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/abb9ec8c-7e56-4b55-ac40-c8743f6316d8-host-slash\") pod \"iptables-alerter-f27nt\" (UID: \"abb9ec8c-7e56-4b55-ac40-c8743f6316d8\") " pod="openshift-network-operator/iptables-alerter-f27nt" Jul 16 11:08:14.664321 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662613 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-run-ovn\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.664321 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662644 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-host-cni-bin\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.664321 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662685 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 16 11:08:14.664321 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662708 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/abb9ec8c-7e56-4b55-ac40-c8743f6316d8-host-slash\") pod \"iptables-alerter-f27nt\" (UID: \"abb9ec8c-7e56-4b55-ac40-c8743f6316d8\") " pod="openshift-network-operator/iptables-alerter-f27nt" Jul 16 11:08:14.664321 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662710 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a4c1563e-b235-48ed-9aef-75e88f6b4b34-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8g6m2\" (UID: \"a4c1563e-b235-48ed-9aef-75e88f6b4b34\") " pod="openshift-multus/multus-additional-cni-plugins-8g6m2" Jul 16 11:08:14.664321 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662750 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sf8t\" (UniqueName: \"kubernetes.io/projected/abb9ec8c-7e56-4b55-ac40-c8743f6316d8-kube-api-access-5sf8t\") pod \"iptables-alerter-f27nt\" (UID: \"abb9ec8c-7e56-4b55-ac40-c8743f6316d8\") " pod="openshift-network-operator/iptables-alerter-f27nt" Jul 16 11:08:14.664321 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662769 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-systemd-units\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.664321 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662787 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-host-cni-netd\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.664321 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662809 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b50845d1-6a5b-402f-a515-193795eed10a-etc-sysctl-d\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.664321 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662829 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3edabd60-32ec-4c7e-9d42-add8aa605248-etc-selinux\") pod \"aws-ebs-csi-driver-node-4fs7g\" (UID: \"3edabd60-32ec-4c7e-9d42-add8aa605248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fs7g" Jul 16 11:08:14.664321 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662830 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b50845d1-6a5b-402f-a515-193795eed10a-var-lib-kubelet\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.664321 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662870 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6355a8cf-05e9-476a-9fbb-ee2612316853-kubelet-config\") pod \"global-pull-secret-syncer-krgqh\" (UID: \"6355a8cf-05e9-476a-9fbb-ee2612316853\") " pod="kube-system/global-pull-secret-syncer-krgqh" Jul 16 11:08:14.664321 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662885 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-systemd-units\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.664321 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662894 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-os-release\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.665102 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662924 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-host-var-lib-cni-multus\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.665102 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662951 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.665102 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662976 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6355a8cf-05e9-476a-9fbb-ee2612316853-original-pull-secret\") pod \"global-pull-secret-syncer-krgqh\" (UID: \"6355a8cf-05e9-476a-9fbb-ee2612316853\") " pod="kube-system/global-pull-secret-syncer-krgqh" Jul 16 11:08:14.665102 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.663007 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-multus-cni-dir\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.665102 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.663027 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-host-cni-netd\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.665102 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.663068 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-hostroot\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.665102 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.663089 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.665102 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.663094 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7444f424-775b-4cb1-b13a-eeb72471a42a-hosts-file\") pod \"node-resolver-czbrz\" (UID: \"7444f424-775b-4cb1-b13a-eeb72471a42a\") " pod="openshift-dns/node-resolver-czbrz" Jul 16 11:08:14.665102 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.662692 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-host-cni-bin\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.665102 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.663124 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a4c1563e-b235-48ed-9aef-75e88f6b4b34-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8g6m2\" (UID: \"a4c1563e-b235-48ed-9aef-75e88f6b4b34\") " pod="openshift-multus/multus-additional-cni-plugins-8g6m2" Jul 16 11:08:14.665102 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.663152 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3934cfdb-5ad2-4c13-8649-8a06c0c0e504-metrics-certs\") pod \"network-metrics-daemon-vdpj9\" (UID: \"3934cfdb-5ad2-4c13-8649-8a06c0c0e504\") " pod="openshift-multus/network-metrics-daemon-vdpj9" Jul 16 11:08:14.665102 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.663175 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-run-systemd\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.665102 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.663213 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-run-systemd\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.665102 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:14.663244 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 11:08:14.665102 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:14.663325 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3934cfdb-5ad2-4c13-8649-8a06c0c0e504-metrics-certs podName:3934cfdb-5ad2-4c13-8649-8a06c0c0e504 nodeName:}" failed. No retries permitted until 2026-07-16 11:08:15.163303574 +0000 UTC m=+2.915561361 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3934cfdb-5ad2-4c13-8649-8a06c0c0e504-metrics-certs") pod "network-metrics-daemon-vdpj9" (UID: "3934cfdb-5ad2-4c13-8649-8a06c0c0e504") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 11:08:14.665102 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.663310 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-node-log\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.665102 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.663356 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3edabd60-32ec-4c7e-9d42-add8aa605248-socket-dir\") pod \"aws-ebs-csi-driver-node-4fs7g\" (UID: \"3edabd60-32ec-4c7e-9d42-add8aa605248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fs7g" Jul 16 11:08:14.665938 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.663359 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-node-log\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.665938 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.663380 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b50845d1-6a5b-402f-a515-193795eed10a-etc-sysctl-conf\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.665938 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.663402 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b50845d1-6a5b-402f-a515-193795eed10a-etc-systemd\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.665938 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.663423 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-host-slash\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.665938 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.663446 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5b54a94d-9649-41e3-960d-a9e1b848a519-ovnkube-script-lib\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.665938 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.663467 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b50845d1-6a5b-402f-a515-193795eed10a-run\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.665938 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.663488 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b50845d1-6a5b-402f-a515-193795eed10a-host\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.665938 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.663517 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3edabd60-32ec-4c7e-9d42-add8aa605248-socket-dir\") pod \"aws-ebs-csi-driver-node-4fs7g\" (UID: \"3edabd60-32ec-4c7e-9d42-add8aa605248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fs7g" Jul 16 11:08:14.665938 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.663520 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6355a8cf-05e9-476a-9fbb-ee2612316853-dbus\") pod \"global-pull-secret-syncer-krgqh\" (UID: \"6355a8cf-05e9-476a-9fbb-ee2612316853\") " pod="kube-system/global-pull-secret-syncer-krgqh" Jul 16 11:08:14.665938 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.663568 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b54a94d-9649-41e3-960d-a9e1b848a519-host-slash\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.665938 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.664041 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5b54a94d-9649-41e3-960d-a9e1b848a519-ovnkube-script-lib\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.667563 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.667510 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b54a94d-9649-41e3-960d-a9e1b848a519-ovn-node-metrics-cert\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.673872 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:14.673851 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 11:08:14.673872 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:14.673875 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 11:08:14.673997 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:14.673888 2559 projected.go:196] Error preparing data for projected volume kube-api-access-4rznn for pod openshift-network-diagnostics/network-check-target-xcw4r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 11:08:14.673997 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:14.673937 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/148edf32-8cc4-4684-b3a7-063d497b0a53-kube-api-access-4rznn podName:148edf32-8cc4-4684-b3a7-063d497b0a53 nodeName:}" failed. No retries permitted until 2026-07-16 11:08:15.17392164 +0000 UTC m=+2.926179416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4rznn" (UniqueName: "kubernetes.io/projected/148edf32-8cc4-4684-b3a7-063d497b0a53-kube-api-access-4rznn") pod "network-check-target-xcw4r" (UID: "148edf32-8cc4-4684-b3a7-063d497b0a53") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 11:08:14.677715 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.677599 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf497\" (UniqueName: \"kubernetes.io/projected/5b54a94d-9649-41e3-960d-a9e1b848a519-kube-api-access-qf497\") pod \"ovnkube-node-jdfpt\" (UID: \"5b54a94d-9649-41e3-960d-a9e1b848a519\") " pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.677715 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.677662 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfkxw\" (UniqueName: \"kubernetes.io/projected/3934cfdb-5ad2-4c13-8649-8a06c0c0e504-kube-api-access-rfkxw\") pod \"network-metrics-daemon-vdpj9\" (UID: \"3934cfdb-5ad2-4c13-8649-8a06c0c0e504\") " pod="openshift-multus/network-metrics-daemon-vdpj9" Jul 16 11:08:14.678555 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.678514 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sf8t\" (UniqueName: \"kubernetes.io/projected/abb9ec8c-7e56-4b55-ac40-c8743f6316d8-kube-api-access-5sf8t\") pod \"iptables-alerter-f27nt\" (UID: \"abb9ec8c-7e56-4b55-ac40-c8743f6316d8\") " pod="openshift-network-operator/iptables-alerter-f27nt" Jul 16 11:08:14.679554 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.679532 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wdfm\" (UniqueName: \"kubernetes.io/projected/3edabd60-32ec-4c7e-9d42-add8aa605248-kube-api-access-6wdfm\") pod \"aws-ebs-csi-driver-node-4fs7g\" (UID: \"3edabd60-32ec-4c7e-9d42-add8aa605248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fs7g" Jul 16 11:08:14.764759 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.764733 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-hostroot\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.764879 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.764775 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7444f424-775b-4cb1-b13a-eeb72471a42a-hosts-file\") pod \"node-resolver-czbrz\" (UID: \"7444f424-775b-4cb1-b13a-eeb72471a42a\") " pod="openshift-dns/node-resolver-czbrz" Jul 16 11:08:14.764879 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.764797 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-hostroot\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.764879 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.764800 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a4c1563e-b235-48ed-9aef-75e88f6b4b34-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8g6m2\" (UID: \"a4c1563e-b235-48ed-9aef-75e88f6b4b34\") " pod="openshift-multus/multus-additional-cni-plugins-8g6m2" Jul 16 11:08:14.764879 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.764858 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7444f424-775b-4cb1-b13a-eeb72471a42a-hosts-file\") pod \"node-resolver-czbrz\" (UID: \"7444f424-775b-4cb1-b13a-eeb72471a42a\") " pod="openshift-dns/node-resolver-czbrz" Jul 16 11:08:14.764879 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.764872 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b50845d1-6a5b-402f-a515-193795eed10a-etc-sysctl-conf\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.765120 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.764945 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b50845d1-6a5b-402f-a515-193795eed10a-etc-systemd\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.765120 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.764985 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b50845d1-6a5b-402f-a515-193795eed10a-run\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.765120 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.764995 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b50845d1-6a5b-402f-a515-193795eed10a-etc-sysctl-conf\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.765120 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.765009 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b50845d1-6a5b-402f-a515-193795eed10a-host\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.765120 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.765031 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6355a8cf-05e9-476a-9fbb-ee2612316853-dbus\") pod \"global-pull-secret-syncer-krgqh\" (UID: \"6355a8cf-05e9-476a-9fbb-ee2612316853\") " pod="kube-system/global-pull-secret-syncer-krgqh" Jul 16 11:08:14.765120 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.765032 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b50845d1-6a5b-402f-a515-193795eed10a-etc-systemd\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.765120 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.765041 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b50845d1-6a5b-402f-a515-193795eed10a-run\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.765120 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.765072 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b50845d1-6a5b-402f-a515-193795eed10a-etc-sysconfig\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.765120 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.765099 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b50845d1-6a5b-402f-a515-193795eed10a-host\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.765574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.765139 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ssqn\" (UniqueName: \"kubernetes.io/projected/3e746f24-46d2-45b8-8849-fe3581b88b89-kube-api-access-8ssqn\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.765574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.765148 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6355a8cf-05e9-476a-9fbb-ee2612316853-dbus\") pod \"global-pull-secret-syncer-krgqh\" (UID: \"6355a8cf-05e9-476a-9fbb-ee2612316853\") " pod="kube-system/global-pull-secret-syncer-krgqh" Jul 16 11:08:14.765574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.765179 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4c1563e-b235-48ed-9aef-75e88f6b4b34-system-cni-dir\") pod \"multus-additional-cni-plugins-8g6m2\" (UID: \"a4c1563e-b235-48ed-9aef-75e88f6b4b34\") " pod="openshift-multus/multus-additional-cni-plugins-8g6m2" Jul 16 11:08:14.765574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.765189 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b50845d1-6a5b-402f-a515-193795eed10a-etc-sysconfig\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.765574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.765300 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/443181d2-b76d-4141-8165-b658caa2328a-agent-certs\") pod \"konnectivity-agent-xvstb\" (UID: \"443181d2-b76d-4141-8165-b658caa2328a\") " pod="kube-system/konnectivity-agent-xvstb" Jul 16 11:08:14.765574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.765327 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3e746f24-46d2-45b8-8849-fe3581b88b89-cni-binary-copy\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.765574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.765355 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7444f424-775b-4cb1-b13a-eeb72471a42a-tmp-dir\") pod \"node-resolver-czbrz\" (UID: \"7444f424-775b-4cb1-b13a-eeb72471a42a\") " pod="openshift-dns/node-resolver-czbrz" Jul 16 11:08:14.765574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.765342 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a4c1563e-b235-48ed-9aef-75e88f6b4b34-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8g6m2\" (UID: \"a4c1563e-b235-48ed-9aef-75e88f6b4b34\") " pod="openshift-multus/multus-additional-cni-plugins-8g6m2" Jul 16 11:08:14.765574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.765380 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqbch\" (UniqueName: \"kubernetes.io/projected/7444f424-775b-4cb1-b13a-eeb72471a42a-kube-api-access-xqbch\") pod \"node-resolver-czbrz\" (UID: \"7444f424-775b-4cb1-b13a-eeb72471a42a\") " pod="openshift-dns/node-resolver-czbrz" Jul 16 11:08:14.765574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.765408 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-etc-kubernetes\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.765574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.765432 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4c1563e-b235-48ed-9aef-75e88f6b4b34-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8g6m2\" (UID: \"a4c1563e-b235-48ed-9aef-75e88f6b4b34\") " pod="openshift-multus/multus-additional-cni-plugins-8g6m2" Jul 16 11:08:14.765574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.765457 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-host-var-lib-cni-bin\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.766210 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.766163 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2080a1e9-bedc-4011-803a-6fda7f7e39e0-host\") pod \"node-ca-tds89\" (UID: \"2080a1e9-bedc-4011-803a-6fda7f7e39e0\") " pod="openshift-image-registry/node-ca-tds89" Jul 16 11:08:14.766279 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.766220 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a4c1563e-b235-48ed-9aef-75e88f6b4b34-os-release\") pod \"multus-additional-cni-plugins-8g6m2\" (UID: \"a4c1563e-b235-48ed-9aef-75e88f6b4b34\") " pod="openshift-multus/multus-additional-cni-plugins-8g6m2" Jul 16 11:08:14.766279 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.766243 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-cnibin\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.766279 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.766262 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4c1563e-b235-48ed-9aef-75e88f6b4b34-cnibin\") pod \"multus-additional-cni-plugins-8g6m2\" (UID: \"a4c1563e-b235-48ed-9aef-75e88f6b4b34\") " pod="openshift-multus/multus-additional-cni-plugins-8g6m2" Jul 16 11:08:14.766424 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.766284 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8z2q\" (UniqueName: \"kubernetes.io/projected/a4c1563e-b235-48ed-9aef-75e88f6b4b34-kube-api-access-t8z2q\") pod \"multus-additional-cni-plugins-8g6m2\" (UID: \"a4c1563e-b235-48ed-9aef-75e88f6b4b34\") " pod="openshift-multus/multus-additional-cni-plugins-8g6m2" Jul 16 11:08:14.766424 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.766306 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b50845d1-6a5b-402f-a515-193795eed10a-sys\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.766424 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.766329 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5vkk\" (UniqueName: \"kubernetes.io/projected/b50845d1-6a5b-402f-a515-193795eed10a-kube-api-access-z5vkk\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.766424 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.766346 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/443181d2-b76d-4141-8165-b658caa2328a-konnectivity-ca\") pod \"konnectivity-agent-xvstb\" (UID: \"443181d2-b76d-4141-8165-b658caa2328a\") " pod="kube-system/konnectivity-agent-xvstb" Jul 16 11:08:14.766424 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.766380 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4c1563e-b235-48ed-9aef-75e88f6b4b34-system-cni-dir\") pod \"multus-additional-cni-plugins-8g6m2\" (UID: \"a4c1563e-b235-48ed-9aef-75e88f6b4b34\") " pod="openshift-multus/multus-additional-cni-plugins-8g6m2" Jul 16 11:08:14.766424 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.766387 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-multus-conf-dir\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.766778 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.766437 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-multus-conf-dir\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.766778 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.766456 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2080a1e9-bedc-4011-803a-6fda7f7e39e0-serviceca\") pod \"node-ca-tds89\" (UID: \"2080a1e9-bedc-4011-803a-6fda7f7e39e0\") " pod="openshift-image-registry/node-ca-tds89" Jul 16 11:08:14.766778 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.766529 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3e746f24-46d2-45b8-8849-fe3581b88b89-cni-binary-copy\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.766778 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.766602 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-cnibin\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.766778 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.766615 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-host-var-lib-cni-bin\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.766778 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.766616 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4c1563e-b235-48ed-9aef-75e88f6b4b34-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8g6m2\" (UID: \"a4c1563e-b235-48ed-9aef-75e88f6b4b34\") " pod="openshift-multus/multus-additional-cni-plugins-8g6m2" Jul 16 11:08:14.766778 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.766689 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4c1563e-b235-48ed-9aef-75e88f6b4b34-cnibin\") pod \"multus-additional-cni-plugins-8g6m2\" (UID: \"a4c1563e-b235-48ed-9aef-75e88f6b4b34\") " pod="openshift-multus/multus-additional-cni-plugins-8g6m2" Jul 16 11:08:14.766778 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.766756 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-etc-kubernetes\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.767141 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.766887 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2080a1e9-bedc-4011-803a-6fda7f7e39e0-serviceca\") pod \"node-ca-tds89\" (UID: \"2080a1e9-bedc-4011-803a-6fda7f7e39e0\") " pod="openshift-image-registry/node-ca-tds89" Jul 16 11:08:14.767141 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.766974 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b50845d1-6a5b-402f-a515-193795eed10a-sys\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.767141 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.767042 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a4c1563e-b235-48ed-9aef-75e88f6b4b34-os-release\") pod \"multus-additional-cni-plugins-8g6m2\" (UID: \"a4c1563e-b235-48ed-9aef-75e88f6b4b34\") " pod="openshift-multus/multus-additional-cni-plugins-8g6m2" Jul 16 11:08:14.767141 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.767043 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2080a1e9-bedc-4011-803a-6fda7f7e39e0-host\") pod \"node-ca-tds89\" (UID: \"2080a1e9-bedc-4011-803a-6fda7f7e39e0\") " pod="openshift-image-registry/node-ca-tds89" Jul 16 11:08:14.767141 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.767047 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmpb9\" (UniqueName: \"kubernetes.io/projected/2080a1e9-bedc-4011-803a-6fda7f7e39e0-kube-api-access-qmpb9\") pod \"node-ca-tds89\" (UID: \"2080a1e9-bedc-4011-803a-6fda7f7e39e0\") " pod="openshift-image-registry/node-ca-tds89" Jul 16 11:08:14.767141 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.767088 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b50845d1-6a5b-402f-a515-193795eed10a-etc-modprobe-d\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.767141 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.767118 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b50845d1-6a5b-402f-a515-193795eed10a-etc-kubernetes\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.767477 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.767243 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b50845d1-6a5b-402f-a515-193795eed10a-etc-modprobe-d\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.767477 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.767279 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b50845d1-6a5b-402f-a515-193795eed10a-etc-tuned\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.767477 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.767321 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7444f424-775b-4cb1-b13a-eeb72471a42a-tmp-dir\") pod \"node-resolver-czbrz\" (UID: \"7444f424-775b-4cb1-b13a-eeb72471a42a\") " pod="openshift-dns/node-resolver-czbrz" Jul 16 11:08:14.767477 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.767324 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-host-run-k8s-cni-cncf-io\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.767477 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.767394 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b50845d1-6a5b-402f-a515-193795eed10a-etc-kubernetes\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.767477 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.767395 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/443181d2-b76d-4141-8165-b658caa2328a-konnectivity-ca\") pod \"konnectivity-agent-xvstb\" (UID: \"443181d2-b76d-4141-8165-b658caa2328a\") " pod="kube-system/konnectivity-agent-xvstb" Jul 16 11:08:14.767477 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.767415 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-host-run-netns\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.767477 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.767449 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-host-run-multus-certs\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.767866 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.767490 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b50845d1-6a5b-402f-a515-193795eed10a-lib-modules\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.767866 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.767545 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b50845d1-6a5b-402f-a515-193795eed10a-tmp\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.767866 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.767549 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-host-run-netns\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.767866 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.767572 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-host-run-k8s-cni-cncf-io\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.767866 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.767594 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-host-var-lib-kubelet\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.767866 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.767644 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3e746f24-46d2-45b8-8849-fe3581b88b89-multus-daemon-config\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.767866 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.767695 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-system-cni-dir\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.767866 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.767703 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b50845d1-6a5b-402f-a515-193795eed10a-lib-modules\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.767866 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.767723 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4c1563e-b235-48ed-9aef-75e88f6b4b34-cni-binary-copy\") pod \"multus-additional-cni-plugins-8g6m2\" (UID: \"a4c1563e-b235-48ed-9aef-75e88f6b4b34\") " pod="openshift-multus/multus-additional-cni-plugins-8g6m2" Jul 16 11:08:14.767866 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.767769 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-multus-socket-dir-parent\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.767866 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.767817 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a4c1563e-b235-48ed-9aef-75e88f6b4b34-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8g6m2\" (UID: \"a4c1563e-b235-48ed-9aef-75e88f6b4b34\") " pod="openshift-multus/multus-additional-cni-plugins-8g6m2" Jul 16 11:08:14.767866 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.767860 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b50845d1-6a5b-402f-a515-193795eed10a-etc-sysctl-d\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.769132 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.767887 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b50845d1-6a5b-402f-a515-193795eed10a-var-lib-kubelet\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.769132 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.767918 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6355a8cf-05e9-476a-9fbb-ee2612316853-kubelet-config\") pod \"global-pull-secret-syncer-krgqh\" (UID: \"6355a8cf-05e9-476a-9fbb-ee2612316853\") " pod="kube-system/global-pull-secret-syncer-krgqh" Jul 16 11:08:14.769132 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.767957 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-os-release\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.769132 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.767990 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-host-var-lib-cni-multus\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.769132 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.768022 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6355a8cf-05e9-476a-9fbb-ee2612316853-original-pull-secret\") pod \"global-pull-secret-syncer-krgqh\" (UID: \"6355a8cf-05e9-476a-9fbb-ee2612316853\") " pod="kube-system/global-pull-secret-syncer-krgqh" Jul 16 11:08:14.769132 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.768047 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-multus-cni-dir\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.769132 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.768162 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-multus-cni-dir\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.769132 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.768211 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-host-var-lib-kubelet\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.769132 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.768258 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4c1563e-b235-48ed-9aef-75e88f6b4b34-cni-binary-copy\") pod \"multus-additional-cni-plugins-8g6m2\" (UID: \"a4c1563e-b235-48ed-9aef-75e88f6b4b34\") " pod="openshift-multus/multus-additional-cni-plugins-8g6m2" Jul 16 11:08:14.769132 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.768265 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-multus-socket-dir-parent\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.769132 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.768772 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3e746f24-46d2-45b8-8849-fe3581b88b89-multus-daemon-config\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.769132 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.768778 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a4c1563e-b235-48ed-9aef-75e88f6b4b34-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8g6m2\" (UID: \"a4c1563e-b235-48ed-9aef-75e88f6b4b34\") " pod="openshift-multus/multus-additional-cni-plugins-8g6m2" Jul 16 11:08:14.769132 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.768855 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-system-cni-dir\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.769132 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.768863 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b50845d1-6a5b-402f-a515-193795eed10a-var-lib-kubelet\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.769132 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.768779 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b50845d1-6a5b-402f-a515-193795eed10a-etc-sysctl-d\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.769132 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:14.768966 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 11:08:14.769132 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.768971 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-os-release\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.769930 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:14.769029 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6355a8cf-05e9-476a-9fbb-ee2612316853-original-pull-secret podName:6355a8cf-05e9-476a-9fbb-ee2612316853 nodeName:}" failed. No retries permitted until 2026-07-16 11:08:15.269012502 +0000 UTC m=+3.021270291 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6355a8cf-05e9-476a-9fbb-ee2612316853-original-pull-secret") pod "global-pull-secret-syncer-krgqh" (UID: "6355a8cf-05e9-476a-9fbb-ee2612316853") : object "kube-system"/"original-pull-secret" not registered Jul 16 11:08:14.769930 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.769036 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6355a8cf-05e9-476a-9fbb-ee2612316853-kubelet-config\") pod \"global-pull-secret-syncer-krgqh\" (UID: \"6355a8cf-05e9-476a-9fbb-ee2612316853\") " pod="kube-system/global-pull-secret-syncer-krgqh" Jul 16 11:08:14.769930 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.769165 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-host-var-lib-cni-multus\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.769930 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.769189 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3e746f24-46d2-45b8-8849-fe3581b88b89-host-run-multus-certs\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.769930 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.769875 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b50845d1-6a5b-402f-a515-193795eed10a-tmp\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.770738 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.770190 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/443181d2-b76d-4141-8165-b658caa2328a-agent-certs\") pod \"konnectivity-agent-xvstb\" (UID: \"443181d2-b76d-4141-8165-b658caa2328a\") " pod="kube-system/konnectivity-agent-xvstb" Jul 16 11:08:14.772258 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.772225 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b50845d1-6a5b-402f-a515-193795eed10a-etc-tuned\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.777472 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.777448 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ssqn\" (UniqueName: \"kubernetes.io/projected/3e746f24-46d2-45b8-8849-fe3581b88b89-kube-api-access-8ssqn\") pod \"multus-jq7z4\" (UID: \"3e746f24-46d2-45b8-8849-fe3581b88b89\") " pod="openshift-multus/multus-jq7z4" Jul 16 11:08:14.778945 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.778923 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5vkk\" (UniqueName: \"kubernetes.io/projected/b50845d1-6a5b-402f-a515-193795eed10a-kube-api-access-z5vkk\") pod \"tuned-5zgqb\" (UID: \"b50845d1-6a5b-402f-a515-193795eed10a\") " pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.779357 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.779304 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmpb9\" (UniqueName: \"kubernetes.io/projected/2080a1e9-bedc-4011-803a-6fda7f7e39e0-kube-api-access-qmpb9\") pod \"node-ca-tds89\" (UID: \"2080a1e9-bedc-4011-803a-6fda7f7e39e0\") " pod="openshift-image-registry/node-ca-tds89" Jul 16 11:08:14.779463 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.779442 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqbch\" (UniqueName: \"kubernetes.io/projected/7444f424-775b-4cb1-b13a-eeb72471a42a-kube-api-access-xqbch\") pod \"node-resolver-czbrz\" (UID: \"7444f424-775b-4cb1-b13a-eeb72471a42a\") " pod="openshift-dns/node-resolver-czbrz" Jul 16 11:08:14.779596 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.779575 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8z2q\" (UniqueName: \"kubernetes.io/projected/a4c1563e-b235-48ed-9aef-75e88f6b4b34-kube-api-access-t8z2q\") pod \"multus-additional-cni-plugins-8g6m2\" (UID: \"a4c1563e-b235-48ed-9aef-75e88f6b4b34\") " pod="openshift-multus/multus-additional-cni-plugins-8g6m2" Jul 16 11:08:14.860602 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.860549 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f27nt" Jul 16 11:08:14.869202 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.869049 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:14.884822 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.884802 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fs7g" Jul 16 11:08:14.890461 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.890441 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" Jul 16 11:08:14.898118 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.898098 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tds89" Jul 16 11:08:14.907579 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.907557 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-czbrz" Jul 16 11:08:14.915388 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.915316 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xvstb" Jul 16 11:08:14.924092 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.924000 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8g6m2" Jul 16 11:08:14.931607 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:14.931589 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jq7z4" Jul 16 11:08:15.170970 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:15.170893 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3934cfdb-5ad2-4c13-8649-8a06c0c0e504-metrics-certs\") pod \"network-metrics-daemon-vdpj9\" (UID: \"3934cfdb-5ad2-4c13-8649-8a06c0c0e504\") " pod="openshift-multus/network-metrics-daemon-vdpj9" Jul 16 11:08:15.171098 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:15.171048 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 11:08:15.171141 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:15.171113 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3934cfdb-5ad2-4c13-8649-8a06c0c0e504-metrics-certs podName:3934cfdb-5ad2-4c13-8649-8a06c0c0e504 nodeName:}" failed. No retries permitted until 2026-07-16 11:08:16.171093498 +0000 UTC m=+3.923351271 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3934cfdb-5ad2-4c13-8649-8a06c0c0e504-metrics-certs") pod "network-metrics-daemon-vdpj9" (UID: "3934cfdb-5ad2-4c13-8649-8a06c0c0e504") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 11:08:15.271826 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:15.271795 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6355a8cf-05e9-476a-9fbb-ee2612316853-original-pull-secret\") pod \"global-pull-secret-syncer-krgqh\" (UID: \"6355a8cf-05e9-476a-9fbb-ee2612316853\") " pod="kube-system/global-pull-secret-syncer-krgqh" Jul 16 11:08:15.271969 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:15.271854 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rznn\" (UniqueName: \"kubernetes.io/projected/148edf32-8cc4-4684-b3a7-063d497b0a53-kube-api-access-4rznn\") pod \"network-check-target-xcw4r\" (UID: \"148edf32-8cc4-4684-b3a7-063d497b0a53\") " pod="openshift-network-diagnostics/network-check-target-xcw4r" Jul 16 11:08:15.271969 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:15.271955 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 11:08:15.272068 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:15.271969 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 11:08:15.272068 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:15.271988 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 11:08:15.272068 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:15.272001 2559 projected.go:196] Error preparing data for projected volume kube-api-access-4rznn for pod openshift-network-diagnostics/network-check-target-xcw4r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 11:08:15.272068 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:15.272025 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6355a8cf-05e9-476a-9fbb-ee2612316853-original-pull-secret podName:6355a8cf-05e9-476a-9fbb-ee2612316853 nodeName:}" failed. No retries permitted until 2026-07-16 11:08:16.272004623 +0000 UTC m=+4.024262407 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6355a8cf-05e9-476a-9fbb-ee2612316853-original-pull-secret") pod "global-pull-secret-syncer-krgqh" (UID: "6355a8cf-05e9-476a-9fbb-ee2612316853") : object "kube-system"/"original-pull-secret" not registered Jul 16 11:08:15.272068 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:15.272050 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/148edf32-8cc4-4684-b3a7-063d497b0a53-kube-api-access-4rznn podName:148edf32-8cc4-4684-b3a7-063d497b0a53 nodeName:}" failed. No retries permitted until 2026-07-16 11:08:16.272034045 +0000 UTC m=+4.024291838 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4rznn" (UniqueName: "kubernetes.io/projected/148edf32-8cc4-4684-b3a7-063d497b0a53-kube-api-access-4rznn") pod "network-check-target-xcw4r" (UID: "148edf32-8cc4-4684-b3a7-063d497b0a53") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 11:08:15.596504 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:15.596423 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 11:03:14 +0000 UTC" deadline="2028-04-30 02:43:31.846339732 +0000 UTC" Jul 16 11:08:15.596504 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:15.596465 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15687h35m16.24987656s" Jul 16 11:08:15.631913 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:15.631883 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b54a94d_9649_41e3_960d_a9e1b848a519.slice/crio-b5a4ed71c326d09ba47863bc18b4e0dcc647f86004140bfedad79badefbab8be WatchSource:0}: Error finding container b5a4ed71c326d09ba47863bc18b4e0dcc647f86004140bfedad79badefbab8be: Status 404 returned error can't find the container with id b5a4ed71c326d09ba47863bc18b4e0dcc647f86004140bfedad79badefbab8be Jul 16 11:08:15.633999 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:15.633513 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e746f24_46d2_45b8_8849_fe3581b88b89.slice/crio-1a014f6ccf1abae9d6e1f5e77c7a63a920c754c5d4eac68b7d4ba4673b441652 WatchSource:0}: Error finding container 1a014f6ccf1abae9d6e1f5e77c7a63a920c754c5d4eac68b7d4ba4673b441652: Status 404 returned error can't find the container with id 1a014f6ccf1abae9d6e1f5e77c7a63a920c754c5d4eac68b7d4ba4673b441652 Jul 16 11:08:15.637679 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:15.637642 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4c1563e_b235_48ed_9aef_75e88f6b4b34.slice/crio-dd322e1353fdbe47d068aeda2e0faaea85611498c7c3a22073a9a41f7893a939 WatchSource:0}: Error finding container dd322e1353fdbe47d068aeda2e0faaea85611498c7c3a22073a9a41f7893a939: Status 404 returned error can't find the container with id dd322e1353fdbe47d068aeda2e0faaea85611498c7c3a22073a9a41f7893a939 Jul 16 11:08:15.638570 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:15.638547 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabb9ec8c_7e56_4b55_ac40_c8743f6316d8.slice/crio-0d84528e0c4fd69032e989361db77402a89459c228703a22827208ae1b1e4e33 WatchSource:0}: Error finding container 0d84528e0c4fd69032e989361db77402a89459c228703a22827208ae1b1e4e33: Status 404 returned error can't find the container with id 0d84528e0c4fd69032e989361db77402a89459c228703a22827208ae1b1e4e33 Jul 16 11:08:15.639732 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:15.639712 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3edabd60_32ec_4c7e_9d42_add8aa605248.slice/crio-0cd7cd7fad795f9fde9b2b8cf95a0f0c85746d5a6153377deb613d811cbe85af WatchSource:0}: Error finding container 0cd7cd7fad795f9fde9b2b8cf95a0f0c85746d5a6153377deb613d811cbe85af: Status 404 returned error can't find the container with id 0cd7cd7fad795f9fde9b2b8cf95a0f0c85746d5a6153377deb613d811cbe85af Jul 16 11:08:15.640801 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:15.640777 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod443181d2_b76d_4141_8165_b658caa2328a.slice/crio-d5860880592784391375b228c4d0da4b62b56621d7f971311a5ba4ecc37aeb17 WatchSource:0}: Error finding container d5860880592784391375b228c4d0da4b62b56621d7f971311a5ba4ecc37aeb17: Status 404 returned error can't find the container with id d5860880592784391375b228c4d0da4b62b56621d7f971311a5ba4ecc37aeb17 Jul 16 11:08:15.641358 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:15.641313 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2080a1e9_bedc_4011_803a_6fda7f7e39e0.slice/crio-06d022ade3ac20213cab27c64b413d0ac3193ff105168aeb2aa3837d22e8b890 WatchSource:0}: Error finding container 06d022ade3ac20213cab27c64b413d0ac3193ff105168aeb2aa3837d22e8b890: Status 404 returned error can't find the container with id 06d022ade3ac20213cab27c64b413d0ac3193ff105168aeb2aa3837d22e8b890 Jul 16 11:08:15.642824 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:15.642623 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7444f424_775b_4cb1_b13a_eeb72471a42a.slice/crio-bb94d82e3b9241eb758229ca3400ac030d3dd00fa0f3c4f5f707acc011041d14 WatchSource:0}: Error finding container bb94d82e3b9241eb758229ca3400ac030d3dd00fa0f3c4f5f707acc011041d14: Status 404 returned error can't find the container with id bb94d82e3b9241eb758229ca3400ac030d3dd00fa0f3c4f5f707acc011041d14 Jul 16 11:08:15.644350 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:15.644235 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb50845d1_6a5b_402f_a515_193795eed10a.slice/crio-d88e3aa8649a6319fff01f3dce1c45848f6290e0c028ce1c1df20508f9c78f30 WatchSource:0}: Error finding container d88e3aa8649a6319fff01f3dce1c45848f6290e0c028ce1c1df20508f9c78f30: Status 404 returned error can't find the container with id d88e3aa8649a6319fff01f3dce1c45848f6290e0c028ce1c1df20508f9c78f30 Jul 16 11:08:15.653699 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:15.653667 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" event={"ID":"b50845d1-6a5b-402f-a515-193795eed10a","Type":"ContainerStarted","Data":"d88e3aa8649a6319fff01f3dce1c45848f6290e0c028ce1c1df20508f9c78f30"} Jul 16 11:08:15.654751 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:15.654725 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f27nt" event={"ID":"abb9ec8c-7e56-4b55-ac40-c8743f6316d8","Type":"ContainerStarted","Data":"0d84528e0c4fd69032e989361db77402a89459c228703a22827208ae1b1e4e33"} Jul 16 11:08:15.655813 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:15.655791 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" event={"ID":"5b54a94d-9649-41e3-960d-a9e1b848a519","Type":"ContainerStarted","Data":"b5a4ed71c326d09ba47863bc18b4e0dcc647f86004140bfedad79badefbab8be"} Jul 16 11:08:15.657036 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:15.657013 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-czbrz" event={"ID":"7444f424-775b-4cb1-b13a-eeb72471a42a","Type":"ContainerStarted","Data":"bb94d82e3b9241eb758229ca3400ac030d3dd00fa0f3c4f5f707acc011041d14"} Jul 16 11:08:15.658049 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:15.658016 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tds89" event={"ID":"2080a1e9-bedc-4011-803a-6fda7f7e39e0","Type":"ContainerStarted","Data":"06d022ade3ac20213cab27c64b413d0ac3193ff105168aeb2aa3837d22e8b890"} Jul 16 11:08:15.659062 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:15.659034 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xvstb" event={"ID":"443181d2-b76d-4141-8165-b658caa2328a","Type":"ContainerStarted","Data":"d5860880592784391375b228c4d0da4b62b56621d7f971311a5ba4ecc37aeb17"} Jul 16 11:08:15.660186 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:15.660163 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fs7g" event={"ID":"3edabd60-32ec-4c7e-9d42-add8aa605248","Type":"ContainerStarted","Data":"0cd7cd7fad795f9fde9b2b8cf95a0f0c85746d5a6153377deb613d811cbe85af"} Jul 16 11:08:15.661177 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:15.661157 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8g6m2" event={"ID":"a4c1563e-b235-48ed-9aef-75e88f6b4b34","Type":"ContainerStarted","Data":"dd322e1353fdbe47d068aeda2e0faaea85611498c7c3a22073a9a41f7893a939"} Jul 16 11:08:15.662198 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:15.662182 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jq7z4" event={"ID":"3e746f24-46d2-45b8-8849-fe3581b88b89","Type":"ContainerStarted","Data":"1a014f6ccf1abae9d6e1f5e77c7a63a920c754c5d4eac68b7d4ba4673b441652"} Jul 16 11:08:16.178559 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:16.178257 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3934cfdb-5ad2-4c13-8649-8a06c0c0e504-metrics-certs\") pod \"network-metrics-daemon-vdpj9\" (UID: \"3934cfdb-5ad2-4c13-8649-8a06c0c0e504\") " pod="openshift-multus/network-metrics-daemon-vdpj9" Jul 16 11:08:16.178559 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:16.178531 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 11:08:16.178784 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:16.178605 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3934cfdb-5ad2-4c13-8649-8a06c0c0e504-metrics-certs podName:3934cfdb-5ad2-4c13-8649-8a06c0c0e504 nodeName:}" failed. No retries permitted until 2026-07-16 11:08:18.178586081 +0000 UTC m=+5.930843876 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3934cfdb-5ad2-4c13-8649-8a06c0c0e504-metrics-certs") pod "network-metrics-daemon-vdpj9" (UID: "3934cfdb-5ad2-4c13-8649-8a06c0c0e504") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 11:08:16.279461 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:16.279427 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rznn\" (UniqueName: \"kubernetes.io/projected/148edf32-8cc4-4684-b3a7-063d497b0a53-kube-api-access-4rznn\") pod \"network-check-target-xcw4r\" (UID: \"148edf32-8cc4-4684-b3a7-063d497b0a53\") " pod="openshift-network-diagnostics/network-check-target-xcw4r" Jul 16 11:08:16.279674 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:16.279496 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6355a8cf-05e9-476a-9fbb-ee2612316853-original-pull-secret\") pod \"global-pull-secret-syncer-krgqh\" (UID: \"6355a8cf-05e9-476a-9fbb-ee2612316853\") " pod="kube-system/global-pull-secret-syncer-krgqh" Jul 16 11:08:16.279674 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:16.279654 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 11:08:16.279808 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:16.279714 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6355a8cf-05e9-476a-9fbb-ee2612316853-original-pull-secret podName:6355a8cf-05e9-476a-9fbb-ee2612316853 nodeName:}" failed. No retries permitted until 2026-07-16 11:08:18.279697766 +0000 UTC m=+6.031955557 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6355a8cf-05e9-476a-9fbb-ee2612316853-original-pull-secret") pod "global-pull-secret-syncer-krgqh" (UID: "6355a8cf-05e9-476a-9fbb-ee2612316853") : object "kube-system"/"original-pull-secret" not registered Jul 16 11:08:16.280154 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:16.280112 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 11:08:16.280154 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:16.280136 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 11:08:16.280154 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:16.280149 2559 projected.go:196] Error preparing data for projected volume kube-api-access-4rznn for pod openshift-network-diagnostics/network-check-target-xcw4r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 11:08:16.280315 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:16.280191 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/148edf32-8cc4-4684-b3a7-063d497b0a53-kube-api-access-4rznn podName:148edf32-8cc4-4684-b3a7-063d497b0a53 nodeName:}" failed. No retries permitted until 2026-07-16 11:08:18.280177384 +0000 UTC m=+6.032435163 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4rznn" (UniqueName: "kubernetes.io/projected/148edf32-8cc4-4684-b3a7-063d497b0a53-kube-api-access-4rznn") pod "network-check-target-xcw4r" (UID: "148edf32-8cc4-4684-b3a7-063d497b0a53") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 11:08:16.596713 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:16.596618 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 11:03:14 +0000 UTC" deadline="2028-03-26 10:52:13.162561584 +0000 UTC" Jul 16 11:08:16.596713 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:16.596670 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14855h43m56.565896037s" Jul 16 11:08:16.647376 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:16.646744 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdpj9" Jul 16 11:08:16.647376 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:16.646874 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdpj9" podUID="3934cfdb-5ad2-4c13-8649-8a06c0c0e504" Jul 16 11:08:16.647376 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:16.647246 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcw4r" Jul 16 11:08:16.647376 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:16.647327 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcw4r" podUID="148edf32-8cc4-4684-b3a7-063d497b0a53" Jul 16 11:08:16.648038 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:16.647770 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krgqh" Jul 16 11:08:16.648038 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:16.647962 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krgqh" podUID="6355a8cf-05e9-476a-9fbb-ee2612316853" Jul 16 11:08:16.669162 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:16.669135 2559 generic.go:356] "Generic (PLEG): container finished" podID="2117623a2f66363e5ef1cf2e000664e9" containerID="23d29c78ff66fe11fd1154cbe4a2dfda5088f8552dbada17e133be2634f7690f" exitCode=0 Jul 16 11:08:16.669263 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:16.669223 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal" event={"ID":"2117623a2f66363e5ef1cf2e000664e9","Type":"ContainerDied","Data":"23d29c78ff66fe11fd1154cbe4a2dfda5088f8552dbada17e133be2634f7690f"} Jul 16 11:08:16.671859 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:16.671836 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-2.ec2.internal" event={"ID":"2de947f41f16a38a13007d8ee00ccad0","Type":"ContainerStarted","Data":"b55edd718d2729674ed0a01fdbb323bf7ada59a7fdc7b1ec2775071f28b909fb"} Jul 16 11:08:16.701280 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:16.701230 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-2.ec2.internal" podStartSLOduration=3.7012137689999998 podStartE2EDuration="3.701213769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:08:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:08:16.700439488 +0000 UTC m=+4.452697284" watchObservedRunningTime="2026-07-16 11:08:16.701213769 +0000 UTC m=+4.453471566" Jul 16 11:08:17.676456 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:17.676359 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal" event={"ID":"2117623a2f66363e5ef1cf2e000664e9","Type":"ContainerStarted","Data":"261fc67cea6508899b7a1f4cb19bc52c2238ec745f9ff8014383134fa1ef5ebb"} Jul 16 11:08:17.697242 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:17.697180 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-2.ec2.internal" podStartSLOduration=4.69716272 podStartE2EDuration="4.69716272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:08:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:08:17.696528167 +0000 UTC m=+5.448785975" watchObservedRunningTime="2026-07-16 11:08:17.69716272 +0000 UTC m=+5.449420516" Jul 16 11:08:18.196102 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:18.196063 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3934cfdb-5ad2-4c13-8649-8a06c0c0e504-metrics-certs\") pod \"network-metrics-daemon-vdpj9\" (UID: \"3934cfdb-5ad2-4c13-8649-8a06c0c0e504\") " pod="openshift-multus/network-metrics-daemon-vdpj9" Jul 16 11:08:18.196297 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:18.196238 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 11:08:18.196359 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:18.196317 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3934cfdb-5ad2-4c13-8649-8a06c0c0e504-metrics-certs podName:3934cfdb-5ad2-4c13-8649-8a06c0c0e504 nodeName:}" failed. No retries permitted until 2026-07-16 11:08:22.19629847 +0000 UTC m=+9.948556247 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3934cfdb-5ad2-4c13-8649-8a06c0c0e504-metrics-certs") pod "network-metrics-daemon-vdpj9" (UID: "3934cfdb-5ad2-4c13-8649-8a06c0c0e504") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 11:08:18.297198 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:18.297162 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rznn\" (UniqueName: \"kubernetes.io/projected/148edf32-8cc4-4684-b3a7-063d497b0a53-kube-api-access-4rznn\") pod \"network-check-target-xcw4r\" (UID: \"148edf32-8cc4-4684-b3a7-063d497b0a53\") " pod="openshift-network-diagnostics/network-check-target-xcw4r" Jul 16 11:08:18.297382 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:18.297247 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6355a8cf-05e9-476a-9fbb-ee2612316853-original-pull-secret\") pod \"global-pull-secret-syncer-krgqh\" (UID: \"6355a8cf-05e9-476a-9fbb-ee2612316853\") " pod="kube-system/global-pull-secret-syncer-krgqh" Jul 16 11:08:18.297447 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:18.297386 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 11:08:18.297447 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:18.297443 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6355a8cf-05e9-476a-9fbb-ee2612316853-original-pull-secret podName:6355a8cf-05e9-476a-9fbb-ee2612316853 nodeName:}" failed. No retries permitted until 2026-07-16 11:08:22.297427092 +0000 UTC m=+10.049684868 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6355a8cf-05e9-476a-9fbb-ee2612316853-original-pull-secret") pod "global-pull-secret-syncer-krgqh" (UID: "6355a8cf-05e9-476a-9fbb-ee2612316853") : object "kube-system"/"original-pull-secret" not registered Jul 16 11:08:18.297705 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:18.297655 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 11:08:18.297705 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:18.297679 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 11:08:18.297705 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:18.297691 2559 projected.go:196] Error preparing data for projected volume kube-api-access-4rznn for pod openshift-network-diagnostics/network-check-target-xcw4r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 11:08:18.297901 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:18.297733 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/148edf32-8cc4-4684-b3a7-063d497b0a53-kube-api-access-4rznn podName:148edf32-8cc4-4684-b3a7-063d497b0a53 nodeName:}" failed. No retries permitted until 2026-07-16 11:08:22.297720872 +0000 UTC m=+10.049978660 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4rznn" (UniqueName: "kubernetes.io/projected/148edf32-8cc4-4684-b3a7-063d497b0a53-kube-api-access-4rznn") pod "network-check-target-xcw4r" (UID: "148edf32-8cc4-4684-b3a7-063d497b0a53") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 11:08:18.645802 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:18.645732 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdpj9" Jul 16 11:08:18.645956 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:18.645867 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdpj9" podUID="3934cfdb-5ad2-4c13-8649-8a06c0c0e504" Jul 16 11:08:18.646279 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:18.646259 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcw4r" Jul 16 11:08:18.646389 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:18.646348 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcw4r" podUID="148edf32-8cc4-4684-b3a7-063d497b0a53" Jul 16 11:08:18.646449 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:18.646411 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krgqh" Jul 16 11:08:18.646505 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:18.646482 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krgqh" podUID="6355a8cf-05e9-476a-9fbb-ee2612316853" Jul 16 11:08:20.644476 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:20.644445 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdpj9" Jul 16 11:08:20.644858 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:20.644585 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdpj9" podUID="3934cfdb-5ad2-4c13-8649-8a06c0c0e504" Jul 16 11:08:20.644858 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:20.644761 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcw4r" Jul 16 11:08:20.644858 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:20.644847 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcw4r" podUID="148edf32-8cc4-4684-b3a7-063d497b0a53" Jul 16 11:08:20.645018 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:20.644899 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krgqh" Jul 16 11:08:20.645018 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:20.644977 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krgqh" podUID="6355a8cf-05e9-476a-9fbb-ee2612316853" Jul 16 11:08:22.229357 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:22.229275 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3934cfdb-5ad2-4c13-8649-8a06c0c0e504-metrics-certs\") pod \"network-metrics-daemon-vdpj9\" (UID: \"3934cfdb-5ad2-4c13-8649-8a06c0c0e504\") " pod="openshift-multus/network-metrics-daemon-vdpj9" Jul 16 11:08:22.229827 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:22.229429 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 11:08:22.229827 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:22.229493 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3934cfdb-5ad2-4c13-8649-8a06c0c0e504-metrics-certs podName:3934cfdb-5ad2-4c13-8649-8a06c0c0e504 nodeName:}" failed. No retries permitted until 2026-07-16 11:08:30.22947499 +0000 UTC m=+17.981732766 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3934cfdb-5ad2-4c13-8649-8a06c0c0e504-metrics-certs") pod "network-metrics-daemon-vdpj9" (UID: "3934cfdb-5ad2-4c13-8649-8a06c0c0e504") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 11:08:22.330537 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:22.330504 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6355a8cf-05e9-476a-9fbb-ee2612316853-original-pull-secret\") pod \"global-pull-secret-syncer-krgqh\" (UID: \"6355a8cf-05e9-476a-9fbb-ee2612316853\") " pod="kube-system/global-pull-secret-syncer-krgqh" Jul 16 11:08:22.330714 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:22.330574 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rznn\" (UniqueName: \"kubernetes.io/projected/148edf32-8cc4-4684-b3a7-063d497b0a53-kube-api-access-4rznn\") pod \"network-check-target-xcw4r\" (UID: \"148edf32-8cc4-4684-b3a7-063d497b0a53\") " pod="openshift-network-diagnostics/network-check-target-xcw4r" Jul 16 11:08:22.330774 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:22.330748 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 11:08:22.330774 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:22.330768 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 11:08:22.330888 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:22.330770 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 11:08:22.330888 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:22.330781 2559 projected.go:196] Error preparing data for projected volume kube-api-access-4rznn for pod openshift-network-diagnostics/network-check-target-xcw4r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 11:08:22.330888 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:22.330843 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6355a8cf-05e9-476a-9fbb-ee2612316853-original-pull-secret podName:6355a8cf-05e9-476a-9fbb-ee2612316853 nodeName:}" failed. No retries permitted until 2026-07-16 11:08:30.330821293 +0000 UTC m=+18.083079081 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6355a8cf-05e9-476a-9fbb-ee2612316853-original-pull-secret") pod "global-pull-secret-syncer-krgqh" (UID: "6355a8cf-05e9-476a-9fbb-ee2612316853") : object "kube-system"/"original-pull-secret" not registered Jul 16 11:08:22.330888 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:22.330865 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/148edf32-8cc4-4684-b3a7-063d497b0a53-kube-api-access-4rznn podName:148edf32-8cc4-4684-b3a7-063d497b0a53 nodeName:}" failed. No retries permitted until 2026-07-16 11:08:30.330855087 +0000 UTC m=+18.083112863 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4rznn" (UniqueName: "kubernetes.io/projected/148edf32-8cc4-4684-b3a7-063d497b0a53-kube-api-access-4rznn") pod "network-check-target-xcw4r" (UID: "148edf32-8cc4-4684-b3a7-063d497b0a53") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 11:08:22.645937 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:22.645866 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdpj9" Jul 16 11:08:22.646098 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:22.645990 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdpj9" podUID="3934cfdb-5ad2-4c13-8649-8a06c0c0e504" Jul 16 11:08:22.646159 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:22.646136 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcw4r" Jul 16 11:08:22.646213 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:22.646188 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krgqh" Jul 16 11:08:22.646320 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:22.646261 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krgqh" podUID="6355a8cf-05e9-476a-9fbb-ee2612316853" Jul 16 11:08:22.646379 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:22.646332 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcw4r" podUID="148edf32-8cc4-4684-b3a7-063d497b0a53" Jul 16 11:08:24.644798 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:24.644753 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krgqh" Jul 16 11:08:24.645193 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:24.644753 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcw4r" Jul 16 11:08:24.645193 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:24.644880 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krgqh" podUID="6355a8cf-05e9-476a-9fbb-ee2612316853" Jul 16 11:08:24.645193 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:24.645003 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcw4r" podUID="148edf32-8cc4-4684-b3a7-063d497b0a53" Jul 16 11:08:24.645193 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:24.644759 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdpj9" Jul 16 11:08:24.645193 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:24.645103 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdpj9" podUID="3934cfdb-5ad2-4c13-8649-8a06c0c0e504" Jul 16 11:08:26.645274 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:26.645240 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krgqh" Jul 16 11:08:26.645708 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:26.645240 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdpj9" Jul 16 11:08:26.645708 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:26.645346 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krgqh" podUID="6355a8cf-05e9-476a-9fbb-ee2612316853" Jul 16 11:08:26.645708 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:26.645380 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcw4r" Jul 16 11:08:26.645708 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:26.645487 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdpj9" podUID="3934cfdb-5ad2-4c13-8649-8a06c0c0e504" Jul 16 11:08:26.645708 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:26.645572 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcw4r" podUID="148edf32-8cc4-4684-b3a7-063d497b0a53" Jul 16 11:08:28.644745 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:28.644705 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcw4r" Jul 16 11:08:28.644745 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:28.644727 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krgqh" Jul 16 11:08:28.644745 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:28.644720 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdpj9" Jul 16 11:08:28.645283 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:28.644825 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcw4r" podUID="148edf32-8cc4-4684-b3a7-063d497b0a53" Jul 16 11:08:28.645283 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:28.645221 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdpj9" podUID="3934cfdb-5ad2-4c13-8649-8a06c0c0e504" Jul 16 11:08:28.645392 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:28.645279 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krgqh" podUID="6355a8cf-05e9-476a-9fbb-ee2612316853" Jul 16 11:08:30.289181 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:30.289094 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3934cfdb-5ad2-4c13-8649-8a06c0c0e504-metrics-certs\") pod \"network-metrics-daemon-vdpj9\" (UID: \"3934cfdb-5ad2-4c13-8649-8a06c0c0e504\") " pod="openshift-multus/network-metrics-daemon-vdpj9" Jul 16 11:08:30.289658 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:30.289217 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 11:08:30.289658 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:30.289278 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3934cfdb-5ad2-4c13-8649-8a06c0c0e504-metrics-certs podName:3934cfdb-5ad2-4c13-8649-8a06c0c0e504 nodeName:}" failed. No retries permitted until 2026-07-16 11:08:46.289259972 +0000 UTC m=+34.041517749 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3934cfdb-5ad2-4c13-8649-8a06c0c0e504-metrics-certs") pod "network-metrics-daemon-vdpj9" (UID: "3934cfdb-5ad2-4c13-8649-8a06c0c0e504") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 11:08:30.390168 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:30.390134 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rznn\" (UniqueName: \"kubernetes.io/projected/148edf32-8cc4-4684-b3a7-063d497b0a53-kube-api-access-4rznn\") pod \"network-check-target-xcw4r\" (UID: \"148edf32-8cc4-4684-b3a7-063d497b0a53\") " pod="openshift-network-diagnostics/network-check-target-xcw4r" Jul 16 11:08:30.390323 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:30.390194 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6355a8cf-05e9-476a-9fbb-ee2612316853-original-pull-secret\") pod \"global-pull-secret-syncer-krgqh\" (UID: \"6355a8cf-05e9-476a-9fbb-ee2612316853\") " pod="kube-system/global-pull-secret-syncer-krgqh" Jul 16 11:08:30.390323 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:30.390302 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 11:08:30.390323 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:30.390308 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 11:08:30.390490 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:30.390328 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 11:08:30.390490 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:30.390339 2559 projected.go:196] Error preparing data for projected volume kube-api-access-4rznn for pod openshift-network-diagnostics/network-check-target-xcw4r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 11:08:30.390490 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:30.390366 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6355a8cf-05e9-476a-9fbb-ee2612316853-original-pull-secret podName:6355a8cf-05e9-476a-9fbb-ee2612316853 nodeName:}" failed. No retries permitted until 2026-07-16 11:08:46.390346743 +0000 UTC m=+34.142604533 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6355a8cf-05e9-476a-9fbb-ee2612316853-original-pull-secret") pod "global-pull-secret-syncer-krgqh" (UID: "6355a8cf-05e9-476a-9fbb-ee2612316853") : object "kube-system"/"original-pull-secret" not registered Jul 16 11:08:30.390490 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:30.390389 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/148edf32-8cc4-4684-b3a7-063d497b0a53-kube-api-access-4rznn podName:148edf32-8cc4-4684-b3a7-063d497b0a53 nodeName:}" failed. No retries permitted until 2026-07-16 11:08:46.390372865 +0000 UTC m=+34.142630663 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4rznn" (UniqueName: "kubernetes.io/projected/148edf32-8cc4-4684-b3a7-063d497b0a53-kube-api-access-4rznn") pod "network-check-target-xcw4r" (UID: "148edf32-8cc4-4684-b3a7-063d497b0a53") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 11:08:30.644910 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:30.644827 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcw4r" Jul 16 11:08:30.644910 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:30.644843 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krgqh" Jul 16 11:08:30.645108 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:30.644953 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcw4r" podUID="148edf32-8cc4-4684-b3a7-063d497b0a53" Jul 16 11:08:30.645108 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:30.645027 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krgqh" podUID="6355a8cf-05e9-476a-9fbb-ee2612316853" Jul 16 11:08:30.645108 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:30.645062 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdpj9" Jul 16 11:08:30.645199 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:30.645167 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdpj9" podUID="3934cfdb-5ad2-4c13-8649-8a06c0c0e504" Jul 16 11:08:32.645320 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:32.645279 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcw4r" Jul 16 11:08:32.645727 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:32.645377 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcw4r" podUID="148edf32-8cc4-4684-b3a7-063d497b0a53" Jul 16 11:08:32.645727 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:32.645458 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdpj9" Jul 16 11:08:32.645727 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:32.645570 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdpj9" podUID="3934cfdb-5ad2-4c13-8649-8a06c0c0e504" Jul 16 11:08:32.645727 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:32.645620 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krgqh" Jul 16 11:08:32.645727 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:32.645693 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krgqh" podUID="6355a8cf-05e9-476a-9fbb-ee2612316853" Jul 16 11:08:34.645267 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:34.645101 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krgqh" Jul 16 11:08:34.646039 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:34.645099 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdpj9" Jul 16 11:08:34.646039 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:34.645336 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krgqh" podUID="6355a8cf-05e9-476a-9fbb-ee2612316853" Jul 16 11:08:34.646039 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:34.645099 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcw4r" Jul 16 11:08:34.646039 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:34.645423 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdpj9" podUID="3934cfdb-5ad2-4c13-8649-8a06c0c0e504" Jul 16 11:08:34.646039 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:34.645474 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcw4r" podUID="148edf32-8cc4-4684-b3a7-063d497b0a53" Jul 16 11:08:34.706252 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:34.706226 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-czbrz" event={"ID":"7444f424-775b-4cb1-b13a-eeb72471a42a","Type":"ContainerStarted","Data":"76b541eaeab8494ee63f60477475ea9ddd5ac7f8635df418b942bd0923c1d191"} Jul 16 11:08:34.707414 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:34.707396 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tds89" event={"ID":"2080a1e9-bedc-4011-803a-6fda7f7e39e0","Type":"ContainerStarted","Data":"aa73ac8ac235f08af8f1ce987dd5cb00516ffb535c2f66a3c4e6f46fa62ec6b1"} Jul 16 11:08:34.708745 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:34.708723 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xvstb" event={"ID":"443181d2-b76d-4141-8165-b658caa2328a","Type":"ContainerStarted","Data":"6074fca0ea495cc51e11604bac7ecf0a1f23852ffadb4d0fddd964fb64b99e40"} Jul 16 11:08:34.709918 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:34.709898 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fs7g" event={"ID":"3edabd60-32ec-4c7e-9d42-add8aa605248","Type":"ContainerStarted","Data":"cbd47e4521005b607599f52810eb5143d3c30df14a35cfb0ecb8770045452cc3"} Jul 16 11:08:34.711209 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:34.711187 2559 generic.go:356] "Generic (PLEG): container finished" podID="a4c1563e-b235-48ed-9aef-75e88f6b4b34" containerID="7759b0ddef9800b803587de8618adbdc17a33317713e08f44dd9d91746b9dba1" exitCode=0 Jul 16 11:08:34.711305 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:34.711260 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8g6m2" event={"ID":"a4c1563e-b235-48ed-9aef-75e88f6b4b34","Type":"ContainerDied","Data":"7759b0ddef9800b803587de8618adbdc17a33317713e08f44dd9d91746b9dba1"} Jul 16 11:08:34.712567 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:34.712541 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jq7z4" event={"ID":"3e746f24-46d2-45b8-8849-fe3581b88b89","Type":"ContainerStarted","Data":"5ca6c376a53cba45fcdd340f9df5132fd5186242f9dede067b740d0b9c380844"} Jul 16 11:08:34.714024 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:34.714005 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" event={"ID":"b50845d1-6a5b-402f-a515-193795eed10a","Type":"ContainerStarted","Data":"9529cd85aea08a7fc7384355da2c68666e665b83b9f36c2d60c5566373fcdbc5"} Jul 16 11:08:34.716435 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:34.716417 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" event={"ID":"5b54a94d-9649-41e3-960d-a9e1b848a519","Type":"ContainerStarted","Data":"74213386880d2c720a618bc09ebb2459acd5fc2d325dd8468783ba2b683177f7"} Jul 16 11:08:34.716535 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:34.716469 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" event={"ID":"5b54a94d-9649-41e3-960d-a9e1b848a519","Type":"ContainerStarted","Data":"dc2db6c6558ac033da37bf63eb172b0407a56ed4f19a326685f4eff6f40bdc2b"} Jul 16 11:08:34.716535 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:34.716498 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" event={"ID":"5b54a94d-9649-41e3-960d-a9e1b848a519","Type":"ContainerStarted","Data":"58c232bd65b0b9b1151bcedcb6ed2d2385288a07b3a22732884588169de80672"} Jul 16 11:08:34.716614 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:34.716537 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" event={"ID":"5b54a94d-9649-41e3-960d-a9e1b848a519","Type":"ContainerStarted","Data":"aa66a5b8fe1ccad19cfbec71cb3ac378f6a93116c370987c49e4b032cadcd494"} Jul 16 11:08:34.716614 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:34.716564 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" event={"ID":"5b54a94d-9649-41e3-960d-a9e1b848a519","Type":"ContainerStarted","Data":"9bbebb6ecf2ae390f6a8e6ef10c0ea0483c18172dbe9ccc6cc10f0a71e972a2f"} Jul 16 11:08:34.720477 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:34.720443 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-czbrz" podStartSLOduration=3.574879417 podStartE2EDuration="21.720431343s" totalImagesPullingTime="18.145551926s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:08:34.720406379 +0000 UTC m=+22.472664174" watchObservedRunningTime="2026-07-16 11:08:34.720431343 +0000 UTC m=+22.472689138" Jul 16 11:08:34.733791 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:34.733756 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xvstb" podStartSLOduration=7.7720767859999995 podStartE2EDuration="21.733745185s" totalImagesPullingTime="13.961668399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:08:34.733487373 +0000 UTC m=+22.485745167" watchObservedRunningTime="2026-07-16 11:08:34.733745185 +0000 UTC m=+22.486002982" Jul 16 11:08:34.748573 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:34.748540 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5zgqb" podStartSLOduration=4.280940776 podStartE2EDuration="22.748528842s" totalImagesPullingTime="18.467588066s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:08:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:08:34.748080626 +0000 UTC m=+22.500338422" watchObservedRunningTime="2026-07-16 11:08:34.748528842 +0000 UTC m=+22.500786636" Jul 16 11:08:34.794073 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:34.794028 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jq7z4" podStartSLOduration=3.250322331 podStartE2EDuration="21.794016362s" totalImagesPullingTime="18.543694031s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:08:34.793680033 +0000 UTC m=+22.545937829" watchObservedRunningTime="2026-07-16 11:08:34.794016362 +0000 UTC m=+22.546274157" Jul 16 11:08:34.809705 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:34.809672 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tds89" podStartSLOduration=12.932653956 podStartE2EDuration="21.809660544s" totalImagesPullingTime="8.877006588s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:08:34.80940924 +0000 UTC m=+22.561667035" watchObservedRunningTime="2026-07-16 11:08:34.809660544 +0000 UTC m=+22.561918339" Jul 16 11:08:35.631441 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:35.631394 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 16 11:08:35.720423 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:35.720395 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fs7g" event={"ID":"3edabd60-32ec-4c7e-9d42-add8aa605248","Type":"ContainerStarted","Data":"fe3690300b3a1a6c54407062507474970bcd12d890b16b11026e625d4eb3845e"} Jul 16 11:08:35.721992 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:35.721953 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f27nt" event={"ID":"abb9ec8c-7e56-4b55-ac40-c8743f6316d8","Type":"ContainerStarted","Data":"7fac0281c2785b5b0f5840d55b4027248d5ad97e6a3f68b2ed16eb70f377a7b5"} Jul 16 11:08:35.725574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:35.725495 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" event={"ID":"5b54a94d-9649-41e3-960d-a9e1b848a519","Type":"ContainerStarted","Data":"01eb22764d0dc8e96fb2cda128db40287a106b75780c4d6dd23ea559cf4d8c09"} Jul 16 11:08:36.628787 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:36.628692 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T11:08:35.631416664Z","UUID":"5bfce4e8-9d40-43e8-9fbb-144c654b6ffc","Handler":null,"Name":"","Endpoint":""} Jul 16 11:08:36.630504 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:36.630485 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 16 11:08:36.630620 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:36.630527 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 16 11:08:36.645311 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:36.645290 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krgqh" Jul 16 11:08:36.645311 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:36.645306 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdpj9" Jul 16 11:08:36.645460 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:36.645386 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krgqh" podUID="6355a8cf-05e9-476a-9fbb-ee2612316853" Jul 16 11:08:36.645694 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:36.645509 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdpj9" podUID="3934cfdb-5ad2-4c13-8649-8a06c0c0e504" Jul 16 11:08:36.645694 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:36.645571 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcw4r" Jul 16 11:08:36.645694 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:36.645660 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcw4r" podUID="148edf32-8cc4-4684-b3a7-063d497b0a53" Jul 16 11:08:36.688008 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:36.687984 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xvstb" Jul 16 11:08:36.688479 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:36.688457 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xvstb" Jul 16 11:08:36.703055 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:36.702985 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-f27nt" podStartSLOduration=10.739290915 podStartE2EDuration="24.702972812s" totalImagesPullingTime="13.963681897s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:08:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:08:35.735750703 +0000 UTC m=+23.488008499" watchObservedRunningTime="2026-07-16 11:08:36.702972812 +0000 UTC m=+24.455230610" Jul 16 11:08:36.730331 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:36.730309 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fs7g" event={"ID":"3edabd60-32ec-4c7e-9d42-add8aa605248","Type":"ContainerStarted","Data":"8fc6fd8540ca46c1e49f1203748b98618d89690dcff5650daea49542ce3b3b02"} Jul 16 11:08:36.749087 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:36.749042 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4fs7g" podStartSLOduration=4.151123831 podStartE2EDuration="24.749024549s" totalImagesPullingTime="20.597900718s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:08:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:08:36.748260484 +0000 UTC m=+24.500518284" watchObservedRunningTime="2026-07-16 11:08:36.749024549 +0000 UTC m=+24.501282325" Jul 16 11:08:37.739649 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:37.739372 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" event={"ID":"5b54a94d-9649-41e3-960d-a9e1b848a519","Type":"ContainerStarted","Data":"d09be122ef30a0872ceabf95498e16bf62efc4a0e23dc30ddc0d8df2fc32e5ea"} Jul 16 11:08:37.740107 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:37.739671 2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 16 11:08:38.116378 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:38.116295 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xvstb" Jul 16 11:08:38.116981 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:38.116887 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xvstb" Jul 16 11:08:38.645394 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:38.645362 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krgqh" Jul 16 11:08:38.645608 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:38.645374 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcw4r" Jul 16 11:08:38.645608 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:38.645468 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krgqh" podUID="6355a8cf-05e9-476a-9fbb-ee2612316853" Jul 16 11:08:38.645608 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:38.645541 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcw4r" podUID="148edf32-8cc4-4684-b3a7-063d497b0a53" Jul 16 11:08:38.645608 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:38.645371 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdpj9" Jul 16 11:08:38.645858 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:38.645707 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdpj9" podUID="3934cfdb-5ad2-4c13-8649-8a06c0c0e504" Jul 16 11:08:39.746493 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:39.746251 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" event={"ID":"5b54a94d-9649-41e3-960d-a9e1b848a519","Type":"ContainerStarted","Data":"b8f98c63123213b0d121506ebc46babae568f9a625de2e2e77fcbbee7d1e079e"} Jul 16 11:08:39.747226 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:39.746511 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:39.747226 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:39.746566 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:39.747226 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:39.746616 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:39.748446 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:39.748419 2559 generic.go:356] "Generic (PLEG): container finished" podID="a4c1563e-b235-48ed-9aef-75e88f6b4b34" containerID="16cb6e9c524cef730cc145efcc8f4be5a28d912bf533ca2478e3fefdac8f8ff6" exitCode=0 Jul 16 11:08:39.748548 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:39.748496 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8g6m2" event={"ID":"a4c1563e-b235-48ed-9aef-75e88f6b4b34","Type":"ContainerDied","Data":"16cb6e9c524cef730cc145efcc8f4be5a28d912bf533ca2478e3fefdac8f8ff6"} Jul 16 11:08:39.761458 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:39.761440 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:39.761623 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:39.761606 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:08:39.776552 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:39.776518 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" podStartSLOduration=9.079051753 podStartE2EDuration="27.776506083s" totalImagesPullingTime="18.69745433s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:08:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:08:39.775692165 +0000 UTC m=+27.527949959" watchObservedRunningTime="2026-07-16 11:08:39.776506083 +0000 UTC m=+27.528763877" Jul 16 11:08:40.644419 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:40.644393 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdpj9" Jul 16 11:08:40.644541 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:40.644495 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdpj9" podUID="3934cfdb-5ad2-4c13-8649-8a06c0c0e504" Jul 16 11:08:40.644541 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:40.644393 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcw4r" Jul 16 11:08:40.644541 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:40.644530 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krgqh" Jul 16 11:08:40.644686 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:40.644594 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcw4r" podUID="148edf32-8cc4-4684-b3a7-063d497b0a53" Jul 16 11:08:40.644686 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:40.644669 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krgqh" podUID="6355a8cf-05e9-476a-9fbb-ee2612316853" Jul 16 11:08:40.752189 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:40.752162 2559 generic.go:356] "Generic (PLEG): container finished" podID="a4c1563e-b235-48ed-9aef-75e88f6b4b34" containerID="f2c03b85b3402dd95d7621e8c0016f009a5b7aa17a1e01074ade8dc4428eb739" exitCode=0 Jul 16 11:08:40.752524 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:40.752225 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8g6m2" event={"ID":"a4c1563e-b235-48ed-9aef-75e88f6b4b34","Type":"ContainerDied","Data":"f2c03b85b3402dd95d7621e8c0016f009a5b7aa17a1e01074ade8dc4428eb739"} Jul 16 11:08:41.245005 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:41.244976 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vdpj9"] Jul 16 11:08:41.245168 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:41.245092 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdpj9" Jul 16 11:08:41.245243 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:41.245224 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdpj9" podUID="3934cfdb-5ad2-4c13-8649-8a06c0c0e504" Jul 16 11:08:41.247866 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:41.247844 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xcw4r"] Jul 16 11:08:41.247980 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:41.247921 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcw4r" Jul 16 11:08:41.248043 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:41.248008 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcw4r" podUID="148edf32-8cc4-4684-b3a7-063d497b0a53" Jul 16 11:08:41.257376 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:41.257355 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-krgqh"] Jul 16 11:08:41.257483 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:41.257417 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krgqh" Jul 16 11:08:41.257483 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:41.257477 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krgqh" podUID="6355a8cf-05e9-476a-9fbb-ee2612316853" Jul 16 11:08:42.646099 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:42.646062 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdpj9" Jul 16 11:08:42.646621 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:42.646110 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcw4r" Jul 16 11:08:42.646621 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:42.646196 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdpj9" podUID="3934cfdb-5ad2-4c13-8649-8a06c0c0e504" Jul 16 11:08:42.646621 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:42.646245 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcw4r" podUID="148edf32-8cc4-4684-b3a7-063d497b0a53" Jul 16 11:08:43.644937 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:43.644862 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krgqh" Jul 16 11:08:43.645085 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:43.644959 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krgqh" podUID="6355a8cf-05e9-476a-9fbb-ee2612316853" Jul 16 11:08:43.762227 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:43.762199 2559 generic.go:356] "Generic (PLEG): container finished" podID="a4c1563e-b235-48ed-9aef-75e88f6b4b34" containerID="3d6cc0642b00d2a5697ffbdabd2afb11506baa6d4b90924f5238f3cf3c05a034" exitCode=0 Jul 16 11:08:43.762547 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:43.762240 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8g6m2" event={"ID":"a4c1563e-b235-48ed-9aef-75e88f6b4b34","Type":"ContainerDied","Data":"3d6cc0642b00d2a5697ffbdabd2afb11506baa6d4b90924f5238f3cf3c05a034"} Jul 16 11:08:44.644774 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:44.644738 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdpj9" Jul 16 11:08:44.644978 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:44.644873 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdpj9" podUID="3934cfdb-5ad2-4c13-8649-8a06c0c0e504" Jul 16 11:08:44.644978 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:44.644932 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcw4r" Jul 16 11:08:44.645096 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:44.645018 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcw4r" podUID="148edf32-8cc4-4684-b3a7-063d497b0a53" Jul 16 11:08:45.645036 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:45.645007 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krgqh" Jul 16 11:08:45.645426 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:45.645130 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-krgqh" podUID="6355a8cf-05e9-476a-9fbb-ee2612316853" Jul 16 11:08:46.311391 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:46.311356 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3934cfdb-5ad2-4c13-8649-8a06c0c0e504-metrics-certs\") pod \"network-metrics-daemon-vdpj9\" (UID: \"3934cfdb-5ad2-4c13-8649-8a06c0c0e504\") " pod="openshift-multus/network-metrics-daemon-vdpj9" Jul 16 11:08:46.311670 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:46.311505 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 11:08:46.311670 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:46.311577 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3934cfdb-5ad2-4c13-8649-8a06c0c0e504-metrics-certs podName:3934cfdb-5ad2-4c13-8649-8a06c0c0e504 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:18.311559264 +0000 UTC m=+66.063817042 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3934cfdb-5ad2-4c13-8649-8a06c0c0e504-metrics-certs") pod "network-metrics-daemon-vdpj9" (UID: "3934cfdb-5ad2-4c13-8649-8a06c0c0e504") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 11:08:46.412080 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:46.412042 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rznn\" (UniqueName: \"kubernetes.io/projected/148edf32-8cc4-4684-b3a7-063d497b0a53-kube-api-access-4rznn\") pod \"network-check-target-xcw4r\" (UID: \"148edf32-8cc4-4684-b3a7-063d497b0a53\") " pod="openshift-network-diagnostics/network-check-target-xcw4r" Jul 16 11:08:46.412245 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:46.412122 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6355a8cf-05e9-476a-9fbb-ee2612316853-original-pull-secret\") pod \"global-pull-secret-syncer-krgqh\" (UID: \"6355a8cf-05e9-476a-9fbb-ee2612316853\") " pod="kube-system/global-pull-secret-syncer-krgqh" Jul 16 11:08:46.412245 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:46.412217 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 11:08:46.412360 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:46.412247 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 11:08:46.412360 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:46.412261 2559 projected.go:196] Error preparing data for projected volume kube-api-access-4rznn for pod openshift-network-diagnostics/network-check-target-xcw4r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 11:08:46.412360 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:46.412280 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 11:08:46.412360 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:46.412315 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/148edf32-8cc4-4684-b3a7-063d497b0a53-kube-api-access-4rznn podName:148edf32-8cc4-4684-b3a7-063d497b0a53 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:18.412300812 +0000 UTC m=+66.164558585 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4rznn" (UniqueName: "kubernetes.io/projected/148edf32-8cc4-4684-b3a7-063d497b0a53-kube-api-access-4rznn") pod "network-check-target-xcw4r" (UID: "148edf32-8cc4-4684-b3a7-063d497b0a53") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 11:08:46.412360 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:46.412335 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6355a8cf-05e9-476a-9fbb-ee2612316853-original-pull-secret podName:6355a8cf-05e9-476a-9fbb-ee2612316853 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:18.412325926 +0000 UTC m=+66.164583700 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6355a8cf-05e9-476a-9fbb-ee2612316853-original-pull-secret") pod "global-pull-secret-syncer-krgqh" (UID: "6355a8cf-05e9-476a-9fbb-ee2612316853") : object "kube-system"/"original-pull-secret" not registered Jul 16 11:08:46.644676 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:46.644586 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdpj9" Jul 16 11:08:46.644824 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:46.644746 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vdpj9" podUID="3934cfdb-5ad2-4c13-8649-8a06c0c0e504" Jul 16 11:08:46.644824 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:46.644797 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcw4r" Jul 16 11:08:46.644935 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:46.644885 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcw4r" podUID="148edf32-8cc4-4684-b3a7-063d497b0a53" Jul 16 11:08:47.065251 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.065224 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-2.ec2.internal" event="NodeReady" Jul 16 11:08:47.065764 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.065338 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 16 11:08:47.100399 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.100365 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54dff647f6-vp85x"] Jul 16 11:08:47.124592 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.124565 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54dff647f6-vp85x"] Jul 16 11:08:47.124759 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.124706 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:08:47.125764 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.125596 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xsg4k"] Jul 16 11:08:47.126878 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.126860 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 16 11:08:47.127228 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.127190 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 16 11:08:47.127340 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.127243 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 16 11:08:47.127404 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.127342 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bq7p2\"" Jul 16 11:08:47.135223 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.135201 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 16 11:08:47.138501 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.138483 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-v5z75"] Jul 16 11:08:47.138621 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.138605 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xsg4k" Jul 16 11:08:47.141154 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.141040 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 16 11:08:47.141154 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.141094 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 16 11:08:47.141315 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.141219 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mgj7r\"" Jul 16 11:08:47.141390 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.141374 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 16 11:08:47.158697 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.158678 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xsg4k"] Jul 16 11:08:47.158799 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.158784 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v5z75" Jul 16 11:08:47.161170 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.161149 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jnq66\"" Jul 16 11:08:47.161468 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.161447 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 16 11:08:47.163149 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.163130 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v5z75"] Jul 16 11:08:47.165505 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.165454 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 16 11:08:47.217070 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.217045 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/017eface-a126-4eec-961d-b076e61b5f45-image-registry-private-configuration\") pod \"image-registry-54dff647f6-vp85x\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:08:47.217176 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.217078 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzrfh\" (UniqueName: \"kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-kube-api-access-hzrfh\") pod \"image-registry-54dff647f6-vp85x\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:08:47.217176 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.217139 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/017eface-a126-4eec-961d-b076e61b5f45-trusted-ca\") pod \"image-registry-54dff647f6-vp85x\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:08:47.217290 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.217211 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/017eface-a126-4eec-961d-b076e61b5f45-registry-certificates\") pod \"image-registry-54dff647f6-vp85x\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:08:47.217290 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.217262 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-registry-tls\") pod \"image-registry-54dff647f6-vp85x\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:08:47.217387 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.217293 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/017eface-a126-4eec-961d-b076e61b5f45-ca-trust-extracted\") pod \"image-registry-54dff647f6-vp85x\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:08:47.217387 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.217318 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/017eface-a126-4eec-961d-b076e61b5f45-installation-pull-secrets\") pod \"image-registry-54dff647f6-vp85x\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:08:47.217387 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.217352 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-bound-sa-token\") pod \"image-registry-54dff647f6-vp85x\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:08:47.318294 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.318230 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/017eface-a126-4eec-961d-b076e61b5f45-trusted-ca\") pod \"image-registry-54dff647f6-vp85x\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:08:47.318294 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.318267 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v99dz\" (UniqueName: \"kubernetes.io/projected/45cdc2d0-20f4-4f63-83cb-80b6e9159a97-kube-api-access-v99dz\") pod \"ingress-canary-xsg4k\" (UID: \"45cdc2d0-20f4-4f63-83cb-80b6e9159a97\") " pod="openshift-ingress-canary/ingress-canary-xsg4k" Jul 16 11:08:47.318486 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.318300 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/017eface-a126-4eec-961d-b076e61b5f45-registry-certificates\") pod \"image-registry-54dff647f6-vp85x\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:08:47.318486 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.318328 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f092f0d-2c7a-4b1e-8598-23348b575cff-tmp-dir\") pod \"dns-default-v5z75\" (UID: \"0f092f0d-2c7a-4b1e-8598-23348b575cff\") " pod="openshift-dns/dns-default-v5z75" Jul 16 11:08:47.318486 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.318400 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-registry-tls\") pod \"image-registry-54dff647f6-vp85x\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:08:47.318486 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.318439 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/017eface-a126-4eec-961d-b076e61b5f45-ca-trust-extracted\") pod \"image-registry-54dff647f6-vp85x\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:08:47.318486 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.318463 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/017eface-a126-4eec-961d-b076e61b5f45-installation-pull-secrets\") pod \"image-registry-54dff647f6-vp85x\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:08:47.318766 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.318492 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l82h\" (UniqueName: \"kubernetes.io/projected/0f092f0d-2c7a-4b1e-8598-23348b575cff-kube-api-access-9l82h\") pod \"dns-default-v5z75\" (UID: \"0f092f0d-2c7a-4b1e-8598-23348b575cff\") " pod="openshift-dns/dns-default-v5z75" Jul 16 11:08:47.318766 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.318518 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-bound-sa-token\") pod \"image-registry-54dff647f6-vp85x\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:08:47.318766 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.318541 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45cdc2d0-20f4-4f63-83cb-80b6e9159a97-cert\") pod \"ingress-canary-xsg4k\" (UID: \"45cdc2d0-20f4-4f63-83cb-80b6e9159a97\") " pod="openshift-ingress-canary/ingress-canary-xsg4k" Jul 16 11:08:47.318766 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.318587 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/017eface-a126-4eec-961d-b076e61b5f45-image-registry-private-configuration\") pod \"image-registry-54dff647f6-vp85x\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:08:47.318766 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.318626 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzrfh\" (UniqueName: \"kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-kube-api-access-hzrfh\") pod \"image-registry-54dff647f6-vp85x\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:08:47.318766 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.318677 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0f092f0d-2c7a-4b1e-8598-23348b575cff-config-volume\") pod \"dns-default-v5z75\" (UID: \"0f092f0d-2c7a-4b1e-8598-23348b575cff\") " pod="openshift-dns/dns-default-v5z75" Jul 16 11:08:47.318766 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.318709 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f092f0d-2c7a-4b1e-8598-23348b575cff-metrics-tls\") pod \"dns-default-v5z75\" (UID: \"0f092f0d-2c7a-4b1e-8598-23348b575cff\") " pod="openshift-dns/dns-default-v5z75" Jul 16 11:08:47.319083 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.318817 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/017eface-a126-4eec-961d-b076e61b5f45-ca-trust-extracted\") pod \"image-registry-54dff647f6-vp85x\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:08:47.319083 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:47.318919 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 11:08:47.319083 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:47.318935 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54dff647f6-vp85x: secret "image-registry-tls" not found Jul 16 11:08:47.319083 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.318960 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/017eface-a126-4eec-961d-b076e61b5f45-registry-certificates\") pod \"image-registry-54dff647f6-vp85x\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:08:47.319083 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:47.318986 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-registry-tls podName:017eface-a126-4eec-961d-b076e61b5f45 nodeName:}" failed. No retries permitted until 2026-07-16 11:08:47.818967844 +0000 UTC m=+35.571225631 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-registry-tls") pod "image-registry-54dff647f6-vp85x" (UID: "017eface-a126-4eec-961d-b076e61b5f45") : secret "image-registry-tls" not found Jul 16 11:08:47.319324 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.319257 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/017eface-a126-4eec-961d-b076e61b5f45-trusted-ca\") pod \"image-registry-54dff647f6-vp85x\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:08:47.323163 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.323129 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/017eface-a126-4eec-961d-b076e61b5f45-image-registry-private-configuration\") pod \"image-registry-54dff647f6-vp85x\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:08:47.323261 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.323136 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/017eface-a126-4eec-961d-b076e61b5f45-installation-pull-secrets\") pod \"image-registry-54dff647f6-vp85x\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:08:47.331547 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.331524 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-bound-sa-token\") pod \"image-registry-54dff647f6-vp85x\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:08:47.331662 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.331616 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzrfh\" (UniqueName: \"kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-kube-api-access-hzrfh\") pod \"image-registry-54dff647f6-vp85x\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:08:47.419680 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.419623 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0f092f0d-2c7a-4b1e-8598-23348b575cff-config-volume\") pod \"dns-default-v5z75\" (UID: \"0f092f0d-2c7a-4b1e-8598-23348b575cff\") " pod="openshift-dns/dns-default-v5z75" Jul 16 11:08:47.419798 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.419682 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f092f0d-2c7a-4b1e-8598-23348b575cff-metrics-tls\") pod \"dns-default-v5z75\" (UID: \"0f092f0d-2c7a-4b1e-8598-23348b575cff\") " pod="openshift-dns/dns-default-v5z75" Jul 16 11:08:47.419798 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:47.419772 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 11:08:47.419913 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.419818 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v99dz\" (UniqueName: \"kubernetes.io/projected/45cdc2d0-20f4-4f63-83cb-80b6e9159a97-kube-api-access-v99dz\") pod \"ingress-canary-xsg4k\" (UID: \"45cdc2d0-20f4-4f63-83cb-80b6e9159a97\") " pod="openshift-ingress-canary/ingress-canary-xsg4k" Jul 16 11:08:47.419913 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:47.419830 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f092f0d-2c7a-4b1e-8598-23348b575cff-metrics-tls podName:0f092f0d-2c7a-4b1e-8598-23348b575cff nodeName:}" failed. No retries permitted until 2026-07-16 11:08:47.91981189 +0000 UTC m=+35.672069669 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f092f0d-2c7a-4b1e-8598-23348b575cff-metrics-tls") pod "dns-default-v5z75" (UID: "0f092f0d-2c7a-4b1e-8598-23348b575cff") : secret "dns-default-metrics-tls" not found Jul 16 11:08:47.419913 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.419886 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f092f0d-2c7a-4b1e-8598-23348b575cff-tmp-dir\") pod \"dns-default-v5z75\" (UID: \"0f092f0d-2c7a-4b1e-8598-23348b575cff\") " pod="openshift-dns/dns-default-v5z75" Jul 16 11:08:47.420068 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.419936 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l82h\" (UniqueName: \"kubernetes.io/projected/0f092f0d-2c7a-4b1e-8598-23348b575cff-kube-api-access-9l82h\") pod \"dns-default-v5z75\" (UID: \"0f092f0d-2c7a-4b1e-8598-23348b575cff\") " pod="openshift-dns/dns-default-v5z75" Jul 16 11:08:47.420068 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.419965 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45cdc2d0-20f4-4f63-83cb-80b6e9159a97-cert\") pod \"ingress-canary-xsg4k\" (UID: \"45cdc2d0-20f4-4f63-83cb-80b6e9159a97\") " pod="openshift-ingress-canary/ingress-canary-xsg4k" Jul 16 11:08:47.420199 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.420175 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f092f0d-2c7a-4b1e-8598-23348b575cff-tmp-dir\") pod \"dns-default-v5z75\" (UID: \"0f092f0d-2c7a-4b1e-8598-23348b575cff\") " pod="openshift-dns/dns-default-v5z75" Jul 16 11:08:47.420256 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.420218 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0f092f0d-2c7a-4b1e-8598-23348b575cff-config-volume\") pod \"dns-default-v5z75\" (UID: \"0f092f0d-2c7a-4b1e-8598-23348b575cff\") " pod="openshift-dns/dns-default-v5z75" Jul 16 11:08:47.422317 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.422293 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45cdc2d0-20f4-4f63-83cb-80b6e9159a97-cert\") pod \"ingress-canary-xsg4k\" (UID: \"45cdc2d0-20f4-4f63-83cb-80b6e9159a97\") " pod="openshift-ingress-canary/ingress-canary-xsg4k" Jul 16 11:08:47.434669 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.434647 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l82h\" (UniqueName: \"kubernetes.io/projected/0f092f0d-2c7a-4b1e-8598-23348b575cff-kube-api-access-9l82h\") pod \"dns-default-v5z75\" (UID: \"0f092f0d-2c7a-4b1e-8598-23348b575cff\") " pod="openshift-dns/dns-default-v5z75" Jul 16 11:08:47.434811 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.434794 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v99dz\" (UniqueName: \"kubernetes.io/projected/45cdc2d0-20f4-4f63-83cb-80b6e9159a97-kube-api-access-v99dz\") pod \"ingress-canary-xsg4k\" (UID: \"45cdc2d0-20f4-4f63-83cb-80b6e9159a97\") " pod="openshift-ingress-canary/ingress-canary-xsg4k" Jul 16 11:08:47.448780 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.448762 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xsg4k" Jul 16 11:08:47.644779 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.644752 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krgqh" Jul 16 11:08:47.648764 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.648739 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 11:08:47.778216 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.778185 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xsg4k"] Jul 16 11:08:47.822954 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.822928 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-registry-tls\") pod \"image-registry-54dff647f6-vp85x\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:08:47.823081 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:47.823062 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 11:08:47.823121 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:47.823083 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54dff647f6-vp85x: secret "image-registry-tls" not found Jul 16 11:08:47.823159 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:47.823137 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-registry-tls podName:017eface-a126-4eec-961d-b076e61b5f45 nodeName:}" failed. No retries permitted until 2026-07-16 11:08:48.82312116 +0000 UTC m=+36.575378933 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-registry-tls") pod "image-registry-54dff647f6-vp85x" (UID: "017eface-a126-4eec-961d-b076e61b5f45") : secret "image-registry-tls" not found Jul 16 11:08:47.847029 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:08:47.847009 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45cdc2d0_20f4_4f63_83cb_80b6e9159a97.slice/crio-b89e1f7e6380e88a9be0f097f987563ff004d057cbfd3c35cf589c3dd80a8f3e WatchSource:0}: Error finding container b89e1f7e6380e88a9be0f097f987563ff004d057cbfd3c35cf589c3dd80a8f3e: Status 404 returned error can't find the container with id b89e1f7e6380e88a9be0f097f987563ff004d057cbfd3c35cf589c3dd80a8f3e Jul 16 11:08:47.924180 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:47.924059 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f092f0d-2c7a-4b1e-8598-23348b575cff-metrics-tls\") pod \"dns-default-v5z75\" (UID: \"0f092f0d-2c7a-4b1e-8598-23348b575cff\") " pod="openshift-dns/dns-default-v5z75" Jul 16 11:08:47.924263 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:47.924197 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 11:08:47.924263 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:47.924249 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f092f0d-2c7a-4b1e-8598-23348b575cff-metrics-tls podName:0f092f0d-2c7a-4b1e-8598-23348b575cff nodeName:}" failed. No retries permitted until 2026-07-16 11:08:48.924234315 +0000 UTC m=+36.676492093 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f092f0d-2c7a-4b1e-8598-23348b575cff-metrics-tls") pod "dns-default-v5z75" (UID: "0f092f0d-2c7a-4b1e-8598-23348b575cff") : secret "dns-default-metrics-tls" not found Jul 16 11:08:48.644876 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:48.644845 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdpj9" Jul 16 11:08:48.645581 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:48.645019 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcw4r" Jul 16 11:08:48.647476 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:48.647453 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 11:08:48.647476 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:48.647459 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 11:08:48.647981 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:48.647961 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hjhcs\"" Jul 16 11:08:48.648107 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:48.647989 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wdm79\"" Jul 16 11:08:48.648107 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:48.648015 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 11:08:48.775578 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:48.775550 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xsg4k" event={"ID":"45cdc2d0-20f4-4f63-83cb-80b6e9159a97","Type":"ContainerStarted","Data":"b89e1f7e6380e88a9be0f097f987563ff004d057cbfd3c35cf589c3dd80a8f3e"} Jul 16 11:08:48.778247 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:48.778225 2559 generic.go:356] "Generic (PLEG): container finished" podID="a4c1563e-b235-48ed-9aef-75e88f6b4b34" containerID="d321de484100dcc196abdf35d370ebc7e0c8ecd345cc2b07d9830ae02d2e9777" exitCode=0 Jul 16 11:08:48.778339 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:48.778260 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8g6m2" event={"ID":"a4c1563e-b235-48ed-9aef-75e88f6b4b34","Type":"ContainerDied","Data":"d321de484100dcc196abdf35d370ebc7e0c8ecd345cc2b07d9830ae02d2e9777"} Jul 16 11:08:48.831446 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:48.831422 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-registry-tls\") pod \"image-registry-54dff647f6-vp85x\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:08:48.831545 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:48.831530 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 11:08:48.831589 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:48.831549 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54dff647f6-vp85x: secret "image-registry-tls" not found Jul 16 11:08:48.831641 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:48.831610 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-registry-tls podName:017eface-a126-4eec-961d-b076e61b5f45 nodeName:}" failed. No retries permitted until 2026-07-16 11:08:50.831589166 +0000 UTC m=+38.583846941 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-registry-tls") pod "image-registry-54dff647f6-vp85x" (UID: "017eface-a126-4eec-961d-b076e61b5f45") : secret "image-registry-tls" not found Jul 16 11:08:48.932687 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:48.932663 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f092f0d-2c7a-4b1e-8598-23348b575cff-metrics-tls\") pod \"dns-default-v5z75\" (UID: \"0f092f0d-2c7a-4b1e-8598-23348b575cff\") " pod="openshift-dns/dns-default-v5z75" Jul 16 11:08:48.932817 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:48.932799 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 11:08:48.932884 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:48.932865 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f092f0d-2c7a-4b1e-8598-23348b575cff-metrics-tls podName:0f092f0d-2c7a-4b1e-8598-23348b575cff nodeName:}" failed. No retries permitted until 2026-07-16 11:08:50.932841529 +0000 UTC m=+38.685099303 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f092f0d-2c7a-4b1e-8598-23348b575cff-metrics-tls") pod "dns-default-v5z75" (UID: "0f092f0d-2c7a-4b1e-8598-23348b575cff") : secret "dns-default-metrics-tls" not found Jul 16 11:08:49.783231 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:49.783206 2559 generic.go:356] "Generic (PLEG): container finished" podID="a4c1563e-b235-48ed-9aef-75e88f6b4b34" containerID="e9a14d588c0963bc77f75249c9227403199c156fc401da14b440b34952e0a39c" exitCode=0 Jul 16 11:08:49.783579 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:49.783262 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8g6m2" event={"ID":"a4c1563e-b235-48ed-9aef-75e88f6b4b34","Type":"ContainerDied","Data":"e9a14d588c0963bc77f75249c9227403199c156fc401da14b440b34952e0a39c"} Jul 16 11:08:50.789670 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:50.789620 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8g6m2" event={"ID":"a4c1563e-b235-48ed-9aef-75e88f6b4b34","Type":"ContainerStarted","Data":"bbf487a3a471c7a7c2ebb3c2d6e2ba6d5dc067aff6088d81111c82b3205147c2"} Jul 16 11:08:50.817127 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:50.817083 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8g6m2" podStartSLOduration=8.079721292 podStartE2EDuration="37.817039515s" totalImagesPullingTime="29.737318223s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:08:13 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:08:50.815650416 +0000 UTC m=+38.567908205" watchObservedRunningTime="2026-07-16 11:08:50.817039515 +0000 UTC m=+38.569297310" Jul 16 11:08:50.845708 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:50.845682 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-registry-tls\") pod \"image-registry-54dff647f6-vp85x\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:08:50.845875 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:50.845851 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 11:08:50.845875 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:50.845876 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54dff647f6-vp85x: secret "image-registry-tls" not found Jul 16 11:08:50.846030 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:50.845937 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-registry-tls podName:017eface-a126-4eec-961d-b076e61b5f45 nodeName:}" failed. No retries permitted until 2026-07-16 11:08:54.845919834 +0000 UTC m=+42.598177633 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-registry-tls") pod "image-registry-54dff647f6-vp85x" (UID: "017eface-a126-4eec-961d-b076e61b5f45") : secret "image-registry-tls" not found Jul 16 11:08:50.946890 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:50.946860 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f092f0d-2c7a-4b1e-8598-23348b575cff-metrics-tls\") pod \"dns-default-v5z75\" (UID: \"0f092f0d-2c7a-4b1e-8598-23348b575cff\") " pod="openshift-dns/dns-default-v5z75" Jul 16 11:08:50.947041 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:50.947021 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 11:08:50.947113 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:50.947093 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f092f0d-2c7a-4b1e-8598-23348b575cff-metrics-tls podName:0f092f0d-2c7a-4b1e-8598-23348b575cff nodeName:}" failed. No retries permitted until 2026-07-16 11:08:54.947071011 +0000 UTC m=+42.699328802 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f092f0d-2c7a-4b1e-8598-23348b575cff-metrics-tls") pod "dns-default-v5z75" (UID: "0f092f0d-2c7a-4b1e-8598-23348b575cff") : secret "dns-default-metrics-tls" not found Jul 16 11:08:52.795645 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:52.795408 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xsg4k" event={"ID":"45cdc2d0-20f4-4f63-83cb-80b6e9159a97","Type":"ContainerStarted","Data":"00cb016bef1d79e45159489a81f0c84d4279cb8920a2e820f167ad6edfcf02a0"} Jul 16 11:08:52.815390 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:52.815346 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xsg4k" podStartSLOduration=1.024460045 podStartE2EDuration="5.815331984s" totalImagesPullingTime="4.790871939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:08:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:08:52.814127647 +0000 UTC m=+40.566385442" watchObservedRunningTime="2026-07-16 11:08:52.815331984 +0000 UTC m=+40.567589814" Jul 16 11:08:54.873897 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:54.873857 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-registry-tls\") pod \"image-registry-54dff647f6-vp85x\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:08:54.874289 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:54.874003 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 11:08:54.874289 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:54.874020 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54dff647f6-vp85x: secret "image-registry-tls" not found Jul 16 11:08:54.874289 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:54.874072 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-registry-tls podName:017eface-a126-4eec-961d-b076e61b5f45 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:02.874057355 +0000 UTC m=+50.626315128 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-registry-tls") pod "image-registry-54dff647f6-vp85x" (UID: "017eface-a126-4eec-961d-b076e61b5f45") : secret "image-registry-tls" not found Jul 16 11:08:54.974404 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:08:54.974373 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f092f0d-2c7a-4b1e-8598-23348b575cff-metrics-tls\") pod \"dns-default-v5z75\" (UID: \"0f092f0d-2c7a-4b1e-8598-23348b575cff\") " pod="openshift-dns/dns-default-v5z75" Jul 16 11:08:54.974558 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:54.974540 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 11:08:54.974654 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:08:54.974615 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f092f0d-2c7a-4b1e-8598-23348b575cff-metrics-tls podName:0f092f0d-2c7a-4b1e-8598-23348b575cff nodeName:}" failed. No retries permitted until 2026-07-16 11:09:02.974593312 +0000 UTC m=+50.726851117 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f092f0d-2c7a-4b1e-8598-23348b575cff-metrics-tls") pod "dns-default-v5z75" (UID: "0f092f0d-2c7a-4b1e-8598-23348b575cff") : secret "dns-default-metrics-tls" not found Jul 16 11:09:02.929396 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:02.929363 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-registry-tls\") pod \"image-registry-54dff647f6-vp85x\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:09:02.929844 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:02.929483 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 11:09:02.929844 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:02.929495 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54dff647f6-vp85x: secret "image-registry-tls" not found Jul 16 11:09:02.929844 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:02.929546 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-registry-tls podName:017eface-a126-4eec-961d-b076e61b5f45 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:18.929527393 +0000 UTC m=+66.681785186 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-registry-tls") pod "image-registry-54dff647f6-vp85x" (UID: "017eface-a126-4eec-961d-b076e61b5f45") : secret "image-registry-tls" not found Jul 16 11:09:03.029969 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:03.029939 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f092f0d-2c7a-4b1e-8598-23348b575cff-metrics-tls\") pod \"dns-default-v5z75\" (UID: \"0f092f0d-2c7a-4b1e-8598-23348b575cff\") " pod="openshift-dns/dns-default-v5z75" Jul 16 11:09:03.030100 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:03.030070 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 11:09:03.030143 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:03.030123 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f092f0d-2c7a-4b1e-8598-23348b575cff-metrics-tls podName:0f092f0d-2c7a-4b1e-8598-23348b575cff nodeName:}" failed. No retries permitted until 2026-07-16 11:09:19.03010904 +0000 UTC m=+66.782366814 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f092f0d-2c7a-4b1e-8598-23348b575cff-metrics-tls") pod "dns-default-v5z75" (UID: "0f092f0d-2c7a-4b1e-8598-23348b575cff") : secret "dns-default-metrics-tls" not found Jul 16 11:09:06.890524 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.890483 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fl8xz"] Jul 16 11:09:06.892827 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.892799 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j7p6v"] Jul 16 11:09:06.892988 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.892927 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fl8xz" Jul 16 11:09:06.894565 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.894542 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gc8vw"] Jul 16 11:09:06.894744 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.894717 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j7p6v" Jul 16 11:09:06.895401 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.895375 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 16 11:09:06.895527 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.895374 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-sgl89\"" Jul 16 11:09:06.895527 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.895421 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 16 11:09:06.896349 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.896323 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-dgjm5"] Jul 16 11:09:06.896469 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.896411 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gc8vw" Jul 16 11:09:06.897145 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.897117 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 16 11:09:06.897145 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.897129 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 16 11:09:06.897319 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.897248 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-xzrs7\"" Jul 16 11:09:06.897319 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.897283 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 16 11:09:06.898332 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.898308 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 16 11:09:06.898484 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.898467 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lc2gt\"" Jul 16 11:09:06.898535 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.898484 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-dgjm5" Jul 16 11:09:06.899750 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.899728 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 16 11:09:06.899863 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.899758 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 16 11:09:06.899863 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.899768 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 16 11:09:06.900580 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.900555 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 16 11:09:06.900723 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.900655 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 16 11:09:06.900926 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.900895 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 16 11:09:06.901057 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.901011 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 16 11:09:06.901511 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.901065 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-th8k7\"" Jul 16 11:09:06.904958 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.904934 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fl8xz"] Jul 16 11:09:06.906395 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.906375 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j7p6v"] Jul 16 11:09:06.908009 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.907983 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 16 11:09:06.908189 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.908165 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gc8vw"] Jul 16 11:09:06.910859 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.910486 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-dgjm5"] Jul 16 11:09:06.952828 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.952803 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5b70f755-1473-4067-92d4-d8f817b17963-snapshots\") pod \"insights-operator-68d9dd94cf-dgjm5\" (UID: \"5b70f755-1473-4067-92d4-d8f817b17963\") " pod="openshift-insights/insights-operator-68d9dd94cf-dgjm5" Jul 16 11:09:06.952932 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.952830 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b70f755-1473-4067-92d4-d8f817b17963-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-dgjm5\" (UID: \"5b70f755-1473-4067-92d4-d8f817b17963\") " pod="openshift-insights/insights-operator-68d9dd94cf-dgjm5" Jul 16 11:09:06.952932 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.952852 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f2c7c9c4-2916-443e-b82b-17927b6e116a-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-gc8vw\" (UID: \"f2c7c9c4-2916-443e-b82b-17927b6e116a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gc8vw" Jul 16 11:09:06.952932 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.952869 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btwkv\" (UniqueName: \"kubernetes.io/projected/c946b90a-62b9-4afb-ae16-7c3106228dca-kube-api-access-btwkv\") pod \"volume-data-source-validator-78495597f6-fl8xz\" (UID: \"c946b90a-62b9-4afb-ae16-7c3106228dca\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fl8xz" Jul 16 11:09:06.952932 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.952884 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b70f755-1473-4067-92d4-d8f817b17963-serving-cert\") pod \"insights-operator-68d9dd94cf-dgjm5\" (UID: \"5b70f755-1473-4067-92d4-d8f817b17963\") " pod="openshift-insights/insights-operator-68d9dd94cf-dgjm5" Jul 16 11:09:06.953108 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.952955 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2c7c9c4-2916-443e-b82b-17927b6e116a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-gc8vw\" (UID: \"f2c7c9c4-2916-443e-b82b-17927b6e116a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gc8vw" Jul 16 11:09:06.953108 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.953005 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b70f755-1473-4067-92d4-d8f817b17963-tmp\") pod \"insights-operator-68d9dd94cf-dgjm5\" (UID: \"5b70f755-1473-4067-92d4-d8f817b17963\") " pod="openshift-insights/insights-operator-68d9dd94cf-dgjm5" Jul 16 11:09:06.953108 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.953029 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b70f755-1473-4067-92d4-d8f817b17963-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-dgjm5\" (UID: \"5b70f755-1473-4067-92d4-d8f817b17963\") " pod="openshift-insights/insights-operator-68d9dd94cf-dgjm5" Jul 16 11:09:06.953108 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.953060 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcf52\" (UniqueName: \"kubernetes.io/projected/eef4b1be-3c27-4c46-a708-939a8e5ac0e7-kube-api-access-zcf52\") pod \"cluster-samples-operator-65db858894-j7p6v\" (UID: \"eef4b1be-3c27-4c46-a708-939a8e5ac0e7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j7p6v" Jul 16 11:09:06.953108 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.953093 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j99fn\" (UniqueName: \"kubernetes.io/projected/f2c7c9c4-2916-443e-b82b-17927b6e116a-kube-api-access-j99fn\") pod \"cluster-monitoring-operator-5f7f494dd4-gc8vw\" (UID: \"f2c7c9c4-2916-443e-b82b-17927b6e116a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gc8vw" Jul 16 11:09:06.953273 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.953119 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g5gc\" (UniqueName: \"kubernetes.io/projected/5b70f755-1473-4067-92d4-d8f817b17963-kube-api-access-4g5gc\") pod \"insights-operator-68d9dd94cf-dgjm5\" (UID: \"5b70f755-1473-4067-92d4-d8f817b17963\") " pod="openshift-insights/insights-operator-68d9dd94cf-dgjm5" Jul 16 11:09:06.953273 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.953144 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eef4b1be-3c27-4c46-a708-939a8e5ac0e7-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-j7p6v\" (UID: \"eef4b1be-3c27-4c46-a708-939a8e5ac0e7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j7p6v" Jul 16 11:09:06.992099 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.992080 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qlp9w"] Jul 16 11:09:06.993859 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.993842 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qlp9w" Jul 16 11:09:06.996064 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.996037 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 16 11:09:06.996064 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.996042 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-t8dxz\"" Jul 16 11:09:06.996344 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.996328 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 16 11:09:06.996433 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.996354 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 16 11:09:06.996433 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:06.996381 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 16 11:09:07.004819 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.004795 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qlp9w"] Jul 16 11:09:07.053563 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.053544 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b70f755-1473-4067-92d4-d8f817b17963-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-dgjm5\" (UID: \"5b70f755-1473-4067-92d4-d8f817b17963\") " pod="openshift-insights/insights-operator-68d9dd94cf-dgjm5" Jul 16 11:09:07.053674 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.053572 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcf52\" (UniqueName: \"kubernetes.io/projected/eef4b1be-3c27-4c46-a708-939a8e5ac0e7-kube-api-access-zcf52\") pod \"cluster-samples-operator-65db858894-j7p6v\" (UID: \"eef4b1be-3c27-4c46-a708-939a8e5ac0e7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j7p6v" Jul 16 11:09:07.053674 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.053590 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8c18fa76-a392-4218-ad02-5f53da15a8e2-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-qlp9w\" (UID: \"8c18fa76-a392-4218-ad02-5f53da15a8e2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qlp9w" Jul 16 11:09:07.053674 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.053608 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j99fn\" (UniqueName: \"kubernetes.io/projected/f2c7c9c4-2916-443e-b82b-17927b6e116a-kube-api-access-j99fn\") pod \"cluster-monitoring-operator-5f7f494dd4-gc8vw\" (UID: \"f2c7c9c4-2916-443e-b82b-17927b6e116a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gc8vw" Jul 16 11:09:07.053674 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.053625 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g5gc\" (UniqueName: \"kubernetes.io/projected/5b70f755-1473-4067-92d4-d8f817b17963-kube-api-access-4g5gc\") pod \"insights-operator-68d9dd94cf-dgjm5\" (UID: \"5b70f755-1473-4067-92d4-d8f817b17963\") " pod="openshift-insights/insights-operator-68d9dd94cf-dgjm5" Jul 16 11:09:07.053860 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.053720 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5b70f755-1473-4067-92d4-d8f817b17963-snapshots\") pod \"insights-operator-68d9dd94cf-dgjm5\" (UID: \"5b70f755-1473-4067-92d4-d8f817b17963\") " pod="openshift-insights/insights-operator-68d9dd94cf-dgjm5" Jul 16 11:09:07.053860 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.053755 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f2c7c9c4-2916-443e-b82b-17927b6e116a-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-gc8vw\" (UID: \"f2c7c9c4-2916-443e-b82b-17927b6e116a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gc8vw" Jul 16 11:09:07.053860 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.053799 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b70f755-1473-4067-92d4-d8f817b17963-serving-cert\") pod \"insights-operator-68d9dd94cf-dgjm5\" (UID: \"5b70f755-1473-4067-92d4-d8f817b17963\") " pod="openshift-insights/insights-operator-68d9dd94cf-dgjm5" Jul 16 11:09:07.053860 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.053837 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2c7c9c4-2916-443e-b82b-17927b6e116a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-gc8vw\" (UID: \"f2c7c9c4-2916-443e-b82b-17927b6e116a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gc8vw" Jul 16 11:09:07.054056 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.053916 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b70f755-1473-4067-92d4-d8f817b17963-tmp\") pod \"insights-operator-68d9dd94cf-dgjm5\" (UID: \"5b70f755-1473-4067-92d4-d8f817b17963\") " pod="openshift-insights/insights-operator-68d9dd94cf-dgjm5" Jul 16 11:09:07.054056 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:07.053973 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 11:09:07.054056 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:07.054043 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2c7c9c4-2916-443e-b82b-17927b6e116a-cluster-monitoring-operator-tls podName:f2c7c9c4-2916-443e-b82b-17927b6e116a nodeName:}" failed. No retries permitted until 2026-07-16 11:09:07.554025508 +0000 UTC m=+55.306283287 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2c7c9c4-2916-443e-b82b-17927b6e116a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-gc8vw" (UID: "f2c7c9c4-2916-443e-b82b-17927b6e116a") : secret "cluster-monitoring-operator-tls" not found Jul 16 11:09:07.054212 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.054089 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8c18fa76-a392-4218-ad02-5f53da15a8e2-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-qlp9w\" (UID: \"8c18fa76-a392-4218-ad02-5f53da15a8e2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qlp9w" Jul 16 11:09:07.054212 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.054120 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eef4b1be-3c27-4c46-a708-939a8e5ac0e7-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-j7p6v\" (UID: \"eef4b1be-3c27-4c46-a708-939a8e5ac0e7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j7p6v" Jul 16 11:09:07.054212 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.054157 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b70f755-1473-4067-92d4-d8f817b17963-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-dgjm5\" (UID: \"5b70f755-1473-4067-92d4-d8f817b17963\") " pod="openshift-insights/insights-operator-68d9dd94cf-dgjm5" Jul 16 11:09:07.054212 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.054198 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z72q\" (UniqueName: \"kubernetes.io/projected/8c18fa76-a392-4218-ad02-5f53da15a8e2-kube-api-access-6z72q\") pod \"kube-storage-version-migrator-operator-799cb7f958-qlp9w\" (UID: \"8c18fa76-a392-4218-ad02-5f53da15a8e2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qlp9w" Jul 16 11:09:07.054464 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.054218 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b70f755-1473-4067-92d4-d8f817b17963-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-dgjm5\" (UID: \"5b70f755-1473-4067-92d4-d8f817b17963\") " pod="openshift-insights/insights-operator-68d9dd94cf-dgjm5" Jul 16 11:09:07.054464 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.054248 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btwkv\" (UniqueName: \"kubernetes.io/projected/c946b90a-62b9-4afb-ae16-7c3106228dca-kube-api-access-btwkv\") pod \"volume-data-source-validator-78495597f6-fl8xz\" (UID: \"c946b90a-62b9-4afb-ae16-7c3106228dca\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fl8xz" Jul 16 11:09:07.054464 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:07.054311 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 11:09:07.054464 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.054348 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b70f755-1473-4067-92d4-d8f817b17963-tmp\") pod \"insights-operator-68d9dd94cf-dgjm5\" (UID: \"5b70f755-1473-4067-92d4-d8f817b17963\") " pod="openshift-insights/insights-operator-68d9dd94cf-dgjm5" Jul 16 11:09:07.054464 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:07.054384 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eef4b1be-3c27-4c46-a708-939a8e5ac0e7-samples-operator-tls podName:eef4b1be-3c27-4c46-a708-939a8e5ac0e7 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:07.554364559 +0000 UTC m=+55.306622333 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/eef4b1be-3c27-4c46-a708-939a8e5ac0e7-samples-operator-tls") pod "cluster-samples-operator-65db858894-j7p6v" (UID: "eef4b1be-3c27-4c46-a708-939a8e5ac0e7") : secret "samples-operator-tls" not found Jul 16 11:09:07.054464 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.054398 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5b70f755-1473-4067-92d4-d8f817b17963-snapshots\") pod \"insights-operator-68d9dd94cf-dgjm5\" (UID: \"5b70f755-1473-4067-92d4-d8f817b17963\") " pod="openshift-insights/insights-operator-68d9dd94cf-dgjm5" Jul 16 11:09:07.054730 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.054591 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f2c7c9c4-2916-443e-b82b-17927b6e116a-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-gc8vw\" (UID: \"f2c7c9c4-2916-443e-b82b-17927b6e116a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gc8vw" Jul 16 11:09:07.054975 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.054958 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b70f755-1473-4067-92d4-d8f817b17963-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-dgjm5\" (UID: \"5b70f755-1473-4067-92d4-d8f817b17963\") " pod="openshift-insights/insights-operator-68d9dd94cf-dgjm5" Jul 16 11:09:07.057573 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.057554 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b70f755-1473-4067-92d4-d8f817b17963-serving-cert\") pod \"insights-operator-68d9dd94cf-dgjm5\" (UID: \"5b70f755-1473-4067-92d4-d8f817b17963\") " pod="openshift-insights/insights-operator-68d9dd94cf-dgjm5" Jul 16 11:09:07.067003 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.066978 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g5gc\" (UniqueName: \"kubernetes.io/projected/5b70f755-1473-4067-92d4-d8f817b17963-kube-api-access-4g5gc\") pod \"insights-operator-68d9dd94cf-dgjm5\" (UID: \"5b70f755-1473-4067-92d4-d8f817b17963\") " pod="openshift-insights/insights-operator-68d9dd94cf-dgjm5" Jul 16 11:09:07.067181 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.067164 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btwkv\" (UniqueName: \"kubernetes.io/projected/c946b90a-62b9-4afb-ae16-7c3106228dca-kube-api-access-btwkv\") pod \"volume-data-source-validator-78495597f6-fl8xz\" (UID: \"c946b90a-62b9-4afb-ae16-7c3106228dca\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fl8xz" Jul 16 11:09:07.068347 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.068327 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcf52\" (UniqueName: \"kubernetes.io/projected/eef4b1be-3c27-4c46-a708-939a8e5ac0e7-kube-api-access-zcf52\") pod \"cluster-samples-operator-65db858894-j7p6v\" (UID: \"eef4b1be-3c27-4c46-a708-939a8e5ac0e7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j7p6v" Jul 16 11:09:07.068664 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.068626 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j99fn\" (UniqueName: \"kubernetes.io/projected/f2c7c9c4-2916-443e-b82b-17927b6e116a-kube-api-access-j99fn\") pod \"cluster-monitoring-operator-5f7f494dd4-gc8vw\" (UID: \"f2c7c9c4-2916-443e-b82b-17927b6e116a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gc8vw" Jul 16 11:09:07.155190 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.155137 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8c18fa76-a392-4218-ad02-5f53da15a8e2-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-qlp9w\" (UID: \"8c18fa76-a392-4218-ad02-5f53da15a8e2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qlp9w" Jul 16 11:09:07.155190 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.155179 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z72q\" (UniqueName: \"kubernetes.io/projected/8c18fa76-a392-4218-ad02-5f53da15a8e2-kube-api-access-6z72q\") pod \"kube-storage-version-migrator-operator-799cb7f958-qlp9w\" (UID: \"8c18fa76-a392-4218-ad02-5f53da15a8e2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qlp9w" Jul 16 11:09:07.155344 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.155306 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8c18fa76-a392-4218-ad02-5f53da15a8e2-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-qlp9w\" (UID: \"8c18fa76-a392-4218-ad02-5f53da15a8e2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qlp9w" Jul 16 11:09:07.155813 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.155796 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8c18fa76-a392-4218-ad02-5f53da15a8e2-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-qlp9w\" (UID: \"8c18fa76-a392-4218-ad02-5f53da15a8e2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qlp9w" Jul 16 11:09:07.157001 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.156982 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8c18fa76-a392-4218-ad02-5f53da15a8e2-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-qlp9w\" (UID: \"8c18fa76-a392-4218-ad02-5f53da15a8e2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qlp9w" Jul 16 11:09:07.163911 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.163891 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z72q\" (UniqueName: \"kubernetes.io/projected/8c18fa76-a392-4218-ad02-5f53da15a8e2-kube-api-access-6z72q\") pod \"kube-storage-version-migrator-operator-799cb7f958-qlp9w\" (UID: \"8c18fa76-a392-4218-ad02-5f53da15a8e2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qlp9w" Jul 16 11:09:07.208804 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.208776 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fl8xz" Jul 16 11:09:07.228755 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.228731 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-dgjm5" Jul 16 11:09:07.301654 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.301605 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qlp9w" Jul 16 11:09:07.358529 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.358502 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fl8xz"] Jul 16 11:09:07.362929 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:09:07.362898 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc946b90a_62b9_4afb_ae16_7c3106228dca.slice/crio-7e559df6a42325056fd108c45cbfbf23de8a3a57c67e0457fc74dfdd4dd25457 WatchSource:0}: Error finding container 7e559df6a42325056fd108c45cbfbf23de8a3a57c67e0457fc74dfdd4dd25457: Status 404 returned error can't find the container with id 7e559df6a42325056fd108c45cbfbf23de8a3a57c67e0457fc74dfdd4dd25457 Jul 16 11:09:07.376785 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.376763 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-dgjm5"] Jul 16 11:09:07.381144 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:09:07.381120 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b70f755_1473_4067_92d4_d8f817b17963.slice/crio-52cb2da78901ca9a2af328ce6b610723da4fae76a40dbb8c2c09ed591fa87df2 WatchSource:0}: Error finding container 52cb2da78901ca9a2af328ce6b610723da4fae76a40dbb8c2c09ed591fa87df2: Status 404 returned error can't find the container with id 52cb2da78901ca9a2af328ce6b610723da4fae76a40dbb8c2c09ed591fa87df2 Jul 16 11:09:07.427529 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.427504 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qlp9w"] Jul 16 11:09:07.430301 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:09:07.430275 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c18fa76_a392_4218_ad02_5f53da15a8e2.slice/crio-e9c86adf34d1d333dfbb1fb496e8bb3be1595f47b91bfdedf095543be1dd60be WatchSource:0}: Error finding container e9c86adf34d1d333dfbb1fb496e8bb3be1595f47b91bfdedf095543be1dd60be: Status 404 returned error can't find the container with id e9c86adf34d1d333dfbb1fb496e8bb3be1595f47b91bfdedf095543be1dd60be Jul 16 11:09:07.558050 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.558015 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eef4b1be-3c27-4c46-a708-939a8e5ac0e7-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-j7p6v\" (UID: \"eef4b1be-3c27-4c46-a708-939a8e5ac0e7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j7p6v" Jul 16 11:09:07.558190 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:07.558169 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 11:09:07.558190 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.558181 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2c7c9c4-2916-443e-b82b-17927b6e116a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-gc8vw\" (UID: \"f2c7c9c4-2916-443e-b82b-17927b6e116a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gc8vw" Jul 16 11:09:07.558281 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:07.558227 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eef4b1be-3c27-4c46-a708-939a8e5ac0e7-samples-operator-tls podName:eef4b1be-3c27-4c46-a708-939a8e5ac0e7 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:08.558211527 +0000 UTC m=+56.310469299 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/eef4b1be-3c27-4c46-a708-939a8e5ac0e7-samples-operator-tls") pod "cluster-samples-operator-65db858894-j7p6v" (UID: "eef4b1be-3c27-4c46-a708-939a8e5ac0e7") : secret "samples-operator-tls" not found Jul 16 11:09:07.558281 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:07.558268 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 11:09:07.558350 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:07.558310 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2c7c9c4-2916-443e-b82b-17927b6e116a-cluster-monitoring-operator-tls podName:f2c7c9c4-2916-443e-b82b-17927b6e116a nodeName:}" failed. No retries permitted until 2026-07-16 11:09:08.558299099 +0000 UTC m=+56.310556876 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2c7c9c4-2916-443e-b82b-17927b6e116a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-gc8vw" (UID: "f2c7c9c4-2916-443e-b82b-17927b6e116a") : secret "cluster-monitoring-operator-tls" not found Jul 16 11:09:07.832114 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.832044 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-dgjm5" event={"ID":"5b70f755-1473-4067-92d4-d8f817b17963","Type":"ContainerStarted","Data":"52cb2da78901ca9a2af328ce6b610723da4fae76a40dbb8c2c09ed591fa87df2"} Jul 16 11:09:07.833281 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.833256 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qlp9w" event={"ID":"8c18fa76-a392-4218-ad02-5f53da15a8e2","Type":"ContainerStarted","Data":"e9c86adf34d1d333dfbb1fb496e8bb3be1595f47b91bfdedf095543be1dd60be"} Jul 16 11:09:07.834339 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:07.834318 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fl8xz" event={"ID":"c946b90a-62b9-4afb-ae16-7c3106228dca","Type":"ContainerStarted","Data":"7e559df6a42325056fd108c45cbfbf23de8a3a57c67e0457fc74dfdd4dd25457"} Jul 16 11:09:08.564355 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:08.564333 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eef4b1be-3c27-4c46-a708-939a8e5ac0e7-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-j7p6v\" (UID: \"eef4b1be-3c27-4c46-a708-939a8e5ac0e7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j7p6v" Jul 16 11:09:08.564729 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:08.564421 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2c7c9c4-2916-443e-b82b-17927b6e116a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-gc8vw\" (UID: \"f2c7c9c4-2916-443e-b82b-17927b6e116a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gc8vw" Jul 16 11:09:08.564729 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:08.564471 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 11:09:08.564729 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:08.564511 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 11:09:08.564729 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:08.564522 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eef4b1be-3c27-4c46-a708-939a8e5ac0e7-samples-operator-tls podName:eef4b1be-3c27-4c46-a708-939a8e5ac0e7 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:10.564507453 +0000 UTC m=+58.316765226 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/eef4b1be-3c27-4c46-a708-939a8e5ac0e7-samples-operator-tls") pod "cluster-samples-operator-65db858894-j7p6v" (UID: "eef4b1be-3c27-4c46-a708-939a8e5ac0e7") : secret "samples-operator-tls" not found Jul 16 11:09:08.564729 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:08.564551 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2c7c9c4-2916-443e-b82b-17927b6e116a-cluster-monitoring-operator-tls podName:f2c7c9c4-2916-443e-b82b-17927b6e116a nodeName:}" failed. No retries permitted until 2026-07-16 11:09:10.564538229 +0000 UTC m=+58.316796004 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2c7c9c4-2916-443e-b82b-17927b6e116a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-gc8vw" (UID: "f2c7c9c4-2916-443e-b82b-17927b6e116a") : secret "cluster-monitoring-operator-tls" not found Jul 16 11:09:08.839238 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:08.839165 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fl8xz" event={"ID":"c946b90a-62b9-4afb-ae16-7c3106228dca","Type":"ContainerStarted","Data":"0080bd1c3a1ea990b160fa9628cd773451fe60b6b115e8870a4bec556dd00d72"} Jul 16 11:09:08.858916 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:08.858852 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fl8xz" podStartSLOduration=1.6717698730000001 podStartE2EDuration="2.858832844s" totalImagesPullingTime="1.187062971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:09:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:09:08.857558321 +0000 UTC m=+56.609816145" watchObservedRunningTime="2026-07-16 11:09:08.858832844 +0000 UTC m=+56.611090640" Jul 16 11:09:09.844587 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:09.844553 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qlp9w" event={"ID":"8c18fa76-a392-4218-ad02-5f53da15a8e2","Type":"ContainerStarted","Data":"b4e4f2c34dd7c81ec49ed7cd45435fa0c130051bcb4b187333be2fd71a362fb2"} Jul 16 11:09:09.861238 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:09.861188 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qlp9w" podStartSLOduration=2.040726247 podStartE2EDuration="3.861169082s" totalImagesPullingTime="1.820442835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:09:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:09:09.860874035 +0000 UTC m=+57.613131853" watchObservedRunningTime="2026-07-16 11:09:09.861169082 +0000 UTC m=+57.613426859" Jul 16 11:09:10.579815 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:10.579784 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2c7c9c4-2916-443e-b82b-17927b6e116a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-gc8vw\" (UID: \"f2c7c9c4-2916-443e-b82b-17927b6e116a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gc8vw" Jul 16 11:09:10.579976 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:10.579834 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eef4b1be-3c27-4c46-a708-939a8e5ac0e7-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-j7p6v\" (UID: \"eef4b1be-3c27-4c46-a708-939a8e5ac0e7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j7p6v" Jul 16 11:09:10.579976 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:10.579939 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 11:09:10.579976 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:10.579968 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 11:09:10.580079 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:10.580003 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2c7c9c4-2916-443e-b82b-17927b6e116a-cluster-monitoring-operator-tls podName:f2c7c9c4-2916-443e-b82b-17927b6e116a nodeName:}" failed. No retries permitted until 2026-07-16 11:09:14.579988108 +0000 UTC m=+62.332245912 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2c7c9c4-2916-443e-b82b-17927b6e116a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-gc8vw" (UID: "f2c7c9c4-2916-443e-b82b-17927b6e116a") : secret "cluster-monitoring-operator-tls" not found Jul 16 11:09:10.580079 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:10.580019 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eef4b1be-3c27-4c46-a708-939a8e5ac0e7-samples-operator-tls podName:eef4b1be-3c27-4c46-a708-939a8e5ac0e7 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:14.580012444 +0000 UTC m=+62.332270217 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/eef4b1be-3c27-4c46-a708-939a8e5ac0e7-samples-operator-tls") pod "cluster-samples-operator-65db858894-j7p6v" (UID: "eef4b1be-3c27-4c46-a708-939a8e5ac0e7") : secret "samples-operator-tls" not found Jul 16 11:09:10.612321 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:10.612295 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fsmjm"] Jul 16 11:09:10.627993 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:10.627970 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fsmjm" Jul 16 11:09:10.631546 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:10.631516 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 16 11:09:10.633404 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:10.633371 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 16 11:09:10.636556 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:10.636530 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-x5x45\"" Jul 16 11:09:10.649660 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:10.649622 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fsmjm"] Jul 16 11:09:10.680963 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:10.680942 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trxqd\" (UniqueName: \"kubernetes.io/projected/4042f669-3669-4616-91cb-1b5f6da88007-kube-api-access-trxqd\") pod \"migrator-7f59b54f6c-fsmjm\" (UID: \"4042f669-3669-4616-91cb-1b5f6da88007\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fsmjm" Jul 16 11:09:10.781926 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:10.781901 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trxqd\" (UniqueName: \"kubernetes.io/projected/4042f669-3669-4616-91cb-1b5f6da88007-kube-api-access-trxqd\") pod \"migrator-7f59b54f6c-fsmjm\" (UID: \"4042f669-3669-4616-91cb-1b5f6da88007\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fsmjm" Jul 16 11:09:10.791832 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:10.791807 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trxqd\" (UniqueName: \"kubernetes.io/projected/4042f669-3669-4616-91cb-1b5f6da88007-kube-api-access-trxqd\") pod \"migrator-7f59b54f6c-fsmjm\" (UID: \"4042f669-3669-4616-91cb-1b5f6da88007\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fsmjm" Jul 16 11:09:10.938678 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:10.938648 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fsmjm" Jul 16 11:09:11.345027 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:11.345009 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fsmjm"] Jul 16 11:09:11.347207 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:09:11.347180 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4042f669_3669_4616_91cb_1b5f6da88007.slice/crio-b41c27bc6cb0c6508bcdbee5f10ce838553cff5cc04eef78b58005d2fdf4ee40 WatchSource:0}: Error finding container b41c27bc6cb0c6508bcdbee5f10ce838553cff5cc04eef78b58005d2fdf4ee40: Status 404 returned error can't find the container with id b41c27bc6cb0c6508bcdbee5f10ce838553cff5cc04eef78b58005d2fdf4ee40 Jul 16 11:09:11.764700 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:11.764680 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jdfpt" Jul 16 11:09:11.854483 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:11.854455 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-dgjm5" event={"ID":"5b70f755-1473-4067-92d4-d8f817b17963","Type":"ContainerStarted","Data":"bc1d8739e804174b2f50a131e1de7862fc848db54c5879ff8f2ac878b92c3c3c"} Jul 16 11:09:11.855467 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:11.855447 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fsmjm" event={"ID":"4042f669-3669-4616-91cb-1b5f6da88007","Type":"ContainerStarted","Data":"b41c27bc6cb0c6508bcdbee5f10ce838553cff5cc04eef78b58005d2fdf4ee40"} Jul 16 11:09:11.886307 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:11.886262 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-dgjm5" podStartSLOduration=2.020335477 podStartE2EDuration="5.886246062s" totalImagesPullingTime="3.865910585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:09:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:09:11.885707825 +0000 UTC m=+59.637965621" watchObservedRunningTime="2026-07-16 11:09:11.886246062 +0000 UTC m=+59.638503859" Jul 16 11:09:12.864396 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:12.864314 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fsmjm" event={"ID":"4042f669-3669-4616-91cb-1b5f6da88007","Type":"ContainerStarted","Data":"1089f217de689e2a9a68abec0b823ac8cb36b339a6fd7726fdd98e9e482a2fdd"} Jul 16 11:09:12.864813 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:12.864406 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fsmjm" event={"ID":"4042f669-3669-4616-91cb-1b5f6da88007","Type":"ContainerStarted","Data":"a7c43dfffadf9a629de679a5e1cc99642ed2eeb8f1531ef295bd097188734724"} Jul 16 11:09:12.893978 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:12.893859 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fsmjm" podStartSLOduration=1.712404579 podStartE2EDuration="2.893841047s" totalImagesPullingTime="1.181436468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:09:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:09:12.892447517 +0000 UTC m=+60.644705311" watchObservedRunningTime="2026-07-16 11:09:12.893841047 +0000 UTC m=+60.646098839" Jul 16 11:09:12.908648 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:12.908598 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tg5pd"] Jul 16 11:09:12.911751 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:12.911735 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tg5pd" Jul 16 11:09:12.913807 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:12.913783 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 16 11:09:12.913915 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:12.913844 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 16 11:09:12.913983 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:12.913969 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hljx9\"" Jul 16 11:09:12.926914 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:12.926892 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tg5pd"] Jul 16 11:09:13.000988 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:13.000960 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c1a3bd51-3d95-4693-85d7-890cb7e0615c-data-volume\") pod \"insights-runtime-extractor-tg5pd\" (UID: \"c1a3bd51-3d95-4693-85d7-890cb7e0615c\") " pod="openshift-insights/insights-runtime-extractor-tg5pd" Jul 16 11:09:13.001094 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:13.001015 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c1a3bd51-3d95-4693-85d7-890cb7e0615c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tg5pd\" (UID: \"c1a3bd51-3d95-4693-85d7-890cb7e0615c\") " pod="openshift-insights/insights-runtime-extractor-tg5pd" Jul 16 11:09:13.001094 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:13.001085 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c1a3bd51-3d95-4693-85d7-890cb7e0615c-crio-socket\") pod \"insights-runtime-extractor-tg5pd\" (UID: \"c1a3bd51-3d95-4693-85d7-890cb7e0615c\") " pod="openshift-insights/insights-runtime-extractor-tg5pd" Jul 16 11:09:13.001176 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:13.001159 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5rg6\" (UniqueName: \"kubernetes.io/projected/c1a3bd51-3d95-4693-85d7-890cb7e0615c-kube-api-access-r5rg6\") pod \"insights-runtime-extractor-tg5pd\" (UID: \"c1a3bd51-3d95-4693-85d7-890cb7e0615c\") " pod="openshift-insights/insights-runtime-extractor-tg5pd" Jul 16 11:09:13.001212 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:13.001200 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c1a3bd51-3d95-4693-85d7-890cb7e0615c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tg5pd\" (UID: \"c1a3bd51-3d95-4693-85d7-890cb7e0615c\") " pod="openshift-insights/insights-runtime-extractor-tg5pd" Jul 16 11:09:13.102369 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:13.102337 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c1a3bd51-3d95-4693-85d7-890cb7e0615c-data-volume\") pod \"insights-runtime-extractor-tg5pd\" (UID: \"c1a3bd51-3d95-4693-85d7-890cb7e0615c\") " pod="openshift-insights/insights-runtime-extractor-tg5pd" Jul 16 11:09:13.102470 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:13.102403 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c1a3bd51-3d95-4693-85d7-890cb7e0615c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tg5pd\" (UID: \"c1a3bd51-3d95-4693-85d7-890cb7e0615c\") " pod="openshift-insights/insights-runtime-extractor-tg5pd" Jul 16 11:09:13.102470 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:13.102446 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c1a3bd51-3d95-4693-85d7-890cb7e0615c-crio-socket\") pod \"insights-runtime-extractor-tg5pd\" (UID: \"c1a3bd51-3d95-4693-85d7-890cb7e0615c\") " pod="openshift-insights/insights-runtime-extractor-tg5pd" Jul 16 11:09:13.102535 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:13.102466 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 11:09:13.102535 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:13.102483 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5rg6\" (UniqueName: \"kubernetes.io/projected/c1a3bd51-3d95-4693-85d7-890cb7e0615c-kube-api-access-r5rg6\") pod \"insights-runtime-extractor-tg5pd\" (UID: \"c1a3bd51-3d95-4693-85d7-890cb7e0615c\") " pod="openshift-insights/insights-runtime-extractor-tg5pd" Jul 16 11:09:13.102535 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:13.102523 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c1a3bd51-3d95-4693-85d7-890cb7e0615c-kube-rbac-proxy-cm podName:c1a3bd51-3d95-4693-85d7-890cb7e0615c nodeName:}" failed. No retries permitted until 2026-07-16 11:09:13.60250852 +0000 UTC m=+61.354766296 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c1a3bd51-3d95-4693-85d7-890cb7e0615c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tg5pd" (UID: "c1a3bd51-3d95-4693-85d7-890cb7e0615c") : configmap "kube-rbac-proxy" not found Jul 16 11:09:13.102664 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:13.102546 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c1a3bd51-3d95-4693-85d7-890cb7e0615c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tg5pd\" (UID: \"c1a3bd51-3d95-4693-85d7-890cb7e0615c\") " pod="openshift-insights/insights-runtime-extractor-tg5pd" Jul 16 11:09:13.102664 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:13.102566 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c1a3bd51-3d95-4693-85d7-890cb7e0615c-crio-socket\") pod \"insights-runtime-extractor-tg5pd\" (UID: \"c1a3bd51-3d95-4693-85d7-890cb7e0615c\") " pod="openshift-insights/insights-runtime-extractor-tg5pd" Jul 16 11:09:13.102664 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:13.102651 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 11:09:13.102776 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:13.102676 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c1a3bd51-3d95-4693-85d7-890cb7e0615c-data-volume\") pod \"insights-runtime-extractor-tg5pd\" (UID: \"c1a3bd51-3d95-4693-85d7-890cb7e0615c\") " pod="openshift-insights/insights-runtime-extractor-tg5pd" Jul 16 11:09:13.102776 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:13.102694 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1a3bd51-3d95-4693-85d7-890cb7e0615c-insights-runtime-extractor-tls podName:c1a3bd51-3d95-4693-85d7-890cb7e0615c nodeName:}" failed. No retries permitted until 2026-07-16 11:09:13.602682712 +0000 UTC m=+61.354940486 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c1a3bd51-3d95-4693-85d7-890cb7e0615c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tg5pd" (UID: "c1a3bd51-3d95-4693-85d7-890cb7e0615c") : secret "insights-runtime-extractor-tls" not found Jul 16 11:09:13.111781 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:13.111761 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5rg6\" (UniqueName: \"kubernetes.io/projected/c1a3bd51-3d95-4693-85d7-890cb7e0615c-kube-api-access-r5rg6\") pod \"insights-runtime-extractor-tg5pd\" (UID: \"c1a3bd51-3d95-4693-85d7-890cb7e0615c\") " pod="openshift-insights/insights-runtime-extractor-tg5pd" Jul 16 11:09:13.606057 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:13.606023 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c1a3bd51-3d95-4693-85d7-890cb7e0615c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tg5pd\" (UID: \"c1a3bd51-3d95-4693-85d7-890cb7e0615c\") " pod="openshift-insights/insights-runtime-extractor-tg5pd" Jul 16 11:09:13.606231 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:13.606120 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c1a3bd51-3d95-4693-85d7-890cb7e0615c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tg5pd\" (UID: \"c1a3bd51-3d95-4693-85d7-890cb7e0615c\") " pod="openshift-insights/insights-runtime-extractor-tg5pd" Jul 16 11:09:13.606231 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:13.606177 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 11:09:13.606231 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:13.606227 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 11:09:13.606336 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:13.606264 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c1a3bd51-3d95-4693-85d7-890cb7e0615c-kube-rbac-proxy-cm podName:c1a3bd51-3d95-4693-85d7-890cb7e0615c nodeName:}" failed. No retries permitted until 2026-07-16 11:09:14.606239731 +0000 UTC m=+62.358497522 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c1a3bd51-3d95-4693-85d7-890cb7e0615c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tg5pd" (UID: "c1a3bd51-3d95-4693-85d7-890cb7e0615c") : configmap "kube-rbac-proxy" not found Jul 16 11:09:13.606336 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:13.606282 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1a3bd51-3d95-4693-85d7-890cb7e0615c-insights-runtime-extractor-tls podName:c1a3bd51-3d95-4693-85d7-890cb7e0615c nodeName:}" failed. No retries permitted until 2026-07-16 11:09:14.606272537 +0000 UTC m=+62.358530309 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c1a3bd51-3d95-4693-85d7-890cb7e0615c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tg5pd" (UID: "c1a3bd51-3d95-4693-85d7-890cb7e0615c") : secret "insights-runtime-extractor-tls" not found Jul 16 11:09:14.613902 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:14.613861 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2c7c9c4-2916-443e-b82b-17927b6e116a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-gc8vw\" (UID: \"f2c7c9c4-2916-443e-b82b-17927b6e116a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gc8vw" Jul 16 11:09:14.614270 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:14.613911 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c1a3bd51-3d95-4693-85d7-890cb7e0615c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tg5pd\" (UID: \"c1a3bd51-3d95-4693-85d7-890cb7e0615c\") " pod="openshift-insights/insights-runtime-extractor-tg5pd" Jul 16 11:09:14.614270 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:14.613934 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eef4b1be-3c27-4c46-a708-939a8e5ac0e7-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-j7p6v\" (UID: \"eef4b1be-3c27-4c46-a708-939a8e5ac0e7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j7p6v" Jul 16 11:09:14.614270 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:14.613987 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c1a3bd51-3d95-4693-85d7-890cb7e0615c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tg5pd\" (UID: \"c1a3bd51-3d95-4693-85d7-890cb7e0615c\") " pod="openshift-insights/insights-runtime-extractor-tg5pd" Jul 16 11:09:14.614270 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:14.613995 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 11:09:14.614270 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:14.614019 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 11:09:14.614270 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:14.614082 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2c7c9c4-2916-443e-b82b-17927b6e116a-cluster-monitoring-operator-tls podName:f2c7c9c4-2916-443e-b82b-17927b6e116a nodeName:}" failed. No retries permitted until 2026-07-16 11:09:22.614060524 +0000 UTC m=+70.366318358 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2c7c9c4-2916-443e-b82b-17927b6e116a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-gc8vw" (UID: "f2c7c9c4-2916-443e-b82b-17927b6e116a") : secret "cluster-monitoring-operator-tls" not found Jul 16 11:09:14.614270 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:14.614098 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c1a3bd51-3d95-4693-85d7-890cb7e0615c-kube-rbac-proxy-cm podName:c1a3bd51-3d95-4693-85d7-890cb7e0615c nodeName:}" failed. No retries permitted until 2026-07-16 11:09:16.614090825 +0000 UTC m=+64.366348597 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c1a3bd51-3d95-4693-85d7-890cb7e0615c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tg5pd" (UID: "c1a3bd51-3d95-4693-85d7-890cb7e0615c") : configmap "kube-rbac-proxy" not found Jul 16 11:09:14.614270 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:14.614112 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 11:09:14.614270 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:14.614112 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 11:09:14.614270 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:14.614204 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eef4b1be-3c27-4c46-a708-939a8e5ac0e7-samples-operator-tls podName:eef4b1be-3c27-4c46-a708-939a8e5ac0e7 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:22.614184681 +0000 UTC m=+70.366442480 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/eef4b1be-3c27-4c46-a708-939a8e5ac0e7-samples-operator-tls") pod "cluster-samples-operator-65db858894-j7p6v" (UID: "eef4b1be-3c27-4c46-a708-939a8e5ac0e7") : secret "samples-operator-tls" not found Jul 16 11:09:14.614270 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:14.614229 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1a3bd51-3d95-4693-85d7-890cb7e0615c-insights-runtime-extractor-tls podName:c1a3bd51-3d95-4693-85d7-890cb7e0615c nodeName:}" failed. No retries permitted until 2026-07-16 11:09:16.614218302 +0000 UTC m=+64.366476075 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c1a3bd51-3d95-4693-85d7-890cb7e0615c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tg5pd" (UID: "c1a3bd51-3d95-4693-85d7-890cb7e0615c") : secret "insights-runtime-extractor-tls" not found Jul 16 11:09:15.699920 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:15.699886 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-czbrz_7444f424-775b-4cb1-b13a-eeb72471a42a/dns-node-resolver/0.log" Jul 16 11:09:16.628114 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:16.628074 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c1a3bd51-3d95-4693-85d7-890cb7e0615c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tg5pd\" (UID: \"c1a3bd51-3d95-4693-85d7-890cb7e0615c\") " pod="openshift-insights/insights-runtime-extractor-tg5pd" Jul 16 11:09:16.628328 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:16.628147 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c1a3bd51-3d95-4693-85d7-890cb7e0615c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tg5pd\" (UID: \"c1a3bd51-3d95-4693-85d7-890cb7e0615c\") " pod="openshift-insights/insights-runtime-extractor-tg5pd" Jul 16 11:09:16.628328 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:16.628226 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 11:09:16.628328 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:16.628296 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 11:09:16.628328 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:16.628318 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c1a3bd51-3d95-4693-85d7-890cb7e0615c-kube-rbac-proxy-cm podName:c1a3bd51-3d95-4693-85d7-890cb7e0615c nodeName:}" failed. No retries permitted until 2026-07-16 11:09:20.628297303 +0000 UTC m=+68.380555107 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c1a3bd51-3d95-4693-85d7-890cb7e0615c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tg5pd" (UID: "c1a3bd51-3d95-4693-85d7-890cb7e0615c") : configmap "kube-rbac-proxy" not found Jul 16 11:09:16.628556 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:16.628348 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1a3bd51-3d95-4693-85d7-890cb7e0615c-insights-runtime-extractor-tls podName:c1a3bd51-3d95-4693-85d7-890cb7e0615c nodeName:}" failed. No retries permitted until 2026-07-16 11:09:20.628335349 +0000 UTC m=+68.380593123 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c1a3bd51-3d95-4693-85d7-890cb7e0615c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tg5pd" (UID: "c1a3bd51-3d95-4693-85d7-890cb7e0615c") : secret "insights-runtime-extractor-tls" not found Jul 16 11:09:16.899514 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:16.899447 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tds89_2080a1e9-bedc-4011-803a-6fda7f7e39e0/node-ca/0.log" Jul 16 11:09:17.699320 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:17.699268 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xsg4k_45cdc2d0-20f4-4f63-83cb-80b6e9159a97/serve-healthcheck-canary/0.log" Jul 16 11:09:17.899942 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:17.899910 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-fsmjm_4042f669-3669-4616-91cb-1b5f6da88007/migrator/0.log" Jul 16 11:09:18.099396 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:18.099322 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-fsmjm_4042f669-3669-4616-91cb-1b5f6da88007/graceful-termination/0.log" Jul 16 11:09:18.299750 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:18.299725 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-qlp9w_8c18fa76-a392-4218-ad02-5f53da15a8e2/kube-storage-version-migrator-operator/0.log" Jul 16 11:09:18.341211 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:18.341190 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3934cfdb-5ad2-4c13-8649-8a06c0c0e504-metrics-certs\") pod \"network-metrics-daemon-vdpj9\" (UID: \"3934cfdb-5ad2-4c13-8649-8a06c0c0e504\") " pod="openshift-multus/network-metrics-daemon-vdpj9" Jul 16 11:09:18.343468 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:18.343451 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 11:09:18.352246 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:18.352198 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 16 11:09:18.352323 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:18.352256 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3934cfdb-5ad2-4c13-8649-8a06c0c0e504-metrics-certs podName:3934cfdb-5ad2-4c13-8649-8a06c0c0e504 nodeName:}" failed. No retries permitted until 2026-07-16 11:10:22.352238959 +0000 UTC m=+130.104496747 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3934cfdb-5ad2-4c13-8649-8a06c0c0e504-metrics-certs") pod "network-metrics-daemon-vdpj9" (UID: "3934cfdb-5ad2-4c13-8649-8a06c0c0e504") : secret "metrics-daemon-secret" not found Jul 16 11:09:18.442049 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:18.442016 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6355a8cf-05e9-476a-9fbb-ee2612316853-original-pull-secret\") pod \"global-pull-secret-syncer-krgqh\" (UID: \"6355a8cf-05e9-476a-9fbb-ee2612316853\") " pod="kube-system/global-pull-secret-syncer-krgqh" Jul 16 11:09:18.442170 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:18.442152 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rznn\" (UniqueName: \"kubernetes.io/projected/148edf32-8cc4-4684-b3a7-063d497b0a53-kube-api-access-4rznn\") pod \"network-check-target-xcw4r\" (UID: \"148edf32-8cc4-4684-b3a7-063d497b0a53\") " pod="openshift-network-diagnostics/network-check-target-xcw4r" Jul 16 11:09:18.444560 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:18.444542 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 11:09:18.444641 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:18.444566 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 11:09:18.454988 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:18.454965 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 11:09:18.455461 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:18.455441 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6355a8cf-05e9-476a-9fbb-ee2612316853-original-pull-secret\") pod \"global-pull-secret-syncer-krgqh\" (UID: \"6355a8cf-05e9-476a-9fbb-ee2612316853\") " pod="kube-system/global-pull-secret-syncer-krgqh" Jul 16 11:09:18.465887 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:18.465859 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rznn\" (UniqueName: \"kubernetes.io/projected/148edf32-8cc4-4684-b3a7-063d497b0a53-kube-api-access-4rznn\") pod \"network-check-target-xcw4r\" (UID: \"148edf32-8cc4-4684-b3a7-063d497b0a53\") " pod="openshift-network-diagnostics/network-check-target-xcw4r" Jul 16 11:09:18.556075 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:18.556044 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-krgqh" Jul 16 11:09:18.662967 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:18.662947 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wdm79\"" Jul 16 11:09:18.671713 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:18.671689 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcw4r" Jul 16 11:09:18.681039 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:18.681017 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-krgqh"] Jul 16 11:09:18.684661 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:09:18.684621 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6355a8cf_05e9_476a_9fbb_ee2612316853.slice/crio-2395759a7cb1d44fc2895e1628190c0a8d91bf2ec6c1841186fb87021520d7a2 WatchSource:0}: Error finding container 2395759a7cb1d44fc2895e1628190c0a8d91bf2ec6c1841186fb87021520d7a2: Status 404 returned error can't find the container with id 2395759a7cb1d44fc2895e1628190c0a8d91bf2ec6c1841186fb87021520d7a2 Jul 16 11:09:18.792572 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:18.792399 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xcw4r"] Jul 16 11:09:18.795158 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:09:18.795126 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod148edf32_8cc4_4684_b3a7_063d497b0a53.slice/crio-b110e80b5a7c82fc0fb8bd5081e9e1b02a4e2e2341eaf9949af9afcaf8822e6e WatchSource:0}: Error finding container b110e80b5a7c82fc0fb8bd5081e9e1b02a4e2e2341eaf9949af9afcaf8822e6e: Status 404 returned error can't find the container with id b110e80b5a7c82fc0fb8bd5081e9e1b02a4e2e2341eaf9949af9afcaf8822e6e Jul 16 11:09:18.883010 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:18.882950 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xcw4r" event={"ID":"148edf32-8cc4-4684-b3a7-063d497b0a53","Type":"ContainerStarted","Data":"b110e80b5a7c82fc0fb8bd5081e9e1b02a4e2e2341eaf9949af9afcaf8822e6e"} Jul 16 11:09:18.884089 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:18.884070 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-krgqh" event={"ID":"6355a8cf-05e9-476a-9fbb-ee2612316853","Type":"ContainerStarted","Data":"2395759a7cb1d44fc2895e1628190c0a8d91bf2ec6c1841186fb87021520d7a2"} Jul 16 11:09:18.946053 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:18.946033 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-registry-tls\") pod \"image-registry-54dff647f6-vp85x\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:09:18.946332 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:18.946181 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 11:09:18.946332 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:18.946199 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54dff647f6-vp85x: secret "image-registry-tls" not found Jul 16 11:09:18.946332 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:18.946251 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-registry-tls podName:017eface-a126-4eec-961d-b076e61b5f45 nodeName:}" failed. No retries permitted until 2026-07-16 11:09:50.946236431 +0000 UTC m=+98.698494224 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-registry-tls") pod "image-registry-54dff647f6-vp85x" (UID: "017eface-a126-4eec-961d-b076e61b5f45") : secret "image-registry-tls" not found Jul 16 11:09:19.046696 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:19.046671 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f092f0d-2c7a-4b1e-8598-23348b575cff-metrics-tls\") pod \"dns-default-v5z75\" (UID: \"0f092f0d-2c7a-4b1e-8598-23348b575cff\") " pod="openshift-dns/dns-default-v5z75" Jul 16 11:09:19.046803 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:19.046791 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 11:09:19.046852 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:19.046835 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f092f0d-2c7a-4b1e-8598-23348b575cff-metrics-tls podName:0f092f0d-2c7a-4b1e-8598-23348b575cff nodeName:}" failed. No retries permitted until 2026-07-16 11:09:51.046824061 +0000 UTC m=+98.799081839 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f092f0d-2c7a-4b1e-8598-23348b575cff-metrics-tls") pod "dns-default-v5z75" (UID: "0f092f0d-2c7a-4b1e-8598-23348b575cff") : secret "dns-default-metrics-tls" not found Jul 16 11:09:20.661144 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:20.661061 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c1a3bd51-3d95-4693-85d7-890cb7e0615c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tg5pd\" (UID: \"c1a3bd51-3d95-4693-85d7-890cb7e0615c\") " pod="openshift-insights/insights-runtime-extractor-tg5pd" Jul 16 11:09:20.661574 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:20.661195 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 11:09:20.661574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:20.661241 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c1a3bd51-3d95-4693-85d7-890cb7e0615c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tg5pd\" (UID: \"c1a3bd51-3d95-4693-85d7-890cb7e0615c\") " pod="openshift-insights/insights-runtime-extractor-tg5pd" Jul 16 11:09:20.661574 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:20.661271 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c1a3bd51-3d95-4693-85d7-890cb7e0615c-kube-rbac-proxy-cm podName:c1a3bd51-3d95-4693-85d7-890cb7e0615c nodeName:}" failed. No retries permitted until 2026-07-16 11:09:28.661249839 +0000 UTC m=+76.413507615 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c1a3bd51-3d95-4693-85d7-890cb7e0615c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tg5pd" (UID: "c1a3bd51-3d95-4693-85d7-890cb7e0615c") : configmap "kube-rbac-proxy" not found Jul 16 11:09:20.661574 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:20.661333 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 11:09:20.661574 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:20.661388 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1a3bd51-3d95-4693-85d7-890cb7e0615c-insights-runtime-extractor-tls podName:c1a3bd51-3d95-4693-85d7-890cb7e0615c nodeName:}" failed. No retries permitted until 2026-07-16 11:09:28.661373653 +0000 UTC m=+76.413631428 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c1a3bd51-3d95-4693-85d7-890cb7e0615c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tg5pd" (UID: "c1a3bd51-3d95-4693-85d7-890cb7e0615c") : secret "insights-runtime-extractor-tls" not found Jul 16 11:09:22.678605 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:22.678571 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eef4b1be-3c27-4c46-a708-939a8e5ac0e7-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-j7p6v\" (UID: \"eef4b1be-3c27-4c46-a708-939a8e5ac0e7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j7p6v" Jul 16 11:09:22.679076 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:22.678696 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2c7c9c4-2916-443e-b82b-17927b6e116a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-gc8vw\" (UID: \"f2c7c9c4-2916-443e-b82b-17927b6e116a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gc8vw" Jul 16 11:09:22.679076 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:22.678783 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 11:09:22.679076 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:22.678833 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2c7c9c4-2916-443e-b82b-17927b6e116a-cluster-monitoring-operator-tls podName:f2c7c9c4-2916-443e-b82b-17927b6e116a nodeName:}" failed. No retries permitted until 2026-07-16 11:09:38.678819322 +0000 UTC m=+86.431077094 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2c7c9c4-2916-443e-b82b-17927b6e116a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-gc8vw" (UID: "f2c7c9c4-2916-443e-b82b-17927b6e116a") : secret "cluster-monitoring-operator-tls" not found Jul 16 11:09:22.681184 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:22.681154 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eef4b1be-3c27-4c46-a708-939a8e5ac0e7-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-j7p6v\" (UID: \"eef4b1be-3c27-4c46-a708-939a8e5ac0e7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j7p6v" Jul 16 11:09:22.820154 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:22.820126 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-xzrs7\"" Jul 16 11:09:22.828196 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:22.828175 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j7p6v" Jul 16 11:09:23.578393 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:23.578371 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j7p6v"] Jul 16 11:09:23.902293 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:23.902217 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j7p6v" event={"ID":"eef4b1be-3c27-4c46-a708-939a8e5ac0e7","Type":"ContainerStarted","Data":"ba829985e179c8f902e2e3b646564fd58cf8a8228ea0c430bd0e3629bfc7da27"} Jul 16 11:09:23.903751 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:23.903717 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-krgqh" event={"ID":"6355a8cf-05e9-476a-9fbb-ee2612316853","Type":"ContainerStarted","Data":"586aee5d3b72a633a9348b0785f85aa0eeee66a0a92a10c67023ff581952db4e"} Jul 16 11:09:23.905096 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:23.905070 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xcw4r" event={"ID":"148edf32-8cc4-4684-b3a7-063d497b0a53","Type":"ContainerStarted","Data":"270d70aa10fa92e03f3db7081a9134335ee0513c18af3b8eb8db94094935046d"} Jul 16 11:09:23.905219 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:23.905203 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xcw4r" Jul 16 11:09:23.918264 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:23.918217 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-krgqh" podStartSLOduration=66.138533541 podStartE2EDuration="1m10.918201112s" totalImagesPullingTime="4.779667571s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:09:23.917446249 +0000 UTC m=+71.669704056" watchObservedRunningTime="2026-07-16 11:09:23.918201112 +0000 UTC m=+71.670458912" Jul 16 11:09:23.931987 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:23.931943 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xcw4r" podStartSLOduration=67.273175318 podStartE2EDuration="1m11.931926768s" totalImagesPullingTime="4.65875145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:08:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:09:23.931741822 +0000 UTC m=+71.683999616" watchObservedRunningTime="2026-07-16 11:09:23.931926768 +0000 UTC m=+71.684184563" Jul 16 11:09:25.913745 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:25.913706 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j7p6v" event={"ID":"eef4b1be-3c27-4c46-a708-939a8e5ac0e7","Type":"ContainerStarted","Data":"674f560b335dcff75b44c9dbc7cc7b950c8119ad68df7d67abe8c53e78a5b9c2"} Jul 16 11:09:25.914155 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:25.913772 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j7p6v" event={"ID":"eef4b1be-3c27-4c46-a708-939a8e5ac0e7","Type":"ContainerStarted","Data":"ed91513b6a5cd19b9fdd9c8185e0a5a2f8d09e5d16c20a8e2439acfdf6173baa"} Jul 16 11:09:25.931902 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:25.931852 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-j7p6v" podStartSLOduration=18.416343296 podStartE2EDuration="19.931832819s" totalImagesPullingTime="1.515489523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:09:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:09:25.931404629 +0000 UTC m=+73.683662424" watchObservedRunningTime="2026-07-16 11:09:25.931832819 +0000 UTC m=+73.684090618" Jul 16 11:09:28.724464 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:28.724424 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c1a3bd51-3d95-4693-85d7-890cb7e0615c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tg5pd\" (UID: \"c1a3bd51-3d95-4693-85d7-890cb7e0615c\") " pod="openshift-insights/insights-runtime-extractor-tg5pd" Jul 16 11:09:28.724902 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:28.724486 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c1a3bd51-3d95-4693-85d7-890cb7e0615c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tg5pd\" (UID: \"c1a3bd51-3d95-4693-85d7-890cb7e0615c\") " pod="openshift-insights/insights-runtime-extractor-tg5pd" Jul 16 11:09:28.724902 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:28.724593 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 11:09:28.724902 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:09:28.724670 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1a3bd51-3d95-4693-85d7-890cb7e0615c-insights-runtime-extractor-tls podName:c1a3bd51-3d95-4693-85d7-890cb7e0615c nodeName:}" failed. No retries permitted until 2026-07-16 11:09:44.72465513 +0000 UTC m=+92.476912917 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c1a3bd51-3d95-4693-85d7-890cb7e0615c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tg5pd" (UID: "c1a3bd51-3d95-4693-85d7-890cb7e0615c") : secret "insights-runtime-extractor-tls" not found Jul 16 11:09:28.725021 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:28.724991 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c1a3bd51-3d95-4693-85d7-890cb7e0615c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tg5pd\" (UID: \"c1a3bd51-3d95-4693-85d7-890cb7e0615c\") " pod="openshift-insights/insights-runtime-extractor-tg5pd" Jul 16 11:09:38.693738 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:38.693581 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2c7c9c4-2916-443e-b82b-17927b6e116a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-gc8vw\" (UID: \"f2c7c9c4-2916-443e-b82b-17927b6e116a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gc8vw" Jul 16 11:09:38.696230 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:38.696204 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2c7c9c4-2916-443e-b82b-17927b6e116a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-gc8vw\" (UID: \"f2c7c9c4-2916-443e-b82b-17927b6e116a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gc8vw" Jul 16 11:09:38.726291 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:38.726259 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lc2gt\"" Jul 16 11:09:38.734856 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:38.734832 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gc8vw" Jul 16 11:09:38.858181 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:38.858153 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gc8vw"] Jul 16 11:09:38.860931 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:09:38.860901 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2c7c9c4_2916_443e_b82b_17927b6e116a.slice/crio-a74307eb2085df067d2a1795c8ac42e31ba14d0259ad86ba1c1a60f0aa7af7e4 WatchSource:0}: Error finding container a74307eb2085df067d2a1795c8ac42e31ba14d0259ad86ba1c1a60f0aa7af7e4: Status 404 returned error can't find the container with id a74307eb2085df067d2a1795c8ac42e31ba14d0259ad86ba1c1a60f0aa7af7e4 Jul 16 11:09:38.955492 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:38.955430 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gc8vw" event={"ID":"f2c7c9c4-2916-443e-b82b-17927b6e116a","Type":"ContainerStarted","Data":"a74307eb2085df067d2a1795c8ac42e31ba14d0259ad86ba1c1a60f0aa7af7e4"} Jul 16 11:09:40.964357 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:40.964326 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gc8vw" event={"ID":"f2c7c9c4-2916-443e-b82b-17927b6e116a","Type":"ContainerStarted","Data":"c94921cab179ee7423105a8f1652101c03744447956771a7df668628413c5297"} Jul 16 11:09:40.982469 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:40.982422 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gc8vw" podStartSLOduration=33.323304677 podStartE2EDuration="34.982405853s" totalImagesPullingTime="1.659101176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:09:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:09:40.981514254 +0000 UTC m=+88.733772050" watchObservedRunningTime="2026-07-16 11:09:40.982405853 +0000 UTC m=+88.734663662" Jul 16 11:09:44.737129 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:44.737088 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c1a3bd51-3d95-4693-85d7-890cb7e0615c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tg5pd\" (UID: \"c1a3bd51-3d95-4693-85d7-890cb7e0615c\") " pod="openshift-insights/insights-runtime-extractor-tg5pd" Jul 16 11:09:44.739666 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:44.739621 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c1a3bd51-3d95-4693-85d7-890cb7e0615c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tg5pd\" (UID: \"c1a3bd51-3d95-4693-85d7-890cb7e0615c\") " pod="openshift-insights/insights-runtime-extractor-tg5pd" Jul 16 11:09:45.020683 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:45.020604 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tg5pd" Jul 16 11:09:45.145971 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:45.145863 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tg5pd"] Jul 16 11:09:45.148388 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:09:45.148359 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1a3bd51_3d95_4693_85d7_890cb7e0615c.slice/crio-56206cf50df394a21465e6eff3e05b7f8af7652322e01cb6027291a0a7524dec WatchSource:0}: Error finding container 56206cf50df394a21465e6eff3e05b7f8af7652322e01cb6027291a0a7524dec: Status 404 returned error can't find the container with id 56206cf50df394a21465e6eff3e05b7f8af7652322e01cb6027291a0a7524dec Jul 16 11:09:45.983995 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:45.983954 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tg5pd" event={"ID":"c1a3bd51-3d95-4693-85d7-890cb7e0615c","Type":"ContainerStarted","Data":"56206cf50df394a21465e6eff3e05b7f8af7652322e01cb6027291a0a7524dec"} Jul 16 11:09:49.999540 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:49.999511 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tg5pd" event={"ID":"c1a3bd51-3d95-4693-85d7-890cb7e0615c","Type":"ContainerStarted","Data":"8dab0811dffbe5010666d9c548bbf8dcbb9f67c885964610422e764e917f26d5"} Jul 16 11:09:50.702759 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:50.702672 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cf7766878-cqw8s"] Jul 16 11:09:50.705899 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:50.705873 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cf7766878-cqw8s" Jul 16 11:09:50.708616 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:50.708593 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 16 11:09:50.709271 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:50.709248 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wrlxb\"" Jul 16 11:09:50.709762 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:50.709740 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 16 11:09:50.709898 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:50.709790 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 16 11:09:50.710584 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:50.710323 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 16 11:09:50.710584 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:50.710397 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 16 11:09:50.710584 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:50.710531 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 16 11:09:50.710814 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:50.710709 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 16 11:09:50.717132 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:50.717109 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cf7766878-cqw8s"] Jul 16 11:09:50.717354 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:50.717331 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 16 11:09:50.787152 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:50.787128 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/570d9191-67a9-402a-a54d-1930e0ed50c6-console-serving-cert\") pod \"console-cf7766878-cqw8s\" (UID: \"570d9191-67a9-402a-a54d-1930e0ed50c6\") " pod="openshift-console/console-cf7766878-cqw8s" Jul 16 11:09:50.787246 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:50.787172 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/570d9191-67a9-402a-a54d-1930e0ed50c6-oauth-serving-cert\") pod \"console-cf7766878-cqw8s\" (UID: \"570d9191-67a9-402a-a54d-1930e0ed50c6\") " pod="openshift-console/console-cf7766878-cqw8s" Jul 16 11:09:50.787246 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:50.787228 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/570d9191-67a9-402a-a54d-1930e0ed50c6-console-oauth-config\") pod \"console-cf7766878-cqw8s\" (UID: \"570d9191-67a9-402a-a54d-1930e0ed50c6\") " pod="openshift-console/console-cf7766878-cqw8s" Jul 16 11:09:50.787361 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:50.787263 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/570d9191-67a9-402a-a54d-1930e0ed50c6-service-ca\") pod \"console-cf7766878-cqw8s\" (UID: \"570d9191-67a9-402a-a54d-1930e0ed50c6\") " pod="openshift-console/console-cf7766878-cqw8s" Jul 16 11:09:50.787361 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:50.787296 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/570d9191-67a9-402a-a54d-1930e0ed50c6-console-config\") pod \"console-cf7766878-cqw8s\" (UID: \"570d9191-67a9-402a-a54d-1930e0ed50c6\") " pod="openshift-console/console-cf7766878-cqw8s" Jul 16 11:09:50.787361 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:50.787343 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/570d9191-67a9-402a-a54d-1930e0ed50c6-trusted-ca-bundle\") pod \"console-cf7766878-cqw8s\" (UID: \"570d9191-67a9-402a-a54d-1930e0ed50c6\") " pod="openshift-console/console-cf7766878-cqw8s" Jul 16 11:09:50.787508 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:50.787437 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5zqq\" (UniqueName: \"kubernetes.io/projected/570d9191-67a9-402a-a54d-1930e0ed50c6-kube-api-access-c5zqq\") pod \"console-cf7766878-cqw8s\" (UID: \"570d9191-67a9-402a-a54d-1930e0ed50c6\") " pod="openshift-console/console-cf7766878-cqw8s" Jul 16 11:09:50.888728 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:50.888503 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/570d9191-67a9-402a-a54d-1930e0ed50c6-service-ca\") pod \"console-cf7766878-cqw8s\" (UID: \"570d9191-67a9-402a-a54d-1930e0ed50c6\") " pod="openshift-console/console-cf7766878-cqw8s" Jul 16 11:09:50.888728 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:50.888549 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/570d9191-67a9-402a-a54d-1930e0ed50c6-console-config\") pod \"console-cf7766878-cqw8s\" (UID: \"570d9191-67a9-402a-a54d-1930e0ed50c6\") " pod="openshift-console/console-cf7766878-cqw8s" Jul 16 11:09:50.888728 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:50.888575 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/570d9191-67a9-402a-a54d-1930e0ed50c6-trusted-ca-bundle\") pod \"console-cf7766878-cqw8s\" (UID: \"570d9191-67a9-402a-a54d-1930e0ed50c6\") " pod="openshift-console/console-cf7766878-cqw8s" Jul 16 11:09:50.888728 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:50.888652 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5zqq\" (UniqueName: \"kubernetes.io/projected/570d9191-67a9-402a-a54d-1930e0ed50c6-kube-api-access-c5zqq\") pod \"console-cf7766878-cqw8s\" (UID: \"570d9191-67a9-402a-a54d-1930e0ed50c6\") " pod="openshift-console/console-cf7766878-cqw8s" Jul 16 11:09:50.888728 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:50.888706 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/570d9191-67a9-402a-a54d-1930e0ed50c6-console-serving-cert\") pod \"console-cf7766878-cqw8s\" (UID: \"570d9191-67a9-402a-a54d-1930e0ed50c6\") " pod="openshift-console/console-cf7766878-cqw8s" Jul 16 11:09:50.889041 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:50.888739 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/570d9191-67a9-402a-a54d-1930e0ed50c6-oauth-serving-cert\") pod \"console-cf7766878-cqw8s\" (UID: \"570d9191-67a9-402a-a54d-1930e0ed50c6\") " pod="openshift-console/console-cf7766878-cqw8s" Jul 16 11:09:50.889041 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:50.888767 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/570d9191-67a9-402a-a54d-1930e0ed50c6-console-oauth-config\") pod \"console-cf7766878-cqw8s\" (UID: \"570d9191-67a9-402a-a54d-1930e0ed50c6\") " pod="openshift-console/console-cf7766878-cqw8s" Jul 16 11:09:50.889311 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:50.889284 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/570d9191-67a9-402a-a54d-1930e0ed50c6-service-ca\") pod \"console-cf7766878-cqw8s\" (UID: \"570d9191-67a9-402a-a54d-1930e0ed50c6\") " pod="openshift-console/console-cf7766878-cqw8s" Jul 16 11:09:50.890312 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:50.890270 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/570d9191-67a9-402a-a54d-1930e0ed50c6-console-config\") pod \"console-cf7766878-cqw8s\" (UID: \"570d9191-67a9-402a-a54d-1930e0ed50c6\") " pod="openshift-console/console-cf7766878-cqw8s" Jul 16 11:09:50.890312 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:50.890302 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/570d9191-67a9-402a-a54d-1930e0ed50c6-oauth-serving-cert\") pod \"console-cf7766878-cqw8s\" (UID: \"570d9191-67a9-402a-a54d-1930e0ed50c6\") " pod="openshift-console/console-cf7766878-cqw8s" Jul 16 11:09:50.890574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:50.890409 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/570d9191-67a9-402a-a54d-1930e0ed50c6-trusted-ca-bundle\") pod \"console-cf7766878-cqw8s\" (UID: \"570d9191-67a9-402a-a54d-1930e0ed50c6\") " pod="openshift-console/console-cf7766878-cqw8s" Jul 16 11:09:50.892408 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:50.892385 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/570d9191-67a9-402a-a54d-1930e0ed50c6-console-serving-cert\") pod \"console-cf7766878-cqw8s\" (UID: \"570d9191-67a9-402a-a54d-1930e0ed50c6\") " pod="openshift-console/console-cf7766878-cqw8s" Jul 16 11:09:50.892838 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:50.892815 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/570d9191-67a9-402a-a54d-1930e0ed50c6-console-oauth-config\") pod \"console-cf7766878-cqw8s\" (UID: \"570d9191-67a9-402a-a54d-1930e0ed50c6\") " pod="openshift-console/console-cf7766878-cqw8s" Jul 16 11:09:50.899806 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:50.899762 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5zqq\" (UniqueName: \"kubernetes.io/projected/570d9191-67a9-402a-a54d-1930e0ed50c6-kube-api-access-c5zqq\") pod \"console-cf7766878-cqw8s\" (UID: \"570d9191-67a9-402a-a54d-1930e0ed50c6\") " pod="openshift-console/console-cf7766878-cqw8s" Jul 16 11:09:50.990340 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:50.990123 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-registry-tls\") pod \"image-registry-54dff647f6-vp85x\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:09:50.992785 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:50.992743 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-registry-tls\") pod \"image-registry-54dff647f6-vp85x\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:09:51.018371 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:51.018347 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cf7766878-cqw8s" Jul 16 11:09:51.039998 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:51.039922 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bq7p2\"" Jul 16 11:09:51.048105 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:51.048084 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:09:51.091475 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:51.090963 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f092f0d-2c7a-4b1e-8598-23348b575cff-metrics-tls\") pod \"dns-default-v5z75\" (UID: \"0f092f0d-2c7a-4b1e-8598-23348b575cff\") " pod="openshift-dns/dns-default-v5z75" Jul 16 11:09:51.098497 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:51.098434 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f092f0d-2c7a-4b1e-8598-23348b575cff-metrics-tls\") pod \"dns-default-v5z75\" (UID: \"0f092f0d-2c7a-4b1e-8598-23348b575cff\") " pod="openshift-dns/dns-default-v5z75" Jul 16 11:09:51.218170 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:51.217931 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cf7766878-cqw8s"] Jul 16 11:09:51.221223 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:09:51.221188 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod570d9191_67a9_402a_a54d_1930e0ed50c6.slice/crio-92e6dca8c17e8bad844964934bb1c8b0370272e3964306b5582c8e3a0cf16043 WatchSource:0}: Error finding container 92e6dca8c17e8bad844964934bb1c8b0370272e3964306b5582c8e3a0cf16043: Status 404 returned error can't find the container with id 92e6dca8c17e8bad844964934bb1c8b0370272e3964306b5582c8e3a0cf16043 Jul 16 11:09:51.254944 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:51.254737 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54dff647f6-vp85x"] Jul 16 11:09:51.257693 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:09:51.257665 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod017eface_a126_4eec_961d_b076e61b5f45.slice/crio-26d545024b7d1b5fa58fccfdfef22d80782fda4571119a95383c4fefd9bcd0b4 WatchSource:0}: Error finding container 26d545024b7d1b5fa58fccfdfef22d80782fda4571119a95383c4fefd9bcd0b4: Status 404 returned error can't find the container with id 26d545024b7d1b5fa58fccfdfef22d80782fda4571119a95383c4fefd9bcd0b4 Jul 16 11:09:51.371626 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:51.371599 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jnq66\"" Jul 16 11:09:51.379709 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:51.379690 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v5z75" Jul 16 11:09:51.562875 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:51.562802 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v5z75"] Jul 16 11:09:51.567796 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:09:51.567764 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f092f0d_2c7a_4b1e_8598_23348b575cff.slice/crio-313360c85b31ba9ebcee42d909dc2aa45894114b7066782e900f10968d7c415d WatchSource:0}: Error finding container 313360c85b31ba9ebcee42d909dc2aa45894114b7066782e900f10968d7c415d: Status 404 returned error can't find the container with id 313360c85b31ba9ebcee42d909dc2aa45894114b7066782e900f10968d7c415d Jul 16 11:09:52.009967 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:52.009890 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v5z75" event={"ID":"0f092f0d-2c7a-4b1e-8598-23348b575cff","Type":"ContainerStarted","Data":"313360c85b31ba9ebcee42d909dc2aa45894114b7066782e900f10968d7c415d"} Jul 16 11:09:52.011619 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:52.011588 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54dff647f6-vp85x" event={"ID":"017eface-a126-4eec-961d-b076e61b5f45","Type":"ContainerStarted","Data":"b98fe11ef3756605cd19240503804625bf44958e91b58156c7acca3cd1a9b0a0"} Jul 16 11:09:52.011774 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:52.011654 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54dff647f6-vp85x" event={"ID":"017eface-a126-4eec-961d-b076e61b5f45","Type":"ContainerStarted","Data":"26d545024b7d1b5fa58fccfdfef22d80782fda4571119a95383c4fefd9bcd0b4"} Jul 16 11:09:52.011774 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:52.011708 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:09:52.013024 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:52.012993 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cf7766878-cqw8s" event={"ID":"570d9191-67a9-402a-a54d-1930e0ed50c6","Type":"ContainerStarted","Data":"92e6dca8c17e8bad844964934bb1c8b0370272e3964306b5582c8e3a0cf16043"} Jul 16 11:09:52.042701 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:52.042415 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-54dff647f6-vp85x" podStartSLOduration=99.042396881 podStartE2EDuration="1m39.042396881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:08:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:09:52.040598131 +0000 UTC m=+99.792855925" watchObservedRunningTime="2026-07-16 11:09:52.042396881 +0000 UTC m=+99.794654679" Jul 16 11:09:54.911535 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:54.911506 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xcw4r" Jul 16 11:09:57.033289 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:57.033250 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tg5pd" event={"ID":"c1a3bd51-3d95-4693-85d7-890cb7e0615c","Type":"ContainerStarted","Data":"6bf8e8dfacb22a50fe2cbb37e621cad0f522c0e0a24fd73d2f7e9f00f86f1d4d"} Jul 16 11:09:57.034933 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:57.034904 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cf7766878-cqw8s" event={"ID":"570d9191-67a9-402a-a54d-1930e0ed50c6","Type":"ContainerStarted","Data":"1e1d3cadedba4e5cb7f2f8aca942919dc61ecaaa409ba6835f078c62e16104a5"} Jul 16 11:09:57.036814 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:57.036787 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v5z75" event={"ID":"0f092f0d-2c7a-4b1e-8598-23348b575cff","Type":"ContainerStarted","Data":"d43217063efcc60608db91b1393f7febead49aa88b82a65c6e782ae4dafbadbb"} Jul 16 11:09:57.036943 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:57.036837 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v5z75" event={"ID":"0f092f0d-2c7a-4b1e-8598-23348b575cff","Type":"ContainerStarted","Data":"4c04a59750512fcf9c0a3b08bff877baab9bf5c6f65fd55f293e5e723ebfb0c3"} Jul 16 11:09:57.036943 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:57.036879 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-v5z75" Jul 16 11:09:57.054811 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:57.054761 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cf7766878-cqw8s" podStartSLOduration=2.265999989 podStartE2EDuration="7.054745337s" totalImagesPullingTime="4.788745348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:09:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:09:57.054043118 +0000 UTC m=+104.806300929" watchObservedRunningTime="2026-07-16 11:09:57.054745337 +0000 UTC m=+104.807003133" Jul 16 11:09:57.074582 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:09:57.074544 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-v5z75" podStartSLOduration=65.584313123 podStartE2EDuration="1m10.074527782s" totalImagesPullingTime="4.490214659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:08:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:09:57.073000092 +0000 UTC m=+104.825257912" watchObservedRunningTime="2026-07-16 11:09:57.074527782 +0000 UTC m=+104.826785579" Jul 16 11:10:00.049791 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:00.049760 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tg5pd" event={"ID":"c1a3bd51-3d95-4693-85d7-890cb7e0615c","Type":"ContainerStarted","Data":"f1ba717fc61526957b1d94777381ba952489b139ccca04e6b7e89b4c63f0a251"} Jul 16 11:10:00.076677 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:00.076614 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tg5pd" podStartSLOduration=33.745174933 podStartE2EDuration="48.076598952s" totalImagesPullingTime="14.331424019s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:09:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:10:00.074176828 +0000 UTC m=+107.826434633" watchObservedRunningTime="2026-07-16 11:10:00.076598952 +0000 UTC m=+107.828856747" Jul 16 11:10:01.018953 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:01.018919 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cf7766878-cqw8s" Jul 16 11:10:01.019137 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:01.018979 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cf7766878-cqw8s" Jul 16 11:10:01.023864 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:01.023835 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cf7766878-cqw8s" Jul 16 11:10:01.056685 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:01.056665 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cf7766878-cqw8s" Jul 16 11:10:01.105142 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:01.105116 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54dff647f6-vp85x"] Jul 16 11:10:05.534206 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:05.534176 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-n9zzj"] Jul 16 11:10:05.537519 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:05.537498 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n9zzj" Jul 16 11:10:05.539889 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:05.539870 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 16 11:10:05.539993 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:05.539953 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 16 11:10:05.539993 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:05.539959 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 16 11:10:05.540195 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:05.540179 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qvwlj\"" Jul 16 11:10:05.540335 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:05.540317 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 16 11:10:05.695511 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:05.695485 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/df439e14-21ac-4386-b406-ae6836a6fc61-node-exporter-tls\") pod \"node-exporter-n9zzj\" (UID: \"df439e14-21ac-4386-b406-ae6836a6fc61\") " pod="openshift-monitoring/node-exporter-n9zzj" Jul 16 11:10:05.695618 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:05.695514 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/df439e14-21ac-4386-b406-ae6836a6fc61-node-exporter-accelerators-collector-config\") pod \"node-exporter-n9zzj\" (UID: \"df439e14-21ac-4386-b406-ae6836a6fc61\") " pod="openshift-monitoring/node-exporter-n9zzj" Jul 16 11:10:05.695618 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:05.695546 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df439e14-21ac-4386-b406-ae6836a6fc61-sys\") pod \"node-exporter-n9zzj\" (UID: \"df439e14-21ac-4386-b406-ae6836a6fc61\") " pod="openshift-monitoring/node-exporter-n9zzj" Jul 16 11:10:05.695618 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:05.695561 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/df439e14-21ac-4386-b406-ae6836a6fc61-node-exporter-wtmp\") pod \"node-exporter-n9zzj\" (UID: \"df439e14-21ac-4386-b406-ae6836a6fc61\") " pod="openshift-monitoring/node-exporter-n9zzj" Jul 16 11:10:05.695758 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:05.695625 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/df439e14-21ac-4386-b406-ae6836a6fc61-node-exporter-textfile\") pod \"node-exporter-n9zzj\" (UID: \"df439e14-21ac-4386-b406-ae6836a6fc61\") " pod="openshift-monitoring/node-exporter-n9zzj" Jul 16 11:10:05.695758 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:05.695691 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/df439e14-21ac-4386-b406-ae6836a6fc61-root\") pod \"node-exporter-n9zzj\" (UID: \"df439e14-21ac-4386-b406-ae6836a6fc61\") " pod="openshift-monitoring/node-exporter-n9zzj" Jul 16 11:10:05.695758 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:05.695730 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df439e14-21ac-4386-b406-ae6836a6fc61-metrics-client-ca\") pod \"node-exporter-n9zzj\" (UID: \"df439e14-21ac-4386-b406-ae6836a6fc61\") " pod="openshift-monitoring/node-exporter-n9zzj" Jul 16 11:10:05.695758 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:05.695748 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx9rt\" (UniqueName: \"kubernetes.io/projected/df439e14-21ac-4386-b406-ae6836a6fc61-kube-api-access-jx9rt\") pod \"node-exporter-n9zzj\" (UID: \"df439e14-21ac-4386-b406-ae6836a6fc61\") " pod="openshift-monitoring/node-exporter-n9zzj" Jul 16 11:10:05.695877 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:05.695775 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/df439e14-21ac-4386-b406-ae6836a6fc61-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n9zzj\" (UID: \"df439e14-21ac-4386-b406-ae6836a6fc61\") " pod="openshift-monitoring/node-exporter-n9zzj" Jul 16 11:10:05.796033 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:05.795977 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df439e14-21ac-4386-b406-ae6836a6fc61-metrics-client-ca\") pod \"node-exporter-n9zzj\" (UID: \"df439e14-21ac-4386-b406-ae6836a6fc61\") " pod="openshift-monitoring/node-exporter-n9zzj" Jul 16 11:10:05.796033 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:05.796003 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx9rt\" (UniqueName: \"kubernetes.io/projected/df439e14-21ac-4386-b406-ae6836a6fc61-kube-api-access-jx9rt\") pod \"node-exporter-n9zzj\" (UID: \"df439e14-21ac-4386-b406-ae6836a6fc61\") " pod="openshift-monitoring/node-exporter-n9zzj" Jul 16 11:10:05.796033 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:05.796029 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/df439e14-21ac-4386-b406-ae6836a6fc61-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n9zzj\" (UID: \"df439e14-21ac-4386-b406-ae6836a6fc61\") " pod="openshift-monitoring/node-exporter-n9zzj" Jul 16 11:10:05.796240 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:05.796059 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/df439e14-21ac-4386-b406-ae6836a6fc61-node-exporter-tls\") pod \"node-exporter-n9zzj\" (UID: \"df439e14-21ac-4386-b406-ae6836a6fc61\") " pod="openshift-monitoring/node-exporter-n9zzj" Jul 16 11:10:05.796240 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:05.796074 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/df439e14-21ac-4386-b406-ae6836a6fc61-node-exporter-accelerators-collector-config\") pod \"node-exporter-n9zzj\" (UID: \"df439e14-21ac-4386-b406-ae6836a6fc61\") " pod="openshift-monitoring/node-exporter-n9zzj" Jul 16 11:10:05.796240 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:05.796113 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df439e14-21ac-4386-b406-ae6836a6fc61-sys\") pod \"node-exporter-n9zzj\" (UID: \"df439e14-21ac-4386-b406-ae6836a6fc61\") " pod="openshift-monitoring/node-exporter-n9zzj" Jul 16 11:10:05.796240 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:05.796128 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/df439e14-21ac-4386-b406-ae6836a6fc61-node-exporter-wtmp\") pod \"node-exporter-n9zzj\" (UID: \"df439e14-21ac-4386-b406-ae6836a6fc61\") " pod="openshift-monitoring/node-exporter-n9zzj" Jul 16 11:10:05.796240 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:05.796151 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/df439e14-21ac-4386-b406-ae6836a6fc61-node-exporter-textfile\") pod \"node-exporter-n9zzj\" (UID: \"df439e14-21ac-4386-b406-ae6836a6fc61\") " pod="openshift-monitoring/node-exporter-n9zzj" Jul 16 11:10:05.796240 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:05.796176 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/df439e14-21ac-4386-b406-ae6836a6fc61-root\") pod \"node-exporter-n9zzj\" (UID: \"df439e14-21ac-4386-b406-ae6836a6fc61\") " pod="openshift-monitoring/node-exporter-n9zzj" Jul 16 11:10:05.796240 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:05.796200 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df439e14-21ac-4386-b406-ae6836a6fc61-sys\") pod \"node-exporter-n9zzj\" (UID: \"df439e14-21ac-4386-b406-ae6836a6fc61\") " pod="openshift-monitoring/node-exporter-n9zzj" Jul 16 11:10:05.796548 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:05.796246 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/df439e14-21ac-4386-b406-ae6836a6fc61-root\") pod \"node-exporter-n9zzj\" (UID: \"df439e14-21ac-4386-b406-ae6836a6fc61\") " pod="openshift-monitoring/node-exporter-n9zzj" Jul 16 11:10:05.796548 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:05.796364 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/df439e14-21ac-4386-b406-ae6836a6fc61-node-exporter-wtmp\") pod \"node-exporter-n9zzj\" (UID: \"df439e14-21ac-4386-b406-ae6836a6fc61\") " pod="openshift-monitoring/node-exporter-n9zzj" Jul 16 11:10:05.796615 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:05.796578 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/df439e14-21ac-4386-b406-ae6836a6fc61-node-exporter-textfile\") pod \"node-exporter-n9zzj\" (UID: \"df439e14-21ac-4386-b406-ae6836a6fc61\") " pod="openshift-monitoring/node-exporter-n9zzj" Jul 16 11:10:05.796747 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:05.796726 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df439e14-21ac-4386-b406-ae6836a6fc61-metrics-client-ca\") pod \"node-exporter-n9zzj\" (UID: \"df439e14-21ac-4386-b406-ae6836a6fc61\") " pod="openshift-monitoring/node-exporter-n9zzj" Jul 16 11:10:05.796827 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:05.796805 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/df439e14-21ac-4386-b406-ae6836a6fc61-node-exporter-accelerators-collector-config\") pod \"node-exporter-n9zzj\" (UID: \"df439e14-21ac-4386-b406-ae6836a6fc61\") " pod="openshift-monitoring/node-exporter-n9zzj" Jul 16 11:10:05.798302 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:05.798281 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/df439e14-21ac-4386-b406-ae6836a6fc61-node-exporter-tls\") pod \"node-exporter-n9zzj\" (UID: \"df439e14-21ac-4386-b406-ae6836a6fc61\") " pod="openshift-monitoring/node-exporter-n9zzj" Jul 16 11:10:05.798514 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:05.798495 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/df439e14-21ac-4386-b406-ae6836a6fc61-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n9zzj\" (UID: \"df439e14-21ac-4386-b406-ae6836a6fc61\") " pod="openshift-monitoring/node-exporter-n9zzj" Jul 16 11:10:05.807932 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:05.807907 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx9rt\" (UniqueName: \"kubernetes.io/projected/df439e14-21ac-4386-b406-ae6836a6fc61-kube-api-access-jx9rt\") pod \"node-exporter-n9zzj\" (UID: \"df439e14-21ac-4386-b406-ae6836a6fc61\") " pod="openshift-monitoring/node-exporter-n9zzj" Jul 16 11:10:05.846469 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:05.846448 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n9zzj" Jul 16 11:10:05.857672 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:10:05.857646 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf439e14_21ac_4386_b406_ae6836a6fc61.slice/crio-8c4b55ccdf57d7c78dbca5ddfca7ffdf0b5f68c681a73fbdfac6d9368a7649cf WatchSource:0}: Error finding container 8c4b55ccdf57d7c78dbca5ddfca7ffdf0b5f68c681a73fbdfac6d9368a7649cf: Status 404 returned error can't find the container with id 8c4b55ccdf57d7c78dbca5ddfca7ffdf0b5f68c681a73fbdfac6d9368a7649cf Jul 16 11:10:06.071299 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:06.071242 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n9zzj" event={"ID":"df439e14-21ac-4386-b406-ae6836a6fc61","Type":"ContainerStarted","Data":"8c4b55ccdf57d7c78dbca5ddfca7ffdf0b5f68c681a73fbdfac6d9368a7649cf"} Jul 16 11:10:07.042689 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:07.042550 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-v5z75" Jul 16 11:10:08.081231 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:08.081196 2559 generic.go:356] "Generic (PLEG): container finished" podID="df439e14-21ac-4386-b406-ae6836a6fc61" containerID="c2f9e8adba40e3f81d180cac03adfab1e70aba2feb46e794b228658998d660b1" exitCode=0 Jul 16 11:10:08.081667 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:08.081292 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n9zzj" event={"ID":"df439e14-21ac-4386-b406-ae6836a6fc61","Type":"ContainerDied","Data":"c2f9e8adba40e3f81d180cac03adfab1e70aba2feb46e794b228658998d660b1"} Jul 16 11:10:09.087317 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:09.087285 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n9zzj" event={"ID":"df439e14-21ac-4386-b406-ae6836a6fc61","Type":"ContainerStarted","Data":"ccd4be9180d8ac127c1fce545cf6fa37a5da9bafe2d5d13aa2dd7e14a58b125c"} Jul 16 11:10:09.087707 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:09.087332 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n9zzj" event={"ID":"df439e14-21ac-4386-b406-ae6836a6fc61","Type":"ContainerStarted","Data":"74a696d501d88781f603e0d78edcce2ab8b570d689f150eecfe1965a5a9465a1"} Jul 16 11:10:09.111476 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:09.111435 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-n9zzj" podStartSLOduration=2.625026999 podStartE2EDuration="4.111416554s" totalImagesPullingTime="1.423171705s" totalInitContainerRuntime="63.21785ms" isStatefulPod=true podCreationTimestamp="2026-07-16 11:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:10:09.110749631 +0000 UTC m=+116.863007425" watchObservedRunningTime="2026-07-16 11:10:09.111416554 +0000 UTC m=+116.863674347" Jul 16 11:10:10.720290 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:10.720265 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-786fcd7d66-9zt2w"] Jul 16 11:10:10.723601 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:10.723583 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-786fcd7d66-9zt2w" Jul 16 11:10:10.733574 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:10.733551 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 16 11:10:10.733795 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:10.733782 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 16 11:10:10.733850 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:10.733791 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 16 11:10:10.734458 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:10.734440 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 16 11:10:10.734458 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:10.734450 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-lwvg6\"" Jul 16 11:10:10.734625 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:10.734506 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 16 11:10:10.738048 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:10.738030 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 16 11:10:10.749579 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:10.749561 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-786fcd7d66-9zt2w"] Jul 16 11:10:10.832647 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:10.832603 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5d9a0a4-6d4b-4360-900e-2eabfbee0d98-serving-certs-ca-bundle\") pod \"telemeter-client-786fcd7d66-9zt2w\" (UID: \"a5d9a0a4-6d4b-4360-900e-2eabfbee0d98\") " pod="openshift-monitoring/telemeter-client-786fcd7d66-9zt2w" Jul 16 11:10:10.832740 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:10.832656 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a5d9a0a4-6d4b-4360-900e-2eabfbee0d98-telemeter-client-tls\") pod \"telemeter-client-786fcd7d66-9zt2w\" (UID: \"a5d9a0a4-6d4b-4360-900e-2eabfbee0d98\") " pod="openshift-monitoring/telemeter-client-786fcd7d66-9zt2w" Jul 16 11:10:10.832740 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:10.832682 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5d9a0a4-6d4b-4360-900e-2eabfbee0d98-metrics-client-ca\") pod \"telemeter-client-786fcd7d66-9zt2w\" (UID: \"a5d9a0a4-6d4b-4360-900e-2eabfbee0d98\") " pod="openshift-monitoring/telemeter-client-786fcd7d66-9zt2w" Jul 16 11:10:10.832740 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:10.832715 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5d9a0a4-6d4b-4360-900e-2eabfbee0d98-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-786fcd7d66-9zt2w\" (UID: \"a5d9a0a4-6d4b-4360-900e-2eabfbee0d98\") " pod="openshift-monitoring/telemeter-client-786fcd7d66-9zt2w" Jul 16 11:10:10.832740 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:10.832732 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a5d9a0a4-6d4b-4360-900e-2eabfbee0d98-secret-telemeter-client\") pod \"telemeter-client-786fcd7d66-9zt2w\" (UID: \"a5d9a0a4-6d4b-4360-900e-2eabfbee0d98\") " pod="openshift-monitoring/telemeter-client-786fcd7d66-9zt2w" Jul 16 11:10:10.832885 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:10.832793 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5d9a0a4-6d4b-4360-900e-2eabfbee0d98-telemeter-trusted-ca-bundle\") pod \"telemeter-client-786fcd7d66-9zt2w\" (UID: \"a5d9a0a4-6d4b-4360-900e-2eabfbee0d98\") " pod="openshift-monitoring/telemeter-client-786fcd7d66-9zt2w" Jul 16 11:10:10.832885 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:10.832848 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a5d9a0a4-6d4b-4360-900e-2eabfbee0d98-federate-client-tls\") pod \"telemeter-client-786fcd7d66-9zt2w\" (UID: \"a5d9a0a4-6d4b-4360-900e-2eabfbee0d98\") " pod="openshift-monitoring/telemeter-client-786fcd7d66-9zt2w" Jul 16 11:10:10.832885 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:10.832866 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tskcb\" (UniqueName: \"kubernetes.io/projected/a5d9a0a4-6d4b-4360-900e-2eabfbee0d98-kube-api-access-tskcb\") pod \"telemeter-client-786fcd7d66-9zt2w\" (UID: \"a5d9a0a4-6d4b-4360-900e-2eabfbee0d98\") " pod="openshift-monitoring/telemeter-client-786fcd7d66-9zt2w" Jul 16 11:10:10.933988 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:10.933968 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a5d9a0a4-6d4b-4360-900e-2eabfbee0d98-telemeter-client-tls\") pod \"telemeter-client-786fcd7d66-9zt2w\" (UID: \"a5d9a0a4-6d4b-4360-900e-2eabfbee0d98\") " pod="openshift-monitoring/telemeter-client-786fcd7d66-9zt2w" Jul 16 11:10:10.934089 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:10.933994 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5d9a0a4-6d4b-4360-900e-2eabfbee0d98-metrics-client-ca\") pod \"telemeter-client-786fcd7d66-9zt2w\" (UID: \"a5d9a0a4-6d4b-4360-900e-2eabfbee0d98\") " pod="openshift-monitoring/telemeter-client-786fcd7d66-9zt2w" Jul 16 11:10:10.934089 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:10.934019 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5d9a0a4-6d4b-4360-900e-2eabfbee0d98-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-786fcd7d66-9zt2w\" (UID: \"a5d9a0a4-6d4b-4360-900e-2eabfbee0d98\") " pod="openshift-monitoring/telemeter-client-786fcd7d66-9zt2w" Jul 16 11:10:10.934089 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:10.934042 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a5d9a0a4-6d4b-4360-900e-2eabfbee0d98-secret-telemeter-client\") pod \"telemeter-client-786fcd7d66-9zt2w\" (UID: \"a5d9a0a4-6d4b-4360-900e-2eabfbee0d98\") " pod="openshift-monitoring/telemeter-client-786fcd7d66-9zt2w" Jul 16 11:10:10.934089 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:10.934085 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5d9a0a4-6d4b-4360-900e-2eabfbee0d98-telemeter-trusted-ca-bundle\") pod \"telemeter-client-786fcd7d66-9zt2w\" (UID: \"a5d9a0a4-6d4b-4360-900e-2eabfbee0d98\") " pod="openshift-monitoring/telemeter-client-786fcd7d66-9zt2w" Jul 16 11:10:10.934289 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:10.934132 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a5d9a0a4-6d4b-4360-900e-2eabfbee0d98-federate-client-tls\") pod \"telemeter-client-786fcd7d66-9zt2w\" (UID: \"a5d9a0a4-6d4b-4360-900e-2eabfbee0d98\") " pod="openshift-monitoring/telemeter-client-786fcd7d66-9zt2w" Jul 16 11:10:10.934289 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:10.934157 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tskcb\" (UniqueName: \"kubernetes.io/projected/a5d9a0a4-6d4b-4360-900e-2eabfbee0d98-kube-api-access-tskcb\") pod \"telemeter-client-786fcd7d66-9zt2w\" (UID: \"a5d9a0a4-6d4b-4360-900e-2eabfbee0d98\") " pod="openshift-monitoring/telemeter-client-786fcd7d66-9zt2w" Jul 16 11:10:10.934289 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:10.934185 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5d9a0a4-6d4b-4360-900e-2eabfbee0d98-serving-certs-ca-bundle\") pod \"telemeter-client-786fcd7d66-9zt2w\" (UID: \"a5d9a0a4-6d4b-4360-900e-2eabfbee0d98\") " pod="openshift-monitoring/telemeter-client-786fcd7d66-9zt2w" Jul 16 11:10:10.940656 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:10.935554 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5d9a0a4-6d4b-4360-900e-2eabfbee0d98-serving-certs-ca-bundle\") pod \"telemeter-client-786fcd7d66-9zt2w\" (UID: \"a5d9a0a4-6d4b-4360-900e-2eabfbee0d98\") " pod="openshift-monitoring/telemeter-client-786fcd7d66-9zt2w" Jul 16 11:10:10.940656 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:10.935566 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5d9a0a4-6d4b-4360-900e-2eabfbee0d98-telemeter-trusted-ca-bundle\") pod \"telemeter-client-786fcd7d66-9zt2w\" (UID: \"a5d9a0a4-6d4b-4360-900e-2eabfbee0d98\") " pod="openshift-monitoring/telemeter-client-786fcd7d66-9zt2w" Jul 16 11:10:10.940656 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:10.935558 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5d9a0a4-6d4b-4360-900e-2eabfbee0d98-metrics-client-ca\") pod \"telemeter-client-786fcd7d66-9zt2w\" (UID: \"a5d9a0a4-6d4b-4360-900e-2eabfbee0d98\") " pod="openshift-monitoring/telemeter-client-786fcd7d66-9zt2w" Jul 16 11:10:10.940656 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:10.937824 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a5d9a0a4-6d4b-4360-900e-2eabfbee0d98-secret-telemeter-client\") pod \"telemeter-client-786fcd7d66-9zt2w\" (UID: \"a5d9a0a4-6d4b-4360-900e-2eabfbee0d98\") " pod="openshift-monitoring/telemeter-client-786fcd7d66-9zt2w" Jul 16 11:10:10.940656 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:10.938403 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a5d9a0a4-6d4b-4360-900e-2eabfbee0d98-telemeter-client-tls\") pod \"telemeter-client-786fcd7d66-9zt2w\" (UID: \"a5d9a0a4-6d4b-4360-900e-2eabfbee0d98\") " pod="openshift-monitoring/telemeter-client-786fcd7d66-9zt2w" Jul 16 11:10:10.940962 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:10.940896 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a5d9a0a4-6d4b-4360-900e-2eabfbee0d98-federate-client-tls\") pod \"telemeter-client-786fcd7d66-9zt2w\" (UID: \"a5d9a0a4-6d4b-4360-900e-2eabfbee0d98\") " pod="openshift-monitoring/telemeter-client-786fcd7d66-9zt2w" Jul 16 11:10:10.940962 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:10.940921 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5d9a0a4-6d4b-4360-900e-2eabfbee0d98-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-786fcd7d66-9zt2w\" (UID: \"a5d9a0a4-6d4b-4360-900e-2eabfbee0d98\") " pod="openshift-monitoring/telemeter-client-786fcd7d66-9zt2w" Jul 16 11:10:10.943267 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:10.943243 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tskcb\" (UniqueName: \"kubernetes.io/projected/a5d9a0a4-6d4b-4360-900e-2eabfbee0d98-kube-api-access-tskcb\") pod \"telemeter-client-786fcd7d66-9zt2w\" (UID: \"a5d9a0a4-6d4b-4360-900e-2eabfbee0d98\") " pod="openshift-monitoring/telemeter-client-786fcd7d66-9zt2w" Jul 16 11:10:11.032123 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.032076 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-786fcd7d66-9zt2w" Jul 16 11:10:11.110296 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.110271 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:10:11.166741 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.166713 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-786fcd7d66-9zt2w"] Jul 16 11:10:11.169545 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:10:11.169519 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5d9a0a4_6d4b_4360_900e_2eabfbee0d98.slice/crio-fd71404e295a5f8745daae71c4e0a25594282c32cb7e5e885676f188f31d975e WatchSource:0}: Error finding container fd71404e295a5f8745daae71c4e0a25594282c32cb7e5e885676f188f31d975e: Status 404 returned error can't find the container with id fd71404e295a5f8745daae71c4e0a25594282c32cb7e5e885676f188f31d975e Jul 16 11:10:11.744804 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.744775 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 11:10:11.749461 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.749438 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.752374 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.752350 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 16 11:10:11.752517 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.752400 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 16 11:10:11.752517 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.752480 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 16 11:10:11.753062 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.752726 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 16 11:10:11.753062 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.752774 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 16 11:10:11.753062 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.752803 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 16 11:10:11.753062 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.752815 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 16 11:10:11.753062 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.752825 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 16 11:10:11.753062 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.752835 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 16 11:10:11.753062 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.752848 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 16 11:10:11.753062 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.752726 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 16 11:10:11.753062 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.752968 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 16 11:10:11.753545 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.753126 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-f6opnlb4q243h\"" Jul 16 11:10:11.753545 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.753163 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-259v7\"" Jul 16 11:10:11.754010 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.753908 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 16 11:10:11.754277 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.754195 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 16 11:10:11.755833 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.755814 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 16 11:10:11.769983 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.769962 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 11:10:11.841262 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.841233 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.841467 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.841268 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.841467 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.841298 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.841467 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.841368 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.841467 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.841391 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.841467 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.841409 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.841467 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.841438 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.841467 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.841460 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.841819 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.841485 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c558c10-6f51-4994-864d-0eb8463caa59-config-out\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.841819 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.841506 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-config\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.841819 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.841567 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-web-config\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.841819 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.841611 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.841819 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.841644 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.841819 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.841672 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.841819 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.841695 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.841819 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.841722 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.841819 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.841758 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c558c10-6f51-4994-864d-0eb8463caa59-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.841819 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.841785 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1c558c10-6f51-4994-864d-0eb8463caa59-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.842253 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.841997 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twf7h\" (UniqueName: \"kubernetes.io/projected/1c558c10-6f51-4994-864d-0eb8463caa59-kube-api-access-twf7h\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.842253 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.842040 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.943271 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.943245 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.943396 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.943284 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.943396 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.943309 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.943396 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.943335 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.943396 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.943365 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.943396 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.943391 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.943678 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.943419 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.943678 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.943443 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.943678 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.943480 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c558c10-6f51-4994-864d-0eb8463caa59-config-out\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.943678 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.943506 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-config\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.943678 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.943532 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-web-config\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.943678 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.943559 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.943678 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.943588 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.943678 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.943617 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.943678 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.943657 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.944085 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.943685 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.944085 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.943723 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c558c10-6f51-4994-864d-0eb8463caa59-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.944085 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.943752 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1c558c10-6f51-4994-864d-0eb8463caa59-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.944085 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.943779 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twf7h\" (UniqueName: \"kubernetes.io/projected/1c558c10-6f51-4994-864d-0eb8463caa59-kube-api-access-twf7h\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.944085 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.943804 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.944085 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.944006 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.944393 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.944140 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.944452 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.944398 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.944876 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.944738 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.947438 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.945604 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.947438 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.945979 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1c558c10-6f51-4994-864d-0eb8463caa59-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.947438 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.947000 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.947438 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.947059 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-config\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.947438 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.947403 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.948064 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.948023 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.948156 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.948047 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.948934 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.948859 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.949026 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.949012 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c558c10-6f51-4994-864d-0eb8463caa59-config-out\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.949154 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.949110 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.949357 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.949308 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-web-config\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.949451 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.949362 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.949596 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.949573 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c558c10-6f51-4994-864d-0eb8463caa59-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.950722 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.950698 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.951112 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.951086 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:11.954120 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:11.954092 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twf7h\" (UniqueName: \"kubernetes.io/projected/1c558c10-6f51-4994-864d-0eb8463caa59-kube-api-access-twf7h\") pod \"prometheus-k8s-0\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:12.061818 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:12.061739 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:12.099392 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:12.099333 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-786fcd7d66-9zt2w" event={"ID":"a5d9a0a4-6d4b-4360-900e-2eabfbee0d98","Type":"ContainerStarted","Data":"fd71404e295a5f8745daae71c4e0a25594282c32cb7e5e885676f188f31d975e"} Jul 16 11:10:12.213488 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:12.213461 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 11:10:12.216207 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:10:12.216180 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c558c10_6f51_4994_864d_0eb8463caa59.slice/crio-e6086bc931e3f54609b2701f8d9cc0f915261835b1a3c0b9808ecd2649a43ac5 WatchSource:0}: Error finding container e6086bc931e3f54609b2701f8d9cc0f915261835b1a3c0b9808ecd2649a43ac5: Status 404 returned error can't find the container with id e6086bc931e3f54609b2701f8d9cc0f915261835b1a3c0b9808ecd2649a43ac5 Jul 16 11:10:13.104909 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:13.104868 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c558c10-6f51-4994-864d-0eb8463caa59","Type":"ContainerStarted","Data":"e6086bc931e3f54609b2701f8d9cc0f915261835b1a3c0b9808ecd2649a43ac5"} Jul 16 11:10:13.106605 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:13.106533 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-786fcd7d66-9zt2w" event={"ID":"a5d9a0a4-6d4b-4360-900e-2eabfbee0d98","Type":"ContainerStarted","Data":"d129b0ac7806a4c67c05e8b2c44c7399637c3dfc87f6e72f52e088ae1e50591e"} Jul 16 11:10:14.112013 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:14.111977 2559 generic.go:356] "Generic (PLEG): container finished" podID="1c558c10-6f51-4994-864d-0eb8463caa59" containerID="63626903861ee8f29409fa2d3f638b299b6c84c247bcef3ce468618ce550f030" exitCode=0 Jul 16 11:10:14.112441 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:14.112075 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c558c10-6f51-4994-864d-0eb8463caa59","Type":"ContainerDied","Data":"63626903861ee8f29409fa2d3f638b299b6c84c247bcef3ce468618ce550f030"} Jul 16 11:10:14.114543 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:14.114517 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-786fcd7d66-9zt2w" event={"ID":"a5d9a0a4-6d4b-4360-900e-2eabfbee0d98","Type":"ContainerStarted","Data":"ebe68d1b360c9194e50f48638b5daf2f1bde3b008c326d76f5367b1cf985bf94"} Jul 16 11:10:14.114657 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:14.114575 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-786fcd7d66-9zt2w" event={"ID":"a5d9a0a4-6d4b-4360-900e-2eabfbee0d98","Type":"ContainerStarted","Data":"0178747c6598d5b839aa4bdd184a6a8b69c26bc75f7ce877413ec235b4ad9814"} Jul 16 11:10:14.175127 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:14.175087 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-786fcd7d66-9zt2w" podStartSLOduration=1.96694843 podStartE2EDuration="4.175072222s" totalImagesPullingTime="2.208123792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:10:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:10:14.17389579 +0000 UTC m=+121.926153602" watchObservedRunningTime="2026-07-16 11:10:14.175072222 +0000 UTC m=+121.927330015" Jul 16 11:10:18.134594 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:18.134551 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c558c10-6f51-4994-864d-0eb8463caa59","Type":"ContainerStarted","Data":"1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c"} Jul 16 11:10:18.134990 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:18.134625 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c558c10-6f51-4994-864d-0eb8463caa59","Type":"ContainerStarted","Data":"dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c"} Jul 16 11:10:20.147084 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:20.147046 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c558c10-6f51-4994-864d-0eb8463caa59","Type":"ContainerStarted","Data":"0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd"} Jul 16 11:10:20.147477 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:20.147116 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c558c10-6f51-4994-864d-0eb8463caa59","Type":"ContainerStarted","Data":"3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785"} Jul 16 11:10:20.147477 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:20.147147 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c558c10-6f51-4994-864d-0eb8463caa59","Type":"ContainerStarted","Data":"d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed"} Jul 16 11:10:20.147477 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:20.147173 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c558c10-6f51-4994-864d-0eb8463caa59","Type":"ContainerStarted","Data":"d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd"} Jul 16 11:10:20.176542 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:20.176495 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.976449574 podStartE2EDuration="9.176477663s" totalImagesPullingTime="6.176423156s" totalInitContainerRuntime="23.604933ms" isStatefulPod=false podCreationTimestamp="2026-07-16 11:10:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:10:20.174191259 +0000 UTC m=+127.926449066" watchObservedRunningTime="2026-07-16 11:10:20.176477663 +0000 UTC m=+127.928735458" Jul 16 11:10:22.062768 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:22.062738 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:10:22.429731 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:22.429709 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3934cfdb-5ad2-4c13-8649-8a06c0c0e504-metrics-certs\") pod \"network-metrics-daemon-vdpj9\" (UID: \"3934cfdb-5ad2-4c13-8649-8a06c0c0e504\") " pod="openshift-multus/network-metrics-daemon-vdpj9" Jul 16 11:10:22.431842 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:22.431813 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3934cfdb-5ad2-4c13-8649-8a06c0c0e504-metrics-certs\") pod \"network-metrics-daemon-vdpj9\" (UID: \"3934cfdb-5ad2-4c13-8649-8a06c0c0e504\") " pod="openshift-multus/network-metrics-daemon-vdpj9" Jul 16 11:10:22.558207 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:22.558187 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hjhcs\"" Jul 16 11:10:22.566845 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:22.566827 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vdpj9" Jul 16 11:10:22.756529 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:22.756503 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vdpj9"] Jul 16 11:10:22.759373 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:10:22.759347 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3934cfdb_5ad2_4c13_8649_8a06c0c0e504.slice/crio-f15a84aadd739ec9a0d9739c41c1a2f436755c4161f75bbeff9d3aecc92eab30 WatchSource:0}: Error finding container f15a84aadd739ec9a0d9739c41c1a2f436755c4161f75bbeff9d3aecc92eab30: Status 404 returned error can't find the container with id f15a84aadd739ec9a0d9739c41c1a2f436755c4161f75bbeff9d3aecc92eab30 Jul 16 11:10:23.158458 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:23.158381 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vdpj9" event={"ID":"3934cfdb-5ad2-4c13-8649-8a06c0c0e504","Type":"ContainerStarted","Data":"f15a84aadd739ec9a0d9739c41c1a2f436755c4161f75bbeff9d3aecc92eab30"} Jul 16 11:10:25.167389 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:25.167347 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vdpj9" event={"ID":"3934cfdb-5ad2-4c13-8649-8a06c0c0e504","Type":"ContainerStarted","Data":"420d5c9e673218739830f5566652ec96747e7b1ffb1ff98829ef6e28b2965325"} Jul 16 11:10:25.167764 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:25.167408 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vdpj9" event={"ID":"3934cfdb-5ad2-4c13-8649-8a06c0c0e504","Type":"ContainerStarted","Data":"1ded0582e1aff796f588549ae48a968ea71f8237093c41c09a0ce4b60d6a8498"} Jul 16 11:10:25.193117 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:25.193070 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vdpj9" podStartSLOduration=131.742518033 podStartE2EDuration="2m13.193056759s" totalImagesPullingTime="1.450538726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:08:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:10:25.191600866 +0000 UTC m=+132.943858664" watchObservedRunningTime="2026-07-16 11:10:25.193056759 +0000 UTC m=+132.945314561" Jul 16 11:10:26.125254 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:26.125218 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-54dff647f6-vp85x" podUID="017eface-a126-4eec-961d-b076e61b5f45" containerName="registry" containerID="cri-o://b98fe11ef3756605cd19240503804625bf44958e91b58156c7acca3cd1a9b0a0" gracePeriod=30 Jul 16 11:10:26.402238 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:26.402177 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cf7766878-cqw8s"] Jul 16 11:10:26.894173 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:26.894150 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:10:26.964682 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:26.964660 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/017eface-a126-4eec-961d-b076e61b5f45-registry-certificates\") pod \"017eface-a126-4eec-961d-b076e61b5f45\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " Jul 16 11:10:26.964824 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:26.964696 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/017eface-a126-4eec-961d-b076e61b5f45-trusted-ca\") pod \"017eface-a126-4eec-961d-b076e61b5f45\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " Jul 16 11:10:26.964824 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:26.964737 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/017eface-a126-4eec-961d-b076e61b5f45-installation-pull-secrets\") pod \"017eface-a126-4eec-961d-b076e61b5f45\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " Jul 16 11:10:26.964944 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:26.964822 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/017eface-a126-4eec-961d-b076e61b5f45-ca-trust-extracted\") pod \"017eface-a126-4eec-961d-b076e61b5f45\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " Jul 16 11:10:26.964944 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:26.964869 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/017eface-a126-4eec-961d-b076e61b5f45-image-registry-private-configuration\") pod \"017eface-a126-4eec-961d-b076e61b5f45\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " Jul 16 11:10:26.964944 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:26.964898 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-registry-tls\") pod \"017eface-a126-4eec-961d-b076e61b5f45\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " Jul 16 11:10:26.964944 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:26.964928 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-bound-sa-token\") pod \"017eface-a126-4eec-961d-b076e61b5f45\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " Jul 16 11:10:26.965123 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:26.964957 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzrfh\" (UniqueName: \"kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-kube-api-access-hzrfh\") pod \"017eface-a126-4eec-961d-b076e61b5f45\" (UID: \"017eface-a126-4eec-961d-b076e61b5f45\") " Jul 16 11:10:26.965178 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:26.965119 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/017eface-a126-4eec-961d-b076e61b5f45-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "017eface-a126-4eec-961d-b076e61b5f45" (UID: "017eface-a126-4eec-961d-b076e61b5f45"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 11:10:26.965236 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:26.965218 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/017eface-a126-4eec-961d-b076e61b5f45-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "017eface-a126-4eec-961d-b076e61b5f45" (UID: "017eface-a126-4eec-961d-b076e61b5f45"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 11:10:26.965314 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:26.965294 2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/017eface-a126-4eec-961d-b076e61b5f45-registry-certificates\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:10:26.967464 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:26.967435 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-kube-api-access-hzrfh" (OuterVolumeSpecName: "kube-api-access-hzrfh") pod "017eface-a126-4eec-961d-b076e61b5f45" (UID: "017eface-a126-4eec-961d-b076e61b5f45"). InnerVolumeSpecName "kube-api-access-hzrfh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 11:10:26.967578 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:26.967506 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "017eface-a126-4eec-961d-b076e61b5f45" (UID: "017eface-a126-4eec-961d-b076e61b5f45"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 11:10:26.967578 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:26.967560 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "017eface-a126-4eec-961d-b076e61b5f45" (UID: "017eface-a126-4eec-961d-b076e61b5f45"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 11:10:26.967776 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:26.967751 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/017eface-a126-4eec-961d-b076e61b5f45-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "017eface-a126-4eec-961d-b076e61b5f45" (UID: "017eface-a126-4eec-961d-b076e61b5f45"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 11:10:26.967828 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:26.967811 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/017eface-a126-4eec-961d-b076e61b5f45-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "017eface-a126-4eec-961d-b076e61b5f45" (UID: "017eface-a126-4eec-961d-b076e61b5f45"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 11:10:26.973385 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:26.973363 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/017eface-a126-4eec-961d-b076e61b5f45-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "017eface-a126-4eec-961d-b076e61b5f45" (UID: "017eface-a126-4eec-961d-b076e61b5f45"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 11:10:27.066561 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:27.066511 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/017eface-a126-4eec-961d-b076e61b5f45-trusted-ca\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:10:27.066561 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:27.066532 2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/017eface-a126-4eec-961d-b076e61b5f45-installation-pull-secrets\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:10:27.066561 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:27.066543 2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/017eface-a126-4eec-961d-b076e61b5f45-ca-trust-extracted\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:10:27.066561 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:27.066552 2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/017eface-a126-4eec-961d-b076e61b5f45-image-registry-private-configuration\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:10:27.066561 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:27.066561 2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-registry-tls\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:10:27.066836 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:27.066569 2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-bound-sa-token\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:10:27.066836 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:27.066577 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzrfh\" (UniqueName: \"kubernetes.io/projected/017eface-a126-4eec-961d-b076e61b5f45-kube-api-access-hzrfh\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:10:27.175388 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:27.175361 2559 generic.go:356] "Generic (PLEG): container finished" podID="017eface-a126-4eec-961d-b076e61b5f45" containerID="b98fe11ef3756605cd19240503804625bf44958e91b58156c7acca3cd1a9b0a0" exitCode=0 Jul 16 11:10:27.175502 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:27.175403 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54dff647f6-vp85x" Jul 16 11:10:27.175502 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:27.175445 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54dff647f6-vp85x" event={"ID":"017eface-a126-4eec-961d-b076e61b5f45","Type":"ContainerDied","Data":"b98fe11ef3756605cd19240503804625bf44958e91b58156c7acca3cd1a9b0a0"} Jul 16 11:10:27.175502 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:27.175494 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54dff647f6-vp85x" event={"ID":"017eface-a126-4eec-961d-b076e61b5f45","Type":"ContainerDied","Data":"26d545024b7d1b5fa58fccfdfef22d80782fda4571119a95383c4fefd9bcd0b4"} Jul 16 11:10:27.175597 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:27.175525 2559 scope.go:117] "RemoveContainer" containerID="b98fe11ef3756605cd19240503804625bf44958e91b58156c7acca3cd1a9b0a0" Jul 16 11:10:27.188741 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:27.188725 2559 scope.go:117] "RemoveContainer" containerID="b98fe11ef3756605cd19240503804625bf44958e91b58156c7acca3cd1a9b0a0" Jul 16 11:10:27.188990 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:10:27.188972 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b98fe11ef3756605cd19240503804625bf44958e91b58156c7acca3cd1a9b0a0\": container with ID starting with b98fe11ef3756605cd19240503804625bf44958e91b58156c7acca3cd1a9b0a0 not found: ID does not exist" containerID="b98fe11ef3756605cd19240503804625bf44958e91b58156c7acca3cd1a9b0a0" Jul 16 11:10:27.189045 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:27.188999 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b98fe11ef3756605cd19240503804625bf44958e91b58156c7acca3cd1a9b0a0"} err="failed to get container status \"b98fe11ef3756605cd19240503804625bf44958e91b58156c7acca3cd1a9b0a0\": rpc error: code = NotFound desc = could not find container \"b98fe11ef3756605cd19240503804625bf44958e91b58156c7acca3cd1a9b0a0\": container with ID starting with b98fe11ef3756605cd19240503804625bf44958e91b58156c7acca3cd1a9b0a0 not found: ID does not exist" Jul 16 11:10:27.196416 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:27.196396 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54dff647f6-vp85x"] Jul 16 11:10:27.207611 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:27.207596 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-54dff647f6-vp85x"] Jul 16 11:10:28.649794 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:28.649759 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="017eface-a126-4eec-961d-b076e61b5f45" path="/var/lib/kubelet/pods/017eface-a126-4eec-961d-b076e61b5f45/volumes" Jul 16 11:10:30.188985 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:30.188951 2559 generic.go:356] "Generic (PLEG): container finished" podID="8c18fa76-a392-4218-ad02-5f53da15a8e2" containerID="b4e4f2c34dd7c81ec49ed7cd45435fa0c130051bcb4b187333be2fd71a362fb2" exitCode=0 Jul 16 11:10:30.189272 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:30.189033 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qlp9w" event={"ID":"8c18fa76-a392-4218-ad02-5f53da15a8e2","Type":"ContainerDied","Data":"b4e4f2c34dd7c81ec49ed7cd45435fa0c130051bcb4b187333be2fd71a362fb2"} Jul 16 11:10:30.189321 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:30.189300 2559 scope.go:117] "RemoveContainer" containerID="b4e4f2c34dd7c81ec49ed7cd45435fa0c130051bcb4b187333be2fd71a362fb2" Jul 16 11:10:31.194705 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:31.194667 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qlp9w" event={"ID":"8c18fa76-a392-4218-ad02-5f53da15a8e2","Type":"ContainerStarted","Data":"e9e5fd3606057185a1e6be60e2a94133e0e7b6ca52c83fdeaa2808659d528c72"} Jul 16 11:10:37.219342 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:37.219311 2559 generic.go:356] "Generic (PLEG): container finished" podID="5b70f755-1473-4067-92d4-d8f817b17963" containerID="bc1d8739e804174b2f50a131e1de7862fc848db54c5879ff8f2ac878b92c3c3c" exitCode=0 Jul 16 11:10:37.219650 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:37.219387 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-dgjm5" event={"ID":"5b70f755-1473-4067-92d4-d8f817b17963","Type":"ContainerDied","Data":"bc1d8739e804174b2f50a131e1de7862fc848db54c5879ff8f2ac878b92c3c3c"} Jul 16 11:10:37.219713 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:37.219695 2559 scope.go:117] "RemoveContainer" containerID="bc1d8739e804174b2f50a131e1de7862fc848db54c5879ff8f2ac878b92c3c3c" Jul 16 11:10:37.949269 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:37.949207 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xsg4k_45cdc2d0-20f4-4f63-83cb-80b6e9159a97/serve-healthcheck-canary/0.log" Jul 16 11:10:38.228112 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:38.228034 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-dgjm5" event={"ID":"5b70f755-1473-4067-92d4-d8f817b17963","Type":"ContainerStarted","Data":"65f6dbc69ed5bc081e2cd8129e2788b90dffb13d765d2bd7f614d7bae3649dbf"} Jul 16 11:10:51.426237 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:51.426145 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-cf7766878-cqw8s" podUID="570d9191-67a9-402a-a54d-1930e0ed50c6" containerName="console" containerID="cri-o://1e1d3cadedba4e5cb7f2f8aca942919dc61ecaaa409ba6835f078c62e16104a5" gracePeriod=15 Jul 16 11:10:51.675996 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:51.675975 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cf7766878-cqw8s" Jul 16 11:10:51.748529 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:51.748472 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/570d9191-67a9-402a-a54d-1930e0ed50c6-oauth-serving-cert\") pod \"570d9191-67a9-402a-a54d-1930e0ed50c6\" (UID: \"570d9191-67a9-402a-a54d-1930e0ed50c6\") " Jul 16 11:10:51.748529 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:51.748513 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/570d9191-67a9-402a-a54d-1930e0ed50c6-console-oauth-config\") pod \"570d9191-67a9-402a-a54d-1930e0ed50c6\" (UID: \"570d9191-67a9-402a-a54d-1930e0ed50c6\") " Jul 16 11:10:51.748748 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:51.748538 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5zqq\" (UniqueName: \"kubernetes.io/projected/570d9191-67a9-402a-a54d-1930e0ed50c6-kube-api-access-c5zqq\") pod \"570d9191-67a9-402a-a54d-1930e0ed50c6\" (UID: \"570d9191-67a9-402a-a54d-1930e0ed50c6\") " Jul 16 11:10:51.748748 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:51.748558 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/570d9191-67a9-402a-a54d-1930e0ed50c6-console-config\") pod \"570d9191-67a9-402a-a54d-1930e0ed50c6\" (UID: \"570d9191-67a9-402a-a54d-1930e0ed50c6\") " Jul 16 11:10:51.748748 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:51.748591 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/570d9191-67a9-402a-a54d-1930e0ed50c6-service-ca\") pod \"570d9191-67a9-402a-a54d-1930e0ed50c6\" (UID: \"570d9191-67a9-402a-a54d-1930e0ed50c6\") " Jul 16 11:10:51.748748 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:51.748612 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/570d9191-67a9-402a-a54d-1930e0ed50c6-console-serving-cert\") pod \"570d9191-67a9-402a-a54d-1930e0ed50c6\" (UID: \"570d9191-67a9-402a-a54d-1930e0ed50c6\") " Jul 16 11:10:51.748748 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:51.748679 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/570d9191-67a9-402a-a54d-1930e0ed50c6-trusted-ca-bundle\") pod \"570d9191-67a9-402a-a54d-1930e0ed50c6\" (UID: \"570d9191-67a9-402a-a54d-1930e0ed50c6\") " Jul 16 11:10:51.749000 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:51.748898 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/570d9191-67a9-402a-a54d-1930e0ed50c6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "570d9191-67a9-402a-a54d-1930e0ed50c6" (UID: "570d9191-67a9-402a-a54d-1930e0ed50c6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 11:10:51.749138 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:51.749103 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/570d9191-67a9-402a-a54d-1930e0ed50c6-console-config" (OuterVolumeSpecName: "console-config") pod "570d9191-67a9-402a-a54d-1930e0ed50c6" (UID: "570d9191-67a9-402a-a54d-1930e0ed50c6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 11:10:51.749138 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:51.749120 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/570d9191-67a9-402a-a54d-1930e0ed50c6-service-ca" (OuterVolumeSpecName: "service-ca") pod "570d9191-67a9-402a-a54d-1930e0ed50c6" (UID: "570d9191-67a9-402a-a54d-1930e0ed50c6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 11:10:51.749276 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:51.749182 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/570d9191-67a9-402a-a54d-1930e0ed50c6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "570d9191-67a9-402a-a54d-1930e0ed50c6" (UID: "570d9191-67a9-402a-a54d-1930e0ed50c6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 11:10:51.750957 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:51.750926 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/570d9191-67a9-402a-a54d-1930e0ed50c6-kube-api-access-c5zqq" (OuterVolumeSpecName: "kube-api-access-c5zqq") pod "570d9191-67a9-402a-a54d-1930e0ed50c6" (UID: "570d9191-67a9-402a-a54d-1930e0ed50c6"). InnerVolumeSpecName "kube-api-access-c5zqq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 11:10:51.750957 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:51.750929 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/570d9191-67a9-402a-a54d-1930e0ed50c6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "570d9191-67a9-402a-a54d-1930e0ed50c6" (UID: "570d9191-67a9-402a-a54d-1930e0ed50c6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 11:10:51.751103 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:51.750952 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/570d9191-67a9-402a-a54d-1930e0ed50c6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "570d9191-67a9-402a-a54d-1930e0ed50c6" (UID: "570d9191-67a9-402a-a54d-1930e0ed50c6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 11:10:51.849415 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:51.849389 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/570d9191-67a9-402a-a54d-1930e0ed50c6-trusted-ca-bundle\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:10:51.849415 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:51.849412 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/570d9191-67a9-402a-a54d-1930e0ed50c6-oauth-serving-cert\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:10:51.849550 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:51.849422 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/570d9191-67a9-402a-a54d-1930e0ed50c6-console-oauth-config\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:10:51.849550 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:51.849431 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5zqq\" (UniqueName: \"kubernetes.io/projected/570d9191-67a9-402a-a54d-1930e0ed50c6-kube-api-access-c5zqq\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:10:51.849550 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:51.849440 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/570d9191-67a9-402a-a54d-1930e0ed50c6-console-config\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:10:51.849550 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:51.849448 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/570d9191-67a9-402a-a54d-1930e0ed50c6-service-ca\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:10:51.849550 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:51.849456 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/570d9191-67a9-402a-a54d-1930e0ed50c6-console-serving-cert\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:10:52.283856 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:52.283830 2559 generic.go:356] "Generic (PLEG): container finished" podID="570d9191-67a9-402a-a54d-1930e0ed50c6" containerID="1e1d3cadedba4e5cb7f2f8aca942919dc61ecaaa409ba6835f078c62e16104a5" exitCode=0 Jul 16 11:10:52.284000 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:52.283876 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cf7766878-cqw8s" Jul 16 11:10:52.284000 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:52.283906 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cf7766878-cqw8s" event={"ID":"570d9191-67a9-402a-a54d-1930e0ed50c6","Type":"ContainerDied","Data":"1e1d3cadedba4e5cb7f2f8aca942919dc61ecaaa409ba6835f078c62e16104a5"} Jul 16 11:10:52.284000 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:52.283949 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cf7766878-cqw8s" event={"ID":"570d9191-67a9-402a-a54d-1930e0ed50c6","Type":"ContainerDied","Data":"92e6dca8c17e8bad844964934bb1c8b0370272e3964306b5582c8e3a0cf16043"} Jul 16 11:10:52.284000 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:52.283969 2559 scope.go:117] "RemoveContainer" containerID="1e1d3cadedba4e5cb7f2f8aca942919dc61ecaaa409ba6835f078c62e16104a5" Jul 16 11:10:52.293040 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:52.293018 2559 scope.go:117] "RemoveContainer" containerID="1e1d3cadedba4e5cb7f2f8aca942919dc61ecaaa409ba6835f078c62e16104a5" Jul 16 11:10:52.293299 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:10:52.293279 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e1d3cadedba4e5cb7f2f8aca942919dc61ecaaa409ba6835f078c62e16104a5\": container with ID starting with 1e1d3cadedba4e5cb7f2f8aca942919dc61ecaaa409ba6835f078c62e16104a5 not found: ID does not exist" containerID="1e1d3cadedba4e5cb7f2f8aca942919dc61ecaaa409ba6835f078c62e16104a5" Jul 16 11:10:52.293375 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:52.293342 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e1d3cadedba4e5cb7f2f8aca942919dc61ecaaa409ba6835f078c62e16104a5"} err="failed to get container status \"1e1d3cadedba4e5cb7f2f8aca942919dc61ecaaa409ba6835f078c62e16104a5\": rpc error: code = NotFound desc = could not find container \"1e1d3cadedba4e5cb7f2f8aca942919dc61ecaaa409ba6835f078c62e16104a5\": container with ID starting with 1e1d3cadedba4e5cb7f2f8aca942919dc61ecaaa409ba6835f078c62e16104a5 not found: ID does not exist" Jul 16 11:10:52.306661 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:52.306620 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cf7766878-cqw8s"] Jul 16 11:10:52.311689 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:52.311664 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cf7766878-cqw8s"] Jul 16 11:10:52.649290 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:10:52.649225 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="570d9191-67a9-402a-a54d-1930e0ed50c6" path="/var/lib/kubelet/pods/570d9191-67a9-402a-a54d-1930e0ed50c6/volumes" Jul 16 11:11:12.062017 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:12.061911 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:12.081283 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:12.081255 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:12.374049 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:12.373982 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:30.111189 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.111157 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 11:11:30.111691 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.111470 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1c558c10-6f51-4994-864d-0eb8463caa59" containerName="prometheus" containerID="cri-o://dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c" gracePeriod=600 Jul 16 11:11:30.111691 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.111523 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1c558c10-6f51-4994-864d-0eb8463caa59" containerName="kube-rbac-proxy-web" containerID="cri-o://d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed" gracePeriod=600 Jul 16 11:11:30.111691 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.111574 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1c558c10-6f51-4994-864d-0eb8463caa59" containerName="config-reloader" containerID="cri-o://1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c" gracePeriod=600 Jul 16 11:11:30.111691 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.111578 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1c558c10-6f51-4994-864d-0eb8463caa59" containerName="kube-rbac-proxy-thanos" containerID="cri-o://0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd" gracePeriod=600 Jul 16 11:11:30.111691 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.111529 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1c558c10-6f51-4994-864d-0eb8463caa59" containerName="kube-rbac-proxy" containerID="cri-o://3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785" gracePeriod=600 Jul 16 11:11:30.111962 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.111710 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1c558c10-6f51-4994-864d-0eb8463caa59" containerName="thanos-sidecar" containerID="cri-o://d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd" gracePeriod=600 Jul 16 11:11:30.348715 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.348689 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:30.426266 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.426234 2559 generic.go:356] "Generic (PLEG): container finished" podID="1c558c10-6f51-4994-864d-0eb8463caa59" containerID="0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd" exitCode=0 Jul 16 11:11:30.426266 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.426263 2559 generic.go:356] "Generic (PLEG): container finished" podID="1c558c10-6f51-4994-864d-0eb8463caa59" containerID="3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785" exitCode=0 Jul 16 11:11:30.426471 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.426273 2559 generic.go:356] "Generic (PLEG): container finished" podID="1c558c10-6f51-4994-864d-0eb8463caa59" containerID="d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed" exitCode=0 Jul 16 11:11:30.426471 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.426282 2559 generic.go:356] "Generic (PLEG): container finished" podID="1c558c10-6f51-4994-864d-0eb8463caa59" containerID="d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd" exitCode=0 Jul 16 11:11:30.426471 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.426290 2559 generic.go:356] "Generic (PLEG): container finished" podID="1c558c10-6f51-4994-864d-0eb8463caa59" containerID="1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c" exitCode=0 Jul 16 11:11:30.426471 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.426298 2559 generic.go:356] "Generic (PLEG): container finished" podID="1c558c10-6f51-4994-864d-0eb8463caa59" containerID="dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c" exitCode=0 Jul 16 11:11:30.426471 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.426316 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:30.426471 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.426320 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c558c10-6f51-4994-864d-0eb8463caa59","Type":"ContainerDied","Data":"0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd"} Jul 16 11:11:30.426471 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.426401 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c558c10-6f51-4994-864d-0eb8463caa59","Type":"ContainerDied","Data":"3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785"} Jul 16 11:11:30.426471 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.426443 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c558c10-6f51-4994-864d-0eb8463caa59","Type":"ContainerDied","Data":"d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed"} Jul 16 11:11:30.426471 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.426471 2559 scope.go:117] "RemoveContainer" containerID="0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd" Jul 16 11:11:30.426872 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.426482 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c558c10-6f51-4994-864d-0eb8463caa59","Type":"ContainerDied","Data":"d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd"} Jul 16 11:11:30.426872 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.426524 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c558c10-6f51-4994-864d-0eb8463caa59","Type":"ContainerDied","Data":"1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c"} Jul 16 11:11:30.426872 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.426563 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c558c10-6f51-4994-864d-0eb8463caa59","Type":"ContainerDied","Data":"dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c"} Jul 16 11:11:30.426872 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.426605 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c558c10-6f51-4994-864d-0eb8463caa59","Type":"ContainerDied","Data":"e6086bc931e3f54609b2701f8d9cc0f915261835b1a3c0b9808ecd2649a43ac5"} Jul 16 11:11:30.434665 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.434627 2559 scope.go:117] "RemoveContainer" containerID="3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785" Jul 16 11:11:30.441325 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.441306 2559 scope.go:117] "RemoveContainer" containerID="d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed" Jul 16 11:11:30.447358 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.447343 2559 scope.go:117] "RemoveContainer" containerID="d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd" Jul 16 11:11:30.453832 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.453818 2559 scope.go:117] "RemoveContainer" containerID="1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c" Jul 16 11:11:30.459928 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.459913 2559 scope.go:117] "RemoveContainer" containerID="dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c" Jul 16 11:11:30.466307 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.466293 2559 scope.go:117] "RemoveContainer" containerID="63626903861ee8f29409fa2d3f638b299b6c84c247bcef3ce468618ce550f030" Jul 16 11:11:30.472197 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.472181 2559 scope.go:117] "RemoveContainer" containerID="0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd" Jul 16 11:11:30.472435 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:11:30.472418 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd\": container with ID starting with 0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd not found: ID does not exist" containerID="0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd" Jul 16 11:11:30.472499 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.472448 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd"} err="failed to get container status \"0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd\": rpc error: code = NotFound desc = could not find container \"0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd\": container with ID starting with 0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd not found: ID does not exist" Jul 16 11:11:30.472499 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.472474 2559 scope.go:117] "RemoveContainer" containerID="3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785" Jul 16 11:11:30.472723 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:11:30.472705 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785\": container with ID starting with 3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785 not found: ID does not exist" containerID="3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785" Jul 16 11:11:30.472776 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.472728 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785"} err="failed to get container status \"3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785\": rpc error: code = NotFound desc = could not find container \"3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785\": container with ID starting with 3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785 not found: ID does not exist" Jul 16 11:11:30.472776 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.472744 2559 scope.go:117] "RemoveContainer" containerID="d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed" Jul 16 11:11:30.472953 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:11:30.472938 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed\": container with ID starting with d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed not found: ID does not exist" containerID="d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed" Jul 16 11:11:30.473010 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.472962 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed"} err="failed to get container status \"d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed\": rpc error: code = NotFound desc = could not find container \"d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed\": container with ID starting with d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed not found: ID does not exist" Jul 16 11:11:30.473010 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.472983 2559 scope.go:117] "RemoveContainer" containerID="d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd" Jul 16 11:11:30.473182 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:11:30.473169 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd\": container with ID starting with d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd not found: ID does not exist" containerID="d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd" Jul 16 11:11:30.473243 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.473188 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd"} err="failed to get container status \"d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd\": rpc error: code = NotFound desc = could not find container \"d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd\": container with ID starting with d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd not found: ID does not exist" Jul 16 11:11:30.473243 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.473204 2559 scope.go:117] "RemoveContainer" containerID="1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c" Jul 16 11:11:30.473409 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:11:30.473396 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c\": container with ID starting with 1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c not found: ID does not exist" containerID="1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c" Jul 16 11:11:30.473463 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.473414 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c"} err="failed to get container status \"1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c\": rpc error: code = NotFound desc = could not find container \"1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c\": container with ID starting with 1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c not found: ID does not exist" Jul 16 11:11:30.473463 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.473430 2559 scope.go:117] "RemoveContainer" containerID="dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c" Jul 16 11:11:30.473700 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:11:30.473684 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c\": container with ID starting with dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c not found: ID does not exist" containerID="dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c" Jul 16 11:11:30.473754 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.473704 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c"} err="failed to get container status \"dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c\": rpc error: code = NotFound desc = could not find container \"dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c\": container with ID starting with dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c not found: ID does not exist" Jul 16 11:11:30.473754 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.473733 2559 scope.go:117] "RemoveContainer" containerID="63626903861ee8f29409fa2d3f638b299b6c84c247bcef3ce468618ce550f030" Jul 16 11:11:30.473981 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:11:30.473963 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63626903861ee8f29409fa2d3f638b299b6c84c247bcef3ce468618ce550f030\": container with ID starting with 63626903861ee8f29409fa2d3f638b299b6c84c247bcef3ce468618ce550f030 not found: ID does not exist" containerID="63626903861ee8f29409fa2d3f638b299b6c84c247bcef3ce468618ce550f030" Jul 16 11:11:30.474032 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.473988 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63626903861ee8f29409fa2d3f638b299b6c84c247bcef3ce468618ce550f030"} err="failed to get container status \"63626903861ee8f29409fa2d3f638b299b6c84c247bcef3ce468618ce550f030\": rpc error: code = NotFound desc = could not find container \"63626903861ee8f29409fa2d3f638b299b6c84c247bcef3ce468618ce550f030\": container with ID starting with 63626903861ee8f29409fa2d3f638b299b6c84c247bcef3ce468618ce550f030 not found: ID does not exist" Jul 16 11:11:30.474032 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.474005 2559 scope.go:117] "RemoveContainer" containerID="0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd" Jul 16 11:11:30.474238 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.474220 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd"} err="failed to get container status \"0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd\": rpc error: code = NotFound desc = could not find container \"0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd\": container with ID starting with 0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd not found: ID does not exist" Jul 16 11:11:30.474285 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.474238 2559 scope.go:117] "RemoveContainer" containerID="3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785" Jul 16 11:11:30.474459 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.474441 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785"} err="failed to get container status \"3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785\": rpc error: code = NotFound desc = could not find container \"3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785\": container with ID starting with 3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785 not found: ID does not exist" Jul 16 11:11:30.474499 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.474460 2559 scope.go:117] "RemoveContainer" containerID="d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed" Jul 16 11:11:30.474688 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.474670 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed"} err="failed to get container status \"d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed\": rpc error: code = NotFound desc = could not find container \"d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed\": container with ID starting with d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed not found: ID does not exist" Jul 16 11:11:30.474739 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.474690 2559 scope.go:117] "RemoveContainer" containerID="d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd" Jul 16 11:11:30.474902 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.474885 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd"} err="failed to get container status \"d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd\": rpc error: code = NotFound desc = could not find container \"d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd\": container with ID starting with d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd not found: ID does not exist" Jul 16 11:11:30.474942 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.474902 2559 scope.go:117] "RemoveContainer" containerID="1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c" Jul 16 11:11:30.475112 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.475095 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c"} err="failed to get container status \"1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c\": rpc error: code = NotFound desc = could not find container \"1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c\": container with ID starting with 1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c not found: ID does not exist" Jul 16 11:11:30.475112 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.475111 2559 scope.go:117] "RemoveContainer" containerID="dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c" Jul 16 11:11:30.475298 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.475284 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c"} err="failed to get container status \"dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c\": rpc error: code = NotFound desc = could not find container \"dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c\": container with ID starting with dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c not found: ID does not exist" Jul 16 11:11:30.475345 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.475299 2559 scope.go:117] "RemoveContainer" containerID="63626903861ee8f29409fa2d3f638b299b6c84c247bcef3ce468618ce550f030" Jul 16 11:11:30.475494 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.475477 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63626903861ee8f29409fa2d3f638b299b6c84c247bcef3ce468618ce550f030"} err="failed to get container status \"63626903861ee8f29409fa2d3f638b299b6c84c247bcef3ce468618ce550f030\": rpc error: code = NotFound desc = could not find container \"63626903861ee8f29409fa2d3f638b299b6c84c247bcef3ce468618ce550f030\": container with ID starting with 63626903861ee8f29409fa2d3f638b299b6c84c247bcef3ce468618ce550f030 not found: ID does not exist" Jul 16 11:11:30.475534 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.475495 2559 scope.go:117] "RemoveContainer" containerID="0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd" Jul 16 11:11:30.475737 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.475721 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd"} err="failed to get container status \"0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd\": rpc error: code = NotFound desc = could not find container \"0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd\": container with ID starting with 0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd not found: ID does not exist" Jul 16 11:11:30.475737 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.475737 2559 scope.go:117] "RemoveContainer" containerID="3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785" Jul 16 11:11:30.475945 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.475929 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785"} err="failed to get container status \"3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785\": rpc error: code = NotFound desc = could not find container \"3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785\": container with ID starting with 3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785 not found: ID does not exist" Jul 16 11:11:30.475945 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.475945 2559 scope.go:117] "RemoveContainer" containerID="d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed" Jul 16 11:11:30.476126 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.476112 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed"} err="failed to get container status \"d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed\": rpc error: code = NotFound desc = could not find container \"d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed\": container with ID starting with d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed not found: ID does not exist" Jul 16 11:11:30.476174 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.476126 2559 scope.go:117] "RemoveContainer" containerID="d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd" Jul 16 11:11:30.476322 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.476308 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd"} err="failed to get container status \"d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd\": rpc error: code = NotFound desc = could not find container \"d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd\": container with ID starting with d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd not found: ID does not exist" Jul 16 11:11:30.476362 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.476323 2559 scope.go:117] "RemoveContainer" containerID="1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c" Jul 16 11:11:30.476498 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.476476 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c"} err="failed to get container status \"1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c\": rpc error: code = NotFound desc = could not find container \"1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c\": container with ID starting with 1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c not found: ID does not exist" Jul 16 11:11:30.476538 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.476498 2559 scope.go:117] "RemoveContainer" containerID="dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c" Jul 16 11:11:30.476695 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.476680 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c"} err="failed to get container status \"dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c\": rpc error: code = NotFound desc = could not find container \"dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c\": container with ID starting with dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c not found: ID does not exist" Jul 16 11:11:30.476695 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.476695 2559 scope.go:117] "RemoveContainer" containerID="63626903861ee8f29409fa2d3f638b299b6c84c247bcef3ce468618ce550f030" Jul 16 11:11:30.476876 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.476861 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63626903861ee8f29409fa2d3f638b299b6c84c247bcef3ce468618ce550f030"} err="failed to get container status \"63626903861ee8f29409fa2d3f638b299b6c84c247bcef3ce468618ce550f030\": rpc error: code = NotFound desc = could not find container \"63626903861ee8f29409fa2d3f638b299b6c84c247bcef3ce468618ce550f030\": container with ID starting with 63626903861ee8f29409fa2d3f638b299b6c84c247bcef3ce468618ce550f030 not found: ID does not exist" Jul 16 11:11:30.476921 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.476876 2559 scope.go:117] "RemoveContainer" containerID="0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd" Jul 16 11:11:30.477087 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.477070 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd"} err="failed to get container status \"0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd\": rpc error: code = NotFound desc = could not find container \"0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd\": container with ID starting with 0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd not found: ID does not exist" Jul 16 11:11:30.477135 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.477088 2559 scope.go:117] "RemoveContainer" containerID="3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785" Jul 16 11:11:30.477275 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.477260 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785"} err="failed to get container status \"3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785\": rpc error: code = NotFound desc = could not find container \"3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785\": container with ID starting with 3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785 not found: ID does not exist" Jul 16 11:11:30.477275 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.477274 2559 scope.go:117] "RemoveContainer" containerID="d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed" Jul 16 11:11:30.477465 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.477446 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed"} err="failed to get container status \"d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed\": rpc error: code = NotFound desc = could not find container \"d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed\": container with ID starting with d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed not found: ID does not exist" Jul 16 11:11:30.477506 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.477466 2559 scope.go:117] "RemoveContainer" containerID="d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd" Jul 16 11:11:30.477678 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.477660 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd"} err="failed to get container status \"d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd\": rpc error: code = NotFound desc = could not find container \"d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd\": container with ID starting with d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd not found: ID does not exist" Jul 16 11:11:30.477716 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.477678 2559 scope.go:117] "RemoveContainer" containerID="1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c" Jul 16 11:11:30.477916 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.477901 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c"} err="failed to get container status \"1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c\": rpc error: code = NotFound desc = could not find container \"1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c\": container with ID starting with 1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c not found: ID does not exist" Jul 16 11:11:30.477952 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.477917 2559 scope.go:117] "RemoveContainer" containerID="dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c" Jul 16 11:11:30.478124 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.478107 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c"} err="failed to get container status \"dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c\": rpc error: code = NotFound desc = could not find container \"dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c\": container with ID starting with dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c not found: ID does not exist" Jul 16 11:11:30.478163 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.478125 2559 scope.go:117] "RemoveContainer" containerID="63626903861ee8f29409fa2d3f638b299b6c84c247bcef3ce468618ce550f030" Jul 16 11:11:30.478308 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.478295 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63626903861ee8f29409fa2d3f638b299b6c84c247bcef3ce468618ce550f030"} err="failed to get container status \"63626903861ee8f29409fa2d3f638b299b6c84c247bcef3ce468618ce550f030\": rpc error: code = NotFound desc = could not find container \"63626903861ee8f29409fa2d3f638b299b6c84c247bcef3ce468618ce550f030\": container with ID starting with 63626903861ee8f29409fa2d3f638b299b6c84c247bcef3ce468618ce550f030 not found: ID does not exist" Jul 16 11:11:30.478347 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.478307 2559 scope.go:117] "RemoveContainer" containerID="0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd" Jul 16 11:11:30.478490 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.478473 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd"} err="failed to get container status \"0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd\": rpc error: code = NotFound desc = could not find container \"0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd\": container with ID starting with 0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd not found: ID does not exist" Jul 16 11:11:30.478532 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.478491 2559 scope.go:117] "RemoveContainer" containerID="3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785" Jul 16 11:11:30.478715 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.478698 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785"} err="failed to get container status \"3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785\": rpc error: code = NotFound desc = could not find container \"3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785\": container with ID starting with 3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785 not found: ID does not exist" Jul 16 11:11:30.478779 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.478720 2559 scope.go:117] "RemoveContainer" containerID="d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed" Jul 16 11:11:30.478921 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.478902 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed"} err="failed to get container status \"d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed\": rpc error: code = NotFound desc = could not find container \"d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed\": container with ID starting with d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed not found: ID does not exist" Jul 16 11:11:30.478972 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.478922 2559 scope.go:117] "RemoveContainer" containerID="d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd" Jul 16 11:11:30.479093 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.479079 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd"} err="failed to get container status \"d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd\": rpc error: code = NotFound desc = could not find container \"d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd\": container with ID starting with d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd not found: ID does not exist" Jul 16 11:11:30.479093 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.479092 2559 scope.go:117] "RemoveContainer" containerID="1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c" Jul 16 11:11:30.479284 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.479267 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c"} err="failed to get container status \"1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c\": rpc error: code = NotFound desc = could not find container \"1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c\": container with ID starting with 1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c not found: ID does not exist" Jul 16 11:11:30.479328 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.479285 2559 scope.go:117] "RemoveContainer" containerID="dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c" Jul 16 11:11:30.479476 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.479459 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c"} err="failed to get container status \"dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c\": rpc error: code = NotFound desc = could not find container \"dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c\": container with ID starting with dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c not found: ID does not exist" Jul 16 11:11:30.479529 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.479476 2559 scope.go:117] "RemoveContainer" containerID="63626903861ee8f29409fa2d3f638b299b6c84c247bcef3ce468618ce550f030" Jul 16 11:11:30.479697 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.479682 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63626903861ee8f29409fa2d3f638b299b6c84c247bcef3ce468618ce550f030"} err="failed to get container status \"63626903861ee8f29409fa2d3f638b299b6c84c247bcef3ce468618ce550f030\": rpc error: code = NotFound desc = could not find container \"63626903861ee8f29409fa2d3f638b299b6c84c247bcef3ce468618ce550f030\": container with ID starting with 63626903861ee8f29409fa2d3f638b299b6c84c247bcef3ce468618ce550f030 not found: ID does not exist" Jul 16 11:11:30.479800 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.479698 2559 scope.go:117] "RemoveContainer" containerID="0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd" Jul 16 11:11:30.479871 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.479854 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd"} err="failed to get container status \"0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd\": rpc error: code = NotFound desc = could not find container \"0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd\": container with ID starting with 0dbb081cc8b0b92b3d46f8b171fb0d38ef1d42a5f7c32130133a69df9c2f4bfd not found: ID does not exist" Jul 16 11:11:30.479910 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.479872 2559 scope.go:117] "RemoveContainer" containerID="3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785" Jul 16 11:11:30.480049 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.480036 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785"} err="failed to get container status \"3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785\": rpc error: code = NotFound desc = could not find container \"3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785\": container with ID starting with 3b123f3d25e8cc6c5c26c3773192b5360a85fd0cabdd9fecf90e4263fae94785 not found: ID does not exist" Jul 16 11:11:30.480091 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.480050 2559 scope.go:117] "RemoveContainer" containerID="d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed" Jul 16 11:11:30.480252 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.480235 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed"} err="failed to get container status \"d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed\": rpc error: code = NotFound desc = could not find container \"d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed\": container with ID starting with d36aa40f4b9aaf8cf76300bfff137957f1ccb96ffd9f7d24c6abf58a55f414ed not found: ID does not exist" Jul 16 11:11:30.480252 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.480251 2559 scope.go:117] "RemoveContainer" containerID="d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd" Jul 16 11:11:30.480441 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.480425 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd"} err="failed to get container status \"d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd\": rpc error: code = NotFound desc = could not find container \"d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd\": container with ID starting with d333ac986922618fa54501de6bc0bba98fe4b68036f48d38f96ed0fdcc21cadd not found: ID does not exist" Jul 16 11:11:30.480441 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.480440 2559 scope.go:117] "RemoveContainer" containerID="1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c" Jul 16 11:11:30.480597 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.480582 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c"} err="failed to get container status \"1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c\": rpc error: code = NotFound desc = could not find container \"1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c\": container with ID starting with 1b9f7dd6f00aae0d4e26d0e8f0c9cff51d134ad1e71f1c910c98c3bfe1570f4c not found: ID does not exist" Jul 16 11:11:30.480655 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.480598 2559 scope.go:117] "RemoveContainer" containerID="dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c" Jul 16 11:11:30.480787 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.480769 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c"} err="failed to get container status \"dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c\": rpc error: code = NotFound desc = could not find container \"dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c\": container with ID starting with dc7512b525b00f1706e7fc778736f7ca52f42089d7dfb7824d8774f469446f4c not found: ID does not exist" Jul 16 11:11:30.480840 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.480788 2559 scope.go:117] "RemoveContainer" containerID="63626903861ee8f29409fa2d3f638b299b6c84c247bcef3ce468618ce550f030" Jul 16 11:11:30.480979 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.480962 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63626903861ee8f29409fa2d3f638b299b6c84c247bcef3ce468618ce550f030"} err="failed to get container status \"63626903861ee8f29409fa2d3f638b299b6c84c247bcef3ce468618ce550f030\": rpc error: code = NotFound desc = could not find container \"63626903861ee8f29409fa2d3f638b299b6c84c247bcef3ce468618ce550f030\": container with ID starting with 63626903861ee8f29409fa2d3f638b299b6c84c247bcef3ce468618ce550f030 not found: ID does not exist" Jul 16 11:11:30.531812 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.531781 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-web-config\") pod \"1c558c10-6f51-4994-864d-0eb8463caa59\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " Jul 16 11:11:30.531898 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.531821 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c558c10-6f51-4994-864d-0eb8463caa59-tls-assets\") pod \"1c558c10-6f51-4994-864d-0eb8463caa59\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " Jul 16 11:11:30.531898 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.531855 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"1c558c10-6f51-4994-864d-0eb8463caa59\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " Jul 16 11:11:30.531898 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.531879 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-secret-grpc-tls\") pod \"1c558c10-6f51-4994-864d-0eb8463caa59\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " Jul 16 11:11:30.532046 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.531908 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"1c558c10-6f51-4994-864d-0eb8463caa59\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " Jul 16 11:11:30.532046 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.531939 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-configmap-metrics-client-ca\") pod \"1c558c10-6f51-4994-864d-0eb8463caa59\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " Jul 16 11:11:30.532046 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.531973 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-configmap-kubelet-serving-ca-bundle\") pod \"1c558c10-6f51-4994-864d-0eb8463caa59\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " Jul 16 11:11:30.532046 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.532002 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-secret-kube-rbac-proxy\") pod \"1c558c10-6f51-4994-864d-0eb8463caa59\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " Jul 16 11:11:30.532046 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.532031 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twf7h\" (UniqueName: \"kubernetes.io/projected/1c558c10-6f51-4994-864d-0eb8463caa59-kube-api-access-twf7h\") pod \"1c558c10-6f51-4994-864d-0eb8463caa59\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " Jul 16 11:11:30.532283 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.532059 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c558c10-6f51-4994-864d-0eb8463caa59-config-out\") pod \"1c558c10-6f51-4994-864d-0eb8463caa59\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " Jul 16 11:11:30.532283 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.532103 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-secret-prometheus-k8s-tls\") pod \"1c558c10-6f51-4994-864d-0eb8463caa59\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " Jul 16 11:11:30.532283 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.532125 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-prometheus-k8s-rulefiles-0\") pod \"1c558c10-6f51-4994-864d-0eb8463caa59\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " Jul 16 11:11:30.532283 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.532151 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-prometheus-trusted-ca-bundle\") pod \"1c558c10-6f51-4994-864d-0eb8463caa59\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " Jul 16 11:11:30.532283 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.532182 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-configmap-serving-certs-ca-bundle\") pod \"1c558c10-6f51-4994-864d-0eb8463caa59\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " Jul 16 11:11:30.532283 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.532211 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-secret-metrics-client-certs\") pod \"1c558c10-6f51-4994-864d-0eb8463caa59\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " Jul 16 11:11:30.532283 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.532257 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-prometheus-k8s-rulefiles-1\") pod \"1c558c10-6f51-4994-864d-0eb8463caa59\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " Jul 16 11:11:30.532599 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.532293 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-prometheus-k8s-rulefiles-2\") pod \"1c558c10-6f51-4994-864d-0eb8463caa59\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " Jul 16 11:11:30.532599 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.532326 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-thanos-prometheus-http-client-file\") pod \"1c558c10-6f51-4994-864d-0eb8463caa59\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " Jul 16 11:11:30.532599 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.532359 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1c558c10-6f51-4994-864d-0eb8463caa59-prometheus-k8s-db\") pod \"1c558c10-6f51-4994-864d-0eb8463caa59\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " Jul 16 11:11:30.532599 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.532387 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-config\") pod \"1c558c10-6f51-4994-864d-0eb8463caa59\" (UID: \"1c558c10-6f51-4994-864d-0eb8463caa59\") " Jul 16 11:11:30.532599 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.532557 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "1c558c10-6f51-4994-864d-0eb8463caa59" (UID: "1c558c10-6f51-4994-864d-0eb8463caa59"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 11:11:30.532866 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.532656 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-configmap-metrics-client-ca\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:11:30.533018 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.532917 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "1c558c10-6f51-4994-864d-0eb8463caa59" (UID: "1c558c10-6f51-4994-864d-0eb8463caa59"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 11:11:30.533092 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.533068 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "1c558c10-6f51-4994-864d-0eb8463caa59" (UID: "1c558c10-6f51-4994-864d-0eb8463caa59"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 11:11:30.533389 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.533365 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "1c558c10-6f51-4994-864d-0eb8463caa59" (UID: "1c558c10-6f51-4994-864d-0eb8463caa59"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 11:11:30.533553 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.533524 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "1c558c10-6f51-4994-864d-0eb8463caa59" (UID: "1c558c10-6f51-4994-864d-0eb8463caa59"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 11:11:30.534506 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.534480 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c558c10-6f51-4994-864d-0eb8463caa59-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1c558c10-6f51-4994-864d-0eb8463caa59" (UID: "1c558c10-6f51-4994-864d-0eb8463caa59"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 11:11:30.534677 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.534654 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "1c558c10-6f51-4994-864d-0eb8463caa59" (UID: "1c558c10-6f51-4994-864d-0eb8463caa59"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 11:11:30.534770 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.534676 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "1c558c10-6f51-4994-864d-0eb8463caa59" (UID: "1c558c10-6f51-4994-864d-0eb8463caa59"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 11:11:30.534956 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.534936 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "1c558c10-6f51-4994-864d-0eb8463caa59" (UID: "1c558c10-6f51-4994-864d-0eb8463caa59"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 11:11:30.535188 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.535148 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "1c558c10-6f51-4994-864d-0eb8463caa59" (UID: "1c558c10-6f51-4994-864d-0eb8463caa59"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 11:11:30.535744 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.535716 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "1c558c10-6f51-4994-864d-0eb8463caa59" (UID: "1c558c10-6f51-4994-864d-0eb8463caa59"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 11:11:30.536011 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.535865 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "1c558c10-6f51-4994-864d-0eb8463caa59" (UID: "1c558c10-6f51-4994-864d-0eb8463caa59"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 11:11:30.536011 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.535954 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c558c10-6f51-4994-864d-0eb8463caa59-config-out" (OuterVolumeSpecName: "config-out") pod "1c558c10-6f51-4994-864d-0eb8463caa59" (UID: "1c558c10-6f51-4994-864d-0eb8463caa59"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 11:11:30.536171 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.536038 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c558c10-6f51-4994-864d-0eb8463caa59-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "1c558c10-6f51-4994-864d-0eb8463caa59" (UID: "1c558c10-6f51-4994-864d-0eb8463caa59"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 11:11:30.536408 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.536377 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "1c558c10-6f51-4994-864d-0eb8463caa59" (UID: "1c558c10-6f51-4994-864d-0eb8463caa59"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 11:11:30.536903 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.536883 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "1c558c10-6f51-4994-864d-0eb8463caa59" (UID: "1c558c10-6f51-4994-864d-0eb8463caa59"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 11:11:30.537069 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.537052 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c558c10-6f51-4994-864d-0eb8463caa59-kube-api-access-twf7h" (OuterVolumeSpecName: "kube-api-access-twf7h") pod "1c558c10-6f51-4994-864d-0eb8463caa59" (UID: "1c558c10-6f51-4994-864d-0eb8463caa59"). InnerVolumeSpecName "kube-api-access-twf7h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 11:11:30.537566 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.537551 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-config" (OuterVolumeSpecName: "config") pod "1c558c10-6f51-4994-864d-0eb8463caa59" (UID: "1c558c10-6f51-4994-864d-0eb8463caa59"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 11:11:30.537705 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.537683 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "1c558c10-6f51-4994-864d-0eb8463caa59" (UID: "1c558c10-6f51-4994-864d-0eb8463caa59"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 11:11:30.544582 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.544561 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-web-config" (OuterVolumeSpecName: "web-config") pod "1c558c10-6f51-4994-864d-0eb8463caa59" (UID: "1c558c10-6f51-4994-864d-0eb8463caa59"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 11:11:30.633357 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.633338 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:11:30.633357 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.633356 2559 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-secret-kube-rbac-proxy\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:11:30.633480 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.633366 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twf7h\" (UniqueName: \"kubernetes.io/projected/1c558c10-6f51-4994-864d-0eb8463caa59-kube-api-access-twf7h\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:11:30.633480 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.633375 2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c558c10-6f51-4994-864d-0eb8463caa59-config-out\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:11:30.633480 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.633383 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:11:30.633480 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.633392 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:11:30.633480 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.633401 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:11:30.633480 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.633409 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:11:30.633480 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.633417 2559 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-secret-metrics-client-certs\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:11:30.633480 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.633425 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:11:30.633480 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.633432 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1c558c10-6f51-4994-864d-0eb8463caa59-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:11:30.633480 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.633440 2559 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:11:30.633480 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.633448 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1c558c10-6f51-4994-864d-0eb8463caa59-prometheus-k8s-db\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:11:30.633480 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.633455 2559 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-config\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:11:30.633480 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.633462 2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-web-config\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:11:30.633480 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.633471 2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c558c10-6f51-4994-864d-0eb8463caa59-tls-assets\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:11:30.633480 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.633478 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:11:30.633480 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.633485 2559 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-secret-grpc-tls\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:11:30.634092 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.633494 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1c558c10-6f51-4994-864d-0eb8463caa59-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:11:30.746027 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.745978 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 11:11:30.750925 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.750907 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 11:11:30.781219 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.781200 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 11:11:30.781457 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.781444 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c558c10-6f51-4994-864d-0eb8463caa59" containerName="kube-rbac-proxy-thanos" Jul 16 11:11:30.781505 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.781459 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c558c10-6f51-4994-864d-0eb8463caa59" containerName="kube-rbac-proxy-thanos" Jul 16 11:11:30.781505 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.781470 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c558c10-6f51-4994-864d-0eb8463caa59" containerName="kube-rbac-proxy" Jul 16 11:11:30.781505 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.781475 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c558c10-6f51-4994-864d-0eb8463caa59" containerName="kube-rbac-proxy" Jul 16 11:11:30.781505 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.781487 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="570d9191-67a9-402a-a54d-1930e0ed50c6" containerName="console" Jul 16 11:11:30.781505 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.781492 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="570d9191-67a9-402a-a54d-1930e0ed50c6" containerName="console" Jul 16 11:11:30.781505 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.781499 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c558c10-6f51-4994-864d-0eb8463caa59" containerName="kube-rbac-proxy-web" Jul 16 11:11:30.781505 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.781504 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c558c10-6f51-4994-864d-0eb8463caa59" containerName="kube-rbac-proxy-web" Jul 16 11:11:30.781707 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.781510 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c558c10-6f51-4994-864d-0eb8463caa59" containerName="config-reloader" Jul 16 11:11:30.781707 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.781515 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c558c10-6f51-4994-864d-0eb8463caa59" containerName="config-reloader" Jul 16 11:11:30.781707 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.781522 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c558c10-6f51-4994-864d-0eb8463caa59" containerName="init-config-reloader" Jul 16 11:11:30.781707 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.781527 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c558c10-6f51-4994-864d-0eb8463caa59" containerName="init-config-reloader" Jul 16 11:11:30.781707 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.781535 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c558c10-6f51-4994-864d-0eb8463caa59" containerName="thanos-sidecar" Jul 16 11:11:30.781707 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.781540 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c558c10-6f51-4994-864d-0eb8463caa59" containerName="thanos-sidecar" Jul 16 11:11:30.781707 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.781549 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c558c10-6f51-4994-864d-0eb8463caa59" containerName="prometheus" Jul 16 11:11:30.781707 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.781554 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c558c10-6f51-4994-864d-0eb8463caa59" containerName="prometheus" Jul 16 11:11:30.781707 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.781560 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="017eface-a126-4eec-961d-b076e61b5f45" containerName="registry" Jul 16 11:11:30.781707 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.781565 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="017eface-a126-4eec-961d-b076e61b5f45" containerName="registry" Jul 16 11:11:30.781707 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.781600 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="017eface-a126-4eec-961d-b076e61b5f45" containerName="registry" Jul 16 11:11:30.781707 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.781606 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c558c10-6f51-4994-864d-0eb8463caa59" containerName="prometheus" Jul 16 11:11:30.781707 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.781612 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c558c10-6f51-4994-864d-0eb8463caa59" containerName="kube-rbac-proxy-web" Jul 16 11:11:30.781707 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.781618 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c558c10-6f51-4994-864d-0eb8463caa59" containerName="kube-rbac-proxy-thanos" Jul 16 11:11:30.781707 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.781624 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c558c10-6f51-4994-864d-0eb8463caa59" containerName="config-reloader" Jul 16 11:11:30.781707 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.781642 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c558c10-6f51-4994-864d-0eb8463caa59" containerName="thanos-sidecar" Jul 16 11:11:30.781707 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.781649 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c558c10-6f51-4994-864d-0eb8463caa59" containerName="kube-rbac-proxy" Jul 16 11:11:30.781707 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.781658 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="570d9191-67a9-402a-a54d-1930e0ed50c6" containerName="console" Jul 16 11:11:30.786540 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.786525 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:30.788839 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.788821 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 16 11:11:30.788940 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.788890 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 16 11:11:30.789116 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.789085 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 16 11:11:30.789215 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.789122 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 16 11:11:30.789215 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.789170 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-f6opnlb4q243h\"" Jul 16 11:11:30.789386 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.789246 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 16 11:11:30.789386 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.789331 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-259v7\"" Jul 16 11:11:30.789503 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.789441 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 16 11:11:30.790156 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.789984 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 16 11:11:30.790278 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.790240 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 16 11:11:30.790362 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.790290 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 16 11:11:30.791660 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.790488 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 16 11:11:30.791660 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.790581 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 16 11:11:30.791660 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.790921 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 16 11:11:30.791841 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.791679 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 16 11:11:30.797039 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.797017 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 16 11:11:30.797591 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.797575 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 16 11:11:30.803479 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.803457 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 11:11:30.934945 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.934924 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e16ebac5-e534-4ac8-9a2b-13f8657464c5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:30.935029 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.934949 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e16ebac5-e534-4ac8-9a2b-13f8657464c5-config\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:30.935029 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.934964 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e16ebac5-e534-4ac8-9a2b-13f8657464c5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:30.935029 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.934980 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e16ebac5-e534-4ac8-9a2b-13f8657464c5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:30.935029 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.935003 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e16ebac5-e534-4ac8-9a2b-13f8657464c5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:30.935167 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.935038 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e16ebac5-e534-4ac8-9a2b-13f8657464c5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:30.935167 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.935064 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qr7f\" (UniqueName: \"kubernetes.io/projected/e16ebac5-e534-4ac8-9a2b-13f8657464c5-kube-api-access-9qr7f\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:30.935167 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.935102 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e16ebac5-e534-4ac8-9a2b-13f8657464c5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:30.935167 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.935128 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e16ebac5-e534-4ac8-9a2b-13f8657464c5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:30.935167 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.935145 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e16ebac5-e534-4ac8-9a2b-13f8657464c5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:30.935320 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.935171 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e16ebac5-e534-4ac8-9a2b-13f8657464c5-config-out\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:30.935320 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.935202 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e16ebac5-e534-4ac8-9a2b-13f8657464c5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:30.935320 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.935221 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e16ebac5-e534-4ac8-9a2b-13f8657464c5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:30.935320 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.935237 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e16ebac5-e534-4ac8-9a2b-13f8657464c5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:30.935320 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.935254 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e16ebac5-e534-4ac8-9a2b-13f8657464c5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:30.935320 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.935272 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e16ebac5-e534-4ac8-9a2b-13f8657464c5-web-config\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:30.935320 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.935289 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e16ebac5-e534-4ac8-9a2b-13f8657464c5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:30.935320 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.935308 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e16ebac5-e534-4ac8-9a2b-13f8657464c5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:30.935553 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.935323 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e16ebac5-e534-4ac8-9a2b-13f8657464c5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:30.935553 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:30.935341 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e16ebac5-e534-4ac8-9a2b-13f8657464c5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.035569 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.035524 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e16ebac5-e534-4ac8-9a2b-13f8657464c5-web-config\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.035569 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.035549 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e16ebac5-e534-4ac8-9a2b-13f8657464c5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.035569 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.035564 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e16ebac5-e534-4ac8-9a2b-13f8657464c5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.035731 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.035581 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e16ebac5-e534-4ac8-9a2b-13f8657464c5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.035731 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.035606 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e16ebac5-e534-4ac8-9a2b-13f8657464c5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.035826 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.035809 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e16ebac5-e534-4ac8-9a2b-13f8657464c5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.035883 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.035847 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e16ebac5-e534-4ac8-9a2b-13f8657464c5-config\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.035939 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.035893 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e16ebac5-e534-4ac8-9a2b-13f8657464c5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.035939 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.035920 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e16ebac5-e534-4ac8-9a2b-13f8657464c5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.036041 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.035963 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e16ebac5-e534-4ac8-9a2b-13f8657464c5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.036041 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.035989 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e16ebac5-e534-4ac8-9a2b-13f8657464c5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.036041 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.036014 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qr7f\" (UniqueName: \"kubernetes.io/projected/e16ebac5-e534-4ac8-9a2b-13f8657464c5-kube-api-access-9qr7f\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.036184 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.036044 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e16ebac5-e534-4ac8-9a2b-13f8657464c5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.036184 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.036070 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e16ebac5-e534-4ac8-9a2b-13f8657464c5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.036184 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.036094 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e16ebac5-e534-4ac8-9a2b-13f8657464c5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.036184 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.036118 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e16ebac5-e534-4ac8-9a2b-13f8657464c5-config-out\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.036184 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.036163 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e16ebac5-e534-4ac8-9a2b-13f8657464c5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.036405 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.036192 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e16ebac5-e534-4ac8-9a2b-13f8657464c5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.036405 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.036218 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e16ebac5-e534-4ac8-9a2b-13f8657464c5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.036405 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.036254 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e16ebac5-e534-4ac8-9a2b-13f8657464c5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.036405 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.036379 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e16ebac5-e534-4ac8-9a2b-13f8657464c5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.036598 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.036427 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e16ebac5-e534-4ac8-9a2b-13f8657464c5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.036598 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.036450 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e16ebac5-e534-4ac8-9a2b-13f8657464c5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.036916 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.036898 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e16ebac5-e534-4ac8-9a2b-13f8657464c5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.038154 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.038130 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e16ebac5-e534-4ac8-9a2b-13f8657464c5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.038750 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.038496 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e16ebac5-e534-4ac8-9a2b-13f8657464c5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.038750 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.038627 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e16ebac5-e534-4ac8-9a2b-13f8657464c5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.039154 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.038904 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e16ebac5-e534-4ac8-9a2b-13f8657464c5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.039154 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.038913 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e16ebac5-e534-4ac8-9a2b-13f8657464c5-web-config\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.039154 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.039018 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e16ebac5-e534-4ac8-9a2b-13f8657464c5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.039361 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.039341 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e16ebac5-e534-4ac8-9a2b-13f8657464c5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.039572 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.039551 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e16ebac5-e534-4ac8-9a2b-13f8657464c5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.039785 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.039759 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e16ebac5-e534-4ac8-9a2b-13f8657464c5-config-out\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.040083 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.040060 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e16ebac5-e534-4ac8-9a2b-13f8657464c5-config\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.040792 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.040739 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e16ebac5-e534-4ac8-9a2b-13f8657464c5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.041092 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.041074 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e16ebac5-e534-4ac8-9a2b-13f8657464c5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.041179 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.041159 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e16ebac5-e534-4ac8-9a2b-13f8657464c5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.041295 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.041279 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e16ebac5-e534-4ac8-9a2b-13f8657464c5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.041741 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.041716 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e16ebac5-e534-4ac8-9a2b-13f8657464c5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.046039 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.046010 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qr7f\" (UniqueName: \"kubernetes.io/projected/e16ebac5-e534-4ac8-9a2b-13f8657464c5-kube-api-access-9qr7f\") pod \"prometheus-k8s-0\" (UID: \"e16ebac5-e534-4ac8-9a2b-13f8657464c5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.099941 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.099926 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:11:31.234032 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.234003 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 11:11:31.237186 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:11:31.237159 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode16ebac5_e534_4ac8_9a2b_13f8657464c5.slice/crio-ca9af755d446b8a849e8670d7fc27c711e88108c2a0daaf86a8463aa3b914d70 WatchSource:0}: Error finding container ca9af755d446b8a849e8670d7fc27c711e88108c2a0daaf86a8463aa3b914d70: Status 404 returned error can't find the container with id ca9af755d446b8a849e8670d7fc27c711e88108c2a0daaf86a8463aa3b914d70 Jul 16 11:11:31.431883 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.431851 2559 generic.go:356] "Generic (PLEG): container finished" podID="e16ebac5-e534-4ac8-9a2b-13f8657464c5" containerID="4f76a470d0c41324904b87a8dc6a83fdced358c32cc440285cab9d75851f9caa" exitCode=0 Jul 16 11:11:31.431974 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.431894 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e16ebac5-e534-4ac8-9a2b-13f8657464c5","Type":"ContainerDied","Data":"4f76a470d0c41324904b87a8dc6a83fdced358c32cc440285cab9d75851f9caa"} Jul 16 11:11:31.431974 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:31.431946 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e16ebac5-e534-4ac8-9a2b-13f8657464c5","Type":"ContainerStarted","Data":"ca9af755d446b8a849e8670d7fc27c711e88108c2a0daaf86a8463aa3b914d70"} Jul 16 11:11:32.438125 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:32.438096 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e16ebac5-e534-4ac8-9a2b-13f8657464c5","Type":"ContainerStarted","Data":"f0e3ad3cdf4ab3fee094ec5453e62125ecd210ca41c061d0c40b7b4f766abb30"} Jul 16 11:11:32.438393 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:32.438157 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e16ebac5-e534-4ac8-9a2b-13f8657464c5","Type":"ContainerStarted","Data":"846964f2e71f9c3f9f2545b9525e4c3dd4817171d4a420bb626d361d4246ae78"} Jul 16 11:11:32.438393 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:32.438181 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e16ebac5-e534-4ac8-9a2b-13f8657464c5","Type":"ContainerStarted","Data":"862a0413053334cf6f85b848b10a128839a058498a4961dda63cba30f9af43c3"} Jul 16 11:11:32.438393 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:32.438205 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e16ebac5-e534-4ac8-9a2b-13f8657464c5","Type":"ContainerStarted","Data":"dab27a3e0aab16fec4e8b7af08d393b690ac9510aae927bfcf6bc76f7edb2670"} Jul 16 11:11:32.438393 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:32.438228 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e16ebac5-e534-4ac8-9a2b-13f8657464c5","Type":"ContainerStarted","Data":"2a75723f77b719c74a645a3e6c81e09bcf896f1e88eddfcb60a64468e224ae1d"} Jul 16 11:11:32.438393 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:32.438253 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e16ebac5-e534-4ac8-9a2b-13f8657464c5","Type":"ContainerStarted","Data":"4bdbe5d0ff2626b569a0c70b90d66668e24048eeff724e19594124a35eacf650"} Jul 16 11:11:32.479006 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:32.475255 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.458495375 podStartE2EDuration="2.475234293s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.738918ms" isStatefulPod=false podCreationTimestamp="2026-07-16 11:11:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:11:32.472808843 +0000 UTC m=+200.225066646" watchObservedRunningTime="2026-07-16 11:11:32.475234293 +0000 UTC m=+200.227492088" Jul 16 11:11:32.649324 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:32.649293 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c558c10-6f51-4994-864d-0eb8463caa59" path="/var/lib/kubelet/pods/1c558c10-6f51-4994-864d-0eb8463caa59/volumes" Jul 16 11:11:36.100449 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:11:36.100423 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:12:31.100740 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:12:31.100706 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:12:31.116080 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:12:31.116058 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:12:31.659942 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:12:31.659913 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 11:13:12.571597 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:12.571569 2559 kubelet.go:1648] "Image garbage collection succeeded" Jul 16 11:13:25.028524 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:25.028486 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-m756t"] Jul 16 11:13:25.032138 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:25.032118 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-m756t" Jul 16 11:13:25.035240 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:25.035217 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 16 11:13:25.044865 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:25.044840 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 16 11:13:25.044963 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:25.044840 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-ppmvz\"" Jul 16 11:13:25.061073 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:25.061049 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-m756t"] Jul 16 11:13:25.154431 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:25.154404 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc57h\" (UniqueName: \"kubernetes.io/projected/a8a1e66f-6959-4589-988d-49c2431a32ff-kube-api-access-hc57h\") pod \"cert-manager-webhook-6486ffd997-m756t\" (UID: \"a8a1e66f-6959-4589-988d-49c2431a32ff\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m756t" Jul 16 11:13:25.154532 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:25.154434 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a8a1e66f-6959-4589-988d-49c2431a32ff-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-m756t\" (UID: \"a8a1e66f-6959-4589-988d-49c2431a32ff\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m756t" Jul 16 11:13:25.254815 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:25.254793 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc57h\" (UniqueName: \"kubernetes.io/projected/a8a1e66f-6959-4589-988d-49c2431a32ff-kube-api-access-hc57h\") pod \"cert-manager-webhook-6486ffd997-m756t\" (UID: \"a8a1e66f-6959-4589-988d-49c2431a32ff\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m756t" Jul 16 11:13:25.254918 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:25.254822 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a8a1e66f-6959-4589-988d-49c2431a32ff-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-m756t\" (UID: \"a8a1e66f-6959-4589-988d-49c2431a32ff\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m756t" Jul 16 11:13:25.290850 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:25.290785 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc57h\" (UniqueName: \"kubernetes.io/projected/a8a1e66f-6959-4589-988d-49c2431a32ff-kube-api-access-hc57h\") pod \"cert-manager-webhook-6486ffd997-m756t\" (UID: \"a8a1e66f-6959-4589-988d-49c2431a32ff\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m756t" Jul 16 11:13:25.311339 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:25.311317 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a8a1e66f-6959-4589-988d-49c2431a32ff-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-m756t\" (UID: \"a8a1e66f-6959-4589-988d-49c2431a32ff\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m756t" Jul 16 11:13:25.350263 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:25.350237 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-m756t" Jul 16 11:13:25.490045 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:25.490014 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-m756t"] Jul 16 11:13:25.497582 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:25.497562 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 11:13:25.840079 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:25.840048 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-m756t" event={"ID":"a8a1e66f-6959-4589-988d-49c2431a32ff","Type":"ContainerStarted","Data":"f2cac834504879f00ef13cec936559225b6d3ecf26862a9d38747a64a6423cd6"} Jul 16 11:13:28.853618 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:28.853577 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-m756t" event={"ID":"a8a1e66f-6959-4589-988d-49c2431a32ff","Type":"ContainerStarted","Data":"ac133cfac8191e660a3709d82e0ab2b9808c83bc6b811d633398ee72347762f0"} Jul 16 11:13:28.854017 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:28.853728 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-m756t" Jul 16 11:13:28.880860 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:28.880813 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-m756t" podStartSLOduration=2.161294169 podStartE2EDuration="4.880799235s" totalImagesPullingTime="2.719505066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:13:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:13:28.880238358 +0000 UTC m=+316.632496154" watchObservedRunningTime="2026-07-16 11:13:28.880799235 +0000 UTC m=+316.633057030" Jul 16 11:13:34.452955 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:34.452922 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-45lj5"] Jul 16 11:13:34.456052 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:34.456035 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-45lj5" Jul 16 11:13:34.461187 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:34.461156 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-dgph9\"" Jul 16 11:13:34.479919 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:34.479892 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-45lj5"] Jul 16 11:13:34.527399 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:34.527368 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98d9r\" (UniqueName: \"kubernetes.io/projected/657cb82b-cfb4-4926-afed-46950564fe80-kube-api-access-98d9r\") pod \"cert-manager-55b4d954d5-45lj5\" (UID: \"657cb82b-cfb4-4926-afed-46950564fe80\") " pod="cert-manager/cert-manager-55b4d954d5-45lj5" Jul 16 11:13:34.527399 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:34.527402 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/657cb82b-cfb4-4926-afed-46950564fe80-bound-sa-token\") pod \"cert-manager-55b4d954d5-45lj5\" (UID: \"657cb82b-cfb4-4926-afed-46950564fe80\") " pod="cert-manager/cert-manager-55b4d954d5-45lj5" Jul 16 11:13:34.628078 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:34.628035 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98d9r\" (UniqueName: \"kubernetes.io/projected/657cb82b-cfb4-4926-afed-46950564fe80-kube-api-access-98d9r\") pod \"cert-manager-55b4d954d5-45lj5\" (UID: \"657cb82b-cfb4-4926-afed-46950564fe80\") " pod="cert-manager/cert-manager-55b4d954d5-45lj5" Jul 16 11:13:34.628078 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:34.628076 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/657cb82b-cfb4-4926-afed-46950564fe80-bound-sa-token\") pod \"cert-manager-55b4d954d5-45lj5\" (UID: \"657cb82b-cfb4-4926-afed-46950564fe80\") " pod="cert-manager/cert-manager-55b4d954d5-45lj5" Jul 16 11:13:34.645586 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:34.645546 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/657cb82b-cfb4-4926-afed-46950564fe80-bound-sa-token\") pod \"cert-manager-55b4d954d5-45lj5\" (UID: \"657cb82b-cfb4-4926-afed-46950564fe80\") " pod="cert-manager/cert-manager-55b4d954d5-45lj5" Jul 16 11:13:34.646381 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:34.646359 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98d9r\" (UniqueName: \"kubernetes.io/projected/657cb82b-cfb4-4926-afed-46950564fe80-kube-api-access-98d9r\") pod \"cert-manager-55b4d954d5-45lj5\" (UID: \"657cb82b-cfb4-4926-afed-46950564fe80\") " pod="cert-manager/cert-manager-55b4d954d5-45lj5" Jul 16 11:13:34.765195 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:34.765098 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-45lj5" Jul 16 11:13:34.859617 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:34.859591 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-m756t" Jul 16 11:13:34.922378 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:34.922350 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-45lj5"] Jul 16 11:13:34.925819 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:13:34.925788 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod657cb82b_cfb4_4926_afed_46950564fe80.slice/crio-98349270a0455d83f8b60d8f537692d33ba2e9fe54b3d1d70e298fe9c4047cea WatchSource:0}: Error finding container 98349270a0455d83f8b60d8f537692d33ba2e9fe54b3d1d70e298fe9c4047cea: Status 404 returned error can't find the container with id 98349270a0455d83f8b60d8f537692d33ba2e9fe54b3d1d70e298fe9c4047cea Jul 16 11:13:35.880316 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:35.880286 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-45lj5" event={"ID":"657cb82b-cfb4-4926-afed-46950564fe80","Type":"ContainerStarted","Data":"b214008f43f4dca22c39e320694f17abb3d49525fe77c8fb05b28614784bcc81"} Jul 16 11:13:35.880708 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:35.880325 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-45lj5" event={"ID":"657cb82b-cfb4-4926-afed-46950564fe80","Type":"ContainerStarted","Data":"98349270a0455d83f8b60d8f537692d33ba2e9fe54b3d1d70e298fe9c4047cea"} Jul 16 11:13:35.907600 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:35.907553 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-45lj5" podStartSLOduration=1.907537576 podStartE2EDuration="1.907537576s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:13:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:13:35.906287635 +0000 UTC m=+323.658545431" watchObservedRunningTime="2026-07-16 11:13:35.907537576 +0000 UTC m=+323.659795370" Jul 16 11:13:36.501239 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:36.501205 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zx279"] Jul 16 11:13:36.504286 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:36.504268 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zx279" Jul 16 11:13:36.507087 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:36.507056 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-tcl2m\"" Jul 16 11:13:36.507220 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:36.507102 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 16 11:13:36.507338 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:36.507323 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 16 11:13:36.516385 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:36.516351 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zx279"] Jul 16 11:13:36.545877 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:36.545844 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7202727-cb78-4f51-9e98-9be126c2af88-tmp\") pod \"openshift-lws-operator-fd8ccff4c-zx279\" (UID: \"d7202727-cb78-4f51-9e98-9be126c2af88\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zx279" Jul 16 11:13:36.546046 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:36.545883 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt24j\" (UniqueName: \"kubernetes.io/projected/d7202727-cb78-4f51-9e98-9be126c2af88-kube-api-access-qt24j\") pod \"openshift-lws-operator-fd8ccff4c-zx279\" (UID: \"d7202727-cb78-4f51-9e98-9be126c2af88\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zx279" Jul 16 11:13:36.646985 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:36.646953 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7202727-cb78-4f51-9e98-9be126c2af88-tmp\") pod \"openshift-lws-operator-fd8ccff4c-zx279\" (UID: \"d7202727-cb78-4f51-9e98-9be126c2af88\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zx279" Jul 16 11:13:36.647163 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:36.647002 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt24j\" (UniqueName: \"kubernetes.io/projected/d7202727-cb78-4f51-9e98-9be126c2af88-kube-api-access-qt24j\") pod \"openshift-lws-operator-fd8ccff4c-zx279\" (UID: \"d7202727-cb78-4f51-9e98-9be126c2af88\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zx279" Jul 16 11:13:36.647350 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:36.647329 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7202727-cb78-4f51-9e98-9be126c2af88-tmp\") pod \"openshift-lws-operator-fd8ccff4c-zx279\" (UID: \"d7202727-cb78-4f51-9e98-9be126c2af88\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zx279" Jul 16 11:13:36.656481 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:36.656445 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt24j\" (UniqueName: \"kubernetes.io/projected/d7202727-cb78-4f51-9e98-9be126c2af88-kube-api-access-qt24j\") pod \"openshift-lws-operator-fd8ccff4c-zx279\" (UID: \"d7202727-cb78-4f51-9e98-9be126c2af88\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zx279" Jul 16 11:13:36.813829 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:36.813751 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zx279" Jul 16 11:13:36.940754 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:36.940723 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zx279"] Jul 16 11:13:36.944009 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:13:36.943983 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7202727_cb78_4f51_9e98_9be126c2af88.slice/crio-d2a2e202e8c5ea75de69692a42a8f95f6bc81550ff5a272af710c5c730aefb92 WatchSource:0}: Error finding container d2a2e202e8c5ea75de69692a42a8f95f6bc81550ff5a272af710c5c730aefb92: Status 404 returned error can't find the container with id d2a2e202e8c5ea75de69692a42a8f95f6bc81550ff5a272af710c5c730aefb92 Jul 16 11:13:37.890706 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:37.890656 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zx279" event={"ID":"d7202727-cb78-4f51-9e98-9be126c2af88","Type":"ContainerStarted","Data":"d2a2e202e8c5ea75de69692a42a8f95f6bc81550ff5a272af710c5c730aefb92"} Jul 16 11:13:39.899421 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:39.899341 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zx279" event={"ID":"d7202727-cb78-4f51-9e98-9be126c2af88","Type":"ContainerStarted","Data":"e958fd4e0747e66cc1482e5d52e0253fb869b8de6551d86f77ff77c911072b81"} Jul 16 11:13:39.917897 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:39.917845 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zx279" podStartSLOduration=1.410716371 podStartE2EDuration="3.917830456s" totalImagesPullingTime="2.507114085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:13:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:13:39.916596796 +0000 UTC m=+327.668854590" watchObservedRunningTime="2026-07-16 11:13:39.917830456 +0000 UTC m=+327.670088251" Jul 16 11:13:55.374915 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:55.374873 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-54dfr"] Jul 16 11:13:55.380785 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:55.380762 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-54dfr" Jul 16 11:13:55.386900 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:55.386878 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 16 11:13:55.390287 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:55.390267 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8lh67\"" Jul 16 11:13:55.390410 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:55.390393 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 16 11:13:55.391160 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:55.391145 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 16 11:13:55.395292 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:55.395272 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 16 11:13:55.406158 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:55.406131 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-54dfr"] Jul 16 11:13:55.492222 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:55.492195 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/071be624-74d3-4610-8b93-fb830912b5f9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f8c4d5c89-54dfr\" (UID: \"071be624-74d3-4610-8b93-fb830912b5f9\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-54dfr" Jul 16 11:13:55.492337 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:55.492239 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/071be624-74d3-4610-8b93-fb830912b5f9-tmp\") pod \"opendatahub-operator-controller-manager-5f8c4d5c89-54dfr\" (UID: \"071be624-74d3-4610-8b93-fb830912b5f9\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-54dfr" Jul 16 11:13:55.492337 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:55.492267 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/071be624-74d3-4610-8b93-fb830912b5f9-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f8c4d5c89-54dfr\" (UID: \"071be624-74d3-4610-8b93-fb830912b5f9\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-54dfr" Jul 16 11:13:55.492337 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:55.492310 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd4wl\" (UniqueName: \"kubernetes.io/projected/071be624-74d3-4610-8b93-fb830912b5f9-kube-api-access-pd4wl\") pod \"opendatahub-operator-controller-manager-5f8c4d5c89-54dfr\" (UID: \"071be624-74d3-4610-8b93-fb830912b5f9\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-54dfr" Jul 16 11:13:55.492455 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:55.492351 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/071be624-74d3-4610-8b93-fb830912b5f9-manifests\") pod \"opendatahub-operator-controller-manager-5f8c4d5c89-54dfr\" (UID: \"071be624-74d3-4610-8b93-fb830912b5f9\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-54dfr" Jul 16 11:13:55.592777 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:55.592754 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/071be624-74d3-4610-8b93-fb830912b5f9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f8c4d5c89-54dfr\" (UID: \"071be624-74d3-4610-8b93-fb830912b5f9\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-54dfr" Jul 16 11:13:55.592895 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:55.592796 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/071be624-74d3-4610-8b93-fb830912b5f9-tmp\") pod \"opendatahub-operator-controller-manager-5f8c4d5c89-54dfr\" (UID: \"071be624-74d3-4610-8b93-fb830912b5f9\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-54dfr" Jul 16 11:13:55.592895 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:55.592825 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/071be624-74d3-4610-8b93-fb830912b5f9-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f8c4d5c89-54dfr\" (UID: \"071be624-74d3-4610-8b93-fb830912b5f9\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-54dfr" Jul 16 11:13:55.592895 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:55.592849 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd4wl\" (UniqueName: \"kubernetes.io/projected/071be624-74d3-4610-8b93-fb830912b5f9-kube-api-access-pd4wl\") pod \"opendatahub-operator-controller-manager-5f8c4d5c89-54dfr\" (UID: \"071be624-74d3-4610-8b93-fb830912b5f9\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-54dfr" Jul 16 11:13:55.592895 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:55.592888 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/071be624-74d3-4610-8b93-fb830912b5f9-manifests\") pod \"opendatahub-operator-controller-manager-5f8c4d5c89-54dfr\" (UID: \"071be624-74d3-4610-8b93-fb830912b5f9\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-54dfr" Jul 16 11:13:55.593339 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:55.593310 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/071be624-74d3-4610-8b93-fb830912b5f9-manifests\") pod \"opendatahub-operator-controller-manager-5f8c4d5c89-54dfr\" (UID: \"071be624-74d3-4610-8b93-fb830912b5f9\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-54dfr" Jul 16 11:13:55.594972 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:55.594950 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/071be624-74d3-4610-8b93-fb830912b5f9-tmp\") pod \"opendatahub-operator-controller-manager-5f8c4d5c89-54dfr\" (UID: \"071be624-74d3-4610-8b93-fb830912b5f9\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-54dfr" Jul 16 11:13:55.595207 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:55.595190 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/071be624-74d3-4610-8b93-fb830912b5f9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f8c4d5c89-54dfr\" (UID: \"071be624-74d3-4610-8b93-fb830912b5f9\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-54dfr" Jul 16 11:13:55.595335 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:55.595314 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/071be624-74d3-4610-8b93-fb830912b5f9-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f8c4d5c89-54dfr\" (UID: \"071be624-74d3-4610-8b93-fb830912b5f9\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-54dfr" Jul 16 11:13:55.603729 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:55.603710 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd4wl\" (UniqueName: \"kubernetes.io/projected/071be624-74d3-4610-8b93-fb830912b5f9-kube-api-access-pd4wl\") pod \"opendatahub-operator-controller-manager-5f8c4d5c89-54dfr\" (UID: \"071be624-74d3-4610-8b93-fb830912b5f9\") " pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-54dfr" Jul 16 11:13:55.691242 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:55.691222 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-54dfr" Jul 16 11:13:55.826117 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:55.826089 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-54dfr"] Jul 16 11:13:55.830120 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:13:55.830095 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod071be624_74d3_4610_8b93_fb830912b5f9.slice/crio-4bc66b0b4614eaf9f97c0f734a3cf1c55a500fa27ca29f32eb2e4e0408fbc3f9 WatchSource:0}: Error finding container 4bc66b0b4614eaf9f97c0f734a3cf1c55a500fa27ca29f32eb2e4e0408fbc3f9: Status 404 returned error can't find the container with id 4bc66b0b4614eaf9f97c0f734a3cf1c55a500fa27ca29f32eb2e4e0408fbc3f9 Jul 16 11:13:55.961034 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:55.960974 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-54dfr" event={"ID":"071be624-74d3-4610-8b93-fb830912b5f9","Type":"ContainerStarted","Data":"4bc66b0b4614eaf9f97c0f734a3cf1c55a500fa27ca29f32eb2e4e0408fbc3f9"} Jul 16 11:13:59.979336 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:13:59.979303 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-54dfr" event={"ID":"071be624-74d3-4610-8b93-fb830912b5f9","Type":"ContainerStarted","Data":"cb27195cc853e1afeb1465e37f14f927345ab12c98567e1d77f5a068ce2f94bf"} Jul 16 11:14:00.984374 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:00.984339 2559 generic.go:356] "Generic (PLEG): container finished" podID="071be624-74d3-4610-8b93-fb830912b5f9" containerID="cb27195cc853e1afeb1465e37f14f927345ab12c98567e1d77f5a068ce2f94bf" exitCode=0 Jul 16 11:14:00.984807 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:00.984429 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-54dfr" event={"ID":"071be624-74d3-4610-8b93-fb830912b5f9","Type":"ContainerDied","Data":"cb27195cc853e1afeb1465e37f14f927345ab12c98567e1d77f5a068ce2f94bf"} Jul 16 11:14:01.990855 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:01.990820 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-54dfr" event={"ID":"071be624-74d3-4610-8b93-fb830912b5f9","Type":"ContainerStarted","Data":"e1b7e217d3ac6d11315ccb1f536440439338fcf3283471466a00b8826342d97e"} Jul 16 11:14:01.991228 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:01.990958 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-54dfr" Jul 16 11:14:02.022916 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:02.022874 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-54dfr" podStartSLOduration=2.35505719 podStartE2EDuration="7.022860359s" totalImagesPullingTime="3.614657534s" totalInitContainerRuntime="1.053145635s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:13:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:14:02.020581209 +0000 UTC m=+349.772839016" watchObservedRunningTime="2026-07-16 11:14:02.022860359 +0000 UTC m=+349.775118154" Jul 16 11:14:12.996923 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:12.996852 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5f8c4d5c89-54dfr" Jul 16 11:14:15.962257 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:15.962218 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-796df6bb6-cfr9r"] Jul 16 11:14:15.967069 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:15.967046 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-796df6bb6-cfr9r" Jul 16 11:14:15.976670 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:15.976648 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 16 11:14:15.977432 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:15.977416 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hxptp\"" Jul 16 11:14:15.977485 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:15.977464 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 16 11:14:15.978004 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:15.977990 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 16 11:14:16.033175 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:16.033154 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-796df6bb6-cfr9r"] Jul 16 11:14:16.052288 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:16.052269 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/786f95eb-a3d5-4d48-9531-ca6a0c45a68a-cert\") pod \"lws-controller-manager-796df6bb6-cfr9r\" (UID: \"786f95eb-a3d5-4d48-9531-ca6a0c45a68a\") " pod="openshift-lws-operator/lws-controller-manager-796df6bb6-cfr9r" Jul 16 11:14:16.052405 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:16.052302 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/786f95eb-a3d5-4d48-9531-ca6a0c45a68a-manager-config\") pod \"lws-controller-manager-796df6bb6-cfr9r\" (UID: \"786f95eb-a3d5-4d48-9531-ca6a0c45a68a\") " pod="openshift-lws-operator/lws-controller-manager-796df6bb6-cfr9r" Jul 16 11:14:16.052405 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:16.052338 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/786f95eb-a3d5-4d48-9531-ca6a0c45a68a-metrics-cert\") pod \"lws-controller-manager-796df6bb6-cfr9r\" (UID: \"786f95eb-a3d5-4d48-9531-ca6a0c45a68a\") " pod="openshift-lws-operator/lws-controller-manager-796df6bb6-cfr9r" Jul 16 11:14:16.052405 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:16.052357 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vs6z\" (UniqueName: \"kubernetes.io/projected/786f95eb-a3d5-4d48-9531-ca6a0c45a68a-kube-api-access-5vs6z\") pod \"lws-controller-manager-796df6bb6-cfr9r\" (UID: \"786f95eb-a3d5-4d48-9531-ca6a0c45a68a\") " pod="openshift-lws-operator/lws-controller-manager-796df6bb6-cfr9r" Jul 16 11:14:16.152857 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:16.152827 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/786f95eb-a3d5-4d48-9531-ca6a0c45a68a-manager-config\") pod \"lws-controller-manager-796df6bb6-cfr9r\" (UID: \"786f95eb-a3d5-4d48-9531-ca6a0c45a68a\") " pod="openshift-lws-operator/lws-controller-manager-796df6bb6-cfr9r" Jul 16 11:14:16.152983 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:16.152886 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/786f95eb-a3d5-4d48-9531-ca6a0c45a68a-metrics-cert\") pod \"lws-controller-manager-796df6bb6-cfr9r\" (UID: \"786f95eb-a3d5-4d48-9531-ca6a0c45a68a\") " pod="openshift-lws-operator/lws-controller-manager-796df6bb6-cfr9r" Jul 16 11:14:16.152983 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:16.152926 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vs6z\" (UniqueName: \"kubernetes.io/projected/786f95eb-a3d5-4d48-9531-ca6a0c45a68a-kube-api-access-5vs6z\") pod \"lws-controller-manager-796df6bb6-cfr9r\" (UID: \"786f95eb-a3d5-4d48-9531-ca6a0c45a68a\") " pod="openshift-lws-operator/lws-controller-manager-796df6bb6-cfr9r" Jul 16 11:14:16.152983 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:16.152979 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/786f95eb-a3d5-4d48-9531-ca6a0c45a68a-cert\") pod \"lws-controller-manager-796df6bb6-cfr9r\" (UID: \"786f95eb-a3d5-4d48-9531-ca6a0c45a68a\") " pod="openshift-lws-operator/lws-controller-manager-796df6bb6-cfr9r" Jul 16 11:14:16.153446 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:16.153426 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/786f95eb-a3d5-4d48-9531-ca6a0c45a68a-manager-config\") pod \"lws-controller-manager-796df6bb6-cfr9r\" (UID: \"786f95eb-a3d5-4d48-9531-ca6a0c45a68a\") " pod="openshift-lws-operator/lws-controller-manager-796df6bb6-cfr9r" Jul 16 11:14:16.155160 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:16.155138 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/786f95eb-a3d5-4d48-9531-ca6a0c45a68a-cert\") pod \"lws-controller-manager-796df6bb6-cfr9r\" (UID: \"786f95eb-a3d5-4d48-9531-ca6a0c45a68a\") " pod="openshift-lws-operator/lws-controller-manager-796df6bb6-cfr9r" Jul 16 11:14:16.155236 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:16.155142 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/786f95eb-a3d5-4d48-9531-ca6a0c45a68a-metrics-cert\") pod \"lws-controller-manager-796df6bb6-cfr9r\" (UID: \"786f95eb-a3d5-4d48-9531-ca6a0c45a68a\") " pod="openshift-lws-operator/lws-controller-manager-796df6bb6-cfr9r" Jul 16 11:14:16.183199 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:16.183174 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vs6z\" (UniqueName: \"kubernetes.io/projected/786f95eb-a3d5-4d48-9531-ca6a0c45a68a-kube-api-access-5vs6z\") pod \"lws-controller-manager-796df6bb6-cfr9r\" (UID: \"786f95eb-a3d5-4d48-9531-ca6a0c45a68a\") " pod="openshift-lws-operator/lws-controller-manager-796df6bb6-cfr9r" Jul 16 11:14:16.276306 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:16.276256 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-796df6bb6-cfr9r" Jul 16 11:14:16.443012 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:16.442984 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-796df6bb6-cfr9r"] Jul 16 11:14:16.445780 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:14:16.445753 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod786f95eb_a3d5_4d48_9531_ca6a0c45a68a.slice/crio-23257826fc76baecae27b9c1a8f8ca9304ac0feb1264e66011e97f8ffd3827e4 WatchSource:0}: Error finding container 23257826fc76baecae27b9c1a8f8ca9304ac0feb1264e66011e97f8ffd3827e4: Status 404 returned error can't find the container with id 23257826fc76baecae27b9c1a8f8ca9304ac0feb1264e66011e97f8ffd3827e4 Jul 16 11:14:17.055283 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:17.055243 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-796df6bb6-cfr9r" event={"ID":"786f95eb-a3d5-4d48-9531-ca6a0c45a68a","Type":"ContainerStarted","Data":"23257826fc76baecae27b9c1a8f8ca9304ac0feb1264e66011e97f8ffd3827e4"} Jul 16 11:14:19.067909 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:19.067871 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-796df6bb6-cfr9r" event={"ID":"786f95eb-a3d5-4d48-9531-ca6a0c45a68a","Type":"ContainerStarted","Data":"eaeae379d072d0b3f240219caa8762a3bf209598e424bd0ba51e91852580f908"} Jul 16 11:14:19.068290 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:19.067988 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-796df6bb6-cfr9r" Jul 16 11:14:19.116025 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:19.115981 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-796df6bb6-cfr9r" podStartSLOduration=2.441804147 podStartE2EDuration="4.115967697s" totalImagesPullingTime="1.67416355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:14:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:14:19.114626308 +0000 UTC m=+366.866884104" watchObservedRunningTime="2026-07-16 11:14:19.115967697 +0000 UTC m=+366.868225492" Jul 16 11:14:28.213956 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:28.213920 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qpncp"] Jul 16 11:14:28.217711 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:28.217689 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qpncp" Jul 16 11:14:28.224298 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:28.224267 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 16 11:14:28.224466 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:28.224311 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 16 11:14:28.224623 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:28.224592 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 16 11:14:28.224800 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:28.224673 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vgpnp\"" Jul 16 11:14:28.224800 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:28.224690 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 16 11:14:28.225270 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:28.225023 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 16 11:14:28.238841 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:28.238822 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 16 11:14:28.252253 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:28.252225 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qpncp"] Jul 16 11:14:28.344417 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:28.344391 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-852ml\" (UniqueName: \"kubernetes.io/projected/c5a2c2f9-070c-4036-ac74-7e71e9076187-kube-api-access-852ml\") pod \"istiod-openshift-gateway-94bb8fbfd-qpncp\" (UID: \"c5a2c2f9-070c-4036-ac74-7e71e9076187\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qpncp" Jul 16 11:14:28.344510 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:28.344433 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c5a2c2f9-070c-4036-ac74-7e71e9076187-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-qpncp\" (UID: \"c5a2c2f9-070c-4036-ac74-7e71e9076187\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qpncp" Jul 16 11:14:28.344510 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:28.344455 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c5a2c2f9-070c-4036-ac74-7e71e9076187-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-qpncp\" (UID: \"c5a2c2f9-070c-4036-ac74-7e71e9076187\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qpncp" Jul 16 11:14:28.344581 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:28.344529 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5a2c2f9-070c-4036-ac74-7e71e9076187-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-qpncp\" (UID: \"c5a2c2f9-070c-4036-ac74-7e71e9076187\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qpncp" Jul 16 11:14:28.344581 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:28.344560 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c5a2c2f9-070c-4036-ac74-7e71e9076187-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-qpncp\" (UID: \"c5a2c2f9-070c-4036-ac74-7e71e9076187\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qpncp" Jul 16 11:14:28.344668 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:28.344597 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5a2c2f9-070c-4036-ac74-7e71e9076187-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-qpncp\" (UID: \"c5a2c2f9-070c-4036-ac74-7e71e9076187\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qpncp" Jul 16 11:14:28.344668 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:28.344614 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c5a2c2f9-070c-4036-ac74-7e71e9076187-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-qpncp\" (UID: \"c5a2c2f9-070c-4036-ac74-7e71e9076187\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qpncp" Jul 16 11:14:28.445175 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:28.445149 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c5a2c2f9-070c-4036-ac74-7e71e9076187-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-qpncp\" (UID: \"c5a2c2f9-070c-4036-ac74-7e71e9076187\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qpncp" Jul 16 11:14:28.445270 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:28.445179 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c5a2c2f9-070c-4036-ac74-7e71e9076187-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-qpncp\" (UID: \"c5a2c2f9-070c-4036-ac74-7e71e9076187\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qpncp" Jul 16 11:14:28.445270 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:28.445209 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5a2c2f9-070c-4036-ac74-7e71e9076187-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-qpncp\" (UID: \"c5a2c2f9-070c-4036-ac74-7e71e9076187\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qpncp" Jul 16 11:14:28.445270 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:28.445228 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c5a2c2f9-070c-4036-ac74-7e71e9076187-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-qpncp\" (UID: \"c5a2c2f9-070c-4036-ac74-7e71e9076187\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qpncp" Jul 16 11:14:28.445270 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:28.445252 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5a2c2f9-070c-4036-ac74-7e71e9076187-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-qpncp\" (UID: \"c5a2c2f9-070c-4036-ac74-7e71e9076187\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qpncp" Jul 16 11:14:28.445455 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:28.445275 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c5a2c2f9-070c-4036-ac74-7e71e9076187-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-qpncp\" (UID: \"c5a2c2f9-070c-4036-ac74-7e71e9076187\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qpncp" Jul 16 11:14:28.445455 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:28.445320 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-852ml\" (UniqueName: \"kubernetes.io/projected/c5a2c2f9-070c-4036-ac74-7e71e9076187-kube-api-access-852ml\") pod \"istiod-openshift-gateway-94bb8fbfd-qpncp\" (UID: \"c5a2c2f9-070c-4036-ac74-7e71e9076187\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qpncp" Jul 16 11:14:28.446142 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:28.446112 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c5a2c2f9-070c-4036-ac74-7e71e9076187-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-qpncp\" (UID: \"c5a2c2f9-070c-4036-ac74-7e71e9076187\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qpncp" Jul 16 11:14:28.448055 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:28.448025 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c5a2c2f9-070c-4036-ac74-7e71e9076187-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-qpncp\" (UID: \"c5a2c2f9-070c-4036-ac74-7e71e9076187\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qpncp" Jul 16 11:14:28.448164 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:28.448059 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c5a2c2f9-070c-4036-ac74-7e71e9076187-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-qpncp\" (UID: \"c5a2c2f9-070c-4036-ac74-7e71e9076187\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qpncp" Jul 16 11:14:28.448164 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:28.448075 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5a2c2f9-070c-4036-ac74-7e71e9076187-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-qpncp\" (UID: \"c5a2c2f9-070c-4036-ac74-7e71e9076187\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qpncp" Jul 16 11:14:28.448164 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:28.448103 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c5a2c2f9-070c-4036-ac74-7e71e9076187-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-qpncp\" (UID: \"c5a2c2f9-070c-4036-ac74-7e71e9076187\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qpncp" Jul 16 11:14:28.459573 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:28.459547 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5a2c2f9-070c-4036-ac74-7e71e9076187-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-qpncp\" (UID: \"c5a2c2f9-070c-4036-ac74-7e71e9076187\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qpncp" Jul 16 11:14:28.468275 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:28.468215 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-852ml\" (UniqueName: \"kubernetes.io/projected/c5a2c2f9-070c-4036-ac74-7e71e9076187-kube-api-access-852ml\") pod \"istiod-openshift-gateway-94bb8fbfd-qpncp\" (UID: \"c5a2c2f9-070c-4036-ac74-7e71e9076187\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qpncp" Jul 16 11:14:28.528053 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:28.528029 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qpncp" Jul 16 11:14:28.715366 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:28.715336 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qpncp"] Jul 16 11:14:28.718403 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:14:28.718343 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5a2c2f9_070c_4036_ac74_7e71e9076187.slice/crio-a9cbed1e30fc9cbdb369a801f25abe06586ce1dfc4c97cf83f0b85369fd53faf WatchSource:0}: Error finding container a9cbed1e30fc9cbdb369a801f25abe06586ce1dfc4c97cf83f0b85369fd53faf: Status 404 returned error can't find the container with id a9cbed1e30fc9cbdb369a801f25abe06586ce1dfc4c97cf83f0b85369fd53faf Jul 16 11:14:29.119168 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:29.119101 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qpncp" event={"ID":"c5a2c2f9-070c-4036-ac74-7e71e9076187","Type":"ContainerStarted","Data":"a9cbed1e30fc9cbdb369a801f25abe06586ce1dfc4c97cf83f0b85369fd53faf"} Jul 16 11:14:30.075195 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:30.075150 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-796df6bb6-cfr9r" Jul 16 11:14:31.320039 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:31.320004 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 16 11:14:31.320285 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:31.320075 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 16 11:14:32.134171 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:32.134139 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qpncp" event={"ID":"c5a2c2f9-070c-4036-ac74-7e71e9076187","Type":"ContainerStarted","Data":"3a60b02a469266fc4e58a8d0a6876c5198f5df5427d388eac36fa672a11c3337"} Jul 16 11:14:32.134333 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:32.134313 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qpncp" Jul 16 11:14:32.135819 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:32.135793 2559 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-qpncp container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 16 11:14:32.135938 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:32.135838 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qpncp" podUID="c5a2c2f9-070c-4036-ac74-7e71e9076187" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 11:14:32.171296 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:32.171256 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qpncp" podStartSLOduration=1.5717522750000001 podStartE2EDuration="4.171242198s" totalImagesPullingTime="2.599489923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:14:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:14:32.169823948 +0000 UTC m=+379.922081743" watchObservedRunningTime="2026-07-16 11:14:32.171242198 +0000 UTC m=+379.923499994" Jul 16 11:14:33.139549 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:14:33.139517 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qpncp" Jul 16 11:16:11.395682 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:16:11.395647 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7h64c"] Jul 16 11:16:11.398868 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:16:11.398849 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7h64c" Jul 16 11:16:11.402357 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:16:11.402339 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-68fj7\"" Jul 16 11:16:11.402660 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:16:11.402626 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 16 11:16:11.403685 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:16:11.403662 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 16 11:16:11.415394 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:16:11.415372 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7h64c"] Jul 16 11:16:11.428999 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:16:11.428973 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qkxg\" (UniqueName: \"kubernetes.io/projected/b055b056-de53-44fe-8e61-117b20464c6c-kube-api-access-2qkxg\") pod \"kuadrant-operator-controller-manager-86878c769f-7h64c\" (UID: \"b055b056-de53-44fe-8e61-117b20464c6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7h64c" Jul 16 11:16:11.429123 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:16:11.429045 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b055b056-de53-44fe-8e61-117b20464c6c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7h64c\" (UID: \"b055b056-de53-44fe-8e61-117b20464c6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7h64c" Jul 16 11:16:11.530250 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:16:11.530216 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b055b056-de53-44fe-8e61-117b20464c6c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7h64c\" (UID: \"b055b056-de53-44fe-8e61-117b20464c6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7h64c" Jul 16 11:16:11.530429 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:16:11.530278 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qkxg\" (UniqueName: \"kubernetes.io/projected/b055b056-de53-44fe-8e61-117b20464c6c-kube-api-access-2qkxg\") pod \"kuadrant-operator-controller-manager-86878c769f-7h64c\" (UID: \"b055b056-de53-44fe-8e61-117b20464c6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7h64c" Jul 16 11:16:11.530585 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:16:11.530564 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b055b056-de53-44fe-8e61-117b20464c6c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7h64c\" (UID: \"b055b056-de53-44fe-8e61-117b20464c6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7h64c" Jul 16 11:16:11.542717 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:16:11.542692 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qkxg\" (UniqueName: \"kubernetes.io/projected/b055b056-de53-44fe-8e61-117b20464c6c-kube-api-access-2qkxg\") pod \"kuadrant-operator-controller-manager-86878c769f-7h64c\" (UID: \"b055b056-de53-44fe-8e61-117b20464c6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7h64c" Jul 16 11:16:11.709163 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:16:11.709130 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7h64c" Jul 16 11:16:11.842957 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:16:11.842824 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7h64c"] Jul 16 11:16:11.846200 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:16:11.846160 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb055b056_de53_44fe_8e61_117b20464c6c.slice/crio-463b50cc8c527dd34c9f9a2d6a7d8ae1eb2e33b1b4ab7146c88a3ad44c876ca7 WatchSource:0}: Error finding container 463b50cc8c527dd34c9f9a2d6a7d8ae1eb2e33b1b4ab7146c88a3ad44c876ca7: Status 404 returned error can't find the container with id 463b50cc8c527dd34c9f9a2d6a7d8ae1eb2e33b1b4ab7146c88a3ad44c876ca7 Jul 16 11:16:12.566387 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:16:12.566350 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7h64c" event={"ID":"b055b056-de53-44fe-8e61-117b20464c6c","Type":"ContainerStarted","Data":"463b50cc8c527dd34c9f9a2d6a7d8ae1eb2e33b1b4ab7146c88a3ad44c876ca7"} Jul 16 11:16:16.592935 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:16:16.592903 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7h64c" event={"ID":"b055b056-de53-44fe-8e61-117b20464c6c","Type":"ContainerStarted","Data":"36e91a347a35dc037f9002dd14a68fe59b3ca8e6585c51e4a2be66b532847782"} Jul 16 11:16:16.593291 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:16:16.593012 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7h64c" Jul 16 11:16:16.614627 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:16:16.614585 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7h64c" podStartSLOduration=0.984146278 podStartE2EDuration="5.614572468s" totalImagesPullingTime="4.63042619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:16:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:16:16.613149312 +0000 UTC m=+484.365407107" watchObservedRunningTime="2026-07-16 11:16:16.614572468 +0000 UTC m=+484.366830264" Jul 16 11:16:27.600061 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:16:27.600029 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7h64c" Jul 16 11:18:09.237404 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:09.237373 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-l6j22"] Jul 16 11:18:09.240616 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:09.240596 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-l6j22" Jul 16 11:18:09.242807 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:09.242778 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 16 11:18:09.242807 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:09.242799 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-qn2pc\"" Jul 16 11:18:09.248913 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:09.248893 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-l6j22"] Jul 16 11:18:09.282101 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:09.282073 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dmt9\" (UniqueName: \"kubernetes.io/projected/1f57fab0-b46f-44aa-85e2-c01cb56dc3a0-kube-api-access-4dmt9\") pod \"payload-pre-processing-74584bb9f8-l6j22\" (UID: \"1f57fab0-b46f-44aa-85e2-c01cb56dc3a0\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-l6j22" Jul 16 11:18:09.282229 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:09.282204 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f57fab0-b46f-44aa-85e2-c01cb56dc3a0-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-l6j22\" (UID: \"1f57fab0-b46f-44aa-85e2-c01cb56dc3a0\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-l6j22" Jul 16 11:18:09.383375 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:09.383347 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dmt9\" (UniqueName: \"kubernetes.io/projected/1f57fab0-b46f-44aa-85e2-c01cb56dc3a0-kube-api-access-4dmt9\") pod \"payload-pre-processing-74584bb9f8-l6j22\" (UID: \"1f57fab0-b46f-44aa-85e2-c01cb56dc3a0\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-l6j22" Jul 16 11:18:09.383492 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:09.383418 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f57fab0-b46f-44aa-85e2-c01cb56dc3a0-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-l6j22\" (UID: \"1f57fab0-b46f-44aa-85e2-c01cb56dc3a0\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-l6j22" Jul 16 11:18:09.384500 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:09.384478 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f57fab0-b46f-44aa-85e2-c01cb56dc3a0-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-l6j22\" (UID: \"1f57fab0-b46f-44aa-85e2-c01cb56dc3a0\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-l6j22" Jul 16 11:18:09.394944 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:09.394918 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dmt9\" (UniqueName: \"kubernetes.io/projected/1f57fab0-b46f-44aa-85e2-c01cb56dc3a0-kube-api-access-4dmt9\") pod \"payload-pre-processing-74584bb9f8-l6j22\" (UID: \"1f57fab0-b46f-44aa-85e2-c01cb56dc3a0\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-l6j22" Jul 16 11:18:09.551176 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:09.551111 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-l6j22" Jul 16 11:18:09.679033 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:09.678941 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-l6j22"] Jul 16 11:18:09.681695 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:18:09.681660 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f57fab0_b46f_44aa_85e2_c01cb56dc3a0.slice/crio-66ceac984a8ea0d06e22960971ae37a1afb95b9c5be1c7371c5314d6a8122253 WatchSource:0}: Error finding container 66ceac984a8ea0d06e22960971ae37a1afb95b9c5be1c7371c5314d6a8122253: Status 404 returned error can't find the container with id 66ceac984a8ea0d06e22960971ae37a1afb95b9c5be1c7371c5314d6a8122253 Jul 16 11:18:10.104442 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:10.104403 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-l6j22" event={"ID":"1f57fab0-b46f-44aa-85e2-c01cb56dc3a0","Type":"ContainerStarted","Data":"66ceac984a8ea0d06e22960971ae37a1afb95b9c5be1c7371c5314d6a8122253"} Jul 16 11:18:12.114786 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:12.114748 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-l6j22" event={"ID":"1f57fab0-b46f-44aa-85e2-c01cb56dc3a0","Type":"ContainerStarted","Data":"22621ae819adfa94bf200aa01a6e2011999d8d7e1b264f9bf4e3d6bc697f7509"} Jul 16 11:18:12.115304 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:12.114892 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-l6j22" Jul 16 11:18:12.130851 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:12.130809 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-l6j22" podStartSLOduration=1.3106944999999999 podStartE2EDuration="3.130791989s" totalImagesPullingTime="1.820097489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:18:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:18:12.129599789 +0000 UTC m=+599.881857600" watchObservedRunningTime="2026-07-16 11:18:12.130791989 +0000 UTC m=+599.883049786" Jul 16 11:18:23.122391 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:23.122364 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-l6j22" Jul 16 11:18:31.923400 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:31.923365 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg"] Jul 16 11:18:31.928774 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:31.928742 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg" Jul 16 11:18:31.932416 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:31.932393 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 16 11:18:31.932416 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:31.932405 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 16 11:18:31.933072 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:31.933059 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 16 11:18:31.933120 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:31.933059 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7wggx\"" Jul 16 11:18:31.941361 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:31.941339 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg"] Jul 16 11:18:32.046906 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:32.046880 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9105f231-a6a2-42d7-ac90-bdccb194c570-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg\" (UID: \"9105f231-a6a2-42d7-ac90-bdccb194c570\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg" Jul 16 11:18:32.047042 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:32.046913 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9105f231-a6a2-42d7-ac90-bdccb194c570-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg\" (UID: \"9105f231-a6a2-42d7-ac90-bdccb194c570\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg" Jul 16 11:18:32.047042 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:32.046935 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64jx7\" (UniqueName: \"kubernetes.io/projected/9105f231-a6a2-42d7-ac90-bdccb194c570-kube-api-access-64jx7\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg\" (UID: \"9105f231-a6a2-42d7-ac90-bdccb194c570\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg" Jul 16 11:18:32.047042 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:32.046955 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9105f231-a6a2-42d7-ac90-bdccb194c570-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg\" (UID: \"9105f231-a6a2-42d7-ac90-bdccb194c570\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg" Jul 16 11:18:32.047042 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:32.046977 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9105f231-a6a2-42d7-ac90-bdccb194c570-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg\" (UID: \"9105f231-a6a2-42d7-ac90-bdccb194c570\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg" Jul 16 11:18:32.047042 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:32.047022 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9105f231-a6a2-42d7-ac90-bdccb194c570-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg\" (UID: \"9105f231-a6a2-42d7-ac90-bdccb194c570\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg" Jul 16 11:18:32.147720 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:32.147697 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9105f231-a6a2-42d7-ac90-bdccb194c570-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg\" (UID: \"9105f231-a6a2-42d7-ac90-bdccb194c570\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg" Jul 16 11:18:32.147844 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:32.147748 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9105f231-a6a2-42d7-ac90-bdccb194c570-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg\" (UID: \"9105f231-a6a2-42d7-ac90-bdccb194c570\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg" Jul 16 11:18:32.147844 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:32.147779 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9105f231-a6a2-42d7-ac90-bdccb194c570-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg\" (UID: \"9105f231-a6a2-42d7-ac90-bdccb194c570\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg" Jul 16 11:18:32.147934 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:32.147884 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64jx7\" (UniqueName: \"kubernetes.io/projected/9105f231-a6a2-42d7-ac90-bdccb194c570-kube-api-access-64jx7\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg\" (UID: \"9105f231-a6a2-42d7-ac90-bdccb194c570\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg" Jul 16 11:18:32.147934 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:32.147916 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9105f231-a6a2-42d7-ac90-bdccb194c570-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg\" (UID: \"9105f231-a6a2-42d7-ac90-bdccb194c570\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg" Jul 16 11:18:32.148084 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:32.148059 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9105f231-a6a2-42d7-ac90-bdccb194c570-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg\" (UID: \"9105f231-a6a2-42d7-ac90-bdccb194c570\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg" Jul 16 11:18:32.148144 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:32.148128 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9105f231-a6a2-42d7-ac90-bdccb194c570-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg\" (UID: \"9105f231-a6a2-42d7-ac90-bdccb194c570\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg" Jul 16 11:18:32.148219 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:32.148202 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9105f231-a6a2-42d7-ac90-bdccb194c570-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg\" (UID: \"9105f231-a6a2-42d7-ac90-bdccb194c570\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg" Jul 16 11:18:32.148284 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:32.148268 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9105f231-a6a2-42d7-ac90-bdccb194c570-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg\" (UID: \"9105f231-a6a2-42d7-ac90-bdccb194c570\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg" Jul 16 11:18:32.150070 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:32.150043 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9105f231-a6a2-42d7-ac90-bdccb194c570-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg\" (UID: \"9105f231-a6a2-42d7-ac90-bdccb194c570\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg" Jul 16 11:18:32.150201 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:32.150182 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9105f231-a6a2-42d7-ac90-bdccb194c570-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg\" (UID: \"9105f231-a6a2-42d7-ac90-bdccb194c570\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg" Jul 16 11:18:32.156223 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:32.156198 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64jx7\" (UniqueName: \"kubernetes.io/projected/9105f231-a6a2-42d7-ac90-bdccb194c570-kube-api-access-64jx7\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg\" (UID: \"9105f231-a6a2-42d7-ac90-bdccb194c570\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg" Jul 16 11:18:32.239279 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:32.239214 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg" Jul 16 11:18:32.366645 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:32.366600 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg"] Jul 16 11:18:32.369929 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:18:32.369891 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9105f231_a6a2_42d7_ac90_bdccb194c570.slice/crio-524f9b8ff085f408244dbb2e281118680d3af09ccbd0f8062970cd2ec4a6e247 WatchSource:0}: Error finding container 524f9b8ff085f408244dbb2e281118680d3af09ccbd0f8062970cd2ec4a6e247: Status 404 returned error can't find the container with id 524f9b8ff085f408244dbb2e281118680d3af09ccbd0f8062970cd2ec4a6e247 Jul 16 11:18:32.371626 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:32.371605 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 11:18:33.206703 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:33.206666 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg" event={"ID":"9105f231-a6a2-42d7-ac90-bdccb194c570","Type":"ContainerStarted","Data":"524f9b8ff085f408244dbb2e281118680d3af09ccbd0f8062970cd2ec4a6e247"} Jul 16 11:18:34.212880 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:34.212847 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg" event={"ID":"9105f231-a6a2-42d7-ac90-bdccb194c570","Type":"ContainerStarted","Data":"5487821b546e1293750aa536cb7851141783a42ee56605fffe0b8057b8e25f1c"} Jul 16 11:18:34.231326 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:34.231259 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg" podStartSLOduration=2.086694842 podStartE2EDuration="3.231242638s" totalImagesPullingTime="1.144547796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:18:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:18:34.229893814 +0000 UTC m=+621.982151623" watchObservedRunningTime="2026-07-16 11:18:34.231242638 +0000 UTC m=+621.983500475" Jul 16 11:18:42.239870 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:42.239838 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg" Jul 16 11:18:42.240244 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:42.239883 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg" Jul 16 11:18:42.252349 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:42.252326 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg" Jul 16 11:18:42.263000 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:18:42.262975 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg" Jul 16 11:19:05.518012 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:19:05.517981 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-tvqcm"] Jul 16 11:19:05.521354 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:19:05.521334 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvqcm" Jul 16 11:19:05.523330 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:19:05.523312 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 16 11:19:05.531217 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:19:05.531198 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-tvqcm"] Jul 16 11:19:05.699607 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:19:05.699569 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b13d3ff-547c-4d5c-a820-c712badb2aea-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvqcm\" (UID: \"7b13d3ff-547c-4d5c-a820-c712badb2aea\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvqcm" Jul 16 11:19:05.699607 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:19:05.699612 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b13d3ff-547c-4d5c-a820-c712badb2aea-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvqcm\" (UID: \"7b13d3ff-547c-4d5c-a820-c712badb2aea\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvqcm" Jul 16 11:19:05.699833 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:19:05.699680 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b13d3ff-547c-4d5c-a820-c712badb2aea-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvqcm\" (UID: \"7b13d3ff-547c-4d5c-a820-c712badb2aea\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvqcm" Jul 16 11:19:05.699833 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:19:05.699715 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztcfd\" (UniqueName: \"kubernetes.io/projected/7b13d3ff-547c-4d5c-a820-c712badb2aea-kube-api-access-ztcfd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvqcm\" (UID: \"7b13d3ff-547c-4d5c-a820-c712badb2aea\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvqcm" Jul 16 11:19:05.699833 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:19:05.699739 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b13d3ff-547c-4d5c-a820-c712badb2aea-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvqcm\" (UID: \"7b13d3ff-547c-4d5c-a820-c712badb2aea\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvqcm" Jul 16 11:19:05.699833 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:19:05.699793 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b13d3ff-547c-4d5c-a820-c712badb2aea-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvqcm\" (UID: \"7b13d3ff-547c-4d5c-a820-c712badb2aea\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvqcm" Jul 16 11:19:05.800916 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:19:05.800839 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b13d3ff-547c-4d5c-a820-c712badb2aea-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvqcm\" (UID: \"7b13d3ff-547c-4d5c-a820-c712badb2aea\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvqcm" Jul 16 11:19:05.800916 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:19:05.800876 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b13d3ff-547c-4d5c-a820-c712badb2aea-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvqcm\" (UID: \"7b13d3ff-547c-4d5c-a820-c712badb2aea\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvqcm" Jul 16 11:19:05.800916 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:19:05.800898 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b13d3ff-547c-4d5c-a820-c712badb2aea-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvqcm\" (UID: \"7b13d3ff-547c-4d5c-a820-c712badb2aea\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvqcm" Jul 16 11:19:05.801166 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:19:05.800920 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztcfd\" (UniqueName: \"kubernetes.io/projected/7b13d3ff-547c-4d5c-a820-c712badb2aea-kube-api-access-ztcfd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvqcm\" (UID: \"7b13d3ff-547c-4d5c-a820-c712badb2aea\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvqcm" Jul 16 11:19:05.801166 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:19:05.800941 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b13d3ff-547c-4d5c-a820-c712badb2aea-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvqcm\" (UID: \"7b13d3ff-547c-4d5c-a820-c712badb2aea\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvqcm" Jul 16 11:19:05.801166 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:19:05.800987 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b13d3ff-547c-4d5c-a820-c712badb2aea-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvqcm\" (UID: \"7b13d3ff-547c-4d5c-a820-c712badb2aea\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvqcm" Jul 16 11:19:05.801319 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:19:05.801295 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b13d3ff-547c-4d5c-a820-c712badb2aea-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvqcm\" (UID: \"7b13d3ff-547c-4d5c-a820-c712badb2aea\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvqcm" Jul 16 11:19:05.801586 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:19:05.801563 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b13d3ff-547c-4d5c-a820-c712badb2aea-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvqcm\" (UID: \"7b13d3ff-547c-4d5c-a820-c712badb2aea\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvqcm" Jul 16 11:19:05.801707 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:19:05.801686 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b13d3ff-547c-4d5c-a820-c712badb2aea-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvqcm\" (UID: \"7b13d3ff-547c-4d5c-a820-c712badb2aea\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvqcm" Jul 16 11:19:05.803367 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:19:05.803339 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b13d3ff-547c-4d5c-a820-c712badb2aea-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvqcm\" (UID: \"7b13d3ff-547c-4d5c-a820-c712badb2aea\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvqcm" Jul 16 11:19:05.803573 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:19:05.803554 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b13d3ff-547c-4d5c-a820-c712badb2aea-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvqcm\" (UID: \"7b13d3ff-547c-4d5c-a820-c712badb2aea\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvqcm" Jul 16 11:19:05.808539 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:19:05.808517 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztcfd\" (UniqueName: \"kubernetes.io/projected/7b13d3ff-547c-4d5c-a820-c712badb2aea-kube-api-access-ztcfd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tvqcm\" (UID: \"7b13d3ff-547c-4d5c-a820-c712badb2aea\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvqcm" Jul 16 11:19:05.831366 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:19:05.831348 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvqcm" Jul 16 11:19:05.959420 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:19:05.959389 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-tvqcm"] Jul 16 11:19:05.963274 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:19:05.963245 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b13d3ff_547c_4d5c_a820_c712badb2aea.slice/crio-2a09be5778df54c7e50ab7e39c144f8d4046bd56fd94a8deb54b34df4915a91f WatchSource:0}: Error finding container 2a09be5778df54c7e50ab7e39c144f8d4046bd56fd94a8deb54b34df4915a91f: Status 404 returned error can't find the container with id 2a09be5778df54c7e50ab7e39c144f8d4046bd56fd94a8deb54b34df4915a91f Jul 16 11:19:06.353194 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:19:06.353159 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvqcm" event={"ID":"7b13d3ff-547c-4d5c-a820-c712badb2aea","Type":"ContainerStarted","Data":"a869ce7b42acd36a07bde7ce4a31da9adec197b8dab34b5b2debc1d5e421bc35"} Jul 16 11:19:06.353324 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:19:06.353211 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvqcm" event={"ID":"7b13d3ff-547c-4d5c-a820-c712badb2aea","Type":"ContainerStarted","Data":"2a09be5778df54c7e50ab7e39c144f8d4046bd56fd94a8deb54b34df4915a91f"} Jul 16 11:19:06.370688 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:19:06.370624 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvqcm" podStartSLOduration=1.153297399 podStartE2EDuration="1.370609961s" totalImagesPullingTime="217.312562ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:19:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:19:06.368527972 +0000 UTC m=+654.120785766" watchObservedRunningTime="2026-07-16 11:19:06.370609961 +0000 UTC m=+654.122867756" Jul 16 11:19:15.832391 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:19:15.832352 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvqcm" Jul 16 11:19:15.832888 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:19:15.832418 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvqcm" Jul 16 11:19:15.845066 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:19:15.845040 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvqcm" Jul 16 11:19:16.408670 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:19:16.408639 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tvqcm" Jul 16 11:27:47.547921 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:27:47.547838 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7h64c"] Jul 16 11:27:47.548424 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:27:47.548084 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7h64c" podUID="b055b056-de53-44fe-8e61-117b20464c6c" containerName="manager" containerID="cri-o://36e91a347a35dc037f9002dd14a68fe59b3ca8e6585c51e4a2be66b532847782" gracePeriod=10 Jul 16 11:27:50.299921 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:27:50.299898 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7h64c" Jul 16 11:27:50.361860 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:27:50.361833 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b055b056-de53-44fe-8e61-117b20464c6c-extensions-socket-volume\") pod \"b055b056-de53-44fe-8e61-117b20464c6c\" (UID: \"b055b056-de53-44fe-8e61-117b20464c6c\") " Jul 16 11:27:50.361998 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:27:50.361886 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qkxg\" (UniqueName: \"kubernetes.io/projected/b055b056-de53-44fe-8e61-117b20464c6c-kube-api-access-2qkxg\") pod \"b055b056-de53-44fe-8e61-117b20464c6c\" (UID: \"b055b056-de53-44fe-8e61-117b20464c6c\") " Jul 16 11:27:50.362270 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:27:50.362239 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b055b056-de53-44fe-8e61-117b20464c6c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b055b056-de53-44fe-8e61-117b20464c6c" (UID: "b055b056-de53-44fe-8e61-117b20464c6c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 11:27:50.364036 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:27:50.364007 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b055b056-de53-44fe-8e61-117b20464c6c-kube-api-access-2qkxg" (OuterVolumeSpecName: "kube-api-access-2qkxg") pod "b055b056-de53-44fe-8e61-117b20464c6c" (UID: "b055b056-de53-44fe-8e61-117b20464c6c"). InnerVolumeSpecName "kube-api-access-2qkxg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 11:27:50.462405 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:27:50.462380 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qkxg\" (UniqueName: \"kubernetes.io/projected/b055b056-de53-44fe-8e61-117b20464c6c-kube-api-access-2qkxg\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:27:50.462405 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:27:50.462403 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b055b056-de53-44fe-8e61-117b20464c6c-extensions-socket-volume\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:27:50.665746 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:27:50.665718 2559 generic.go:356] "Generic (PLEG): container finished" podID="b055b056-de53-44fe-8e61-117b20464c6c" containerID="36e91a347a35dc037f9002dd14a68fe59b3ca8e6585c51e4a2be66b532847782" exitCode=0 Jul 16 11:27:50.665840 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:27:50.665755 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7h64c" Jul 16 11:27:50.665840 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:27:50.665799 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7h64c" event={"ID":"b055b056-de53-44fe-8e61-117b20464c6c","Type":"ContainerDied","Data":"36e91a347a35dc037f9002dd14a68fe59b3ca8e6585c51e4a2be66b532847782"} Jul 16 11:27:50.665919 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:27:50.665847 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7h64c" event={"ID":"b055b056-de53-44fe-8e61-117b20464c6c","Type":"ContainerDied","Data":"463b50cc8c527dd34c9f9a2d6a7d8ae1eb2e33b1b4ab7146c88a3ad44c876ca7"} Jul 16 11:27:50.665919 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:27:50.665871 2559 scope.go:117] "RemoveContainer" containerID="36e91a347a35dc037f9002dd14a68fe59b3ca8e6585c51e4a2be66b532847782" Jul 16 11:27:50.674725 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:27:50.674709 2559 scope.go:117] "RemoveContainer" containerID="36e91a347a35dc037f9002dd14a68fe59b3ca8e6585c51e4a2be66b532847782" Jul 16 11:27:50.674964 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:27:50.674946 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36e91a347a35dc037f9002dd14a68fe59b3ca8e6585c51e4a2be66b532847782\": container with ID starting with 36e91a347a35dc037f9002dd14a68fe59b3ca8e6585c51e4a2be66b532847782 not found: ID does not exist" containerID="36e91a347a35dc037f9002dd14a68fe59b3ca8e6585c51e4a2be66b532847782" Jul 16 11:27:50.675012 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:27:50.674971 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36e91a347a35dc037f9002dd14a68fe59b3ca8e6585c51e4a2be66b532847782"} err="failed to get container status \"36e91a347a35dc037f9002dd14a68fe59b3ca8e6585c51e4a2be66b532847782\": rpc error: code = NotFound desc = could not find container \"36e91a347a35dc037f9002dd14a68fe59b3ca8e6585c51e4a2be66b532847782\": container with ID starting with 36e91a347a35dc037f9002dd14a68fe59b3ca8e6585c51e4a2be66b532847782 not found: ID does not exist" Jul 16 11:27:50.683348 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:27:50.683327 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7h64c"] Jul 16 11:27:50.689356 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:27:50.689336 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7h64c"] Jul 16 11:27:52.649688 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:27:52.649653 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b055b056-de53-44fe-8e61-117b20464c6c" path="/var/lib/kubelet/pods/b055b056-de53-44fe-8e61-117b20464c6c/volumes" Jul 16 11:28:48.732856 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:28:48.732825 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xvc7"] Jul 16 11:28:48.733295 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:28:48.733122 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b055b056-de53-44fe-8e61-117b20464c6c" containerName="manager" Jul 16 11:28:48.733295 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:28:48.733133 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b055b056-de53-44fe-8e61-117b20464c6c" containerName="manager" Jul 16 11:28:48.733295 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:28:48.733205 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b055b056-de53-44fe-8e61-117b20464c6c" containerName="manager" Jul 16 11:28:48.736085 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:28:48.736067 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xvc7" Jul 16 11:28:48.738440 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:28:48.738417 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 16 11:28:48.738440 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:28:48.738429 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-68fj7\"" Jul 16 11:28:48.738716 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:28:48.738703 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 16 11:28:48.750093 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:28:48.750071 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xvc7"] Jul 16 11:28:48.919875 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:28:48.919847 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d6f7946-4a0f-43b4-98f6-9dbfd292f7e4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8xvc7\" (UID: \"8d6f7946-4a0f-43b4-98f6-9dbfd292f7e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xvc7" Jul 16 11:28:48.919996 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:28:48.919879 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrzrt\" (UniqueName: \"kubernetes.io/projected/8d6f7946-4a0f-43b4-98f6-9dbfd292f7e4-kube-api-access-hrzrt\") pod \"kuadrant-operator-controller-manager-86878c769f-8xvc7\" (UID: \"8d6f7946-4a0f-43b4-98f6-9dbfd292f7e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xvc7" Jul 16 11:28:49.020513 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:28:49.020443 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d6f7946-4a0f-43b4-98f6-9dbfd292f7e4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8xvc7\" (UID: \"8d6f7946-4a0f-43b4-98f6-9dbfd292f7e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xvc7" Jul 16 11:28:49.020513 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:28:49.020482 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrzrt\" (UniqueName: \"kubernetes.io/projected/8d6f7946-4a0f-43b4-98f6-9dbfd292f7e4-kube-api-access-hrzrt\") pod \"kuadrant-operator-controller-manager-86878c769f-8xvc7\" (UID: \"8d6f7946-4a0f-43b4-98f6-9dbfd292f7e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xvc7" Jul 16 11:28:49.020821 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:28:49.020800 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d6f7946-4a0f-43b4-98f6-9dbfd292f7e4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8xvc7\" (UID: \"8d6f7946-4a0f-43b4-98f6-9dbfd292f7e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xvc7" Jul 16 11:28:49.028881 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:28:49.028865 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrzrt\" (UniqueName: \"kubernetes.io/projected/8d6f7946-4a0f-43b4-98f6-9dbfd292f7e4-kube-api-access-hrzrt\") pod \"kuadrant-operator-controller-manager-86878c769f-8xvc7\" (UID: \"8d6f7946-4a0f-43b4-98f6-9dbfd292f7e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xvc7" Jul 16 11:28:49.046502 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:28:49.046487 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xvc7" Jul 16 11:28:49.182113 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:28:49.182082 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xvc7"] Jul 16 11:28:49.185666 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:28:49.185615 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d6f7946_4a0f_43b4_98f6_9dbfd292f7e4.slice/crio-65a76393791f2b60297da1c6d1bab7bc19b66fe78d3d8dbba0e8dabfd32e8e0a WatchSource:0}: Error finding container 65a76393791f2b60297da1c6d1bab7bc19b66fe78d3d8dbba0e8dabfd32e8e0a: Status 404 returned error can't find the container with id 65a76393791f2b60297da1c6d1bab7bc19b66fe78d3d8dbba0e8dabfd32e8e0a Jul 16 11:28:49.933781 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:28:49.933741 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xvc7" event={"ID":"8d6f7946-4a0f-43b4-98f6-9dbfd292f7e4","Type":"ContainerStarted","Data":"0d8077cd711c3a3d4aa58f8a222bf9e840bb3c34152e3df78e32c9a0e05527b4"} Jul 16 11:28:49.934162 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:28:49.933803 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xvc7" event={"ID":"8d6f7946-4a0f-43b4-98f6-9dbfd292f7e4","Type":"ContainerStarted","Data":"65a76393791f2b60297da1c6d1bab7bc19b66fe78d3d8dbba0e8dabfd32e8e0a"} Jul 16 11:28:49.934162 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:28:49.933882 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xvc7" Jul 16 11:28:49.960300 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:28:49.960259 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xvc7" podStartSLOduration=1.960245279 podStartE2EDuration="1.960245279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:28:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:28:49.957371517 +0000 UTC m=+1237.709629325" watchObservedRunningTime="2026-07-16 11:28:49.960245279 +0000 UTC m=+1237.712503074" Jul 16 11:29:00.939960 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:29:00.939927 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xvc7" Jul 16 11:35:22.118127 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:22.118034 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-29a4483c-c78678558-j4dbt"] Jul 16 11:35:22.121248 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:22.121230 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-29a4483c-c78678558-j4dbt" Jul 16 11:35:22.123528 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:22.123502 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-29a4483c-serving-cert\"" Jul 16 11:35:22.123671 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:22.123549 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kt2rk\"" Jul 16 11:35:22.123671 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:22.123586 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 16 11:35:22.124395 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:22.124380 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 16 11:35:22.134252 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:22.134233 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-29a4483c-c78678558-j4dbt"] Jul 16 11:35:22.256297 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:22.256271 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npw8l\" (UniqueName: \"kubernetes.io/projected/9379bebc-b74e-4a57-976a-851c98b48228-kube-api-access-npw8l\") pod \"maas-api-e2e-derive-29a4483c-c78678558-j4dbt\" (UID: \"9379bebc-b74e-4a57-976a-851c98b48228\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-29a4483c-c78678558-j4dbt" Jul 16 11:35:22.256432 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:22.256328 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9379bebc-b74e-4a57-976a-851c98b48228-maas-api-tls\") pod \"maas-api-e2e-derive-29a4483c-c78678558-j4dbt\" (UID: \"9379bebc-b74e-4a57-976a-851c98b48228\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-29a4483c-c78678558-j4dbt" Jul 16 11:35:22.256432 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:22.256354 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9379bebc-b74e-4a57-976a-851c98b48228-openshift-service-ca\") pod \"maas-api-e2e-derive-29a4483c-c78678558-j4dbt\" (UID: \"9379bebc-b74e-4a57-976a-851c98b48228\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-29a4483c-c78678558-j4dbt" Jul 16 11:35:22.357081 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:22.357052 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9379bebc-b74e-4a57-976a-851c98b48228-maas-api-tls\") pod \"maas-api-e2e-derive-29a4483c-c78678558-j4dbt\" (UID: \"9379bebc-b74e-4a57-976a-851c98b48228\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-29a4483c-c78678558-j4dbt" Jul 16 11:35:22.357081 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:22.357082 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9379bebc-b74e-4a57-976a-851c98b48228-openshift-service-ca\") pod \"maas-api-e2e-derive-29a4483c-c78678558-j4dbt\" (UID: \"9379bebc-b74e-4a57-976a-851c98b48228\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-29a4483c-c78678558-j4dbt" Jul 16 11:35:22.357248 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:22.357178 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npw8l\" (UniqueName: \"kubernetes.io/projected/9379bebc-b74e-4a57-976a-851c98b48228-kube-api-access-npw8l\") pod \"maas-api-e2e-derive-29a4483c-c78678558-j4dbt\" (UID: \"9379bebc-b74e-4a57-976a-851c98b48228\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-29a4483c-c78678558-j4dbt" Jul 16 11:35:22.357792 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:22.357765 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9379bebc-b74e-4a57-976a-851c98b48228-openshift-service-ca\") pod \"maas-api-e2e-derive-29a4483c-c78678558-j4dbt\" (UID: \"9379bebc-b74e-4a57-976a-851c98b48228\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-29a4483c-c78678558-j4dbt" Jul 16 11:35:22.359557 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:22.359533 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9379bebc-b74e-4a57-976a-851c98b48228-maas-api-tls\") pod \"maas-api-e2e-derive-29a4483c-c78678558-j4dbt\" (UID: \"9379bebc-b74e-4a57-976a-851c98b48228\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-29a4483c-c78678558-j4dbt" Jul 16 11:35:22.368314 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:22.368260 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npw8l\" (UniqueName: \"kubernetes.io/projected/9379bebc-b74e-4a57-976a-851c98b48228-kube-api-access-npw8l\") pod \"maas-api-e2e-derive-29a4483c-c78678558-j4dbt\" (UID: \"9379bebc-b74e-4a57-976a-851c98b48228\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-29a4483c-c78678558-j4dbt" Jul 16 11:35:22.431055 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:22.431030 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-29a4483c-c78678558-j4dbt" Jul 16 11:35:22.563049 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:22.563021 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-29a4483c-c78678558-j4dbt"] Jul 16 11:35:22.565689 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:35:22.565663 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9379bebc_b74e_4a57_976a_851c98b48228.slice/crio-4b39d8bc8b6f9f58949a96646d8dbe1f025ad787f823e0a2bb270629e3935f7d WatchSource:0}: Error finding container 4b39d8bc8b6f9f58949a96646d8dbe1f025ad787f823e0a2bb270629e3935f7d: Status 404 returned error can't find the container with id 4b39d8bc8b6f9f58949a96646d8dbe1f025ad787f823e0a2bb270629e3935f7d Jul 16 11:35:22.567065 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:22.567047 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 11:35:22.675071 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:22.675043 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-29a4483c-c78678558-j4dbt" event={"ID":"9379bebc-b74e-4a57-976a-851c98b48228","Type":"ContainerStarted","Data":"4b39d8bc8b6f9f58949a96646d8dbe1f025ad787f823e0a2bb270629e3935f7d"} Jul 16 11:35:25.691600 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:25.691563 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-29a4483c-c78678558-j4dbt" event={"ID":"9379bebc-b74e-4a57-976a-851c98b48228","Type":"ContainerStarted","Data":"0ac1760e737a76bb053f8b6d6d32ad10efaeee2baddd598f25ff2c53a496931f"} Jul 16 11:35:25.692013 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:25.691755 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-29a4483c-c78678558-j4dbt" Jul 16 11:35:25.710183 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:25.710139 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-29a4483c-c78678558-j4dbt" podStartSLOduration=1.445127804 podStartE2EDuration="3.7101264s" totalImagesPullingTime="2.264998596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:35:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:35:25.708799103 +0000 UTC m=+1633.461056921" watchObservedRunningTime="2026-07-16 11:35:25.7101264 +0000 UTC m=+1633.462384195" Jul 16 11:35:31.703222 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:31.703193 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-29a4483c-c78678558-j4dbt" Jul 16 11:35:33.490896 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:33.490859 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-29a4483c-c78678558-j4dbt"] Jul 16 11:35:33.491386 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:33.491101 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-29a4483c-c78678558-j4dbt" podUID="9379bebc-b74e-4a57-976a-851c98b48228" containerName="maas-api" containerID="cri-o://0ac1760e737a76bb053f8b6d6d32ad10efaeee2baddd598f25ff2c53a496931f" gracePeriod=30 Jul 16 11:35:33.729099 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:33.729071 2559 generic.go:356] "Generic (PLEG): container finished" podID="9379bebc-b74e-4a57-976a-851c98b48228" containerID="0ac1760e737a76bb053f8b6d6d32ad10efaeee2baddd598f25ff2c53a496931f" exitCode=0 Jul 16 11:35:33.729225 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:33.729147 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-29a4483c-c78678558-j4dbt" event={"ID":"9379bebc-b74e-4a57-976a-851c98b48228","Type":"ContainerDied","Data":"0ac1760e737a76bb053f8b6d6d32ad10efaeee2baddd598f25ff2c53a496931f"} Jul 16 11:35:33.729225 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:33.729208 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-29a4483c-c78678558-j4dbt" event={"ID":"9379bebc-b74e-4a57-976a-851c98b48228","Type":"ContainerDied","Data":"4b39d8bc8b6f9f58949a96646d8dbe1f025ad787f823e0a2bb270629e3935f7d"} Jul 16 11:35:33.729313 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:33.729229 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b39d8bc8b6f9f58949a96646d8dbe1f025ad787f823e0a2bb270629e3935f7d" Jul 16 11:35:33.739258 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:33.739240 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-29a4483c-c78678558-j4dbt" Jul 16 11:35:33.852716 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:33.852649 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npw8l\" (UniqueName: \"kubernetes.io/projected/9379bebc-b74e-4a57-976a-851c98b48228-kube-api-access-npw8l\") pod \"9379bebc-b74e-4a57-976a-851c98b48228\" (UID: \"9379bebc-b74e-4a57-976a-851c98b48228\") " Jul 16 11:35:33.852844 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:33.852742 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9379bebc-b74e-4a57-976a-851c98b48228-maas-api-tls\") pod \"9379bebc-b74e-4a57-976a-851c98b48228\" (UID: \"9379bebc-b74e-4a57-976a-851c98b48228\") " Jul 16 11:35:33.852844 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:33.852790 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9379bebc-b74e-4a57-976a-851c98b48228-openshift-service-ca\") pod \"9379bebc-b74e-4a57-976a-851c98b48228\" (UID: \"9379bebc-b74e-4a57-976a-851c98b48228\") " Jul 16 11:35:33.853202 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:33.853173 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9379bebc-b74e-4a57-976a-851c98b48228-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9379bebc-b74e-4a57-976a-851c98b48228" (UID: "9379bebc-b74e-4a57-976a-851c98b48228"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 11:35:33.855010 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:33.854982 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9379bebc-b74e-4a57-976a-851c98b48228-kube-api-access-npw8l" (OuterVolumeSpecName: "kube-api-access-npw8l") pod "9379bebc-b74e-4a57-976a-851c98b48228" (UID: "9379bebc-b74e-4a57-976a-851c98b48228"). InnerVolumeSpecName "kube-api-access-npw8l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 11:35:33.855143 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:33.855079 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9379bebc-b74e-4a57-976a-851c98b48228-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9379bebc-b74e-4a57-976a-851c98b48228" (UID: "9379bebc-b74e-4a57-976a-851c98b48228"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 11:35:33.954120 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:33.954096 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npw8l\" (UniqueName: \"kubernetes.io/projected/9379bebc-b74e-4a57-976a-851c98b48228-kube-api-access-npw8l\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:35:33.954120 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:33.954117 2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9379bebc-b74e-4a57-976a-851c98b48228-maas-api-tls\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:35:33.954245 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:33.954128 2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9379bebc-b74e-4a57-976a-851c98b48228-openshift-service-ca\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:35:34.733272 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:34.733243 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-29a4483c-c78678558-j4dbt" Jul 16 11:35:34.749769 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:34.749745 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-29a4483c-c78678558-j4dbt"] Jul 16 11:35:34.752624 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:34.752600 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-29a4483c-c78678558-j4dbt"] Jul 16 11:35:36.651826 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:35:36.651787 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9379bebc-b74e-4a57-976a-851c98b48228" path="/var/lib/kubelet/pods/9379bebc-b74e-4a57-976a-851c98b48228/volumes" Jul 16 11:37:18.916607 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:18.916580 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb"] Jul 16 11:37:18.917062 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:18.916913 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9379bebc-b74e-4a57-976a-851c98b48228" containerName="maas-api" Jul 16 11:37:18.917062 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:18.916925 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9379bebc-b74e-4a57-976a-851c98b48228" containerName="maas-api" Jul 16 11:37:18.917062 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:18.916995 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9379bebc-b74e-4a57-976a-851c98b48228" containerName="maas-api" Jul 16 11:37:18.920086 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:18.920064 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb" Jul 16 11:37:18.922213 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:18.922188 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kt2rk\"" Jul 16 11:37:18.922344 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:18.922308 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 16 11:37:18.922814 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:18.922794 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 16 11:37:18.922914 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:18.922796 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-41466a73-serving-cert\"" Jul 16 11:37:18.932297 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:18.932273 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb"] Jul 16 11:37:18.978015 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:18.977992 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9556293-ec51-42de-8c49-2c668a1b9777-openshift-service-ca\") pod \"maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb\" (UID: \"b9556293-ec51-42de-8c49-2c668a1b9777\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb" Jul 16 11:37:18.978145 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:18.978053 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k2nn\" (UniqueName: \"kubernetes.io/projected/b9556293-ec51-42de-8c49-2c668a1b9777-kube-api-access-5k2nn\") pod \"maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb\" (UID: \"b9556293-ec51-42de-8c49-2c668a1b9777\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb" Jul 16 11:37:18.978145 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:18.978139 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9556293-ec51-42de-8c49-2c668a1b9777-maas-api-tls\") pod \"maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb\" (UID: \"b9556293-ec51-42de-8c49-2c668a1b9777\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb" Jul 16 11:37:19.079486 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:19.079459 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9556293-ec51-42de-8c49-2c668a1b9777-openshift-service-ca\") pod \"maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb\" (UID: \"b9556293-ec51-42de-8c49-2c668a1b9777\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb" Jul 16 11:37:19.079615 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:19.079505 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k2nn\" (UniqueName: \"kubernetes.io/projected/b9556293-ec51-42de-8c49-2c668a1b9777-kube-api-access-5k2nn\") pod \"maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb\" (UID: \"b9556293-ec51-42de-8c49-2c668a1b9777\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb" Jul 16 11:37:19.079615 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:19.079539 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9556293-ec51-42de-8c49-2c668a1b9777-maas-api-tls\") pod \"maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb\" (UID: \"b9556293-ec51-42de-8c49-2c668a1b9777\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb" Jul 16 11:37:19.079768 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:37:19.079664 2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-41466a73-serving-cert: secret "maas-api-e2e-mt-41466a73-serving-cert" not found Jul 16 11:37:19.079768 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:37:19.079726 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9556293-ec51-42de-8c49-2c668a1b9777-maas-api-tls podName:b9556293-ec51-42de-8c49-2c668a1b9777 nodeName:}" failed. No retries permitted until 2026-07-16 11:37:19.579707339 +0000 UTC m=+1747.331965114 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b9556293-ec51-42de-8c49-2c668a1b9777-maas-api-tls") pod "maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb" (UID: "b9556293-ec51-42de-8c49-2c668a1b9777") : secret "maas-api-e2e-mt-41466a73-serving-cert" not found Jul 16 11:37:19.080073 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:19.080054 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9556293-ec51-42de-8c49-2c668a1b9777-openshift-service-ca\") pod \"maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb\" (UID: \"b9556293-ec51-42de-8c49-2c668a1b9777\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb" Jul 16 11:37:19.089807 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:19.089777 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k2nn\" (UniqueName: \"kubernetes.io/projected/b9556293-ec51-42de-8c49-2c668a1b9777-kube-api-access-5k2nn\") pod \"maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb\" (UID: \"b9556293-ec51-42de-8c49-2c668a1b9777\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb" Jul 16 11:37:19.583746 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:19.583704 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9556293-ec51-42de-8c49-2c668a1b9777-maas-api-tls\") pod \"maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb\" (UID: \"b9556293-ec51-42de-8c49-2c668a1b9777\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb" Jul 16 11:37:19.586058 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:19.586035 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9556293-ec51-42de-8c49-2c668a1b9777-maas-api-tls\") pod \"maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb\" (UID: \"b9556293-ec51-42de-8c49-2c668a1b9777\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb" Jul 16 11:37:19.830421 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:19.830391 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb" Jul 16 11:37:19.962298 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:19.962273 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb"] Jul 16 11:37:19.964399 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:37:19.964368 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9556293_ec51_42de_8c49_2c668a1b9777.slice/crio-89c16582b8655603d3f228a33fa9305195c1513cb4632dc6aceac1f98236d09f WatchSource:0}: Error finding container 89c16582b8655603d3f228a33fa9305195c1513cb4632dc6aceac1f98236d09f: Status 404 returned error can't find the container with id 89c16582b8655603d3f228a33fa9305195c1513cb4632dc6aceac1f98236d09f Jul 16 11:37:20.212467 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:20.212436 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb" event={"ID":"b9556293-ec51-42de-8c49-2c668a1b9777","Type":"ContainerStarted","Data":"89c16582b8655603d3f228a33fa9305195c1513cb4632dc6aceac1f98236d09f"} Jul 16 11:37:21.218049 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:21.218006 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb" event={"ID":"b9556293-ec51-42de-8c49-2c668a1b9777","Type":"ContainerStarted","Data":"77f2206e26088b3df8a34a5952936c194e41055aec8de345ce273d96c3ac2a18"} Jul 16 11:37:21.218423 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:21.218143 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb" Jul 16 11:37:21.234725 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:21.234680 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb" podStartSLOduration=2.7481342140000002 podStartE2EDuration="3.234665357s" totalImagesPullingTime="486.531143ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:37:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:37:21.233451663 +0000 UTC m=+1748.985709459" watchObservedRunningTime="2026-07-16 11:37:21.234665357 +0000 UTC m=+1748.986923149" Jul 16 11:37:27.227874 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:27.227846 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb" Jul 16 11:37:37.300675 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:37.300621 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb"] Jul 16 11:37:37.301200 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:37.300864 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb" podUID="b9556293-ec51-42de-8c49-2c668a1b9777" containerName="maas-api" containerID="cri-o://77f2206e26088b3df8a34a5952936c194e41055aec8de345ce273d96c3ac2a18" gracePeriod=30 Jul 16 11:37:37.552743 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:37.552687 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb" Jul 16 11:37:37.618995 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:37.618971 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9556293-ec51-42de-8c49-2c668a1b9777-openshift-service-ca\") pod \"b9556293-ec51-42de-8c49-2c668a1b9777\" (UID: \"b9556293-ec51-42de-8c49-2c668a1b9777\") " Jul 16 11:37:37.619119 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:37.619019 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5k2nn\" (UniqueName: \"kubernetes.io/projected/b9556293-ec51-42de-8c49-2c668a1b9777-kube-api-access-5k2nn\") pod \"b9556293-ec51-42de-8c49-2c668a1b9777\" (UID: \"b9556293-ec51-42de-8c49-2c668a1b9777\") " Jul 16 11:37:37.619119 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:37.619053 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9556293-ec51-42de-8c49-2c668a1b9777-maas-api-tls\") pod \"b9556293-ec51-42de-8c49-2c668a1b9777\" (UID: \"b9556293-ec51-42de-8c49-2c668a1b9777\") " Jul 16 11:37:37.619362 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:37.619339 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9556293-ec51-42de-8c49-2c668a1b9777-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b9556293-ec51-42de-8c49-2c668a1b9777" (UID: "b9556293-ec51-42de-8c49-2c668a1b9777"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 11:37:37.621046 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:37.621023 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9556293-ec51-42de-8c49-2c668a1b9777-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b9556293-ec51-42de-8c49-2c668a1b9777" (UID: "b9556293-ec51-42de-8c49-2c668a1b9777"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 11:37:37.621127 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:37.621084 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9556293-ec51-42de-8c49-2c668a1b9777-kube-api-access-5k2nn" (OuterVolumeSpecName: "kube-api-access-5k2nn") pod "b9556293-ec51-42de-8c49-2c668a1b9777" (UID: "b9556293-ec51-42de-8c49-2c668a1b9777"). InnerVolumeSpecName "kube-api-access-5k2nn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 11:37:37.719666 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:37.719626 2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9556293-ec51-42de-8c49-2c668a1b9777-openshift-service-ca\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:37:37.719666 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:37.719664 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5k2nn\" (UniqueName: \"kubernetes.io/projected/b9556293-ec51-42de-8c49-2c668a1b9777-kube-api-access-5k2nn\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:37:37.719792 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:37.719673 2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9556293-ec51-42de-8c49-2c668a1b9777-maas-api-tls\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:37:38.295085 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:38.295049 2559 generic.go:356] "Generic (PLEG): container finished" podID="b9556293-ec51-42de-8c49-2c668a1b9777" containerID="77f2206e26088b3df8a34a5952936c194e41055aec8de345ce273d96c3ac2a18" exitCode=0 Jul 16 11:37:38.295250 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:38.295097 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb" Jul 16 11:37:38.295250 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:38.295109 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb" event={"ID":"b9556293-ec51-42de-8c49-2c668a1b9777","Type":"ContainerDied","Data":"77f2206e26088b3df8a34a5952936c194e41055aec8de345ce273d96c3ac2a18"} Jul 16 11:37:38.295250 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:38.295158 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb" event={"ID":"b9556293-ec51-42de-8c49-2c668a1b9777","Type":"ContainerDied","Data":"89c16582b8655603d3f228a33fa9305195c1513cb4632dc6aceac1f98236d09f"} Jul 16 11:37:38.295250 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:38.295181 2559 scope.go:117] "RemoveContainer" containerID="77f2206e26088b3df8a34a5952936c194e41055aec8de345ce273d96c3ac2a18" Jul 16 11:37:38.303988 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:38.303820 2559 scope.go:117] "RemoveContainer" containerID="77f2206e26088b3df8a34a5952936c194e41055aec8de345ce273d96c3ac2a18" Jul 16 11:37:38.304204 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:37:38.304071 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77f2206e26088b3df8a34a5952936c194e41055aec8de345ce273d96c3ac2a18\": container with ID starting with 77f2206e26088b3df8a34a5952936c194e41055aec8de345ce273d96c3ac2a18 not found: ID does not exist" containerID="77f2206e26088b3df8a34a5952936c194e41055aec8de345ce273d96c3ac2a18" Jul 16 11:37:38.304204 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:38.304094 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77f2206e26088b3df8a34a5952936c194e41055aec8de345ce273d96c3ac2a18"} err="failed to get container status \"77f2206e26088b3df8a34a5952936c194e41055aec8de345ce273d96c3ac2a18\": rpc error: code = NotFound desc = could not find container \"77f2206e26088b3df8a34a5952936c194e41055aec8de345ce273d96c3ac2a18\": container with ID starting with 77f2206e26088b3df8a34a5952936c194e41055aec8de345ce273d96c3ac2a18 not found: ID does not exist" Jul 16 11:37:38.315495 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:38.315476 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb"] Jul 16 11:37:38.321813 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:38.321792 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-41466a73-6b5d8f88fb-kd8fb"] Jul 16 11:37:38.650879 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:37:38.650819 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9556293-ec51-42de-8c49-2c668a1b9777" path="/var/lib/kubelet/pods/b9556293-ec51-42de-8c49-2c668a1b9777/volumes" Jul 16 11:39:01.176419 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:01.176389 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f"] Jul 16 11:39:01.176862 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:01.176787 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9556293-ec51-42de-8c49-2c668a1b9777" containerName="maas-api" Jul 16 11:39:01.176862 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:01.176800 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9556293-ec51-42de-8c49-2c668a1b9777" containerName="maas-api" Jul 16 11:39:01.176862 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:01.176855 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9556293-ec51-42de-8c49-2c668a1b9777" containerName="maas-api" Jul 16 11:39:01.179832 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:01.179812 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f" Jul 16 11:39:01.182781 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:01.182759 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-a0660d-serving-cert\"" Jul 16 11:39:01.182910 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:01.182796 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 16 11:39:01.183611 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:01.183589 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 16 11:39:01.183771 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:01.183616 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kt2rk\"" Jul 16 11:39:01.201245 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:01.201205 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f"] Jul 16 11:39:01.217643 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:01.217611 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5gq9\" (UniqueName: \"kubernetes.io/projected/e5fb7618-f914-4c9d-941b-b0d8cbcac611-kube-api-access-t5gq9\") pod \"maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f\" (UID: \"e5fb7618-f914-4c9d-941b-b0d8cbcac611\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f" Jul 16 11:39:01.217747 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:01.217657 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5fb7618-f914-4c9d-941b-b0d8cbcac611-maas-api-tls\") pod \"maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f\" (UID: \"e5fb7618-f914-4c9d-941b-b0d8cbcac611\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f" Jul 16 11:39:01.217747 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:01.217689 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5fb7618-f914-4c9d-941b-b0d8cbcac611-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f\" (UID: \"e5fb7618-f914-4c9d-941b-b0d8cbcac611\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f" Jul 16 11:39:01.318164 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:01.318142 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5fb7618-f914-4c9d-941b-b0d8cbcac611-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f\" (UID: \"e5fb7618-f914-4c9d-941b-b0d8cbcac611\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f" Jul 16 11:39:01.318274 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:01.318197 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5gq9\" (UniqueName: \"kubernetes.io/projected/e5fb7618-f914-4c9d-941b-b0d8cbcac611-kube-api-access-t5gq9\") pod \"maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f\" (UID: \"e5fb7618-f914-4c9d-941b-b0d8cbcac611\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f" Jul 16 11:39:01.318274 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:01.318220 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5fb7618-f914-4c9d-941b-b0d8cbcac611-maas-api-tls\") pod \"maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f\" (UID: \"e5fb7618-f914-4c9d-941b-b0d8cbcac611\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f" Jul 16 11:39:01.318346 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:39:01.318303 2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-a0660d-serving-cert: secret "maas-api-e2e-inf-a-a0660d-serving-cert" not found Jul 16 11:39:01.318378 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:39:01.318359 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5fb7618-f914-4c9d-941b-b0d8cbcac611-maas-api-tls podName:e5fb7618-f914-4c9d-941b-b0d8cbcac611 nodeName:}" failed. No retries permitted until 2026-07-16 11:39:01.818343501 +0000 UTC m=+1849.570601273 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e5fb7618-f914-4c9d-941b-b0d8cbcac611-maas-api-tls") pod "maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f" (UID: "e5fb7618-f914-4c9d-941b-b0d8cbcac611") : secret "maas-api-e2e-inf-a-a0660d-serving-cert" not found Jul 16 11:39:01.318775 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:01.318757 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5fb7618-f914-4c9d-941b-b0d8cbcac611-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f\" (UID: \"e5fb7618-f914-4c9d-941b-b0d8cbcac611\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f" Jul 16 11:39:01.358140 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:01.358119 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5gq9\" (UniqueName: \"kubernetes.io/projected/e5fb7618-f914-4c9d-941b-b0d8cbcac611-kube-api-access-t5gq9\") pod \"maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f\" (UID: \"e5fb7618-f914-4c9d-941b-b0d8cbcac611\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f" Jul 16 11:39:01.822004 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:01.821975 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5fb7618-f914-4c9d-941b-b0d8cbcac611-maas-api-tls\") pod \"maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f\" (UID: \"e5fb7618-f914-4c9d-941b-b0d8cbcac611\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f" Jul 16 11:39:01.824153 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:01.824134 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5fb7618-f914-4c9d-941b-b0d8cbcac611-maas-api-tls\") pod \"maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f\" (UID: \"e5fb7618-f914-4c9d-941b-b0d8cbcac611\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f" Jul 16 11:39:02.090487 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:02.090421 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f" Jul 16 11:39:02.232778 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:02.232751 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f"] Jul 16 11:39:02.234552 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:39:02.234524 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5fb7618_f914_4c9d_941b_b0d8cbcac611.slice/crio-f86ce4dd3a9b30e18b407b1836df01a5140da3928ad928a8c8045b9cdfc63f5f WatchSource:0}: Error finding container f86ce4dd3a9b30e18b407b1836df01a5140da3928ad928a8c8045b9cdfc63f5f: Status 404 returned error can't find the container with id f86ce4dd3a9b30e18b407b1836df01a5140da3928ad928a8c8045b9cdfc63f5f Jul 16 11:39:02.674946 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:02.674921 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f" event={"ID":"e5fb7618-f914-4c9d-941b-b0d8cbcac611","Type":"ContainerStarted","Data":"f86ce4dd3a9b30e18b407b1836df01a5140da3928ad928a8c8045b9cdfc63f5f"} Jul 16 11:39:03.681594 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:03.681561 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f" event={"ID":"e5fb7618-f914-4c9d-941b-b0d8cbcac611","Type":"ContainerStarted","Data":"97daf6be77646f1cd1c0146c746fbff8117a7f45eb09f9173db35e586e557a88"} Jul 16 11:39:03.681976 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:03.681625 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f" Jul 16 11:39:03.699891 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:03.699847 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f" podStartSLOduration=2.273035071 podStartE2EDuration="2.699831886s" totalImagesPullingTime="426.796815ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:39:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:39:03.697496259 +0000 UTC m=+1851.449754063" watchObservedRunningTime="2026-07-16 11:39:03.699831886 +0000 UTC m=+1851.452089679" Jul 16 11:39:09.169307 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:09.169272 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9"] Jul 16 11:39:09.172819 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:09.172797 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9" Jul 16 11:39:09.175597 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:09.175574 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-ca07b2-serving-cert\"" Jul 16 11:39:09.190492 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:09.190470 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9"] Jul 16 11:39:09.277151 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:09.277117 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkxlp\" (UniqueName: \"kubernetes.io/projected/bfb53b80-5e25-4086-9030-17ca31ef26cf-kube-api-access-wkxlp\") pod \"maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9\" (UID: \"bfb53b80-5e25-4086-9030-17ca31ef26cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9" Jul 16 11:39:09.277291 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:09.277204 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfb53b80-5e25-4086-9030-17ca31ef26cf-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9\" (UID: \"bfb53b80-5e25-4086-9030-17ca31ef26cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9" Jul 16 11:39:09.277291 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:09.277234 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfb53b80-5e25-4086-9030-17ca31ef26cf-maas-api-tls\") pod \"maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9\" (UID: \"bfb53b80-5e25-4086-9030-17ca31ef26cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9" Jul 16 11:39:09.377990 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:09.377965 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkxlp\" (UniqueName: \"kubernetes.io/projected/bfb53b80-5e25-4086-9030-17ca31ef26cf-kube-api-access-wkxlp\") pod \"maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9\" (UID: \"bfb53b80-5e25-4086-9030-17ca31ef26cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9" Jul 16 11:39:09.378112 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:09.378017 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfb53b80-5e25-4086-9030-17ca31ef26cf-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9\" (UID: \"bfb53b80-5e25-4086-9030-17ca31ef26cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9" Jul 16 11:39:09.378112 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:09.378034 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfb53b80-5e25-4086-9030-17ca31ef26cf-maas-api-tls\") pod \"maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9\" (UID: \"bfb53b80-5e25-4086-9030-17ca31ef26cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9" Jul 16 11:39:09.378220 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:39:09.378124 2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-ca07b2-serving-cert: secret "maas-api-e2e-inf-b-ca07b2-serving-cert" not found Jul 16 11:39:09.378220 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:39:09.378183 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfb53b80-5e25-4086-9030-17ca31ef26cf-maas-api-tls podName:bfb53b80-5e25-4086-9030-17ca31ef26cf nodeName:}" failed. No retries permitted until 2026-07-16 11:39:09.878168531 +0000 UTC m=+1857.630426304 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bfb53b80-5e25-4086-9030-17ca31ef26cf-maas-api-tls") pod "maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9" (UID: "bfb53b80-5e25-4086-9030-17ca31ef26cf") : secret "maas-api-e2e-inf-b-ca07b2-serving-cert" not found Jul 16 11:39:09.378746 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:09.378724 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfb53b80-5e25-4086-9030-17ca31ef26cf-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9\" (UID: \"bfb53b80-5e25-4086-9030-17ca31ef26cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9" Jul 16 11:39:09.386898 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:09.386873 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkxlp\" (UniqueName: \"kubernetes.io/projected/bfb53b80-5e25-4086-9030-17ca31ef26cf-kube-api-access-wkxlp\") pod \"maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9\" (UID: \"bfb53b80-5e25-4086-9030-17ca31ef26cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9" Jul 16 11:39:09.691787 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:09.691766 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f" Jul 16 11:39:09.881766 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:09.881736 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfb53b80-5e25-4086-9030-17ca31ef26cf-maas-api-tls\") pod \"maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9\" (UID: \"bfb53b80-5e25-4086-9030-17ca31ef26cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9" Jul 16 11:39:09.884238 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:09.884212 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfb53b80-5e25-4086-9030-17ca31ef26cf-maas-api-tls\") pod \"maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9\" (UID: \"bfb53b80-5e25-4086-9030-17ca31ef26cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9" Jul 16 11:39:10.082830 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:10.082757 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9" Jul 16 11:39:10.212302 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:10.212275 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9"] Jul 16 11:39:10.214645 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:39:10.214603 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfb53b80_5e25_4086_9030_17ca31ef26cf.slice/crio-98cdd8bc5254f12edea9e2a70bd149d255c9e6b414b0b684b20a07ea26073905 WatchSource:0}: Error finding container 98cdd8bc5254f12edea9e2a70bd149d255c9e6b414b0b684b20a07ea26073905: Status 404 returned error can't find the container with id 98cdd8bc5254f12edea9e2a70bd149d255c9e6b414b0b684b20a07ea26073905 Jul 16 11:39:10.719202 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:10.719168 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9" event={"ID":"bfb53b80-5e25-4086-9030-17ca31ef26cf","Type":"ContainerStarted","Data":"98cdd8bc5254f12edea9e2a70bd149d255c9e6b414b0b684b20a07ea26073905"} Jul 16 11:39:11.724623 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:11.724586 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9" event={"ID":"bfb53b80-5e25-4086-9030-17ca31ef26cf","Type":"ContainerStarted","Data":"45c8dcb123f268ab0c680e74cfec6f6baf3c5a2b8cf9e39a9357e7f874e2906d"} Jul 16 11:39:11.724999 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:11.724691 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9" Jul 16 11:39:11.745805 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:11.745761 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9" podStartSLOduration=1.8772071430000001 podStartE2EDuration="2.745747134s" totalImagesPullingTime="868.539991ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:39:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:39:11.743816601 +0000 UTC m=+1859.496074395" watchObservedRunningTime="2026-07-16 11:39:11.745747134 +0000 UTC m=+1859.498004930" Jul 16 11:39:17.733797 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:39:17.733769 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9" Jul 16 11:41:00.547295 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:00.547251 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f"] Jul 16 11:41:00.547888 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:00.547613 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f" podUID="e5fb7618-f914-4c9d-941b-b0d8cbcac611" containerName="maas-api" containerID="cri-o://97daf6be77646f1cd1c0146c746fbff8117a7f45eb09f9173db35e586e557a88" gracePeriod=30 Jul 16 11:41:00.796734 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:00.796706 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f" Jul 16 11:41:00.883877 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:00.883806 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5fb7618-f914-4c9d-941b-b0d8cbcac611-maas-api-tls\") pod \"e5fb7618-f914-4c9d-941b-b0d8cbcac611\" (UID: \"e5fb7618-f914-4c9d-941b-b0d8cbcac611\") " Jul 16 11:41:00.884019 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:00.883901 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5gq9\" (UniqueName: \"kubernetes.io/projected/e5fb7618-f914-4c9d-941b-b0d8cbcac611-kube-api-access-t5gq9\") pod \"e5fb7618-f914-4c9d-941b-b0d8cbcac611\" (UID: \"e5fb7618-f914-4c9d-941b-b0d8cbcac611\") " Jul 16 11:41:00.884019 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:00.883931 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5fb7618-f914-4c9d-941b-b0d8cbcac611-openshift-service-ca\") pod \"e5fb7618-f914-4c9d-941b-b0d8cbcac611\" (UID: \"e5fb7618-f914-4c9d-941b-b0d8cbcac611\") " Jul 16 11:41:00.884328 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:00.884303 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5fb7618-f914-4c9d-941b-b0d8cbcac611-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e5fb7618-f914-4c9d-941b-b0d8cbcac611" (UID: "e5fb7618-f914-4c9d-941b-b0d8cbcac611"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 11:41:00.885902 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:00.885862 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5fb7618-f914-4c9d-941b-b0d8cbcac611-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e5fb7618-f914-4c9d-941b-b0d8cbcac611" (UID: "e5fb7618-f914-4c9d-941b-b0d8cbcac611"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 11:41:00.886021 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:00.885988 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5fb7618-f914-4c9d-941b-b0d8cbcac611-kube-api-access-t5gq9" (OuterVolumeSpecName: "kube-api-access-t5gq9") pod "e5fb7618-f914-4c9d-941b-b0d8cbcac611" (UID: "e5fb7618-f914-4c9d-941b-b0d8cbcac611"). InnerVolumeSpecName "kube-api-access-t5gq9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 11:41:00.985495 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:00.985470 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5gq9\" (UniqueName: \"kubernetes.io/projected/e5fb7618-f914-4c9d-941b-b0d8cbcac611-kube-api-access-t5gq9\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:41:00.985495 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:00.985492 2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5fb7618-f914-4c9d-941b-b0d8cbcac611-openshift-service-ca\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:41:00.985705 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:00.985503 2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5fb7618-f914-4c9d-941b-b0d8cbcac611-maas-api-tls\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:41:01.224067 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:01.224038 2559 generic.go:356] "Generic (PLEG): container finished" podID="e5fb7618-f914-4c9d-941b-b0d8cbcac611" containerID="97daf6be77646f1cd1c0146c746fbff8117a7f45eb09f9173db35e586e557a88" exitCode=0 Jul 16 11:41:01.224215 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:01.224080 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f" Jul 16 11:41:01.224215 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:01.224079 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f" event={"ID":"e5fb7618-f914-4c9d-941b-b0d8cbcac611","Type":"ContainerDied","Data":"97daf6be77646f1cd1c0146c746fbff8117a7f45eb09f9173db35e586e557a88"} Jul 16 11:41:01.224215 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:01.224132 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f" event={"ID":"e5fb7618-f914-4c9d-941b-b0d8cbcac611","Type":"ContainerDied","Data":"f86ce4dd3a9b30e18b407b1836df01a5140da3928ad928a8c8045b9cdfc63f5f"} Jul 16 11:41:01.224215 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:01.224155 2559 scope.go:117] "RemoveContainer" containerID="97daf6be77646f1cd1c0146c746fbff8117a7f45eb09f9173db35e586e557a88" Jul 16 11:41:01.233285 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:01.233270 2559 scope.go:117] "RemoveContainer" containerID="97daf6be77646f1cd1c0146c746fbff8117a7f45eb09f9173db35e586e557a88" Jul 16 11:41:01.233526 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:41:01.233506 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97daf6be77646f1cd1c0146c746fbff8117a7f45eb09f9173db35e586e557a88\": container with ID starting with 97daf6be77646f1cd1c0146c746fbff8117a7f45eb09f9173db35e586e557a88 not found: ID does not exist" containerID="97daf6be77646f1cd1c0146c746fbff8117a7f45eb09f9173db35e586e557a88" Jul 16 11:41:01.233587 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:01.233539 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97daf6be77646f1cd1c0146c746fbff8117a7f45eb09f9173db35e586e557a88"} err="failed to get container status \"97daf6be77646f1cd1c0146c746fbff8117a7f45eb09f9173db35e586e557a88\": rpc error: code = NotFound desc = could not find container \"97daf6be77646f1cd1c0146c746fbff8117a7f45eb09f9173db35e586e557a88\": container with ID starting with 97daf6be77646f1cd1c0146c746fbff8117a7f45eb09f9173db35e586e557a88 not found: ID does not exist" Jul 16 11:41:01.247321 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:01.247298 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f"] Jul 16 11:41:01.251377 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:01.251357 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a0660d-56f9659ff5-wh74f"] Jul 16 11:41:02.650342 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:02.650301 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5fb7618-f914-4c9d-941b-b0d8cbcac611" path="/var/lib/kubelet/pods/e5fb7618-f914-4c9d-941b-b0d8cbcac611/volumes" Jul 16 11:41:07.843352 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:07.843258 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9"] Jul 16 11:41:07.843813 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:07.843511 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9" podUID="bfb53b80-5e25-4086-9030-17ca31ef26cf" containerName="maas-api" containerID="cri-o://45c8dcb123f268ab0c680e74cfec6f6baf3c5a2b8cf9e39a9357e7f874e2906d" gracePeriod=30 Jul 16 11:41:08.095799 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:08.095739 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9" Jul 16 11:41:08.140746 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:08.140721 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfb53b80-5e25-4086-9030-17ca31ef26cf-maas-api-tls\") pod \"bfb53b80-5e25-4086-9030-17ca31ef26cf\" (UID: \"bfb53b80-5e25-4086-9030-17ca31ef26cf\") " Jul 16 11:41:08.140862 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:08.140760 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfb53b80-5e25-4086-9030-17ca31ef26cf-openshift-service-ca\") pod \"bfb53b80-5e25-4086-9030-17ca31ef26cf\" (UID: \"bfb53b80-5e25-4086-9030-17ca31ef26cf\") " Jul 16 11:41:08.140862 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:08.140847 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkxlp\" (UniqueName: \"kubernetes.io/projected/bfb53b80-5e25-4086-9030-17ca31ef26cf-kube-api-access-wkxlp\") pod \"bfb53b80-5e25-4086-9030-17ca31ef26cf\" (UID: \"bfb53b80-5e25-4086-9030-17ca31ef26cf\") " Jul 16 11:41:08.141187 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:08.141152 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfb53b80-5e25-4086-9030-17ca31ef26cf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bfb53b80-5e25-4086-9030-17ca31ef26cf" (UID: "bfb53b80-5e25-4086-9030-17ca31ef26cf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 11:41:08.142863 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:08.142840 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfb53b80-5e25-4086-9030-17ca31ef26cf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bfb53b80-5e25-4086-9030-17ca31ef26cf" (UID: "bfb53b80-5e25-4086-9030-17ca31ef26cf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 11:41:08.142992 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:08.142972 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfb53b80-5e25-4086-9030-17ca31ef26cf-kube-api-access-wkxlp" (OuterVolumeSpecName: "kube-api-access-wkxlp") pod "bfb53b80-5e25-4086-9030-17ca31ef26cf" (UID: "bfb53b80-5e25-4086-9030-17ca31ef26cf"). InnerVolumeSpecName "kube-api-access-wkxlp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 11:41:08.242226 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:08.242203 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkxlp\" (UniqueName: \"kubernetes.io/projected/bfb53b80-5e25-4086-9030-17ca31ef26cf-kube-api-access-wkxlp\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:41:08.242226 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:08.242223 2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfb53b80-5e25-4086-9030-17ca31ef26cf-maas-api-tls\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:41:08.242348 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:08.242233 2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfb53b80-5e25-4086-9030-17ca31ef26cf-openshift-service-ca\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:41:08.256083 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:08.256056 2559 generic.go:356] "Generic (PLEG): container finished" podID="bfb53b80-5e25-4086-9030-17ca31ef26cf" containerID="45c8dcb123f268ab0c680e74cfec6f6baf3c5a2b8cf9e39a9357e7f874e2906d" exitCode=0 Jul 16 11:41:08.256175 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:08.256105 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9" Jul 16 11:41:08.256175 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:08.256145 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9" event={"ID":"bfb53b80-5e25-4086-9030-17ca31ef26cf","Type":"ContainerDied","Data":"45c8dcb123f268ab0c680e74cfec6f6baf3c5a2b8cf9e39a9357e7f874e2906d"} Jul 16 11:41:08.256287 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:08.256209 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9" event={"ID":"bfb53b80-5e25-4086-9030-17ca31ef26cf","Type":"ContainerDied","Data":"98cdd8bc5254f12edea9e2a70bd149d255c9e6b414b0b684b20a07ea26073905"} Jul 16 11:41:08.256287 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:08.256241 2559 scope.go:117] "RemoveContainer" containerID="45c8dcb123f268ab0c680e74cfec6f6baf3c5a2b8cf9e39a9357e7f874e2906d" Jul 16 11:41:08.264789 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:08.264771 2559 scope.go:117] "RemoveContainer" containerID="45c8dcb123f268ab0c680e74cfec6f6baf3c5a2b8cf9e39a9357e7f874e2906d" Jul 16 11:41:08.265028 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:41:08.265011 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45c8dcb123f268ab0c680e74cfec6f6baf3c5a2b8cf9e39a9357e7f874e2906d\": container with ID starting with 45c8dcb123f268ab0c680e74cfec6f6baf3c5a2b8cf9e39a9357e7f874e2906d not found: ID does not exist" containerID="45c8dcb123f268ab0c680e74cfec6f6baf3c5a2b8cf9e39a9357e7f874e2906d" Jul 16 11:41:08.265071 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:08.265036 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45c8dcb123f268ab0c680e74cfec6f6baf3c5a2b8cf9e39a9357e7f874e2906d"} err="failed to get container status \"45c8dcb123f268ab0c680e74cfec6f6baf3c5a2b8cf9e39a9357e7f874e2906d\": rpc error: code = NotFound desc = could not find container \"45c8dcb123f268ab0c680e74cfec6f6baf3c5a2b8cf9e39a9357e7f874e2906d\": container with ID starting with 45c8dcb123f268ab0c680e74cfec6f6baf3c5a2b8cf9e39a9357e7f874e2906d not found: ID does not exist" Jul 16 11:41:08.276485 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:08.276465 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9"] Jul 16 11:41:08.280383 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:08.280362 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ca07b2-575f5c97fb-fcsj9"] Jul 16 11:41:08.650734 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:08.650705 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfb53b80-5e25-4086-9030-17ca31ef26cf" path="/var/lib/kubelet/pods/bfb53b80-5e25-4086-9030-17ca31ef26cf/volumes" Jul 16 11:41:17.924307 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:17.924274 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-959ed9-5b5f4f7c5b-b9jcf"] Jul 16 11:41:17.924796 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:17.924614 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfb53b80-5e25-4086-9030-17ca31ef26cf" containerName="maas-api" Jul 16 11:41:17.924796 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:17.924644 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfb53b80-5e25-4086-9030-17ca31ef26cf" containerName="maas-api" Jul 16 11:41:17.924796 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:17.924665 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5fb7618-f914-4c9d-941b-b0d8cbcac611" containerName="maas-api" Jul 16 11:41:17.924796 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:17.924670 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5fb7618-f914-4c9d-941b-b0d8cbcac611" containerName="maas-api" Jul 16 11:41:17.924796 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:17.924733 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5fb7618-f914-4c9d-941b-b0d8cbcac611" containerName="maas-api" Jul 16 11:41:17.924796 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:17.924742 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfb53b80-5e25-4086-9030-17ca31ef26cf" containerName="maas-api" Jul 16 11:41:17.933751 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:17.933725 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-959ed9-5b5f4f7c5b-b9jcf" Jul 16 11:41:17.936332 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:17.936304 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kt2rk\"" Jul 16 11:41:17.936495 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:17.936471 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 16 11:41:17.936942 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:17.936921 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 16 11:41:17.937046 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:17.936951 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-959ed9-serving-cert\"" Jul 16 11:41:17.945179 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:17.945155 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-959ed9-5b5f4f7c5b-b9jcf"] Jul 16 11:41:18.018412 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:18.018390 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d407272a-8cd5-4e03-9766-75084f87644b-openshift-service-ca\") pod \"maas-api-e2e-api-a-959ed9-5b5f4f7c5b-b9jcf\" (UID: \"d407272a-8cd5-4e03-9766-75084f87644b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-959ed9-5b5f4f7c5b-b9jcf" Jul 16 11:41:18.018519 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:18.018426 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk8b8\" (UniqueName: \"kubernetes.io/projected/d407272a-8cd5-4e03-9766-75084f87644b-kube-api-access-wk8b8\") pod \"maas-api-e2e-api-a-959ed9-5b5f4f7c5b-b9jcf\" (UID: \"d407272a-8cd5-4e03-9766-75084f87644b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-959ed9-5b5f4f7c5b-b9jcf" Jul 16 11:41:18.018519 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:18.018485 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d407272a-8cd5-4e03-9766-75084f87644b-maas-api-tls\") pod \"maas-api-e2e-api-a-959ed9-5b5f4f7c5b-b9jcf\" (UID: \"d407272a-8cd5-4e03-9766-75084f87644b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-959ed9-5b5f4f7c5b-b9jcf" Jul 16 11:41:18.119750 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:18.119721 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk8b8\" (UniqueName: \"kubernetes.io/projected/d407272a-8cd5-4e03-9766-75084f87644b-kube-api-access-wk8b8\") pod \"maas-api-e2e-api-a-959ed9-5b5f4f7c5b-b9jcf\" (UID: \"d407272a-8cd5-4e03-9766-75084f87644b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-959ed9-5b5f4f7c5b-b9jcf" Jul 16 11:41:18.119875 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:18.119858 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d407272a-8cd5-4e03-9766-75084f87644b-maas-api-tls\") pod \"maas-api-e2e-api-a-959ed9-5b5f4f7c5b-b9jcf\" (UID: \"d407272a-8cd5-4e03-9766-75084f87644b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-959ed9-5b5f4f7c5b-b9jcf" Jul 16 11:41:18.119935 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:18.119908 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d407272a-8cd5-4e03-9766-75084f87644b-openshift-service-ca\") pod \"maas-api-e2e-api-a-959ed9-5b5f4f7c5b-b9jcf\" (UID: \"d407272a-8cd5-4e03-9766-75084f87644b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-959ed9-5b5f4f7c5b-b9jcf" Jul 16 11:41:18.120904 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:18.120882 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d407272a-8cd5-4e03-9766-75084f87644b-openshift-service-ca\") pod \"maas-api-e2e-api-a-959ed9-5b5f4f7c5b-b9jcf\" (UID: \"d407272a-8cd5-4e03-9766-75084f87644b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-959ed9-5b5f4f7c5b-b9jcf" Jul 16 11:41:18.122378 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:18.122361 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d407272a-8cd5-4e03-9766-75084f87644b-maas-api-tls\") pod \"maas-api-e2e-api-a-959ed9-5b5f4f7c5b-b9jcf\" (UID: \"d407272a-8cd5-4e03-9766-75084f87644b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-959ed9-5b5f4f7c5b-b9jcf" Jul 16 11:41:18.130947 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:18.130928 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk8b8\" (UniqueName: \"kubernetes.io/projected/d407272a-8cd5-4e03-9766-75084f87644b-kube-api-access-wk8b8\") pod \"maas-api-e2e-api-a-959ed9-5b5f4f7c5b-b9jcf\" (UID: \"d407272a-8cd5-4e03-9766-75084f87644b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-959ed9-5b5f4f7c5b-b9jcf" Jul 16 11:41:18.244537 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:18.244486 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-959ed9-5b5f4f7c5b-b9jcf" Jul 16 11:41:18.377677 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:18.377653 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-959ed9-5b5f4f7c5b-b9jcf"] Jul 16 11:41:18.379981 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:41:18.379947 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd407272a_8cd5_4e03_9766_75084f87644b.slice/crio-42f384dbd42678953fb377b8d53e983fa3bcdd96959fc558efd51dc3d2e6c795 WatchSource:0}: Error finding container 42f384dbd42678953fb377b8d53e983fa3bcdd96959fc558efd51dc3d2e6c795: Status 404 returned error can't find the container with id 42f384dbd42678953fb377b8d53e983fa3bcdd96959fc558efd51dc3d2e6c795 Jul 16 11:41:18.381258 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:18.381237 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 11:41:19.316243 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:19.316212 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-959ed9-5b5f4f7c5b-b9jcf" event={"ID":"d407272a-8cd5-4e03-9766-75084f87644b","Type":"ContainerStarted","Data":"e0c678b6c0a8dd2e396188f4c61e66581de6246e85d043f083140275a1c3d190"} Jul 16 11:41:19.316589 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:19.316260 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-959ed9-5b5f4f7c5b-b9jcf" event={"ID":"d407272a-8cd5-4e03-9766-75084f87644b","Type":"ContainerStarted","Data":"42f384dbd42678953fb377b8d53e983fa3bcdd96959fc558efd51dc3d2e6c795"} Jul 16 11:41:19.316589 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:19.316316 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-959ed9-5b5f4f7c5b-b9jcf" Jul 16 11:41:19.346392 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:19.346345 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-959ed9-5b5f4f7c5b-b9jcf" podStartSLOduration=1.836959681 podStartE2EDuration="2.346330778s" totalImagesPullingTime="509.371097ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:41:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:41:19.345692412 +0000 UTC m=+1987.097950226" watchObservedRunningTime="2026-07-16 11:41:19.346330778 +0000 UTC m=+1987.098588573" Jul 16 11:41:25.327820 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:25.327787 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-959ed9-5b5f4f7c5b-b9jcf" Jul 16 11:41:25.839054 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:25.839021 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e7dc57-54b66788bf-n2765"] Jul 16 11:41:25.842595 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:25.842571 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e7dc57-54b66788bf-n2765" Jul 16 11:41:25.844659 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:25.844618 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-e7dc57-serving-cert\"" Jul 16 11:41:25.852674 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:25.852652 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e7dc57-54b66788bf-n2765"] Jul 16 11:41:25.982025 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:25.981993 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06bad591-4240-483e-872e-62626c8326e2-openshift-service-ca\") pod \"maas-api-e2e-api-b-e7dc57-54b66788bf-n2765\" (UID: \"06bad591-4240-483e-872e-62626c8326e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e7dc57-54b66788bf-n2765" Jul 16 11:41:25.982157 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:25.982034 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5mj8\" (UniqueName: \"kubernetes.io/projected/06bad591-4240-483e-872e-62626c8326e2-kube-api-access-k5mj8\") pod \"maas-api-e2e-api-b-e7dc57-54b66788bf-n2765\" (UID: \"06bad591-4240-483e-872e-62626c8326e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e7dc57-54b66788bf-n2765" Jul 16 11:41:25.982157 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:25.982132 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06bad591-4240-483e-872e-62626c8326e2-maas-api-tls\") pod \"maas-api-e2e-api-b-e7dc57-54b66788bf-n2765\" (UID: \"06bad591-4240-483e-872e-62626c8326e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e7dc57-54b66788bf-n2765" Jul 16 11:41:26.083080 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:26.083046 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06bad591-4240-483e-872e-62626c8326e2-maas-api-tls\") pod \"maas-api-e2e-api-b-e7dc57-54b66788bf-n2765\" (UID: \"06bad591-4240-483e-872e-62626c8326e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e7dc57-54b66788bf-n2765" Jul 16 11:41:26.083206 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:26.083093 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06bad591-4240-483e-872e-62626c8326e2-openshift-service-ca\") pod \"maas-api-e2e-api-b-e7dc57-54b66788bf-n2765\" (UID: \"06bad591-4240-483e-872e-62626c8326e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e7dc57-54b66788bf-n2765" Jul 16 11:41:26.083206 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:26.083118 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5mj8\" (UniqueName: \"kubernetes.io/projected/06bad591-4240-483e-872e-62626c8326e2-kube-api-access-k5mj8\") pod \"maas-api-e2e-api-b-e7dc57-54b66788bf-n2765\" (UID: \"06bad591-4240-483e-872e-62626c8326e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e7dc57-54b66788bf-n2765" Jul 16 11:41:26.083274 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:41:26.083205 2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-e7dc57-serving-cert: secret "maas-api-e2e-api-b-e7dc57-serving-cert" not found Jul 16 11:41:26.083326 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:41:26.083289 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06bad591-4240-483e-872e-62626c8326e2-maas-api-tls podName:06bad591-4240-483e-872e-62626c8326e2 nodeName:}" failed. No retries permitted until 2026-07-16 11:41:26.58326708 +0000 UTC m=+1994.335524873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/06bad591-4240-483e-872e-62626c8326e2-maas-api-tls") pod "maas-api-e2e-api-b-e7dc57-54b66788bf-n2765" (UID: "06bad591-4240-483e-872e-62626c8326e2") : secret "maas-api-e2e-api-b-e7dc57-serving-cert" not found Jul 16 11:41:26.083768 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:26.083751 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06bad591-4240-483e-872e-62626c8326e2-openshift-service-ca\") pod \"maas-api-e2e-api-b-e7dc57-54b66788bf-n2765\" (UID: \"06bad591-4240-483e-872e-62626c8326e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e7dc57-54b66788bf-n2765" Jul 16 11:41:26.096850 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:26.096791 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5mj8\" (UniqueName: \"kubernetes.io/projected/06bad591-4240-483e-872e-62626c8326e2-kube-api-access-k5mj8\") pod \"maas-api-e2e-api-b-e7dc57-54b66788bf-n2765\" (UID: \"06bad591-4240-483e-872e-62626c8326e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e7dc57-54b66788bf-n2765" Jul 16 11:41:26.587409 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:26.587378 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06bad591-4240-483e-872e-62626c8326e2-maas-api-tls\") pod \"maas-api-e2e-api-b-e7dc57-54b66788bf-n2765\" (UID: \"06bad591-4240-483e-872e-62626c8326e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e7dc57-54b66788bf-n2765" Jul 16 11:41:26.589732 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:26.589706 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06bad591-4240-483e-872e-62626c8326e2-maas-api-tls\") pod \"maas-api-e2e-api-b-e7dc57-54b66788bf-n2765\" (UID: \"06bad591-4240-483e-872e-62626c8326e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e7dc57-54b66788bf-n2765" Jul 16 11:41:26.754553 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:26.754529 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e7dc57-54b66788bf-n2765" Jul 16 11:41:26.885062 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:26.885028 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e7dc57-54b66788bf-n2765"] Jul 16 11:41:26.887667 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:41:26.887617 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06bad591_4240_483e_872e_62626c8326e2.slice/crio-5acb2127990ec32bcd5957e4f33412754d80489c503902f5ecce87da5a70494b WatchSource:0}: Error finding container 5acb2127990ec32bcd5957e4f33412754d80489c503902f5ecce87da5a70494b: Status 404 returned error can't find the container with id 5acb2127990ec32bcd5957e4f33412754d80489c503902f5ecce87da5a70494b Jul 16 11:41:27.357557 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:27.357523 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e7dc57-54b66788bf-n2765" event={"ID":"06bad591-4240-483e-872e-62626c8326e2","Type":"ContainerStarted","Data":"5acb2127990ec32bcd5957e4f33412754d80489c503902f5ecce87da5a70494b"} Jul 16 11:41:28.363746 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:28.363708 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e7dc57-54b66788bf-n2765" event={"ID":"06bad591-4240-483e-872e-62626c8326e2","Type":"ContainerStarted","Data":"8ed18c7a9d3a9c199a60f7d47af588fdd3b5e22e618a757593723721c472ee2a"} Jul 16 11:41:28.364097 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:28.363834 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e7dc57-54b66788bf-n2765" Jul 16 11:41:28.381495 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:28.381454 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e7dc57-54b66788bf-n2765" podStartSLOduration=2.8171559090000002 podStartE2EDuration="3.38144189s" totalImagesPullingTime="564.285981ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:41:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:41:28.379759715 +0000 UTC m=+1996.132017529" watchObservedRunningTime="2026-07-16 11:41:28.38144189 +0000 UTC m=+1996.133699684" Jul 16 11:41:34.373678 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:34.373623 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e7dc57-54b66788bf-n2765" Jul 16 11:41:44.498738 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:44.498705 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-959ed9-5b5f4f7c5b-b9jcf"] Jul 16 11:41:44.499184 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:44.498955 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-959ed9-5b5f4f7c5b-b9jcf" podUID="d407272a-8cd5-4e03-9766-75084f87644b" containerName="maas-api" containerID="cri-o://e0c678b6c0a8dd2e396188f4c61e66581de6246e85d043f083140275a1c3d190" gracePeriod=30 Jul 16 11:41:44.751464 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:44.751412 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-959ed9-5b5f4f7c5b-b9jcf" Jul 16 11:41:44.932760 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:44.932732 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wk8b8\" (UniqueName: \"kubernetes.io/projected/d407272a-8cd5-4e03-9766-75084f87644b-kube-api-access-wk8b8\") pod \"d407272a-8cd5-4e03-9766-75084f87644b\" (UID: \"d407272a-8cd5-4e03-9766-75084f87644b\") " Jul 16 11:41:44.932899 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:44.932780 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d407272a-8cd5-4e03-9766-75084f87644b-openshift-service-ca\") pod \"d407272a-8cd5-4e03-9766-75084f87644b\" (UID: \"d407272a-8cd5-4e03-9766-75084f87644b\") " Jul 16 11:41:44.932899 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:44.932858 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d407272a-8cd5-4e03-9766-75084f87644b-maas-api-tls\") pod \"d407272a-8cd5-4e03-9766-75084f87644b\" (UID: \"d407272a-8cd5-4e03-9766-75084f87644b\") " Jul 16 11:41:44.933174 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:44.933144 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d407272a-8cd5-4e03-9766-75084f87644b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d407272a-8cd5-4e03-9766-75084f87644b" (UID: "d407272a-8cd5-4e03-9766-75084f87644b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 11:41:44.934883 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:44.934854 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d407272a-8cd5-4e03-9766-75084f87644b-kube-api-access-wk8b8" (OuterVolumeSpecName: "kube-api-access-wk8b8") pod "d407272a-8cd5-4e03-9766-75084f87644b" (UID: "d407272a-8cd5-4e03-9766-75084f87644b"). InnerVolumeSpecName "kube-api-access-wk8b8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 11:41:44.934976 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:44.934906 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d407272a-8cd5-4e03-9766-75084f87644b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d407272a-8cd5-4e03-9766-75084f87644b" (UID: "d407272a-8cd5-4e03-9766-75084f87644b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 11:41:45.033693 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:45.033601 2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d407272a-8cd5-4e03-9766-75084f87644b-maas-api-tls\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:41:45.033693 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:45.033655 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wk8b8\" (UniqueName: \"kubernetes.io/projected/d407272a-8cd5-4e03-9766-75084f87644b-kube-api-access-wk8b8\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:41:45.033693 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:45.033672 2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d407272a-8cd5-4e03-9766-75084f87644b-openshift-service-ca\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:41:45.442694 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:45.442656 2559 generic.go:356] "Generic (PLEG): container finished" podID="d407272a-8cd5-4e03-9766-75084f87644b" containerID="e0c678b6c0a8dd2e396188f4c61e66581de6246e85d043f083140275a1c3d190" exitCode=0 Jul 16 11:41:45.442694 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:45.442687 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-959ed9-5b5f4f7c5b-b9jcf" Jul 16 11:41:45.442931 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:45.442735 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-959ed9-5b5f4f7c5b-b9jcf" event={"ID":"d407272a-8cd5-4e03-9766-75084f87644b","Type":"ContainerDied","Data":"e0c678b6c0a8dd2e396188f4c61e66581de6246e85d043f083140275a1c3d190"} Jul 16 11:41:45.442931 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:45.442791 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-959ed9-5b5f4f7c5b-b9jcf" event={"ID":"d407272a-8cd5-4e03-9766-75084f87644b","Type":"ContainerDied","Data":"42f384dbd42678953fb377b8d53e983fa3bcdd96959fc558efd51dc3d2e6c795"} Jul 16 11:41:45.442931 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:45.442815 2559 scope.go:117] "RemoveContainer" containerID="e0c678b6c0a8dd2e396188f4c61e66581de6246e85d043f083140275a1c3d190" Jul 16 11:41:45.451822 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:45.451805 2559 scope.go:117] "RemoveContainer" containerID="e0c678b6c0a8dd2e396188f4c61e66581de6246e85d043f083140275a1c3d190" Jul 16 11:41:45.452071 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:41:45.452051 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0c678b6c0a8dd2e396188f4c61e66581de6246e85d043f083140275a1c3d190\": container with ID starting with e0c678b6c0a8dd2e396188f4c61e66581de6246e85d043f083140275a1c3d190 not found: ID does not exist" containerID="e0c678b6c0a8dd2e396188f4c61e66581de6246e85d043f083140275a1c3d190" Jul 16 11:41:45.452132 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:45.452079 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0c678b6c0a8dd2e396188f4c61e66581de6246e85d043f083140275a1c3d190"} err="failed to get container status \"e0c678b6c0a8dd2e396188f4c61e66581de6246e85d043f083140275a1c3d190\": rpc error: code = NotFound desc = could not find container \"e0c678b6c0a8dd2e396188f4c61e66581de6246e85d043f083140275a1c3d190\": container with ID starting with e0c678b6c0a8dd2e396188f4c61e66581de6246e85d043f083140275a1c3d190 not found: ID does not exist" Jul 16 11:41:45.463419 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:45.463398 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-959ed9-5b5f4f7c5b-b9jcf"] Jul 16 11:41:45.467684 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:45.467661 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-959ed9-5b5f4f7c5b-b9jcf"] Jul 16 11:41:46.651081 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:46.651047 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d407272a-8cd5-4e03-9766-75084f87644b" path="/var/lib/kubelet/pods/d407272a-8cd5-4e03-9766-75084f87644b/volumes" Jul 16 11:41:57.858842 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:57.858810 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e7dc57-54b66788bf-n2765"] Jul 16 11:41:57.859297 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:57.858996 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e7dc57-54b66788bf-n2765" podUID="06bad591-4240-483e-872e-62626c8326e2" containerName="maas-api" containerID="cri-o://8ed18c7a9d3a9c199a60f7d47af588fdd3b5e22e618a757593723721c472ee2a" gracePeriod=30 Jul 16 11:41:58.105005 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:58.104978 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e7dc57-54b66788bf-n2765" Jul 16 11:41:58.234719 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:58.234692 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06bad591-4240-483e-872e-62626c8326e2-openshift-service-ca\") pod \"06bad591-4240-483e-872e-62626c8326e2\" (UID: \"06bad591-4240-483e-872e-62626c8326e2\") " Jul 16 11:41:58.234860 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:58.234732 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06bad591-4240-483e-872e-62626c8326e2-maas-api-tls\") pod \"06bad591-4240-483e-872e-62626c8326e2\" (UID: \"06bad591-4240-483e-872e-62626c8326e2\") " Jul 16 11:41:58.234860 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:58.234769 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5mj8\" (UniqueName: \"kubernetes.io/projected/06bad591-4240-483e-872e-62626c8326e2-kube-api-access-k5mj8\") pod \"06bad591-4240-483e-872e-62626c8326e2\" (UID: \"06bad591-4240-483e-872e-62626c8326e2\") " Jul 16 11:41:58.235103 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:58.235078 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06bad591-4240-483e-872e-62626c8326e2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "06bad591-4240-483e-872e-62626c8326e2" (UID: "06bad591-4240-483e-872e-62626c8326e2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 11:41:58.236771 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:58.236750 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06bad591-4240-483e-872e-62626c8326e2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "06bad591-4240-483e-872e-62626c8326e2" (UID: "06bad591-4240-483e-872e-62626c8326e2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 11:41:58.236836 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:58.236812 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06bad591-4240-483e-872e-62626c8326e2-kube-api-access-k5mj8" (OuterVolumeSpecName: "kube-api-access-k5mj8") pod "06bad591-4240-483e-872e-62626c8326e2" (UID: "06bad591-4240-483e-872e-62626c8326e2"). InnerVolumeSpecName "kube-api-access-k5mj8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 11:41:58.336104 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:58.336079 2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06bad591-4240-483e-872e-62626c8326e2-openshift-service-ca\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:41:58.336104 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:58.336104 2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06bad591-4240-483e-872e-62626c8326e2-maas-api-tls\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:41:58.336280 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:58.336115 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5mj8\" (UniqueName: \"kubernetes.io/projected/06bad591-4240-483e-872e-62626c8326e2-kube-api-access-k5mj8\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:41:58.505251 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:58.505189 2559 generic.go:356] "Generic (PLEG): container finished" podID="06bad591-4240-483e-872e-62626c8326e2" containerID="8ed18c7a9d3a9c199a60f7d47af588fdd3b5e22e618a757593723721c472ee2a" exitCode=0 Jul 16 11:41:58.505251 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:58.505219 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e7dc57-54b66788bf-n2765" event={"ID":"06bad591-4240-483e-872e-62626c8326e2","Type":"ContainerDied","Data":"8ed18c7a9d3a9c199a60f7d47af588fdd3b5e22e618a757593723721c472ee2a"} Jul 16 11:41:58.505251 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:58.505240 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e7dc57-54b66788bf-n2765" Jul 16 11:41:58.505455 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:58.505255 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e7dc57-54b66788bf-n2765" event={"ID":"06bad591-4240-483e-872e-62626c8326e2","Type":"ContainerDied","Data":"5acb2127990ec32bcd5957e4f33412754d80489c503902f5ecce87da5a70494b"} Jul 16 11:41:58.505455 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:58.505275 2559 scope.go:117] "RemoveContainer" containerID="8ed18c7a9d3a9c199a60f7d47af588fdd3b5e22e618a757593723721c472ee2a" Jul 16 11:41:58.514348 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:58.514331 2559 scope.go:117] "RemoveContainer" containerID="8ed18c7a9d3a9c199a60f7d47af588fdd3b5e22e618a757593723721c472ee2a" Jul 16 11:41:58.514570 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:41:58.514556 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ed18c7a9d3a9c199a60f7d47af588fdd3b5e22e618a757593723721c472ee2a\": container with ID starting with 8ed18c7a9d3a9c199a60f7d47af588fdd3b5e22e618a757593723721c472ee2a not found: ID does not exist" containerID="8ed18c7a9d3a9c199a60f7d47af588fdd3b5e22e618a757593723721c472ee2a" Jul 16 11:41:58.514623 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:58.514577 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ed18c7a9d3a9c199a60f7d47af588fdd3b5e22e618a757593723721c472ee2a"} err="failed to get container status \"8ed18c7a9d3a9c199a60f7d47af588fdd3b5e22e618a757593723721c472ee2a\": rpc error: code = NotFound desc = could not find container \"8ed18c7a9d3a9c199a60f7d47af588fdd3b5e22e618a757593723721c472ee2a\": container with ID starting with 8ed18c7a9d3a9c199a60f7d47af588fdd3b5e22e618a757593723721c472ee2a not found: ID does not exist" Jul 16 11:41:58.525093 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:58.525072 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e7dc57-54b66788bf-n2765"] Jul 16 11:41:58.530646 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:58.530610 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e7dc57-54b66788bf-n2765"] Jul 16 11:41:58.650615 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:41:58.650583 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06bad591-4240-483e-872e-62626c8326e2" path="/var/lib/kubelet/pods/06bad591-4240-483e-872e-62626c8326e2/volumes" Jul 16 11:42:08.120233 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:08.120203 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j"] Jul 16 11:42:08.120693 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:08.120512 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d407272a-8cd5-4e03-9766-75084f87644b" containerName="maas-api" Jul 16 11:42:08.120693 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:08.120523 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d407272a-8cd5-4e03-9766-75084f87644b" containerName="maas-api" Jul 16 11:42:08.120693 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:08.120540 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06bad591-4240-483e-872e-62626c8326e2" containerName="maas-api" Jul 16 11:42:08.120693 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:08.120545 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="06bad591-4240-483e-872e-62626c8326e2" containerName="maas-api" Jul 16 11:42:08.120693 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:08.120603 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d407272a-8cd5-4e03-9766-75084f87644b" containerName="maas-api" Jul 16 11:42:08.120693 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:08.120611 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="06bad591-4240-483e-872e-62626c8326e2" containerName="maas-api" Jul 16 11:42:08.124739 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:08.124722 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j" Jul 16 11:42:08.126849 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:08.126829 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 16 11:42:08.127025 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:08.126856 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 16 11:42:08.127510 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:08.127489 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kt2rk\"" Jul 16 11:42:08.127580 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:08.127498 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-bfa604-serving-cert\"" Jul 16 11:42:08.133069 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:08.133048 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j"] Jul 16 11:42:08.202650 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:08.202609 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90c4a60e-566f-450b-bcd8-dbe0de56f36a-maas-api-tls\") pod \"maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j\" (UID: \"90c4a60e-566f-450b-bcd8-dbe0de56f36a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j" Jul 16 11:42:08.202807 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:08.202655 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90c4a60e-566f-450b-bcd8-dbe0de56f36a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j\" (UID: \"90c4a60e-566f-450b-bcd8-dbe0de56f36a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j" Jul 16 11:42:08.202807 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:08.202740 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mxnr\" (UniqueName: \"kubernetes.io/projected/90c4a60e-566f-450b-bcd8-dbe0de56f36a-kube-api-access-4mxnr\") pod \"maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j\" (UID: \"90c4a60e-566f-450b-bcd8-dbe0de56f36a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j" Jul 16 11:42:08.303825 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:08.303790 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mxnr\" (UniqueName: \"kubernetes.io/projected/90c4a60e-566f-450b-bcd8-dbe0de56f36a-kube-api-access-4mxnr\") pod \"maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j\" (UID: \"90c4a60e-566f-450b-bcd8-dbe0de56f36a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j" Jul 16 11:42:08.303982 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:08.303893 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90c4a60e-566f-450b-bcd8-dbe0de56f36a-maas-api-tls\") pod \"maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j\" (UID: \"90c4a60e-566f-450b-bcd8-dbe0de56f36a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j" Jul 16 11:42:08.303982 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:08.303921 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90c4a60e-566f-450b-bcd8-dbe0de56f36a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j\" (UID: \"90c4a60e-566f-450b-bcd8-dbe0de56f36a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j" Jul 16 11:42:08.304117 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:42:08.304023 2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-bfa604-serving-cert: secret "maas-api-e2e-shared-a-bfa604-serving-cert" not found Jul 16 11:42:08.304117 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:42:08.304090 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90c4a60e-566f-450b-bcd8-dbe0de56f36a-maas-api-tls podName:90c4a60e-566f-450b-bcd8-dbe0de56f36a nodeName:}" failed. No retries permitted until 2026-07-16 11:42:08.80407559 +0000 UTC m=+2036.556333362 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/90c4a60e-566f-450b-bcd8-dbe0de56f36a-maas-api-tls") pod "maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j" (UID: "90c4a60e-566f-450b-bcd8-dbe0de56f36a") : secret "maas-api-e2e-shared-a-bfa604-serving-cert" not found Jul 16 11:42:08.304558 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:08.304535 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90c4a60e-566f-450b-bcd8-dbe0de56f36a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j\" (UID: \"90c4a60e-566f-450b-bcd8-dbe0de56f36a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j" Jul 16 11:42:08.315293 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:08.315266 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mxnr\" (UniqueName: \"kubernetes.io/projected/90c4a60e-566f-450b-bcd8-dbe0de56f36a-kube-api-access-4mxnr\") pod \"maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j\" (UID: \"90c4a60e-566f-450b-bcd8-dbe0de56f36a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j" Jul 16 11:42:08.807392 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:08.807356 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90c4a60e-566f-450b-bcd8-dbe0de56f36a-maas-api-tls\") pod \"maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j\" (UID: \"90c4a60e-566f-450b-bcd8-dbe0de56f36a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j" Jul 16 11:42:08.809860 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:08.809836 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90c4a60e-566f-450b-bcd8-dbe0de56f36a-maas-api-tls\") pod \"maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j\" (UID: \"90c4a60e-566f-450b-bcd8-dbe0de56f36a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j" Jul 16 11:42:09.035461 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:09.035427 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j" Jul 16 11:42:09.163971 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:09.163949 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j"] Jul 16 11:42:09.165826 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:42:09.165792 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90c4a60e_566f_450b_bcd8_dbe0de56f36a.slice/crio-8e73237ff2444a056863c65245acb3e28587503aa7f45bdeb416b11f53d378a8 WatchSource:0}: Error finding container 8e73237ff2444a056863c65245acb3e28587503aa7f45bdeb416b11f53d378a8: Status 404 returned error can't find the container with id 8e73237ff2444a056863c65245acb3e28587503aa7f45bdeb416b11f53d378a8 Jul 16 11:42:09.554158 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:09.554131 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j" event={"ID":"90c4a60e-566f-450b-bcd8-dbe0de56f36a","Type":"ContainerStarted","Data":"8e73237ff2444a056863c65245acb3e28587503aa7f45bdeb416b11f53d378a8"} Jul 16 11:42:10.560120 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:10.560086 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j" event={"ID":"90c4a60e-566f-450b-bcd8-dbe0de56f36a","Type":"ContainerStarted","Data":"625eb76f0b3ad9cd0829b7eb4694e58448fd26698c247fc1ec5be1c40fa6d0ad"} Jul 16 11:42:10.560497 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:10.560212 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j" Jul 16 11:42:10.580160 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:10.580120 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j" podStartSLOduration=2.238832969 podStartE2EDuration="2.580106348s" totalImagesPullingTime="341.273379ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:42:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:42:10.578873572 +0000 UTC m=+2038.331131368" watchObservedRunningTime="2026-07-16 11:42:10.580106348 +0000 UTC m=+2038.332364144" Jul 16 11:42:12.782164 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:12.782134 2559 scope.go:117] "RemoveContainer" containerID="0ac1760e737a76bb053f8b6d6d32ad10efaeee2baddd598f25ff2c53a496931f" Jul 16 11:42:16.262484 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:16.262445 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl"] Jul 16 11:42:16.265731 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:16.265713 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl" Jul 16 11:42:16.268603 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:16.268582 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-f05981-serving-cert\"" Jul 16 11:42:16.291804 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:16.291783 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl"] Jul 16 11:42:16.360415 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:16.360393 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fxch\" (UniqueName: \"kubernetes.io/projected/3449c886-7678-4f87-8898-455171abaaeb-kube-api-access-4fxch\") pod \"maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl\" (UID: \"3449c886-7678-4f87-8898-455171abaaeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl" Jul 16 11:42:16.360521 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:16.360446 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3449c886-7678-4f87-8898-455171abaaeb-maas-api-tls\") pod \"maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl\" (UID: \"3449c886-7678-4f87-8898-455171abaaeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl" Jul 16 11:42:16.360521 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:16.360465 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3449c886-7678-4f87-8898-455171abaaeb-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl\" (UID: \"3449c886-7678-4f87-8898-455171abaaeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl" Jul 16 11:42:16.460824 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:16.460797 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3449c886-7678-4f87-8898-455171abaaeb-maas-api-tls\") pod \"maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl\" (UID: \"3449c886-7678-4f87-8898-455171abaaeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl" Jul 16 11:42:16.460954 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:16.460840 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3449c886-7678-4f87-8898-455171abaaeb-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl\" (UID: \"3449c886-7678-4f87-8898-455171abaaeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl" Jul 16 11:42:16.460954 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:16.460928 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fxch\" (UniqueName: \"kubernetes.io/projected/3449c886-7678-4f87-8898-455171abaaeb-kube-api-access-4fxch\") pod \"maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl\" (UID: \"3449c886-7678-4f87-8898-455171abaaeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl" Jul 16 11:42:16.461071 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:42:16.460951 2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-f05981-serving-cert: secret "maas-api-e2e-shared-b-f05981-serving-cert" not found Jul 16 11:42:16.461071 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:42:16.461005 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3449c886-7678-4f87-8898-455171abaaeb-maas-api-tls podName:3449c886-7678-4f87-8898-455171abaaeb nodeName:}" failed. No retries permitted until 2026-07-16 11:42:16.960989564 +0000 UTC m=+2044.713247337 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3449c886-7678-4f87-8898-455171abaaeb-maas-api-tls") pod "maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl" (UID: "3449c886-7678-4f87-8898-455171abaaeb") : secret "maas-api-e2e-shared-b-f05981-serving-cert" not found Jul 16 11:42:16.461437 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:16.461419 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3449c886-7678-4f87-8898-455171abaaeb-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl\" (UID: \"3449c886-7678-4f87-8898-455171abaaeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl" Jul 16 11:42:16.470981 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:16.470948 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fxch\" (UniqueName: \"kubernetes.io/projected/3449c886-7678-4f87-8898-455171abaaeb-kube-api-access-4fxch\") pod \"maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl\" (UID: \"3449c886-7678-4f87-8898-455171abaaeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl" Jul 16 11:42:16.571777 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:16.571722 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j" Jul 16 11:42:16.964119 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:16.964086 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3449c886-7678-4f87-8898-455171abaaeb-maas-api-tls\") pod \"maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl\" (UID: \"3449c886-7678-4f87-8898-455171abaaeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl" Jul 16 11:42:16.964292 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:42:16.964209 2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-f05981-serving-cert: secret "maas-api-e2e-shared-b-f05981-serving-cert" not found Jul 16 11:42:16.964292 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:42:16.964270 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3449c886-7678-4f87-8898-455171abaaeb-maas-api-tls podName:3449c886-7678-4f87-8898-455171abaaeb nodeName:}" failed. No retries permitted until 2026-07-16 11:42:17.964254343 +0000 UTC m=+2045.716512116 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3449c886-7678-4f87-8898-455171abaaeb-maas-api-tls") pod "maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl" (UID: "3449c886-7678-4f87-8898-455171abaaeb") : secret "maas-api-e2e-shared-b-f05981-serving-cert" not found Jul 16 11:42:17.972667 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:17.972615 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3449c886-7678-4f87-8898-455171abaaeb-maas-api-tls\") pod \"maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl\" (UID: \"3449c886-7678-4f87-8898-455171abaaeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl" Jul 16 11:42:17.975012 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:17.974985 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3449c886-7678-4f87-8898-455171abaaeb-maas-api-tls\") pod \"maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl\" (UID: \"3449c886-7678-4f87-8898-455171abaaeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl" Jul 16 11:42:18.078594 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:18.078563 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl" Jul 16 11:42:18.209756 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:18.209725 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl"] Jul 16 11:42:18.211418 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:42:18.211392 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3449c886_7678_4f87_8898_455171abaaeb.slice/crio-20d235bfcaa9be438d88ba9d5ca4cc3abbf8a8956e00fe7d4f3633924ebb6f8c WatchSource:0}: Error finding container 20d235bfcaa9be438d88ba9d5ca4cc3abbf8a8956e00fe7d4f3633924ebb6f8c: Status 404 returned error can't find the container with id 20d235bfcaa9be438d88ba9d5ca4cc3abbf8a8956e00fe7d4f3633924ebb6f8c Jul 16 11:42:18.600567 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:18.600536 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl" event={"ID":"3449c886-7678-4f87-8898-455171abaaeb","Type":"ContainerStarted","Data":"20d235bfcaa9be438d88ba9d5ca4cc3abbf8a8956e00fe7d4f3633924ebb6f8c"} Jul 16 11:42:19.607288 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:19.607251 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl" event={"ID":"3449c886-7678-4f87-8898-455171abaaeb","Type":"ContainerStarted","Data":"690aa2f9a4937802ee9ac255d3817f8f5dab98a61d23938709e34784164163c4"} Jul 16 11:42:19.607725 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:19.607366 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl" Jul 16 11:42:19.625585 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:19.625536 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl" podStartSLOduration=3.202001527 podStartE2EDuration="3.625522728s" totalImagesPullingTime="423.521201ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:42:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:42:19.623310688 +0000 UTC m=+2047.375568483" watchObservedRunningTime="2026-07-16 11:42:19.625522728 +0000 UTC m=+2047.377780523" Jul 16 11:42:25.617188 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:42:25.617159 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl" Jul 16 11:45:00.148986 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:45:00.148953 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f05981-29736705-rcbws"] Jul 16 11:45:00.152348 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:45:00.152320 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f05981-29736705-rcbws" Jul 16 11:45:00.154057 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:45:00.154036 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736705-9bpnn"] Jul 16 11:45:00.154497 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:45:00.154480 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4mqwr\"" Jul 16 11:45:00.158024 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:45:00.157999 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736705-9bpnn" Jul 16 11:45:00.168459 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:45:00.168436 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f05981-29736705-rcbws" Jul 16 11:45:00.173824 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:45:00.173755 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f05981-29736705-rcbws"] Jul 16 11:45:00.177405 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:45:00.177383 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736705-9bpnn" Jul 16 11:45:00.182982 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:45:00.182442 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736705-9bpnn"] Jul 16 11:45:00.322979 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:45:00.322947 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f05981-29736705-rcbws"] Jul 16 11:45:00.325215 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:45:00.325181 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5f03c2b_be1d_41eb_b3cc_b856d4ea7f3c.slice/crio-2ab48a5b22a9fc93a54ffc0efce63967c432922124fc4a443bb92ee0a0fa455c WatchSource:0}: Error finding container 2ab48a5b22a9fc93a54ffc0efce63967c432922124fc4a443bb92ee0a0fa455c: Status 404 returned error can't find the container with id 2ab48a5b22a9fc93a54ffc0efce63967c432922124fc4a443bb92ee0a0fa455c Jul 16 11:45:00.335282 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:45:00.335258 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f05981-29736705-rcbws" event={"ID":"d5f03c2b-be1d-41eb-b3cc-b856d4ea7f3c","Type":"ContainerStarted","Data":"2ab48a5b22a9fc93a54ffc0efce63967c432922124fc4a443bb92ee0a0fa455c"} Jul 16 11:45:00.353582 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:45:00.353562 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736705-9bpnn"] Jul 16 11:45:00.355889 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:45:00.355857 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fb1639d_5ae5_4a45_bfa4_690d09c7ce15.slice/crio-8b66dfbc33c5836290181fd5fcceaaf300a76d939c5b7e4f24d411cca3fee854 WatchSource:0}: Error finding container 8b66dfbc33c5836290181fd5fcceaaf300a76d939c5b7e4f24d411cca3fee854: Status 404 returned error can't find the container with id 8b66dfbc33c5836290181fd5fcceaaf300a76d939c5b7e4f24d411cca3fee854 Jul 16 11:45:01.341987 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:45:01.341948 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736705-9bpnn" event={"ID":"5fb1639d-5ae5-4a45-bfa4-690d09c7ce15","Type":"ContainerStarted","Data":"8b66dfbc33c5836290181fd5fcceaaf300a76d939c5b7e4f24d411cca3fee854"} Jul 16 11:45:03.352857 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:45:03.352820 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736705-9bpnn" event={"ID":"5fb1639d-5ae5-4a45-bfa4-690d09c7ce15","Type":"ContainerStarted","Data":"6ae8934ebe48a23bc86416cbc8d67e3086df0889b243cef9f2f389d16fa33597"} Jul 16 11:45:03.354289 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:45:03.354267 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f05981-29736705-rcbws" event={"ID":"d5f03c2b-be1d-41eb-b3cc-b856d4ea7f3c","Type":"ContainerStarted","Data":"e71706b666e04a43204a5495761110442f3befe2d14a17f4d58a51c1713e57c2"} Jul 16 11:45:03.383134 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:45:03.383087 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736705-9bpnn" podStartSLOduration=1.16075284 podStartE2EDuration="3.383072761s" totalImagesPullingTime="2.222319921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:45:03.380810782 +0000 UTC m=+2211.133068577" watchObservedRunningTime="2026-07-16 11:45:03.383072761 +0000 UTC m=+2211.135330556" Jul 16 11:45:03.397583 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:45:03.397537 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f05981-29736705-rcbws" podStartSLOduration=1.140560737 podStartE2EDuration="3.397523998s" totalImagesPullingTime="2.256963261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:45:03.39730358 +0000 UTC m=+2211.149561388" watchObservedRunningTime="2026-07-16 11:45:03.397523998 +0000 UTC m=+2211.149781793" Jul 16 11:45:04.360777 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:45:04.360739 2559 generic.go:356] "Generic (PLEG): container finished" podID="d5f03c2b-be1d-41eb-b3cc-b856d4ea7f3c" containerID="e71706b666e04a43204a5495761110442f3befe2d14a17f4d58a51c1713e57c2" exitCode=0 Jul 16 11:45:04.361235 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:45:04.360829 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f05981-29736705-rcbws" event={"ID":"d5f03c2b-be1d-41eb-b3cc-b856d4ea7f3c","Type":"ContainerDied","Data":"e71706b666e04a43204a5495761110442f3befe2d14a17f4d58a51c1713e57c2"} Jul 16 11:45:04.362308 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:45:04.362281 2559 generic.go:356] "Generic (PLEG): container finished" podID="5fb1639d-5ae5-4a45-bfa4-690d09c7ce15" containerID="6ae8934ebe48a23bc86416cbc8d67e3086df0889b243cef9f2f389d16fa33597" exitCode=0 Jul 16 11:45:04.362410 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:45:04.362365 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736705-9bpnn" event={"ID":"5fb1639d-5ae5-4a45-bfa4-690d09c7ce15","Type":"ContainerDied","Data":"6ae8934ebe48a23bc86416cbc8d67e3086df0889b243cef9f2f389d16fa33597"} Jul 16 11:45:05.521720 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:45:05.521694 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f05981-29736705-rcbws" Jul 16 11:45:05.525259 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:45:05.525241 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736705-9bpnn" Jul 16 11:45:06.371920 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:45:06.371894 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f05981-29736705-rcbws" Jul 16 11:45:06.371920 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:45:06.371901 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f05981-29736705-rcbws" event={"ID":"d5f03c2b-be1d-41eb-b3cc-b856d4ea7f3c","Type":"ContainerDied","Data":"2ab48a5b22a9fc93a54ffc0efce63967c432922124fc4a443bb92ee0a0fa455c"} Jul 16 11:45:06.372153 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:45:06.371953 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ab48a5b22a9fc93a54ffc0efce63967c432922124fc4a443bb92ee0a0fa455c" Jul 16 11:45:06.373236 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:45:06.373204 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736705-9bpnn" Jul 16 11:45:06.373352 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:45:06.373208 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736705-9bpnn" event={"ID":"5fb1639d-5ae5-4a45-bfa4-690d09c7ce15","Type":"ContainerDied","Data":"8b66dfbc33c5836290181fd5fcceaaf300a76d939c5b7e4f24d411cca3fee854"} Jul 16 11:45:06.373396 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:45:06.373355 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b66dfbc33c5836290181fd5fcceaaf300a76d939c5b7e4f24d411cca3fee854" Jul 16 11:48:47.024938 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:48:47.024856 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j"] Jul 16 11:48:47.025463 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:48:47.025099 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j" podUID="90c4a60e-566f-450b-bcd8-dbe0de56f36a" containerName="maas-api" containerID="cri-o://625eb76f0b3ad9cd0829b7eb4694e58448fd26698c247fc1ec5be1c40fa6d0ad" gracePeriod=30 Jul 16 11:48:47.279013 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:48:47.278950 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j" Jul 16 11:48:47.378548 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:48:47.378517 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90c4a60e-566f-450b-bcd8-dbe0de56f36a-openshift-service-ca\") pod \"90c4a60e-566f-450b-bcd8-dbe0de56f36a\" (UID: \"90c4a60e-566f-450b-bcd8-dbe0de56f36a\") " Jul 16 11:48:47.378548 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:48:47.378554 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mxnr\" (UniqueName: \"kubernetes.io/projected/90c4a60e-566f-450b-bcd8-dbe0de56f36a-kube-api-access-4mxnr\") pod \"90c4a60e-566f-450b-bcd8-dbe0de56f36a\" (UID: \"90c4a60e-566f-450b-bcd8-dbe0de56f36a\") " Jul 16 11:48:47.378863 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:48:47.378841 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90c4a60e-566f-450b-bcd8-dbe0de56f36a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "90c4a60e-566f-450b-bcd8-dbe0de56f36a" (UID: "90c4a60e-566f-450b-bcd8-dbe0de56f36a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 11:48:47.380689 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:48:47.380660 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90c4a60e-566f-450b-bcd8-dbe0de56f36a-kube-api-access-4mxnr" (OuterVolumeSpecName: "kube-api-access-4mxnr") pod "90c4a60e-566f-450b-bcd8-dbe0de56f36a" (UID: "90c4a60e-566f-450b-bcd8-dbe0de56f36a"). InnerVolumeSpecName "kube-api-access-4mxnr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 11:48:47.398209 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:48:47.398183 2559 generic.go:356] "Generic (PLEG): container finished" podID="90c4a60e-566f-450b-bcd8-dbe0de56f36a" containerID="625eb76f0b3ad9cd0829b7eb4694e58448fd26698c247fc1ec5be1c40fa6d0ad" exitCode=0 Jul 16 11:48:47.398320 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:48:47.398227 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j" event={"ID":"90c4a60e-566f-450b-bcd8-dbe0de56f36a","Type":"ContainerDied","Data":"625eb76f0b3ad9cd0829b7eb4694e58448fd26698c247fc1ec5be1c40fa6d0ad"} Jul 16 11:48:47.398320 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:48:47.398233 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j" Jul 16 11:48:47.398320 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:48:47.398266 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j" event={"ID":"90c4a60e-566f-450b-bcd8-dbe0de56f36a","Type":"ContainerDied","Data":"8e73237ff2444a056863c65245acb3e28587503aa7f45bdeb416b11f53d378a8"} Jul 16 11:48:47.398320 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:48:47.398288 2559 scope.go:117] "RemoveContainer" containerID="625eb76f0b3ad9cd0829b7eb4694e58448fd26698c247fc1ec5be1c40fa6d0ad" Jul 16 11:48:47.406559 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:48:47.406540 2559 scope.go:117] "RemoveContainer" containerID="625eb76f0b3ad9cd0829b7eb4694e58448fd26698c247fc1ec5be1c40fa6d0ad" Jul 16 11:48:47.406830 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:48:47.406810 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"625eb76f0b3ad9cd0829b7eb4694e58448fd26698c247fc1ec5be1c40fa6d0ad\": container with ID starting with 625eb76f0b3ad9cd0829b7eb4694e58448fd26698c247fc1ec5be1c40fa6d0ad not found: ID does not exist" containerID="625eb76f0b3ad9cd0829b7eb4694e58448fd26698c247fc1ec5be1c40fa6d0ad" Jul 16 11:48:47.406896 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:48:47.406839 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"625eb76f0b3ad9cd0829b7eb4694e58448fd26698c247fc1ec5be1c40fa6d0ad"} err="failed to get container status \"625eb76f0b3ad9cd0829b7eb4694e58448fd26698c247fc1ec5be1c40fa6d0ad\": rpc error: code = NotFound desc = could not find container \"625eb76f0b3ad9cd0829b7eb4694e58448fd26698c247fc1ec5be1c40fa6d0ad\": container with ID starting with 625eb76f0b3ad9cd0829b7eb4694e58448fd26698c247fc1ec5be1c40fa6d0ad not found: ID does not exist" Jul 16 11:48:47.479214 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:48:47.479190 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90c4a60e-566f-450b-bcd8-dbe0de56f36a-maas-api-tls\") pod \"90c4a60e-566f-450b-bcd8-dbe0de56f36a\" (UID: \"90c4a60e-566f-450b-bcd8-dbe0de56f36a\") " Jul 16 11:48:47.479530 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:48:47.479512 2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90c4a60e-566f-450b-bcd8-dbe0de56f36a-openshift-service-ca\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:48:47.479604 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:48:47.479534 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mxnr\" (UniqueName: \"kubernetes.io/projected/90c4a60e-566f-450b-bcd8-dbe0de56f36a-kube-api-access-4mxnr\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:48:47.481236 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:48:47.481210 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90c4a60e-566f-450b-bcd8-dbe0de56f36a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "90c4a60e-566f-450b-bcd8-dbe0de56f36a" (UID: "90c4a60e-566f-450b-bcd8-dbe0de56f36a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 11:48:47.580683 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:48:47.580593 2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90c4a60e-566f-450b-bcd8-dbe0de56f36a-maas-api-tls\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:48:47.724910 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:48:47.724881 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j"] Jul 16 11:48:47.728829 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:48:47.728807 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-bfa604-577d864d7-nvn4j"] Jul 16 11:48:48.650247 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:48:48.650209 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90c4a60e-566f-450b-bcd8-dbe0de56f36a" path="/var/lib/kubelet/pods/90c4a60e-566f-450b-bcd8-dbe0de56f36a/volumes" Jul 16 11:49:00.165306 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:00.165265 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl"] Jul 16 11:49:00.165754 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:00.165566 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl" podUID="3449c886-7678-4f87-8898-455171abaaeb" containerName="maas-api" containerID="cri-o://690aa2f9a4937802ee9ac255d3817f8f5dab98a61d23938709e34784164163c4" gracePeriod=30 Jul 16 11:49:00.192601 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:00.192572 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f05981-29736705-rcbws"] Jul 16 11:49:00.195219 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:00.195199 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f05981-29736705-rcbws"] Jul 16 11:49:00.422273 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:00.422217 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl" Jul 16 11:49:00.461180 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:00.461148 2559 generic.go:356] "Generic (PLEG): container finished" podID="3449c886-7678-4f87-8898-455171abaaeb" containerID="690aa2f9a4937802ee9ac255d3817f8f5dab98a61d23938709e34784164163c4" exitCode=0 Jul 16 11:49:00.461290 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:00.461187 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl" Jul 16 11:49:00.461290 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:00.461190 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl" event={"ID":"3449c886-7678-4f87-8898-455171abaaeb","Type":"ContainerDied","Data":"690aa2f9a4937802ee9ac255d3817f8f5dab98a61d23938709e34784164163c4"} Jul 16 11:49:00.461290 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:00.461239 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl" event={"ID":"3449c886-7678-4f87-8898-455171abaaeb","Type":"ContainerDied","Data":"20d235bfcaa9be438d88ba9d5ca4cc3abbf8a8956e00fe7d4f3633924ebb6f8c"} Jul 16 11:49:00.461290 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:00.461269 2559 scope.go:117] "RemoveContainer" containerID="690aa2f9a4937802ee9ac255d3817f8f5dab98a61d23938709e34784164163c4" Jul 16 11:49:00.470331 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:00.470312 2559 scope.go:117] "RemoveContainer" containerID="690aa2f9a4937802ee9ac255d3817f8f5dab98a61d23938709e34784164163c4" Jul 16 11:49:00.470605 ip-10-0-139-2 kubenswrapper[2559]: E0716 11:49:00.470581 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"690aa2f9a4937802ee9ac255d3817f8f5dab98a61d23938709e34784164163c4\": container with ID starting with 690aa2f9a4937802ee9ac255d3817f8f5dab98a61d23938709e34784164163c4 not found: ID does not exist" containerID="690aa2f9a4937802ee9ac255d3817f8f5dab98a61d23938709e34784164163c4" Jul 16 11:49:00.470713 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:00.470616 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"690aa2f9a4937802ee9ac255d3817f8f5dab98a61d23938709e34784164163c4"} err="failed to get container status \"690aa2f9a4937802ee9ac255d3817f8f5dab98a61d23938709e34784164163c4\": rpc error: code = NotFound desc = could not find container \"690aa2f9a4937802ee9ac255d3817f8f5dab98a61d23938709e34784164163c4\": container with ID starting with 690aa2f9a4937802ee9ac255d3817f8f5dab98a61d23938709e34784164163c4 not found: ID does not exist" Jul 16 11:49:00.478878 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:00.478858 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3449c886-7678-4f87-8898-455171abaaeb-openshift-service-ca\") pod \"3449c886-7678-4f87-8898-455171abaaeb\" (UID: \"3449c886-7678-4f87-8898-455171abaaeb\") " Jul 16 11:49:00.478967 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:00.478895 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3449c886-7678-4f87-8898-455171abaaeb-maas-api-tls\") pod \"3449c886-7678-4f87-8898-455171abaaeb\" (UID: \"3449c886-7678-4f87-8898-455171abaaeb\") " Jul 16 11:49:00.478967 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:00.478925 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fxch\" (UniqueName: \"kubernetes.io/projected/3449c886-7678-4f87-8898-455171abaaeb-kube-api-access-4fxch\") pod \"3449c886-7678-4f87-8898-455171abaaeb\" (UID: \"3449c886-7678-4f87-8898-455171abaaeb\") " Jul 16 11:49:00.479269 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:00.479241 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3449c886-7678-4f87-8898-455171abaaeb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3449c886-7678-4f87-8898-455171abaaeb" (UID: "3449c886-7678-4f87-8898-455171abaaeb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 11:49:00.480960 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:00.480935 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3449c886-7678-4f87-8898-455171abaaeb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3449c886-7678-4f87-8898-455171abaaeb" (UID: "3449c886-7678-4f87-8898-455171abaaeb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 11:49:00.481355 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:00.481337 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3449c886-7678-4f87-8898-455171abaaeb-kube-api-access-4fxch" (OuterVolumeSpecName: "kube-api-access-4fxch") pod "3449c886-7678-4f87-8898-455171abaaeb" (UID: "3449c886-7678-4f87-8898-455171abaaeb"). InnerVolumeSpecName "kube-api-access-4fxch". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 11:49:00.579715 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:00.579685 2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3449c886-7678-4f87-8898-455171abaaeb-openshift-service-ca\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:49:00.579715 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:00.579706 2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3449c886-7678-4f87-8898-455171abaaeb-maas-api-tls\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:49:00.579715 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:00.579715 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fxch\" (UniqueName: \"kubernetes.io/projected/3449c886-7678-4f87-8898-455171abaaeb-kube-api-access-4fxch\") on node \"ip-10-0-139-2.ec2.internal\" DevicePath \"\"" Jul 16 11:49:00.650621 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:00.650594 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5f03c2b-be1d-41eb-b3cc-b856d4ea7f3c" path="/var/lib/kubelet/pods/d5f03c2b-be1d-41eb-b3cc-b856d4ea7f3c/volumes" Jul 16 11:49:00.775969 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:00.775915 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl"] Jul 16 11:49:00.781758 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:00.781737 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f05981-5f67f4b8d8-zrccl"] Jul 16 11:49:02.650393 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:02.650361 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3449c886-7678-4f87-8898-455171abaaeb" path="/var/lib/kubelet/pods/3449c886-7678-4f87-8898-455171abaaeb/volumes" Jul 16 11:49:13.030767 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:13.030741 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f8c4d5c89-54dfr_071be624-74d3-4610-8b93-fb830912b5f9/copy-manifests/0.log" Jul 16 11:49:13.037444 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:13.037421 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f8c4d5c89-54dfr_071be624-74d3-4610-8b93-fb830912b5f9/manager/0.log" Jul 16 11:49:13.848964 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:13.848932 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29736705-9bpnn_5fb1639d-5ae5-4a45-bfa4-690d09c7ce15/cleanup/0.log" Jul 16 11:49:15.797003 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:15.796963 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-8xvc7_8d6f7946-4a0f-43b4-98f6-9dbfd292f7e4/manager/0.log" Jul 16 11:49:16.499127 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:16.499098 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qpncp_c5a2c2f9-070c-4036-ac74-7e71e9076187/discovery/0.log" Jul 16 11:49:16.961908 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:16.961880 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-l6j22_1f57fab0-b46f-44aa-85e2-c01cb56dc3a0/payload-pre-processing/0.log" Jul 16 11:49:17.548157 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:17.548126 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-xgrbg_9105f231-a6a2-42d7-ac90-bdccb194c570/main/0.log" Jul 16 11:49:17.781403 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:17.781376 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-tvqcm_7b13d3ff-547c-4d5c-a820-c712badb2aea/main/0.log" Jul 16 11:49:26.600807 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:26.600768 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-krgqh_6355a8cf-05e9-476a-9fbb-ee2612316853/global-pull-secret-syncer/0.log" Jul 16 11:49:26.762939 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:26.762909 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xvstb_443181d2-b76d-4141-8165-b658caa2328a/konnectivity-agent/0.log" Jul 16 11:49:26.845869 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:26.845835 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-2.ec2.internal_2de947f41f16a38a13007d8ee00ccad0/haproxy/0.log" Jul 16 11:49:32.952125 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:32.952086 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-8xvc7_8d6f7946-4a0f-43b4-98f6-9dbfd292f7e4/manager/0.log" Jul 16 11:49:35.054434 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:35.054366 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-gc8vw_f2c7c9c4-2916-443e-b82b-17927b6e116a/cluster-monitoring-operator/0.log" Jul 16 11:49:35.468881 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:35.468846 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n9zzj_df439e14-21ac-4386-b406-ae6836a6fc61/node-exporter/0.log" Jul 16 11:49:35.499918 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:35.499895 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n9zzj_df439e14-21ac-4386-b406-ae6836a6fc61/kube-rbac-proxy/0.log" Jul 16 11:49:35.543007 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:35.542984 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n9zzj_df439e14-21ac-4386-b406-ae6836a6fc61/init-textfile/0.log" Jul 16 11:49:35.694035 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:35.694010 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e16ebac5-e534-4ac8-9a2b-13f8657464c5/prometheus/0.log" Jul 16 11:49:35.745837 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:35.745763 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e16ebac5-e534-4ac8-9a2b-13f8657464c5/config-reloader/0.log" Jul 16 11:49:35.792897 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:35.792866 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e16ebac5-e534-4ac8-9a2b-13f8657464c5/thanos-sidecar/0.log" Jul 16 11:49:35.834519 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:35.834501 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e16ebac5-e534-4ac8-9a2b-13f8657464c5/kube-rbac-proxy-web/0.log" Jul 16 11:49:35.875414 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:35.875391 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e16ebac5-e534-4ac8-9a2b-13f8657464c5/kube-rbac-proxy/0.log" Jul 16 11:49:35.911468 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:35.911441 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e16ebac5-e534-4ac8-9a2b-13f8657464c5/kube-rbac-proxy-thanos/0.log" Jul 16 11:49:35.948529 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:35.948504 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e16ebac5-e534-4ac8-9a2b-13f8657464c5/init-config-reloader/0.log" Jul 16 11:49:36.111790 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:36.111719 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-786fcd7d66-9zt2w_a5d9a0a4-6d4b-4360-900e-2eabfbee0d98/telemeter-client/0.log" Jul 16 11:49:36.155483 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:36.155456 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-786fcd7d66-9zt2w_a5d9a0a4-6d4b-4360-900e-2eabfbee0d98/reload/0.log" Jul 16 11:49:36.197390 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:36.197366 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-786fcd7d66-9zt2w_a5d9a0a4-6d4b-4360-900e-2eabfbee0d98/kube-rbac-proxy/0.log" Jul 16 11:49:37.069716 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.069681 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8p4bp/perf-node-gather-daemonset-nqnr6"] Jul 16 11:49:37.070041 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.070026 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3449c886-7678-4f87-8898-455171abaaeb" containerName="maas-api" Jul 16 11:49:37.070087 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.070043 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3449c886-7678-4f87-8898-455171abaaeb" containerName="maas-api" Jul 16 11:49:37.070087 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.070053 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fb1639d-5ae5-4a45-bfa4-690d09c7ce15" containerName="cleanup" Jul 16 11:49:37.070087 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.070059 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fb1639d-5ae5-4a45-bfa4-690d09c7ce15" containerName="cleanup" Jul 16 11:49:37.070087 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.070077 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90c4a60e-566f-450b-bcd8-dbe0de56f36a" containerName="maas-api" Jul 16 11:49:37.070087 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.070083 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="90c4a60e-566f-450b-bcd8-dbe0de56f36a" containerName="maas-api" Jul 16 11:49:37.070247 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.070094 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5f03c2b-be1d-41eb-b3cc-b856d4ea7f3c" containerName="cleanup" Jul 16 11:49:37.070247 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.070100 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5f03c2b-be1d-41eb-b3cc-b856d4ea7f3c" containerName="cleanup" Jul 16 11:49:37.070247 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.070157 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3449c886-7678-4f87-8898-455171abaaeb" containerName="maas-api" Jul 16 11:49:37.070247 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.070165 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5f03c2b-be1d-41eb-b3cc-b856d4ea7f3c" containerName="cleanup" Jul 16 11:49:37.070247 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.070173 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fb1639d-5ae5-4a45-bfa4-690d09c7ce15" containerName="cleanup" Jul 16 11:49:37.070247 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.070179 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="90c4a60e-566f-450b-bcd8-dbe0de56f36a" containerName="maas-api" Jul 16 11:49:37.073015 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.072993 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-nqnr6" Jul 16 11:49:37.075133 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.075110 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8p4bp\"/\"openshift-service-ca.crt\"" Jul 16 11:49:37.075270 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.075155 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8p4bp\"/\"default-dockercfg-8p8z5\"" Jul 16 11:49:37.075270 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.075163 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8p4bp\"/\"kube-root-ca.crt\"" Jul 16 11:49:37.082213 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.082190 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8p4bp/perf-node-gather-daemonset-nqnr6"] Jul 16 11:49:37.152345 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.152314 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/64150c7b-d710-48ef-9192-74a2241c9f47-sys\") pod \"perf-node-gather-daemonset-nqnr6\" (UID: \"64150c7b-d710-48ef-9192-74a2241c9f47\") " pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-nqnr6" Jul 16 11:49:37.152704 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.152356 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/64150c7b-d710-48ef-9192-74a2241c9f47-lib-modules\") pod \"perf-node-gather-daemonset-nqnr6\" (UID: \"64150c7b-d710-48ef-9192-74a2241c9f47\") " pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-nqnr6" Jul 16 11:49:37.152704 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.152381 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/64150c7b-d710-48ef-9192-74a2241c9f47-podres\") pod \"perf-node-gather-daemonset-nqnr6\" (UID: \"64150c7b-d710-48ef-9192-74a2241c9f47\") " pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-nqnr6" Jul 16 11:49:37.152704 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.152408 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/64150c7b-d710-48ef-9192-74a2241c9f47-proc\") pod \"perf-node-gather-daemonset-nqnr6\" (UID: \"64150c7b-d710-48ef-9192-74a2241c9f47\") " pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-nqnr6" Jul 16 11:49:37.152704 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.152499 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvl7h\" (UniqueName: \"kubernetes.io/projected/64150c7b-d710-48ef-9192-74a2241c9f47-kube-api-access-dvl7h\") pod \"perf-node-gather-daemonset-nqnr6\" (UID: \"64150c7b-d710-48ef-9192-74a2241c9f47\") " pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-nqnr6" Jul 16 11:49:37.253376 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.253348 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/64150c7b-d710-48ef-9192-74a2241c9f47-sys\") pod \"perf-node-gather-daemonset-nqnr6\" (UID: \"64150c7b-d710-48ef-9192-74a2241c9f47\") " pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-nqnr6" Jul 16 11:49:37.253495 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.253383 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/64150c7b-d710-48ef-9192-74a2241c9f47-lib-modules\") pod \"perf-node-gather-daemonset-nqnr6\" (UID: \"64150c7b-d710-48ef-9192-74a2241c9f47\") " pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-nqnr6" Jul 16 11:49:37.253495 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.253402 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/64150c7b-d710-48ef-9192-74a2241c9f47-podres\") pod \"perf-node-gather-daemonset-nqnr6\" (UID: \"64150c7b-d710-48ef-9192-74a2241c9f47\") " pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-nqnr6" Jul 16 11:49:37.253495 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.253417 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/64150c7b-d710-48ef-9192-74a2241c9f47-proc\") pod \"perf-node-gather-daemonset-nqnr6\" (UID: \"64150c7b-d710-48ef-9192-74a2241c9f47\") " pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-nqnr6" Jul 16 11:49:37.253495 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.253455 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvl7h\" (UniqueName: \"kubernetes.io/projected/64150c7b-d710-48ef-9192-74a2241c9f47-kube-api-access-dvl7h\") pod \"perf-node-gather-daemonset-nqnr6\" (UID: \"64150c7b-d710-48ef-9192-74a2241c9f47\") " pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-nqnr6" Jul 16 11:49:37.253693 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.253485 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/64150c7b-d710-48ef-9192-74a2241c9f47-sys\") pod \"perf-node-gather-daemonset-nqnr6\" (UID: \"64150c7b-d710-48ef-9192-74a2241c9f47\") " pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-nqnr6" Jul 16 11:49:37.253693 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.253525 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/64150c7b-d710-48ef-9192-74a2241c9f47-proc\") pod \"perf-node-gather-daemonset-nqnr6\" (UID: \"64150c7b-d710-48ef-9192-74a2241c9f47\") " pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-nqnr6" Jul 16 11:49:37.253693 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.253550 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/64150c7b-d710-48ef-9192-74a2241c9f47-podres\") pod \"perf-node-gather-daemonset-nqnr6\" (UID: \"64150c7b-d710-48ef-9192-74a2241c9f47\") " pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-nqnr6" Jul 16 11:49:37.253693 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.253552 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/64150c7b-d710-48ef-9192-74a2241c9f47-lib-modules\") pod \"perf-node-gather-daemonset-nqnr6\" (UID: \"64150c7b-d710-48ef-9192-74a2241c9f47\") " pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-nqnr6" Jul 16 11:49:37.262315 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.262291 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvl7h\" (UniqueName: \"kubernetes.io/projected/64150c7b-d710-48ef-9192-74a2241c9f47-kube-api-access-dvl7h\") pod \"perf-node-gather-daemonset-nqnr6\" (UID: \"64150c7b-d710-48ef-9192-74a2241c9f47\") " pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-nqnr6" Jul 16 11:49:37.384341 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.384266 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-nqnr6" Jul 16 11:49:37.520076 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.520048 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8p4bp/perf-node-gather-daemonset-nqnr6"] Jul 16 11:49:37.522016 ip-10-0-139-2 kubenswrapper[2559]: W0716 11:49:37.521992 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod64150c7b_d710_48ef_9192_74a2241c9f47.slice/crio-23785cd518679385074cc8132806697764aafe74adef4cc086b47335b82a7af5 WatchSource:0}: Error finding container 23785cd518679385074cc8132806697764aafe74adef4cc086b47335b82a7af5: Status 404 returned error can't find the container with id 23785cd518679385074cc8132806697764aafe74adef4cc086b47335b82a7af5 Jul 16 11:49:37.641702 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.641626 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-nqnr6" event={"ID":"64150c7b-d710-48ef-9192-74a2241c9f47","Type":"ContainerStarted","Data":"baf4f7008eea6c53016b8cfeb6e778e6897a483580f9872e8715ec5bae81d0c6"} Jul 16 11:49:37.641702 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.641697 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-nqnr6" event={"ID":"64150c7b-d710-48ef-9192-74a2241c9f47","Type":"ContainerStarted","Data":"23785cd518679385074cc8132806697764aafe74adef4cc086b47335b82a7af5"} Jul 16 11:49:37.641843 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.641778 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-nqnr6" Jul 16 11:49:37.658679 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:37.658622 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-nqnr6" podStartSLOduration=0.658610707 podStartE2EDuration="658.610707ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:49:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:49:37.658230006 +0000 UTC m=+2485.410487817" watchObservedRunningTime="2026-07-16 11:49:37.658610707 +0000 UTC m=+2485.410868499" Jul 16 11:49:39.350033 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:39.349988 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-fl8xz_c946b90a-62b9-4afb-ae16-7c3106228dca/volume-data-source-validator/0.log" Jul 16 11:49:40.491437 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:40.491408 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v5z75_0f092f0d-2c7a-4b1e-8598-23348b575cff/dns/0.log" Jul 16 11:49:40.515961 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:40.515932 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v5z75_0f092f0d-2c7a-4b1e-8598-23348b575cff/kube-rbac-proxy/0.log" Jul 16 11:49:40.624886 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:40.624860 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-czbrz_7444f424-775b-4cb1-b13a-eeb72471a42a/dns-node-resolver/0.log" Jul 16 11:49:41.289959 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:41.289917 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tds89_2080a1e9-bedc-4011-803a-6fda7f7e39e0/node-ca/0.log" Jul 16 11:49:42.448408 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:42.448376 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qpncp_c5a2c2f9-070c-4036-ac74-7e71e9076187/discovery/0.log" Jul 16 11:49:42.609614 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:42.609581 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-l6j22_1f57fab0-b46f-44aa-85e2-c01cb56dc3a0/payload-pre-processing/0.log" Jul 16 11:49:43.438147 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:43.438115 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xsg4k_45cdc2d0-20f4-4f63-83cb-80b6e9159a97/serve-healthcheck-canary/0.log" Jul 16 11:49:43.657978 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:43.657952 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8p4bp/perf-node-gather-daemonset-nqnr6" Jul 16 11:49:43.928317 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:43.928292 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-dgjm5_5b70f755-1473-4067-92d4-d8f817b17963/insights-operator/0.log" Jul 16 11:49:43.929327 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:43.929301 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-dgjm5_5b70f755-1473-4067-92d4-d8f817b17963/insights-operator/1.log" Jul 16 11:49:44.088718 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:44.088694 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tg5pd_c1a3bd51-3d95-4693-85d7-890cb7e0615c/kube-rbac-proxy/0.log" Jul 16 11:49:44.108851 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:44.108830 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tg5pd_c1a3bd51-3d95-4693-85d7-890cb7e0615c/exporter/0.log" Jul 16 11:49:44.131795 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:44.131776 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tg5pd_c1a3bd51-3d95-4693-85d7-890cb7e0615c/extractor/0.log" Jul 16 11:49:47.087558 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:47.087527 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f8c4d5c89-54dfr_071be624-74d3-4610-8b93-fb830912b5f9/manager/0.log" Jul 16 11:49:47.109385 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:47.109359 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f8c4d5c89-54dfr_071be624-74d3-4610-8b93-fb830912b5f9/copy-manifests/0.log" Jul 16 11:49:48.572579 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:48.572552 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-796df6bb6-cfr9r_786f95eb-a3d5-4d48-9531-ca6a0c45a68a/manager/0.log" Jul 16 11:49:48.606896 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:48.606833 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-zx279_d7202727-cb78-4f51-9e98-9be126c2af88/openshift-lws-operator/0.log" Jul 16 11:49:48.630411 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:48.630392 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qpncp_c5a2c2f9-070c-4036-ac74-7e71e9076187/discovery/0.log" Jul 16 11:49:48.764871 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:48.764850 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-l6j22_1f57fab0-b46f-44aa-85e2-c01cb56dc3a0/payload-pre-processing/0.log" Jul 16 11:49:50.125427 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:50.125393 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qpncp_c5a2c2f9-070c-4036-ac74-7e71e9076187/discovery/0.log" Jul 16 11:49:50.258715 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:50.258677 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-l6j22_1f57fab0-b46f-44aa-85e2-c01cb56dc3a0/payload-pre-processing/0.log" Jul 16 11:49:53.650251 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:53.650224 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-fsmjm_4042f669-3669-4616-91cb-1b5f6da88007/migrator/0.log" Jul 16 11:49:53.673868 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:53.673846 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-fsmjm_4042f669-3669-4616-91cb-1b5f6da88007/graceful-termination/0.log" Jul 16 11:49:54.043093 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:54.043047 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-qlp9w_8c18fa76-a392-4218-ad02-5f53da15a8e2/kube-storage-version-migrator-operator/1.log" Jul 16 11:49:54.045160 ip-10-0-139-2 kubenswrapper[2559]: I0716 11:49:54.045138 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-qlp9w_8c18fa76-a392-4218-ad02-5f53da15a8e2/kube-storage-version-migrator-operator/0.log"