Jul 14 11:11:34.055295 ip-10-0-139-35 systemd[1]: Starting Kubernetes Kubelet... Jul 14 11:11:34.478053 ip-10-0-139-35 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 11:11:34.478053 ip-10-0-139-35 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 14 11:11:34.478053 ip-10-0-139-35 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 11:11:34.478053 ip-10-0-139-35 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 14 11:11:34.478053 ip-10-0-139-35 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 11:11:34.478810 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.478136 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 14 11:11:34.485464 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485433 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 11:11:34.485464 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485463 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 11:11:34.485464 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485467 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 11:11:34.485464 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485471 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 11:11:34.485609 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485475 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 11:11:34.485609 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485480 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 11:11:34.485609 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485482 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 11:11:34.485609 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485485 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 11:11:34.485609 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485488 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 11:11:34.485609 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485492 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 11:11:34.485609 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485495 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 11:11:34.485609 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485497 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 11:11:34.485609 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485500 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 11:11:34.485609 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485502 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 11:11:34.485609 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485505 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 11:11:34.485609 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485507 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 11:11:34.485609 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485510 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 11:11:34.485609 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485512 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 11:11:34.485609 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485514 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 11:11:34.485609 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485517 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 11:11:34.485609 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485519 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 11:11:34.485609 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485522 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 11:11:34.485609 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485524 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 11:11:34.485609 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485527 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 14 11:11:34.486093 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485530 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 11:11:34.486093 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485537 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 11:11:34.486093 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485539 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 11:11:34.486093 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485542 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 11:11:34.486093 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485545 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 11:11:34.486093 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485547 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 11:11:34.486093 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485549 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 11:11:34.486093 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485552 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 11:11:34.486093 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485555 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 11:11:34.486093 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485557 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 11:11:34.486093 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485560 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 11:11:34.486093 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485563 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 11:11:34.486093 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485565 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 11:11:34.486093 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485568 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 11:11:34.486093 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485571 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 11:11:34.486093 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485574 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 11:11:34.486093 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485577 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 11:11:34.486093 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485580 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 11:11:34.486093 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485582 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 11:11:34.486093 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485586 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 11:11:34.486639 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485588 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 11:11:34.486639 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485591 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 11:11:34.486639 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485594 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 11:11:34.486639 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485597 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 11:11:34.486639 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485599 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 11:11:34.486639 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485602 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 11:11:34.486639 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485604 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 11:11:34.486639 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485607 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 11:11:34.486639 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485609 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 11:11:34.486639 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485613 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 11:11:34.486639 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485617 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 11:11:34.486639 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485621 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 11:11:34.486639 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485624 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 11:11:34.486639 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485627 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 11:11:34.486639 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485630 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 11:11:34.486639 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485632 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 11:11:34.486639 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485635 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 11:11:34.486639 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485637 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 11:11:34.486639 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485640 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 11:11:34.487128 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485643 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 11:11:34.487128 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485645 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 11:11:34.487128 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485648 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 11:11:34.487128 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485651 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 11:11:34.487128 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485653 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 11:11:34.487128 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485656 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 11:11:34.487128 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485658 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 11:11:34.487128 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485661 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 11:11:34.487128 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485666 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 11:11:34.487128 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485668 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 11:11:34.487128 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485671 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 11:11:34.487128 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485673 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 11:11:34.487128 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485676 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 11:11:34.487128 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485678 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 11:11:34.487128 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485681 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 11:11:34.487128 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485683 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 11:11:34.487128 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485687 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 11:11:34.487128 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485689 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 11:11:34.487128 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485692 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 11:11:34.487128 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485694 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 11:11:34.487682 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485696 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 11:11:34.487682 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485699 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 11:11:34.487682 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485701 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 11:11:34.487682 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485704 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 11:11:34.487682 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485706 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 11:11:34.487682 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485708 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 11:11:34.487682 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485712 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 11:11:34.487682 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485715 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 11:11:34.487682 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485718 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 11:11:34.487682 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485721 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 11:11:34.487682 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485723 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 11:11:34.487682 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485728 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 11:11:34.487682 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485731 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 11:11:34.487682 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485734 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 11:11:34.487682 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485736 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 11:11:34.487682 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.485739 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 11:11:34.487682 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486497 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 11:11:34.487682 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486505 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 11:11:34.487682 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486509 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 11:11:34.488182 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486512 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 11:11:34.488182 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486515 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 11:11:34.488182 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486519 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 11:11:34.488182 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486521 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 11:11:34.488182 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486524 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 11:11:34.488182 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486527 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 11:11:34.488182 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486529 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 11:11:34.488182 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486532 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 11:11:34.488182 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486535 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 11:11:34.488182 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486538 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 11:11:34.488182 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486541 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 11:11:34.488182 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486543 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 11:11:34.488182 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486546 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 11:11:34.488182 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486548 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 11:11:34.488182 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486551 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 11:11:34.488182 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486554 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 11:11:34.488182 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486556 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 11:11:34.488182 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486558 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 11:11:34.488182 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486561 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 11:11:34.488182 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486564 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 11:11:34.488683 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486566 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 11:11:34.488683 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486568 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 11:11:34.488683 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486571 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 11:11:34.488683 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486574 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 11:11:34.488683 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486577 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 11:11:34.488683 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486580 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 11:11:34.488683 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486582 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 11:11:34.488683 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486586 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 11:11:34.488683 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486591 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 11:11:34.488683 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486594 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 11:11:34.488683 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486597 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 11:11:34.488683 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486599 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 11:11:34.488683 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486602 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 11:11:34.488683 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486604 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 11:11:34.488683 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486606 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 11:11:34.488683 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486609 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 11:11:34.488683 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486612 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 11:11:34.488683 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486614 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 11:11:34.488683 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486617 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 11:11:34.489176 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486621 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 11:11:34.489176 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486624 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 11:11:34.489176 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486627 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 11:11:34.489176 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486630 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 11:11:34.489176 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486633 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 11:11:34.489176 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486636 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 11:11:34.489176 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486639 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 11:11:34.489176 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486642 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 11:11:34.489176 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486645 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 14 11:11:34.489176 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486648 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 11:11:34.489176 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486651 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 11:11:34.489176 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486654 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 11:11:34.489176 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486656 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 11:11:34.489176 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486660 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 11:11:34.489176 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486664 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 11:11:34.489176 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486667 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 11:11:34.489176 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486670 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 11:11:34.489176 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486672 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 11:11:34.489176 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486675 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 11:11:34.489643 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486677 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 11:11:34.489643 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486680 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 11:11:34.489643 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486683 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 11:11:34.489643 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486685 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 11:11:34.489643 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486688 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 11:11:34.489643 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486690 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 11:11:34.489643 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486693 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 11:11:34.489643 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486695 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 11:11:34.489643 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486697 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 11:11:34.489643 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486700 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 11:11:34.489643 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486702 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 11:11:34.489643 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486704 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 11:11:34.489643 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486707 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 11:11:34.489643 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486709 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 11:11:34.489643 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486712 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 11:11:34.489643 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486714 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 11:11:34.489643 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486717 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 11:11:34.489643 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486719 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 11:11:34.489643 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486723 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 11:11:34.489643 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486726 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 11:11:34.490245 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486729 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 11:11:34.490245 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486732 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 11:11:34.490245 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486735 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 11:11:34.490245 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486737 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 11:11:34.490245 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486739 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 11:11:34.490245 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486742 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 11:11:34.490245 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486744 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 11:11:34.490245 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486747 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 11:11:34.490245 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486749 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 11:11:34.490245 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486752 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 11:11:34.490245 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486754 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 11:11:34.490245 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486757 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 11:11:34.490245 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486759 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 11:11:34.490245 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486762 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 11:11:34.490245 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486764 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 11:11:34.490245 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486767 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 11:11:34.490245 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486771 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 11:11:34.490245 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.486773 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 11:11:34.490245 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487254 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 11:11:34.490245 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487261 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 11:11:34.490728 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487264 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 11:11:34.490728 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487267 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 11:11:34.490728 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487270 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 11:11:34.490728 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487272 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 11:11:34.490728 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487275 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 11:11:34.490728 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487278 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 11:11:34.490728 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487281 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 11:11:34.490728 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487284 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 11:11:34.490728 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487286 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 11:11:34.490728 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487289 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 11:11:34.490728 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487292 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 11:11:34.490728 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487295 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 11:11:34.490728 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487301 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 11:11:34.490728 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487304 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 11:11:34.490728 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487306 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 11:11:34.490728 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487309 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 11:11:34.490728 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487311 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 11:11:34.490728 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487314 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 11:11:34.490728 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487317 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 11:11:34.490728 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487319 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 11:11:34.491234 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487322 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 11:11:34.491234 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487325 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 11:11:34.491234 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487328 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 11:11:34.491234 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487331 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 11:11:34.491234 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487335 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 11:11:34.491234 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487338 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 11:11:34.491234 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487341 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 11:11:34.491234 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487343 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 11:11:34.491234 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487346 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 11:11:34.491234 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487349 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 11:11:34.491234 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487351 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 11:11:34.491234 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487354 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 11:11:34.491234 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487356 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 11:11:34.491234 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487358 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 11:11:34.491234 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487361 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 11:11:34.491234 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487363 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 11:11:34.491234 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487366 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 11:11:34.491234 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487368 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 11:11:34.491234 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487371 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 11:11:34.491234 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487373 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 11:11:34.491725 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487376 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 11:11:34.491725 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487378 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 11:11:34.491725 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487381 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 11:11:34.491725 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487384 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 11:11:34.491725 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487389 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 11:11:34.491725 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487391 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 11:11:34.491725 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487394 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 11:11:34.491725 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487396 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 11:11:34.491725 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487398 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 11:11:34.491725 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487401 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 11:11:34.491725 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487404 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 11:11:34.491725 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487408 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 11:11:34.491725 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487412 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 11:11:34.491725 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487415 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 11:11:34.491725 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487418 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 11:11:34.491725 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487421 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 11:11:34.491725 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487423 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 11:11:34.491725 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487426 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 11:11:34.491725 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487429 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 11:11:34.492264 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487431 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 11:11:34.492264 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487434 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 11:11:34.492264 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487437 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 11:11:34.492264 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487439 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 11:11:34.492264 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487441 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 11:11:34.492264 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487444 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 11:11:34.492264 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487446 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 11:11:34.492264 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487448 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 11:11:34.492264 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487451 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 11:11:34.492264 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487453 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 11:11:34.492264 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487456 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 11:11:34.492264 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487458 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 11:11:34.492264 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487461 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 11:11:34.492264 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487463 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 11:11:34.492264 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487466 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 11:11:34.492264 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487468 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 11:11:34.492264 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487471 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 11:11:34.492264 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487475 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 11:11:34.492264 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487479 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 11:11:34.492722 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487481 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 11:11:34.492722 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487484 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 11:11:34.492722 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487486 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 11:11:34.492722 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487488 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 11:11:34.492722 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487491 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 11:11:34.492722 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487493 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 11:11:34.492722 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487498 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 11:11:34.492722 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487501 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 14 11:11:34.492722 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487503 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 11:11:34.492722 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487505 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 11:11:34.492722 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487508 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 11:11:34.492722 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487510 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 11:11:34.492722 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487513 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 11:11:34.492722 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487516 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 11:11:34.492722 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487519 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 11:11:34.492722 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487521 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 11:11:34.492722 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487524 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 11:11:34.492722 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487528 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 11:11:34.492722 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.487531 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 11:11:34.492722 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487615 2576 flags.go:64] FLAG: --address="0.0.0.0" Jul 14 11:11:34.493245 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487624 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 14 11:11:34.493245 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487633 2576 flags.go:64] FLAG: --anonymous-auth="true" Jul 14 11:11:34.493245 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487637 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 14 11:11:34.493245 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487641 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 14 11:11:34.493245 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487644 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 14 11:11:34.493245 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487648 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 14 11:11:34.493245 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487653 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 14 11:11:34.493245 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487656 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 14 11:11:34.493245 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487659 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 14 11:11:34.493245 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487662 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 14 11:11:34.493245 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487667 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 14 11:11:34.493245 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487672 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 14 11:11:34.493245 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487675 2576 flags.go:64] FLAG: --cgroup-root="" Jul 14 11:11:34.493245 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487679 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 14 11:11:34.493245 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487681 2576 flags.go:64] FLAG: --client-ca-file="" Jul 14 11:11:34.493245 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487684 2576 flags.go:64] FLAG: --cloud-provider="external" Jul 14 11:11:34.493245 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487687 2576 flags.go:64] FLAG: --cluster-dns="[]" Jul 14 11:11:34.493245 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487691 2576 flags.go:64] FLAG: --cluster-domain="" Jul 14 11:11:34.493245 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487695 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 14 11:11:34.493245 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487699 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 14 11:11:34.493245 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487702 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 14 11:11:34.493245 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487705 2576 flags.go:64] FLAG: --container-log-max-files="5" Jul 14 11:11:34.493245 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487709 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 14 11:11:34.493245 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487712 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 14 11:11:34.493818 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487715 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 14 11:11:34.493818 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487719 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 14 11:11:34.493818 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487722 2576 flags.go:64] FLAG: --contention-profiling="false" Jul 14 11:11:34.493818 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487725 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 14 11:11:34.493818 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487728 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 14 11:11:34.493818 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487731 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 14 11:11:34.493818 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487734 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 14 11:11:34.493818 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487738 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 14 11:11:34.493818 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487741 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 14 11:11:34.493818 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487744 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 14 11:11:34.493818 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487746 2576 flags.go:64] FLAG: --enable-load-reader="false" Jul 14 11:11:34.493818 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487749 2576 flags.go:64] FLAG: --enable-server="true" Jul 14 11:11:34.493818 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487752 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 14 11:11:34.493818 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487757 2576 flags.go:64] FLAG: --event-burst="100" Jul 14 11:11:34.493818 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487760 2576 flags.go:64] FLAG: --event-qps="50" Jul 14 11:11:34.493818 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487763 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 14 11:11:34.493818 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487766 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 14 11:11:34.493818 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487769 2576 flags.go:64] FLAG: --eviction-hard="" Jul 14 11:11:34.493818 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487775 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 14 11:11:34.493818 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487777 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 14 11:11:34.493818 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487781 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 14 11:11:34.493818 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487784 2576 flags.go:64] FLAG: --eviction-soft="" Jul 14 11:11:34.493818 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487787 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 14 11:11:34.493818 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487790 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 14 11:11:34.493818 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487793 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 14 11:11:34.494531 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487796 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jul 14 11:11:34.494531 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487802 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 14 11:11:34.494531 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487805 2576 flags.go:64] FLAG: --fail-swap-on="true" Jul 14 11:11:34.494531 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487808 2576 flags.go:64] FLAG: --feature-gates="" Jul 14 11:11:34.494531 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487812 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jul 14 11:11:34.494531 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487815 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 14 11:11:34.494531 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487818 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 14 11:11:34.494531 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487821 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 14 11:11:34.494531 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487824 2576 flags.go:64] FLAG: --healthz-port="10248" Jul 14 11:11:34.494531 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487827 2576 flags.go:64] FLAG: --help="false" Jul 14 11:11:34.494531 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487830 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-139-35.ec2.internal" Jul 14 11:11:34.494531 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487833 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 14 11:11:34.494531 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487836 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jul 14 11:11:34.494531 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487839 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 14 11:11:34.494531 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487843 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 14 11:11:34.494531 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487846 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 14 11:11:34.494531 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487849 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 14 11:11:34.494531 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487851 2576 flags.go:64] FLAG: --image-service-endpoint="" Jul 14 11:11:34.494531 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487854 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 14 11:11:34.494531 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487857 2576 flags.go:64] FLAG: --kube-api-burst="100" Jul 14 11:11:34.494531 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487860 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 14 11:11:34.494531 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487863 2576 flags.go:64] FLAG: --kube-api-qps="50" Jul 14 11:11:34.494531 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487866 2576 flags.go:64] FLAG: --kube-reserved="" Jul 14 11:11:34.494531 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487869 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 14 11:11:34.495140 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487872 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 14 11:11:34.495140 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487876 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jul 14 11:11:34.495140 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487879 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 14 11:11:34.495140 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487882 2576 flags.go:64] FLAG: --lock-file="" Jul 14 11:11:34.495140 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487885 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 14 11:11:34.495140 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487888 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 14 11:11:34.495140 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487891 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 14 11:11:34.495140 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487897 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jul 14 11:11:34.495140 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487900 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 14 11:11:34.495140 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487904 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jul 14 11:11:34.495140 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487908 2576 flags.go:64] FLAG: --logging-format="text" Jul 14 11:11:34.495140 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487911 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 14 11:11:34.495140 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487914 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 14 11:11:34.495140 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487917 2576 flags.go:64] FLAG: --manifest-url="" Jul 14 11:11:34.495140 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487938 2576 flags.go:64] FLAG: --manifest-url-header="" Jul 14 11:11:34.495140 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487943 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 14 11:11:34.495140 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487946 2576 flags.go:64] FLAG: --max-open-files="1000000" Jul 14 11:11:34.495140 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487951 2576 flags.go:64] FLAG: --max-pods="110" Jul 14 11:11:34.495140 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487954 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 14 11:11:34.495140 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487957 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 14 11:11:34.495140 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487960 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jul 14 11:11:34.495140 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487962 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 14 11:11:34.495140 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487966 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 14 11:11:34.495140 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487969 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 14 11:11:34.495140 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487972 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 14 11:11:34.495782 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487980 2576 flags.go:64] FLAG: --node-status-max-images="50" Jul 14 11:11:34.495782 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487983 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 14 11:11:34.495782 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487986 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jul 14 11:11:34.495782 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487989 2576 flags.go:64] FLAG: --pod-cidr="" Jul 14 11:11:34.495782 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487993 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 14 11:11:34.495782 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.487999 2576 flags.go:64] FLAG: --pod-manifest-path="" Jul 14 11:11:34.495782 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488002 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jul 14 11:11:34.495782 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488005 2576 flags.go:64] FLAG: --pods-per-core="0" Jul 14 11:11:34.495782 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488010 2576 flags.go:64] FLAG: --port="10250" Jul 14 11:11:34.495782 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488013 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 14 11:11:34.495782 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488016 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0584346045b8c8624" Jul 14 11:11:34.495782 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488019 2576 flags.go:64] FLAG: --qos-reserved="" Jul 14 11:11:34.495782 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488022 2576 flags.go:64] FLAG: --read-only-port="10255" Jul 14 11:11:34.495782 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488025 2576 flags.go:64] FLAG: --register-node="true" Jul 14 11:11:34.495782 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488028 2576 flags.go:64] FLAG: --register-with-taints="" Jul 14 11:11:34.495782 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488038 2576 flags.go:64] FLAG: --registry-burst="10" Jul 14 11:11:34.495782 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488040 2576 flags.go:64] FLAG: --registry-qps="5" Jul 14 11:11:34.495782 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488045 2576 flags.go:64] FLAG: --reserved-cpus="" Jul 14 11:11:34.495782 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488048 2576 flags.go:64] FLAG: --reserved-memory="" Jul 14 11:11:34.495782 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488051 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 14 11:11:34.495782 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488055 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 14 11:11:34.495782 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488058 2576 flags.go:64] FLAG: --rotate-certificates="false" Jul 14 11:11:34.495782 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488060 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 14 11:11:34.495782 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488063 2576 flags.go:64] FLAG: --runonce="false" Jul 14 11:11:34.495782 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488066 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 14 11:11:34.496408 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488069 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 14 11:11:34.496408 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488072 2576 flags.go:64] FLAG: --seccomp-default="false" Jul 14 11:11:34.496408 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488075 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 14 11:11:34.496408 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488078 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 14 11:11:34.496408 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488081 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 14 11:11:34.496408 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488084 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 14 11:11:34.496408 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488087 2576 flags.go:64] FLAG: --storage-driver-password="root" Jul 14 11:11:34.496408 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488090 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jul 14 11:11:34.496408 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488093 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jul 14 11:11:34.496408 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488095 2576 flags.go:64] FLAG: --storage-driver-user="root" Jul 14 11:11:34.496408 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488098 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 14 11:11:34.496408 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488101 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 14 11:11:34.496408 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488104 2576 flags.go:64] FLAG: --system-cgroups="" Jul 14 11:11:34.496408 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488107 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 14 11:11:34.496408 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488112 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 14 11:11:34.496408 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488117 2576 flags.go:64] FLAG: --tls-cert-file="" Jul 14 11:11:34.496408 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488120 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 14 11:11:34.496408 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488124 2576 flags.go:64] FLAG: --tls-min-version="" Jul 14 11:11:34.496408 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488127 2576 flags.go:64] FLAG: --tls-private-key-file="" Jul 14 11:11:34.496408 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488129 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jul 14 11:11:34.496408 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488133 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 14 11:11:34.496408 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488136 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jul 14 11:11:34.496408 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488139 2576 flags.go:64] FLAG: --v="2" Jul 14 11:11:34.496408 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488143 2576 flags.go:64] FLAG: --version="false" Jul 14 11:11:34.496408 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488152 2576 flags.go:64] FLAG: --vmodule="" Jul 14 11:11:34.497040 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488156 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 14 11:11:34.497040 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488159 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 14 11:11:34.497040 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488287 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 11:11:34.497040 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488291 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 11:11:34.497040 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488294 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 11:11:34.497040 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488299 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 11:11:34.497040 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488303 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 11:11:34.497040 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488307 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 11:11:34.497040 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488311 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 11:11:34.497040 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488314 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 11:11:34.497040 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488317 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 11:11:34.497040 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488319 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 11:11:34.497040 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488322 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 11:11:34.497040 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488325 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 11:11:34.497040 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488328 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 11:11:34.497040 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488331 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 11:11:34.497040 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488333 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 11:11:34.497040 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488335 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 11:11:34.497040 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488338 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 11:11:34.497512 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488340 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 11:11:34.497512 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488343 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 11:11:34.497512 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488345 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 11:11:34.497512 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488349 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 11:11:34.497512 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488352 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 11:11:34.497512 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488354 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 11:11:34.497512 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488357 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 11:11:34.497512 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488359 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 11:11:34.497512 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488362 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 11:11:34.497512 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488364 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 11:11:34.497512 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488367 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 11:11:34.497512 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488369 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 11:11:34.497512 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488373 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 11:11:34.497512 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488376 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 11:11:34.497512 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488378 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 11:11:34.497512 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488381 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 11:11:34.497512 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488383 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 11:11:34.497512 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488386 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 11:11:34.497512 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488389 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 11:11:34.498000 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488391 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 11:11:34.498000 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488393 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 11:11:34.498000 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488396 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 11:11:34.498000 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488400 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 11:11:34.498000 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488403 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 11:11:34.498000 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488406 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 11:11:34.498000 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488409 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 11:11:34.498000 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488412 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 11:11:34.498000 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488415 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 11:11:34.498000 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488417 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 11:11:34.498000 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488419 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 11:11:34.498000 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488422 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 11:11:34.498000 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488424 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 11:11:34.498000 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488426 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 11:11:34.498000 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488429 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 11:11:34.498000 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488431 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 11:11:34.498000 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488436 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 11:11:34.498000 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488438 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 11:11:34.498000 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488441 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 11:11:34.498465 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488443 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 11:11:34.498465 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488446 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 11:11:34.498465 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488448 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 11:11:34.498465 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488451 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 11:11:34.498465 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488454 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 11:11:34.498465 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488456 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 11:11:34.498465 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488460 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 11:11:34.498465 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488463 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 11:11:34.498465 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488465 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 11:11:34.498465 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488468 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 11:11:34.498465 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488471 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 11:11:34.498465 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488473 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 11:11:34.498465 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488476 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 11:11:34.498465 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488478 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 11:11:34.498465 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488480 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 11:11:34.498465 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488483 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 11:11:34.498465 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488485 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 11:11:34.498465 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488488 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 11:11:34.498465 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488490 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 11:11:34.498465 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488493 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 11:11:34.498997 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488495 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 11:11:34.498997 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488498 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 11:11:34.498997 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488501 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 11:11:34.498997 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488503 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 11:11:34.498997 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488506 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 11:11:34.498997 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488508 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 11:11:34.498997 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488510 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 11:11:34.498997 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488513 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 11:11:34.498997 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488516 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 11:11:34.498997 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488519 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 11:11:34.498997 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488521 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 11:11:34.498997 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488524 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 11:11:34.498997 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488526 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 14 11:11:34.498997 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488529 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 11:11:34.498997 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488531 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 11:11:34.498997 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488534 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 11:11:34.498997 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488536 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 11:11:34.498997 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488539 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 11:11:34.498997 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488543 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 11:11:34.498997 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488546 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 11:11:34.498997 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488548 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 11:11:34.499506 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488551 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 11:11:34.499506 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488553 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 11:11:34.499506 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.488556 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 11:11:34.499506 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.488561 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 11:11:34.499506 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.495603 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 14 11:11:34.499506 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.495624 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 14 11:11:34.499506 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.495644 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 14 11:11:34.499506 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.495650 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 14 11:11:34.499506 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495724 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 11:11:34.499506 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495730 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 11:11:34.499506 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495733 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 11:11:34.499506 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495736 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 11:11:34.499506 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495739 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 11:11:34.499506 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495742 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 11:11:34.499506 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495745 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 11:11:34.499879 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495747 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 11:11:34.499879 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495750 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 11:11:34.499879 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495753 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 11:11:34.499879 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495755 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 11:11:34.499879 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495757 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 11:11:34.499879 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495760 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 11:11:34.499879 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495762 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 11:11:34.499879 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495765 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 11:11:34.499879 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495767 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 11:11:34.499879 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495770 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 11:11:34.499879 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495772 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 11:11:34.499879 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495774 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 11:11:34.499879 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495777 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 11:11:34.499879 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495780 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 11:11:34.499879 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495783 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 11:11:34.499879 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495786 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 11:11:34.499879 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495789 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 11:11:34.499879 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495791 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 11:11:34.499879 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495794 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 11:11:34.499879 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495797 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 11:11:34.500372 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495799 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 11:11:34.500372 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495802 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 11:11:34.500372 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495805 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 11:11:34.500372 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495808 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 11:11:34.500372 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495810 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 11:11:34.500372 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495813 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 11:11:34.500372 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495816 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 11:11:34.500372 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495818 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 11:11:34.500372 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495821 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 11:11:34.500372 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495823 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 11:11:34.500372 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495826 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 11:11:34.500372 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495829 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 11:11:34.500372 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495831 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 11:11:34.500372 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495833 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 11:11:34.500372 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495836 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 11:11:34.500372 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495839 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 11:11:34.500372 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495841 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 11:11:34.500372 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495844 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 11:11:34.500372 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495846 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 11:11:34.500839 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495849 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 11:11:34.500839 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495851 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 11:11:34.500839 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495853 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 14 11:11:34.500839 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495856 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 11:11:34.500839 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495858 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 11:11:34.500839 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495861 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 11:11:34.500839 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495863 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 11:11:34.500839 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495868 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 11:11:34.500839 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495872 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 11:11:34.500839 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495875 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 11:11:34.500839 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495878 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 11:11:34.500839 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495880 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 11:11:34.500839 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495883 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 11:11:34.500839 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495886 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 11:11:34.500839 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495889 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 11:11:34.500839 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495893 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 11:11:34.500839 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495896 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 11:11:34.500839 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495898 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 11:11:34.500839 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495900 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 11:11:34.501326 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495903 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 11:11:34.501326 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495905 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 11:11:34.501326 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495907 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 11:11:34.501326 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495910 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 11:11:34.501326 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495912 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 11:11:34.501326 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495917 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 11:11:34.501326 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495934 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 11:11:34.501326 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495938 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 11:11:34.501326 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495942 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 11:11:34.501326 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495945 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 11:11:34.501326 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495948 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 11:11:34.501326 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495952 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 11:11:34.501326 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495956 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 11:11:34.501326 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495964 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 11:11:34.501326 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495967 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 11:11:34.501326 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495969 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 11:11:34.501326 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495972 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 11:11:34.501326 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495975 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 11:11:34.501326 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495977 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 11:11:34.501821 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495980 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 11:11:34.501821 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495982 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 11:11:34.501821 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495985 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 11:11:34.501821 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495988 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 11:11:34.501821 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495990 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 11:11:34.501821 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495993 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 11:11:34.501821 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495996 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 11:11:34.501821 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.495999 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 11:11:34.501821 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496001 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 11:11:34.501821 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496004 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 11:11:34.501821 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496006 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 11:11:34.501821 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496009 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 11:11:34.501821 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496012 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 11:11:34.501821 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496014 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 11:11:34.501821 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496017 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 11:11:34.502209 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.496022 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 11:11:34.502209 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496140 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 11:11:34.502209 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496145 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 11:11:34.502209 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496148 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 11:11:34.502209 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496151 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 11:11:34.502209 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496155 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 11:11:34.502209 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496158 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 11:11:34.502209 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496162 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 11:11:34.502209 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496164 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 11:11:34.502209 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496167 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 11:11:34.502209 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496170 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 11:11:34.502209 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496172 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 11:11:34.502209 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496174 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 11:11:34.502209 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496177 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 11:11:34.502555 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496179 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 11:11:34.502555 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496182 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 11:11:34.502555 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496185 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 11:11:34.502555 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496188 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 11:11:34.502555 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496190 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 11:11:34.502555 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496193 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 11:11:34.502555 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496196 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 11:11:34.502555 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496198 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 11:11:34.502555 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496201 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 11:11:34.502555 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496203 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 11:11:34.502555 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496206 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 11:11:34.502555 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496209 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 11:11:34.502555 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496211 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 11:11:34.502555 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496214 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 11:11:34.502555 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496216 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 11:11:34.502555 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496219 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 11:11:34.502555 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496222 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 11:11:34.502555 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496224 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 11:11:34.502555 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496227 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 11:11:34.502555 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496229 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 11:11:34.503061 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496232 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 11:11:34.503061 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496234 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 11:11:34.503061 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496237 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 11:11:34.503061 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496239 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 11:11:34.503061 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496242 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 11:11:34.503061 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496244 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 11:11:34.503061 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496247 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 11:11:34.503061 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496249 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 11:11:34.503061 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496252 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 11:11:34.503061 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496254 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 11:11:34.503061 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496257 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 11:11:34.503061 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496259 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 11:11:34.503061 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496262 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 11:11:34.503061 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496264 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 11:11:34.503061 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496267 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 11:11:34.503061 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496270 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 11:11:34.503061 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496272 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 11:11:34.503061 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496275 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 11:11:34.503061 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496278 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 11:11:34.503061 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496281 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 11:11:34.503548 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496283 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 11:11:34.503548 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496286 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 11:11:34.503548 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496288 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 11:11:34.503548 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496291 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 11:11:34.503548 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496293 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 11:11:34.503548 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496296 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 14 11:11:34.503548 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496298 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 11:11:34.503548 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496300 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 11:11:34.503548 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496303 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 11:11:34.503548 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496305 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 11:11:34.503548 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496307 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 11:11:34.503548 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496310 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 11:11:34.503548 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496313 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 11:11:34.503548 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496315 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 11:11:34.503548 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496318 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 11:11:34.503548 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496320 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 11:11:34.503548 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496323 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 11:11:34.503548 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496325 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 11:11:34.503548 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496328 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 11:11:34.503548 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496330 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 11:11:34.504087 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496332 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 11:11:34.504087 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496335 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 11:11:34.504087 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496338 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 11:11:34.504087 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496340 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 11:11:34.504087 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496342 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 11:11:34.504087 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496345 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 11:11:34.504087 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496349 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 11:11:34.504087 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496352 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 11:11:34.504087 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496356 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 11:11:34.504087 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496359 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 11:11:34.504087 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496361 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 11:11:34.504087 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496365 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 11:11:34.504087 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496369 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 11:11:34.504087 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496372 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 11:11:34.504087 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496374 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 11:11:34.504087 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496377 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 11:11:34.504087 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496379 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 11:11:34.504087 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496382 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 11:11:34.504087 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496384 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 11:11:34.504559 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496386 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 11:11:34.504559 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496389 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 11:11:34.504559 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496391 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 11:11:34.504559 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496394 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 11:11:34.504559 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496396 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 11:11:34.504559 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496398 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 11:11:34.504559 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:34.496401 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 11:11:34.504559 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.496406 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 11:11:34.504559 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.496550 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jul 14 11:11:34.504559 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.498806 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 14 11:11:34.504559 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.500900 2576 server.go:1019] "Starting client certificate rotation" Jul 14 11:11:34.504559 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.501023 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 11:11:34.504559 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.501066 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 11:11:34.504559 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.503792 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 11:11:34.505387 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.505365 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 11:11:34.513538 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.513509 2576 log.go:25] "Validated CRI v1 runtime API" Jul 14 11:11:34.515903 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.515883 2576 log.go:25] "Validated CRI v1 image API" Jul 14 11:11:34.517578 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.517555 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 14 11:11:34.520402 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.520376 2576 fs.go:135] Filesystem UUIDs: map[2bb427d4-51be-46da-96d8-3c956c2e1fd5:/dev/nvme0n1p4 65bd9664-9fec-47f2-af86-bd1d4d2e1499:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 14 11:11:34.520402 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.520397 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 14 11:11:34.525111 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.524979 2576 manager.go:216] Machine: {Timestamp:2026-07-14 11:11:34.524396872 +0000 UTC m=+0.339392622 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100500 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec212f7c0d3022eec29655689151bb0a SystemUUID:ec212f7c-0d30-22ee-c296-55689151bb0a BootID:bfa0210e-8818-450d-91e6-d1ba8ec59fcb Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:35:1a:bb:70:dd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:35:1a:bb:70:dd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:e0:67:43:a8:06 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 14 11:11:34.525111 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.525101 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 14 11:11:34.525278 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.525196 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 14 11:11:34.528283 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.528245 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 14 11:11:34.528451 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.528287 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-35.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 14 11:11:34.529064 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.529050 2576 topology_manager.go:138] "Creating topology manager with none policy" Jul 14 11:11:34.529105 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.529068 2576 container_manager_linux.go:309] "Creating device plugin manager" Jul 14 11:11:34.529105 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.529076 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 11:11:34.529105 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.529088 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 11:11:34.530440 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.530426 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 14 11:11:34.534147 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.534124 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 14 11:11:34.534306 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.534294 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 14 11:11:34.534973 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.534959 2576 kubelet.go:486] "Attempting to sync node with API server" Jul 14 11:11:34.535043 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.534980 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 14 11:11:34.535043 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.535001 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 14 11:11:34.535043 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.535016 2576 kubelet.go:398] "Adding apiserver pod source" Jul 14 11:11:34.535043 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.535028 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 14 11:11:34.535463 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.535450 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 11:11:34.535500 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.535469 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 11:11:34.537588 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.537561 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 11:11:34.538168 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.538151 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 14 11:11:34.540270 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.540251 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 14 11:11:34.540354 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.540290 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 14 11:11:34.540513 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.540499 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 14 11:11:34.540582 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.540520 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 14 11:11:34.540582 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.540529 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 14 11:11:34.540582 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.540538 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 14 11:11:34.540582 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.540550 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 14 11:11:34.540582 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.540557 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 14 11:11:34.541279 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.541264 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 14 11:11:34.541279 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.541280 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 14 11:11:34.541391 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.541291 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 14 11:11:34.541391 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.541299 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 14 11:11:34.541391 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.541312 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 14 11:11:34.541391 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.541325 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 14 11:11:34.542204 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.542191 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 14 11:11:34.542256 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.542206 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 14 11:11:34.545711 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.545693 2576 server.go:1268] "Started kubelet" Jul 14 11:11:34.545836 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.545802 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 14 11:11:34.545880 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.545788 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 14 11:11:34.545939 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.545885 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 14 11:11:34.546739 ip-10-0-139-35 systemd[1]: Started Kubernetes Kubelet. Jul 14 11:11:34.547448 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.547286 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 14 11:11:34.551899 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:34.551832 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-35.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 14 11:11:34.552124 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:34.551883 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 14 11:11:34.552667 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.552645 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-35.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 14 11:11:34.553399 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:34.553376 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 14 11:11:34.553989 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.553968 2576 server.go:310] "Adding debug handlers to kubelet server" Jul 14 11:11:34.558465 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:34.557119 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-35.ec2.internal.18c2238dd9ebe5e4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-35.ec2.internal,UID:ip-10-0-139-35.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-35.ec2.internal,},FirstTimestamp:2026-07-14 11:11:34.545614308 +0000 UTC m=+0.360610101,LastTimestamp:2026-07-14 11:11:34.545614308 +0000 UTC m=+0.360610101,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-35.ec2.internal,}" Jul 14 11:11:34.558465 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.558455 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 14 11:11:34.558465 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.558463 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 14 11:11:34.558689 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:34.558563 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-35.ec2.internal\" not found" Jul 14 11:11:34.559191 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.559172 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 14 11:11:34.559191 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.559175 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 14 11:11:34.559330 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.559202 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 14 11:11:34.559330 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.559291 2576 reconstruct.go:97] "Volume reconstruction finished" Jul 14 11:11:34.559330 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.559300 2576 reconciler.go:29] "Reconciler: start to sync state" Jul 14 11:11:34.560225 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.560206 2576 factory.go:55] Registering systemd factory Jul 14 11:11:34.560308 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.560230 2576 factory.go:223] Registration of the systemd container factory successfully Jul 14 11:11:34.560614 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.560475 2576 factory.go:153] Registering CRI-O factory Jul 14 11:11:34.560614 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.560492 2576 factory.go:223] Registration of the crio container factory successfully Jul 14 11:11:34.560614 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.560545 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 14 11:11:34.560614 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.560570 2576 factory.go:103] Registering Raw factory Jul 14 11:11:34.560614 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.560585 2576 manager.go:1196] Started watching for new ooms in manager Jul 14 11:11:34.561041 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.561023 2576 manager.go:349] Starting recovery of all containers Jul 14 11:11:34.565755 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:34.565719 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 14 11:11:34.565851 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:34.565808 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-35.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 14 11:11:34.570263 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.570131 2576 manager.go:354] Recovery completed Jul 14 11:11:34.572099 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:34.572069 2576 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 14 11:11:34.575336 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.575322 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 11:11:34.577597 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.577569 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-35.ec2.internal" event="NodeHasSufficientMemory" Jul 14 11:11:34.577658 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.577613 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-35.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 11:11:34.577658 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.577627 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-35.ec2.internal" event="NodeHasSufficientPID" Jul 14 11:11:34.578239 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.578224 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 14 11:11:34.578239 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.578237 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 14 11:11:34.578371 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.578257 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 14 11:11:34.578371 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.578291 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 11:11:34.579105 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.579089 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-35.ec2.internal" event="NodeHasSufficientMemory" Jul 14 11:11:34.579181 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.579124 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-35.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 11:11:34.579181 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.579139 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-35.ec2.internal" event="NodeHasSufficientPID" Jul 14 11:11:34.579494 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.579478 2576 policy_none.go:49] "None policy: Start" Jul 14 11:11:34.579494 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.579496 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 14 11:11:34.579594 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.579508 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 14 11:11:34.579818 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:34.579744 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-35.ec2.internal.18c2238ddbd3eabd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-35.ec2.internal,UID:ip-10-0-139-35.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-35.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-35.ec2.internal,},FirstTimestamp:2026-07-14 11:11:34.577597117 +0000 UTC m=+0.392592852,LastTimestamp:2026-07-14 11:11:34.577597117 +0000 UTC m=+0.392592852,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-35.ec2.internal,}" Jul 14 11:11:34.580835 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.580824 2576 policy_none.go:47] "Start" Jul 14 11:11:34.586542 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.586523 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6wnhn" Jul 14 11:11:34.593560 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:34.593458 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-35.ec2.internal.18c2238ddbd4448d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-35.ec2.internal,UID:ip-10-0-139-35.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-35.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-35.ec2.internal,},FirstTimestamp:2026-07-14 11:11:34.577620109 +0000 UTC m=+0.392615845,LastTimestamp:2026-07-14 11:11:34.577620109 +0000 UTC m=+0.392615845,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-35.ec2.internal,}" Jul 14 11:11:34.597447 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:34.597368 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-35.ec2.internal.18c2238ddbd46fe6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-35.ec2.internal,UID:ip-10-0-139-35.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-35.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-35.ec2.internal,},FirstTimestamp:2026-07-14 11:11:34.577631206 +0000 UTC m=+0.392626936,LastTimestamp:2026-07-14 11:11:34.577631206 +0000 UTC m=+0.392626936,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-35.ec2.internal,}" Jul 14 11:11:34.597876 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.597854 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6wnhn" Jul 14 11:11:34.622736 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.622713 2576 manager.go:337] "Starting Device Plugin manager" Jul 14 11:11:34.622902 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:34.622763 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 14 11:11:34.622902 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.622776 2576 server.go:87] "Starting device plugin registration server" Jul 14 11:11:34.623160 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.623145 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 14 11:11:34.623212 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.623164 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 14 11:11:34.623306 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.623286 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 14 11:11:34.623408 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.623388 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 14 11:11:34.623408 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.623401 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 14 11:11:34.623942 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:34.623901 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 14 11:11:34.624075 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:34.623973 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-35.ec2.internal\" not found" Jul 14 11:11:34.711083 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.711039 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 14 11:11:34.712528 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.712509 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 14 11:11:34.712598 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.712562 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 14 11:11:34.712598 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.712591 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jul 14 11:11:34.712671 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:34.712638 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 14 11:11:34.716305 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.716278 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 11:11:34.723784 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.723756 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 11:11:34.725037 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.725019 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-35.ec2.internal" event="NodeHasSufficientMemory" Jul 14 11:11:34.725125 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.725053 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-35.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 11:11:34.725125 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.725065 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-35.ec2.internal" event="NodeHasSufficientPID" Jul 14 11:11:34.725125 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.725089 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-35.ec2.internal" Jul 14 11:11:34.745314 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.745248 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-35.ec2.internal" Jul 14 11:11:34.745314 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:34.745283 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-35.ec2.internal\": node \"ip-10-0-139-35.ec2.internal\" not found" Jul 14 11:11:34.799223 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:34.799192 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-35.ec2.internal\" not found" Jul 14 11:11:34.813220 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.813178 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-35.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-35.ec2.internal"] Jul 14 11:11:34.813293 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.813263 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 11:11:34.815692 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.815675 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-35.ec2.internal" event="NodeHasSufficientMemory" Jul 14 11:11:34.815786 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.815704 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-35.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 11:11:34.815786 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.815714 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-35.ec2.internal" event="NodeHasSufficientPID" Jul 14 11:11:34.816841 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.816827 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 11:11:34.816959 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.816943 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-35.ec2.internal" Jul 14 11:11:34.816998 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.816986 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 11:11:34.817646 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.817626 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-35.ec2.internal" event="NodeHasSufficientMemory" Jul 14 11:11:34.817740 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.817653 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-35.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 11:11:34.817740 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.817662 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-35.ec2.internal" event="NodeHasSufficientPID" Jul 14 11:11:34.817740 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.817623 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-35.ec2.internal" event="NodeHasSufficientMemory" Jul 14 11:11:34.817740 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.817729 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-35.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 11:11:34.817883 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.817745 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-35.ec2.internal" event="NodeHasSufficientPID" Jul 14 11:11:34.818963 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.818945 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-35.ec2.internal" Jul 14 11:11:34.819065 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.818974 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 11:11:34.819676 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.819652 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-35.ec2.internal" event="NodeHasSufficientMemory" Jul 14 11:11:34.819747 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.819689 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-35.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 11:11:34.819747 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.819701 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-35.ec2.internal" event="NodeHasSufficientPID" Jul 14 11:11:34.834636 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:34.834603 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-35.ec2.internal\" not found" node="ip-10-0-139-35.ec2.internal" Jul 14 11:11:34.838757 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:34.838735 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-35.ec2.internal\" not found" node="ip-10-0-139-35.ec2.internal" Jul 14 11:11:34.862112 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.862076 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c51082c0153c21c37ec0e44752612da3-config\") pod \"kube-apiserver-proxy-ip-10-0-139-35.ec2.internal\" (UID: \"c51082c0153c21c37ec0e44752612da3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-35.ec2.internal" Jul 14 11:11:34.862112 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.862114 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/05132bffdc399194f7afbfef4cacafcb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-35.ec2.internal\" (UID: \"05132bffdc399194f7afbfef4cacafcb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-35.ec2.internal" Jul 14 11:11:34.862248 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.862142 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/05132bffdc399194f7afbfef4cacafcb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-35.ec2.internal\" (UID: \"05132bffdc399194f7afbfef4cacafcb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-35.ec2.internal" Jul 14 11:11:34.899542 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:34.899505 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-35.ec2.internal\" not found" Jul 14 11:11:34.962299 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.962262 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c51082c0153c21c37ec0e44752612da3-config\") pod \"kube-apiserver-proxy-ip-10-0-139-35.ec2.internal\" (UID: \"c51082c0153c21c37ec0e44752612da3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-35.ec2.internal" Jul 14 11:11:34.962415 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.962310 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/05132bffdc399194f7afbfef4cacafcb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-35.ec2.internal\" (UID: \"05132bffdc399194f7afbfef4cacafcb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-35.ec2.internal" Jul 14 11:11:34.962415 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.962329 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/05132bffdc399194f7afbfef4cacafcb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-35.ec2.internal\" (UID: \"05132bffdc399194f7afbfef4cacafcb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-35.ec2.internal" Jul 14 11:11:34.962415 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.962376 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/05132bffdc399194f7afbfef4cacafcb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-35.ec2.internal\" (UID: \"05132bffdc399194f7afbfef4cacafcb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-35.ec2.internal" Jul 14 11:11:34.962415 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.962385 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/05132bffdc399194f7afbfef4cacafcb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-35.ec2.internal\" (UID: \"05132bffdc399194f7afbfef4cacafcb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-35.ec2.internal" Jul 14 11:11:34.962415 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:34.962386 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c51082c0153c21c37ec0e44752612da3-config\") pod \"kube-apiserver-proxy-ip-10-0-139-35.ec2.internal\" (UID: \"c51082c0153c21c37ec0e44752612da3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-35.ec2.internal" Jul 14 11:11:35.000365 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:35.000288 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-35.ec2.internal\" not found" Jul 14 11:11:35.101036 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:35.101000 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-35.ec2.internal\" not found" Jul 14 11:11:35.136177 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:35.136150 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-35.ec2.internal" Jul 14 11:11:35.142010 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:35.141986 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-35.ec2.internal" Jul 14 11:11:35.202038 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:35.201994 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-35.ec2.internal\" not found" Jul 14 11:11:35.302651 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:35.302574 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-35.ec2.internal\" not found" Jul 14 11:11:35.403120 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:35.403079 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-35.ec2.internal\" not found" Jul 14 11:11:35.499740 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:35.499708 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 14 11:11:35.500338 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:35.499897 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 14 11:11:35.503894 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:35.503871 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-35.ec2.internal\" not found" Jul 14 11:11:36.843001 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:36.842956 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 11:06:35 +0000 UTC" deadline="2028-02-05 15:37:11.801975671 +0000 UTC" Jul 14 11:11:36.843001 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:36.842998 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13708h25m34.958983163s" Jul 14 11:11:36.846154 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:36.846122 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-35.ec2.internal\" not found" Jul 14 11:11:36.884475 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:36.884442 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 11:11:36.885643 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:36.885622 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-35.ec2.internal" event="NodeHasSufficientMemory" Jul 14 11:11:36.885752 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:36.885656 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-35.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 11:11:36.885752 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:36.885666 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-35.ec2.internal" event="NodeHasSufficientPID" Jul 14 11:11:36.907151 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:36.907114 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc51082c0153c21c37ec0e44752612da3.slice/crio-0eb75e7d4853fabd10cbd3c3c1043c06eb825ebdd264e1640eaa3a44902f7229 WatchSource:0}: Error finding container 0eb75e7d4853fabd10cbd3c3c1043c06eb825ebdd264e1640eaa3a44902f7229: Status 404 returned error can't find the container with id 0eb75e7d4853fabd10cbd3c3c1043c06eb825ebdd264e1640eaa3a44902f7229 Jul 14 11:11:36.911461 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:36.911438 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 11:11:36.946630 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:36.946594 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-35.ec2.internal\" not found" Jul 14 11:11:36.958058 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:36.958010 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-35.ec2.internal" event={"ID":"c51082c0153c21c37ec0e44752612da3","Type":"ContainerStarted","Data":"0eb75e7d4853fabd10cbd3c3c1043c06eb825ebdd264e1640eaa3a44902f7229"} Jul 14 11:11:36.968134 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:36.968109 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 11:11:37.000639 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.000601 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-35.ec2.internal" Jul 14 11:11:37.013327 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.013300 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 11:11:37.015497 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.015480 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-35.ec2.internal" Jul 14 11:11:37.035035 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.035011 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 11:11:37.140868 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.140851 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 11:11:37.143227 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:37.143204 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05132bffdc399194f7afbfef4cacafcb.slice/crio-408b23feef839b9ac220c4ad320c73df9c81364f7f0b95db0b912d7f6c9dd251 WatchSource:0}: Error finding container 408b23feef839b9ac220c4ad320c73df9c81364f7f0b95db0b912d7f6c9dd251: Status 404 returned error can't find the container with id 408b23feef839b9ac220c4ad320c73df9c81364f7f0b95db0b912d7f6c9dd251 Jul 14 11:11:37.355485 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.355456 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 11:11:37.711034 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.710996 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 11:11:37.778179 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.778142 2576 apiserver.go:52] "Watching apiserver" Jul 14 11:11:37.786949 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.786906 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 14 11:11:37.791503 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.791449 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-35.ec2.internal","openshift-multus/multus-additional-cni-plugins-v2tgd","openshift-network-diagnostics/network-check-target-8hpw4","openshift-cluster-node-tuning-operator/tuned-khg77","openshift-dns/node-resolver-rf5p6","openshift-multus/multus-9fwbj","openshift-multus/network-metrics-daemon-pql69","openshift-network-operator/iptables-alerter-kn68m","openshift-ovn-kubernetes/ovnkube-node-rvhwc","kube-system/global-pull-secret-syncer-mcz4r","kube-system/konnectivity-agent-kd42k","kube-system/kube-apiserver-proxy-ip-10-0-139-35.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wshj6","openshift-image-registry/node-ca-qmwvf"] Jul 14 11:11:37.793181 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.793149 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kn68m" Jul 14 11:11:37.794651 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.794626 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:11:37.794789 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:37.794739 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pql69" podUID="8792ce35-00f9-4101-aab2-346a02150768" Jul 14 11:11:37.796391 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.796360 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hpw4" Jul 14 11:11:37.796507 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:37.796455 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hpw4" podUID="62c5ec52-328c-4c4c-85ad-ecfe23a6e93e" Jul 14 11:11:37.796828 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.796806 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 14 11:11:37.797403 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.797378 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 14 11:11:37.797908 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.797887 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.799563 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.798591 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-46tk9\"" Jul 14 11:11:37.799563 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.798966 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 14 11:11:37.799563 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.799232 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rf5p6" Jul 14 11:11:37.800846 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.800824 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 14 11:11:37.801108 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.801091 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.802399 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.802379 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v2tgd" Jul 14 11:11:37.803423 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.803400 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 14 11:11:37.803532 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.803488 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-npkh5\"" Jul 14 11:11:37.803532 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.803510 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 14 11:11:37.803964 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.803945 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:37.805420 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.805404 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcz4r" Jul 14 11:11:37.805508 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:37.805483 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mcz4r" podUID="485ab2d2-0fbc-4d2d-95b0-d60732668829" Jul 14 11:11:37.806609 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.806589 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kd42k" Jul 14 11:11:37.806928 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.806912 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 14 11:11:37.807059 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.807047 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 14 11:11:37.807107 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.807056 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 14 11:11:37.808057 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.808038 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wshj6" Jul 14 11:11:37.808493 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.808318 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 14 11:11:37.808581 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.808565 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 14 11:11:37.808702 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.808685 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 14 11:11:37.808911 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.808830 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jkjgp\"" Jul 14 11:11:37.808911 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.808831 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rgkcg\"" Jul 14 11:11:37.810055 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.809641 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qmwvf" Jul 14 11:11:37.813317 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813294 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-etc-sysctl-d\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.813436 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813326 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-host-var-lib-cni-bin\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.813436 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813344 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkm9w\" (UniqueName: \"kubernetes.io/projected/8792ce35-00f9-4101-aab2-346a02150768-kube-api-access-hkm9w\") pod \"network-metrics-daemon-pql69\" (UID: \"8792ce35-00f9-4101-aab2-346a02150768\") " pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:11:37.813436 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813366 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-etc-kubernetes\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.813436 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813388 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-host-run-netns\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.813436 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813407 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e02a70bf-1675-40bd-b486-2a13f65e845b-iptables-alerter-script\") pod \"iptables-alerter-kn68m\" (UID: \"e02a70bf-1675-40bd-b486-2a13f65e845b\") " pod="openshift-network-operator/iptables-alerter-kn68m" Jul 14 11:11:37.813436 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813420 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-host\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.813436 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813435 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-os-release\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.813801 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813452 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-host-var-lib-kubelet\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.813801 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813476 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-host-run-multus-certs\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.813801 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813493 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8cb4cc75-45c5-4e00-8434-71d348adcb4d-hosts-file\") pod \"node-resolver-rf5p6\" (UID: \"8cb4cc75-45c5-4e00-8434-71d348adcb4d\") " pod="openshift-dns/node-resolver-rf5p6" Jul 14 11:11:37.813801 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813512 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-etc-kubernetes\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.813801 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813526 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-tmp\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.813801 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813577 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e02a70bf-1675-40bd-b486-2a13f65e845b-host-slash\") pod \"iptables-alerter-kn68m\" (UID: \"e02a70bf-1675-40bd-b486-2a13f65e845b\") " pod="openshift-network-operator/iptables-alerter-kn68m" Jul 14 11:11:37.813801 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813599 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-etc-modprobe-d\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.813801 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813614 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-etc-systemd\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.813801 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813628 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-multus-conf-dir\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.813801 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813648 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-etc-sysconfig\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.813801 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813665 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-lib-modules\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.813801 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813680 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-etc-tuned\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.813801 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813692 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8cb4cc75-45c5-4e00-8434-71d348adcb4d-tmp-dir\") pod \"node-resolver-rf5p6\" (UID: \"8cb4cc75-45c5-4e00-8434-71d348adcb4d\") " pod="openshift-dns/node-resolver-rf5p6" Jul 14 11:11:37.813801 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813706 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79wlk\" (UniqueName: \"kubernetes.io/projected/8cb4cc75-45c5-4e00-8434-71d348adcb4d-kube-api-access-79wlk\") pod \"node-resolver-rf5p6\" (UID: \"8cb4cc75-45c5-4e00-8434-71d348adcb4d\") " pod="openshift-dns/node-resolver-rf5p6" Jul 14 11:11:37.813801 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813721 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-multus-cni-dir\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.813801 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813735 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-cnibin\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.813801 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813748 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-host-var-lib-cni-multus\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.814675 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813763 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-etc-sysctl-conf\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.814675 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813778 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-run\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.814675 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813807 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6dde3a96-cce6-4b23-aa81-61c89f0a836d-cni-binary-copy\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.814675 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813823 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-host-run-k8s-cni-cncf-io\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.814675 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813838 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6dde3a96-cce6-4b23-aa81-61c89f0a836d-multus-daemon-config\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.814675 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813851 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rndz\" (UniqueName: \"kubernetes.io/projected/6dde3a96-cce6-4b23-aa81-61c89f0a836d-kube-api-access-2rndz\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.814675 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813866 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8792ce35-00f9-4101-aab2-346a02150768-metrics-certs\") pod \"network-metrics-daemon-pql69\" (UID: \"8792ce35-00f9-4101-aab2-346a02150768\") " pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:11:37.814675 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813881 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-sys\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.814675 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813898 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-var-lib-kubelet\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.814675 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813915 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twn95\" (UniqueName: \"kubernetes.io/projected/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-kube-api-access-twn95\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.814675 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813945 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-system-cni-dir\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.814675 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813961 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-multus-socket-dir-parent\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.814675 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813976 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-hostroot\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.814675 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.813994 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tjw8\" (UniqueName: \"kubernetes.io/projected/e02a70bf-1675-40bd-b486-2a13f65e845b-kube-api-access-4tjw8\") pod \"iptables-alerter-kn68m\" (UID: \"e02a70bf-1675-40bd-b486-2a13f65e845b\") " pod="openshift-network-operator/iptables-alerter-kn68m" Jul 14 11:11:37.814675 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.814022 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdxlj\" (UniqueName: \"kubernetes.io/projected/62c5ec52-328c-4c4c-85ad-ecfe23a6e93e-kube-api-access-wdxlj\") pod \"network-check-target-8hpw4\" (UID: \"62c5ec52-328c-4c4c-85ad-ecfe23a6e93e\") " pod="openshift-network-diagnostics/network-check-target-8hpw4" Jul 14 11:11:37.815237 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.814974 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 14 11:11:37.815402 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.815384 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 14 11:11:37.815444 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.815430 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 14 11:11:37.816991 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.815670 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 14 11:11:37.816991 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.815701 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ph787\"" Jul 14 11:11:37.816991 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.815731 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4pr82\"" Jul 14 11:11:37.816991 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.815776 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pd8nn\"" Jul 14 11:11:37.816991 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.816066 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 14 11:11:37.816991 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.816305 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6c78x\"" Jul 14 11:11:37.816991 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.816375 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 14 11:11:37.816991 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.816456 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 14 11:11:37.816991 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.816496 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 14 11:11:37.816991 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.816378 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 14 11:11:37.816991 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.816653 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 14 11:11:37.816991 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.815384 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9r85h\"" Jul 14 11:11:37.816991 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.816916 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 14 11:11:37.817696 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.817055 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 14 11:11:37.817696 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.817179 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 14 11:11:37.817696 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.817256 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 14 11:11:37.817696 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.817268 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 14 11:11:37.817696 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.817325 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 14 11:11:37.835748 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.835718 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 11:11:37.880589 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.880551 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-f4j7t" Jul 14 11:11:37.889446 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.889405 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-f4j7t" Jul 14 11:11:37.902355 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.902311 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 14 11:11:37.919187 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.914855 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8cb4cc75-45c5-4e00-8434-71d348adcb4d-hosts-file\") pod \"node-resolver-rf5p6\" (UID: \"8cb4cc75-45c5-4e00-8434-71d348adcb4d\") " pod="openshift-dns/node-resolver-rf5p6" Jul 14 11:11:37.919187 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.914903 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghwwr\" (UniqueName: \"kubernetes.io/projected/c428ac6b-bf9d-4d77-8554-c2c09614b02c-kube-api-access-ghwwr\") pod \"node-ca-qmwvf\" (UID: \"c428ac6b-bf9d-4d77-8554-c2c09614b02c\") " pod="openshift-image-registry/node-ca-qmwvf" Jul 14 11:11:37.919187 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.914933 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e02a70bf-1675-40bd-b486-2a13f65e845b-host-slash\") pod \"iptables-alerter-kn68m\" (UID: \"e02a70bf-1675-40bd-b486-2a13f65e845b\") " pod="openshift-network-operator/iptables-alerter-kn68m" Jul 14 11:11:37.919187 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.914959 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-etc-modprobe-d\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.919187 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.914983 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-etc-systemd\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.919187 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915000 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-multus-conf-dir\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.919187 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915015 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-run-systemd\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:37.919187 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915029 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-etc-sysconfig\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.919187 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915044 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-lib-modules\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.919187 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915061 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8cb4cc75-45c5-4e00-8434-71d348adcb4d-tmp-dir\") pod \"node-resolver-rf5p6\" (UID: \"8cb4cc75-45c5-4e00-8434-71d348adcb4d\") " pod="openshift-dns/node-resolver-rf5p6" Jul 14 11:11:37.919187 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915086 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-multus-cni-dir\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.919187 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915107 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-cnibin\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.919187 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915126 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-host-var-lib-cni-multus\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.919187 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915140 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rndz\" (UniqueName: \"kubernetes.io/projected/6dde3a96-cce6-4b23-aa81-61c89f0a836d-kube-api-access-2rndz\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.919187 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915156 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/720aefb6-81a1-44d1-a01f-4bc07ff30465-ovn-node-metrics-cert\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:37.919187 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915172 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7fa811e8-b74b-4cf5-ab86-0570d535e142-cnibin\") pod \"multus-additional-cni-plugins-v2tgd\" (UID: \"7fa811e8-b74b-4cf5-ab86-0570d535e142\") " pod="openshift-multus/multus-additional-cni-plugins-v2tgd" Jul 14 11:11:37.919187 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915189 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-etc-sysctl-conf\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.920216 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915204 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-run\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.920216 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915218 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8792ce35-00f9-4101-aab2-346a02150768-metrics-certs\") pod \"network-metrics-daemon-pql69\" (UID: \"8792ce35-00f9-4101-aab2-346a02150768\") " pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:11:37.920216 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915233 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-var-lib-kubelet\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.920216 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915248 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-system-cni-dir\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.920216 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915272 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-multus-socket-dir-parent\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.920216 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915294 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-hostroot\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.920216 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915314 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-log-socket\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:37.920216 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915349 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-etc-sysctl-d\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.920216 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915364 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-host-var-lib-cni-bin\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.920216 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915379 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7fa811e8-b74b-4cf5-ab86-0570d535e142-system-cni-dir\") pod \"multus-additional-cni-plugins-v2tgd\" (UID: \"7fa811e8-b74b-4cf5-ab86-0570d535e142\") " pod="openshift-multus/multus-additional-cni-plugins-v2tgd" Jul 14 11:11:37.920216 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915399 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsmsv\" (UniqueName: \"kubernetes.io/projected/720aefb6-81a1-44d1-a01f-4bc07ff30465-kube-api-access-bsmsv\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:37.920216 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915415 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkm9w\" (UniqueName: \"kubernetes.io/projected/8792ce35-00f9-4101-aab2-346a02150768-kube-api-access-hkm9w\") pod \"network-metrics-daemon-pql69\" (UID: \"8792ce35-00f9-4101-aab2-346a02150768\") " pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:11:37.920216 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915438 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-etc-kubernetes\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.920216 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915456 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-host-run-netns\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.920216 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915476 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f8cdb4dc-f26c-4e5a-92a6-888681827bda-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wshj6\" (UID: \"f8cdb4dc-f26c-4e5a-92a6-888681827bda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wshj6" Jul 14 11:11:37.920216 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915501 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f8cdb4dc-f26c-4e5a-92a6-888681827bda-sys-fs\") pod \"aws-ebs-csi-driver-node-wshj6\" (UID: \"f8cdb4dc-f26c-4e5a-92a6-888681827bda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wshj6" Jul 14 11:11:37.920216 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915515 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c428ac6b-bf9d-4d77-8554-c2c09614b02c-host\") pod \"node-ca-qmwvf\" (UID: \"c428ac6b-bf9d-4d77-8554-c2c09614b02c\") " pod="openshift-image-registry/node-ca-qmwvf" Jul 14 11:11:37.921014 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915529 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-host-cni-bin\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:37.921014 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915565 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/485ab2d2-0fbc-4d2d-95b0-d60732668829-dbus\") pod \"global-pull-secret-syncer-mcz4r\" (UID: \"485ab2d2-0fbc-4d2d-95b0-d60732668829\") " pod="kube-system/global-pull-secret-syncer-mcz4r" Jul 14 11:11:37.921014 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915604 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e02a70bf-1675-40bd-b486-2a13f65e845b-iptables-alerter-script\") pod \"iptables-alerter-kn68m\" (UID: \"e02a70bf-1675-40bd-b486-2a13f65e845b\") " pod="openshift-network-operator/iptables-alerter-kn68m" Jul 14 11:11:37.921014 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915626 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-host-run-multus-certs\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.921014 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915649 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-var-lib-openvswitch\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:37.921014 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915671 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-run\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.921014 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915680 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/720aefb6-81a1-44d1-a01f-4bc07ff30465-ovnkube-config\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:37.921014 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915707 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/720aefb6-81a1-44d1-a01f-4bc07ff30465-env-overrides\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:37.921014 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915853 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-host-var-lib-cni-multus\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.921014 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915899 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8cb4cc75-45c5-4e00-8434-71d348adcb4d-hosts-file\") pod \"node-resolver-rf5p6\" (UID: \"8cb4cc75-45c5-4e00-8434-71d348adcb4d\") " pod="openshift-dns/node-resolver-rf5p6" Jul 14 11:11:37.921014 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.915944 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e02a70bf-1675-40bd-b486-2a13f65e845b-host-slash\") pod \"iptables-alerter-kn68m\" (UID: \"e02a70bf-1675-40bd-b486-2a13f65e845b\") " pod="openshift-network-operator/iptables-alerter-kn68m" Jul 14 11:11:37.921014 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.916057 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-etc-modprobe-d\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.921014 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.916096 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-etc-systemd\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.921014 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.916144 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-etc-kubernetes\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.921014 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.916170 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c428ac6b-bf9d-4d77-8554-c2c09614b02c-serviceca\") pod \"node-ca-qmwvf\" (UID: \"c428ac6b-bf9d-4d77-8554-c2c09614b02c\") " pod="openshift-image-registry/node-ca-qmwvf" Jul 14 11:11:37.921014 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.916204 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7fa811e8-b74b-4cf5-ab86-0570d535e142-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v2tgd\" (UID: \"7fa811e8-b74b-4cf5-ab86-0570d535e142\") " pod="openshift-multus/multus-additional-cni-plugins-v2tgd" Jul 14 11:11:37.921014 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.916217 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-etc-sysctl-d\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.921779 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.916230 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/720aefb6-81a1-44d1-a01f-4bc07ff30465-ovnkube-script-lib\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:37.921779 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.916254 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-multus-conf-dir\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.921779 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.916255 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-tmp\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.921779 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.916288 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f8cdb4dc-f26c-4e5a-92a6-888681827bda-socket-dir\") pod \"aws-ebs-csi-driver-node-wshj6\" (UID: \"f8cdb4dc-f26c-4e5a-92a6-888681827bda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wshj6" Jul 14 11:11:37.921779 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.916342 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f8cdb4dc-f26c-4e5a-92a6-888681827bda-etc-selinux\") pod \"aws-ebs-csi-driver-node-wshj6\" (UID: \"f8cdb4dc-f26c-4e5a-92a6-888681827bda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wshj6" Jul 14 11:11:37.921779 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.916366 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7fa811e8-b74b-4cf5-ab86-0570d535e142-cni-binary-copy\") pod \"multus-additional-cni-plugins-v2tgd\" (UID: \"7fa811e8-b74b-4cf5-ab86-0570d535e142\") " pod="openshift-multus/multus-additional-cni-plugins-v2tgd" Jul 14 11:11:37.921779 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.916390 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-host-run-netns\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:37.921779 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.916416 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-host-cni-netd\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:37.921779 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.916462 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-etc-tuned\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.921779 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.916489 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79wlk\" (UniqueName: \"kubernetes.io/projected/8cb4cc75-45c5-4e00-8434-71d348adcb4d-kube-api-access-79wlk\") pod \"node-resolver-rf5p6\" (UID: \"8cb4cc75-45c5-4e00-8434-71d348adcb4d\") " pod="openshift-dns/node-resolver-rf5p6" Jul 14 11:11:37.921779 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.916515 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb44p\" (UniqueName: \"kubernetes.io/projected/f8cdb4dc-f26c-4e5a-92a6-888681827bda-kube-api-access-cb44p\") pod \"aws-ebs-csi-driver-node-wshj6\" (UID: \"f8cdb4dc-f26c-4e5a-92a6-888681827bda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wshj6" Jul 14 11:11:37.921779 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.916563 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpx7t\" (UniqueName: \"kubernetes.io/projected/7fa811e8-b74b-4cf5-ab86-0570d535e142-kube-api-access-jpx7t\") pod \"multus-additional-cni-plugins-v2tgd\" (UID: \"7fa811e8-b74b-4cf5-ab86-0570d535e142\") " pod="openshift-multus/multus-additional-cni-plugins-v2tgd" Jul 14 11:11:37.921779 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.916591 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-host-kubelet\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:37.921779 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.916615 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-etc-openvswitch\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:37.921779 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.916617 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 14 11:11:37.921779 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.916668 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-run-ovn\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:37.921779 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.916691 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-node-log\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:37.922583 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.916718 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6dde3a96-cce6-4b23-aa81-61c89f0a836d-cni-binary-copy\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.922583 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.916740 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-host-run-k8s-cni-cncf-io\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.922583 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.916763 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6dde3a96-cce6-4b23-aa81-61c89f0a836d-multus-daemon-config\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.922583 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.916785 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f8cdb4dc-f26c-4e5a-92a6-888681827bda-registration-dir\") pod \"aws-ebs-csi-driver-node-wshj6\" (UID: \"f8cdb4dc-f26c-4e5a-92a6-888681827bda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wshj6" Jul 14 11:11:37.922583 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.916810 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7fa811e8-b74b-4cf5-ab86-0570d535e142-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v2tgd\" (UID: \"7fa811e8-b74b-4cf5-ab86-0570d535e142\") " pod="openshift-multus/multus-additional-cni-plugins-v2tgd" Jul 14 11:11:37.922583 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.916836 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-systemd-units\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:37.922583 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.916861 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-run-openvswitch\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:37.922583 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.916888 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-host-run-ovn-kubernetes\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:37.922583 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.916964 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-sys\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.922583 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.917189 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-host-var-lib-cni-bin\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.922583 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.917330 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-etc-sysctl-conf\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.922583 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.917815 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-system-cni-dir\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.922583 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.917874 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-etc-sysconfig\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.922583 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.918006 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-lib-modules\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.922583 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:37.918130 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:37.922583 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:37.918207 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8792ce35-00f9-4101-aab2-346a02150768-metrics-certs podName:8792ce35-00f9-4101-aab2-346a02150768 nodeName:}" failed. No retries permitted until 2026-07-14 11:11:38.418176883 +0000 UTC m=+2.991557252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8792ce35-00f9-4101-aab2-346a02150768-metrics-certs") pod "network-metrics-daemon-pql69" (UID: "8792ce35-00f9-4101-aab2-346a02150768") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:37.922583 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.918216 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e02a70bf-1675-40bd-b486-2a13f65e845b-iptables-alerter-script\") pod \"iptables-alerter-kn68m\" (UID: \"e02a70bf-1675-40bd-b486-2a13f65e845b\") " pod="openshift-network-operator/iptables-alerter-kn68m" Jul 14 11:11:37.923146 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.918274 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-etc-kubernetes\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.923146 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.918309 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-host-run-multus-certs\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.923146 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.918342 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-host-run-netns\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.923146 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.918400 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twn95\" (UniqueName: \"kubernetes.io/projected/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-kube-api-access-twn95\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.923146 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.918439 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f8cdb4dc-f26c-4e5a-92a6-888681827bda-device-dir\") pod \"aws-ebs-csi-driver-node-wshj6\" (UID: \"f8cdb4dc-f26c-4e5a-92a6-888681827bda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wshj6" Jul 14 11:11:37.923146 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.918459 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-var-lib-kubelet\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.923146 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.918467 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5e0333e8-ff9a-4d6b-a66a-d3c651db407d-konnectivity-ca\") pod \"konnectivity-agent-kd42k\" (UID: \"5e0333e8-ff9a-4d6b-a66a-d3c651db407d\") " pod="kube-system/konnectivity-agent-kd42k" Jul 14 11:11:37.923146 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.918497 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tjw8\" (UniqueName: \"kubernetes.io/projected/e02a70bf-1675-40bd-b486-2a13f65e845b-kube-api-access-4tjw8\") pod \"iptables-alerter-kn68m\" (UID: \"e02a70bf-1675-40bd-b486-2a13f65e845b\") " pod="openshift-network-operator/iptables-alerter-kn68m" Jul 14 11:11:37.923146 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.918527 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdxlj\" (UniqueName: \"kubernetes.io/projected/62c5ec52-328c-4c4c-85ad-ecfe23a6e93e-kube-api-access-wdxlj\") pod \"network-check-target-8hpw4\" (UID: \"62c5ec52-328c-4c4c-85ad-ecfe23a6e93e\") " pod="openshift-network-diagnostics/network-check-target-8hpw4" Jul 14 11:11:37.923146 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.918573 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7fa811e8-b74b-4cf5-ab86-0570d535e142-os-release\") pod \"multus-additional-cni-plugins-v2tgd\" (UID: \"7fa811e8-b74b-4cf5-ab86-0570d535e142\") " pod="openshift-multus/multus-additional-cni-plugins-v2tgd" Jul 14 11:11:37.923146 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.918601 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7fa811e8-b74b-4cf5-ab86-0570d535e142-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v2tgd\" (UID: \"7fa811e8-b74b-4cf5-ab86-0570d535e142\") " pod="openshift-multus/multus-additional-cni-plugins-v2tgd" Jul 14 11:11:37.923146 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.918629 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/485ab2d2-0fbc-4d2d-95b0-d60732668829-original-pull-secret\") pod \"global-pull-secret-syncer-mcz4r\" (UID: \"485ab2d2-0fbc-4d2d-95b0-d60732668829\") " pod="kube-system/global-pull-secret-syncer-mcz4r" Jul 14 11:11:37.923146 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.918654 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5e0333e8-ff9a-4d6b-a66a-d3c651db407d-agent-certs\") pod \"konnectivity-agent-kd42k\" (UID: \"5e0333e8-ff9a-4d6b-a66a-d3c651db407d\") " pod="kube-system/konnectivity-agent-kd42k" Jul 14 11:11:37.923146 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.918694 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:37.923146 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.918728 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/485ab2d2-0fbc-4d2d-95b0-d60732668829-kubelet-config\") pod \"global-pull-secret-syncer-mcz4r\" (UID: \"485ab2d2-0fbc-4d2d-95b0-d60732668829\") " pod="kube-system/global-pull-secret-syncer-mcz4r" Jul 14 11:11:37.923146 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.918746 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8cb4cc75-45c5-4e00-8434-71d348adcb4d-tmp-dir\") pod \"node-resolver-rf5p6\" (UID: \"8cb4cc75-45c5-4e00-8434-71d348adcb4d\") " pod="openshift-dns/node-resolver-rf5p6" Jul 14 11:11:37.923146 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.918755 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-host\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.924039 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.918784 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-os-release\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.924039 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.918804 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-hostroot\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.924039 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.918812 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-host-var-lib-kubelet\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.924039 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.918839 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-host-slash\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:37.924039 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.918854 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-multus-cni-dir\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.924039 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.918899 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-multus-socket-dir-parent\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.924039 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.918925 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-sys\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.924039 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.918939 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-cnibin\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.924039 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.919713 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6dde3a96-cce6-4b23-aa81-61c89f0a836d-cni-binary-copy\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.924039 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.919770 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-host-run-k8s-cni-cncf-io\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.924039 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.920227 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6dde3a96-cce6-4b23-aa81-61c89f0a836d-multus-daemon-config\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.924039 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.921338 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-etc-kubernetes\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.924039 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.921400 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-host\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.924039 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.921490 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-host-var-lib-kubelet\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.924039 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.921574 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6dde3a96-cce6-4b23-aa81-61c89f0a836d-os-release\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.925357 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.925326 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-tmp\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.927241 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.927183 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-etc-tuned\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.934217 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.934187 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rndz\" (UniqueName: \"kubernetes.io/projected/6dde3a96-cce6-4b23-aa81-61c89f0a836d-kube-api-access-2rndz\") pod \"multus-9fwbj\" (UID: \"6dde3a96-cce6-4b23-aa81-61c89f0a836d\") " pod="openshift-multus/multus-9fwbj" Jul 14 11:11:37.938742 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.938671 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkm9w\" (UniqueName: \"kubernetes.io/projected/8792ce35-00f9-4101-aab2-346a02150768-kube-api-access-hkm9w\") pod \"network-metrics-daemon-pql69\" (UID: \"8792ce35-00f9-4101-aab2-346a02150768\") " pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:11:37.938742 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:37.938736 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 11:11:37.938952 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:37.938762 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 11:11:37.938952 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:37.938776 2576 projected.go:196] Error preparing data for projected volume kube-api-access-wdxlj for pod openshift-network-diagnostics/network-check-target-8hpw4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:37.938952 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:37.938852 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62c5ec52-328c-4c4c-85ad-ecfe23a6e93e-kube-api-access-wdxlj podName:62c5ec52-328c-4c4c-85ad-ecfe23a6e93e nodeName:}" failed. No retries permitted until 2026-07-14 11:11:38.438831629 +0000 UTC m=+3.012211984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wdxlj" (UniqueName: "kubernetes.io/projected/62c5ec52-328c-4c4c-85ad-ecfe23a6e93e-kube-api-access-wdxlj") pod "network-check-target-8hpw4" (UID: "62c5ec52-328c-4c4c-85ad-ecfe23a6e93e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:37.939559 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.939517 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twn95\" (UniqueName: \"kubernetes.io/projected/7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31-kube-api-access-twn95\") pod \"tuned-khg77\" (UID: \"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31\") " pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:37.941303 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.941133 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79wlk\" (UniqueName: \"kubernetes.io/projected/8cb4cc75-45c5-4e00-8434-71d348adcb4d-kube-api-access-79wlk\") pod \"node-resolver-rf5p6\" (UID: \"8cb4cc75-45c5-4e00-8434-71d348adcb4d\") " pod="openshift-dns/node-resolver-rf5p6" Jul 14 11:11:37.941732 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.941708 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tjw8\" (UniqueName: \"kubernetes.io/projected/e02a70bf-1675-40bd-b486-2a13f65e845b-kube-api-access-4tjw8\") pod \"iptables-alerter-kn68m\" (UID: \"e02a70bf-1675-40bd-b486-2a13f65e845b\") " pod="openshift-network-operator/iptables-alerter-kn68m" Jul 14 11:11:37.960444 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:37.960397 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-35.ec2.internal" event={"ID":"05132bffdc399194f7afbfef4cacafcb","Type":"ContainerStarted","Data":"408b23feef839b9ac220c4ad320c73df9c81364f7f0b95db0b912d7f6c9dd251"} Jul 14 11:11:38.019316 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.019216 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7fa811e8-b74b-4cf5-ab86-0570d535e142-system-cni-dir\") pod \"multus-additional-cni-plugins-v2tgd\" (UID: \"7fa811e8-b74b-4cf5-ab86-0570d535e142\") " pod="openshift-multus/multus-additional-cni-plugins-v2tgd" Jul 14 11:11:38.019316 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.019263 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsmsv\" (UniqueName: \"kubernetes.io/projected/720aefb6-81a1-44d1-a01f-4bc07ff30465-kube-api-access-bsmsv\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.019316 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.019291 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f8cdb4dc-f26c-4e5a-92a6-888681827bda-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wshj6\" (UID: \"f8cdb4dc-f26c-4e5a-92a6-888681827bda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wshj6" Jul 14 11:11:38.019316 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.019313 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f8cdb4dc-f26c-4e5a-92a6-888681827bda-sys-fs\") pod \"aws-ebs-csi-driver-node-wshj6\" (UID: \"f8cdb4dc-f26c-4e5a-92a6-888681827bda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wshj6" Jul 14 11:11:38.019735 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.019331 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7fa811e8-b74b-4cf5-ab86-0570d535e142-system-cni-dir\") pod \"multus-additional-cni-plugins-v2tgd\" (UID: \"7fa811e8-b74b-4cf5-ab86-0570d535e142\") " pod="openshift-multus/multus-additional-cni-plugins-v2tgd" Jul 14 11:11:38.019735 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.019337 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c428ac6b-bf9d-4d77-8554-c2c09614b02c-host\") pod \"node-ca-qmwvf\" (UID: \"c428ac6b-bf9d-4d77-8554-c2c09614b02c\") " pod="openshift-image-registry/node-ca-qmwvf" Jul 14 11:11:38.019735 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.019380 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c428ac6b-bf9d-4d77-8554-c2c09614b02c-host\") pod \"node-ca-qmwvf\" (UID: \"c428ac6b-bf9d-4d77-8554-c2c09614b02c\") " pod="openshift-image-registry/node-ca-qmwvf" Jul 14 11:11:38.019735 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.019439 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f8cdb4dc-f26c-4e5a-92a6-888681827bda-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wshj6\" (UID: \"f8cdb4dc-f26c-4e5a-92a6-888681827bda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wshj6" Jul 14 11:11:38.019735 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.019436 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-host-cni-bin\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.019735 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.019507 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-host-cni-bin\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.019735 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.019440 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f8cdb4dc-f26c-4e5a-92a6-888681827bda-sys-fs\") pod \"aws-ebs-csi-driver-node-wshj6\" (UID: \"f8cdb4dc-f26c-4e5a-92a6-888681827bda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wshj6" Jul 14 11:11:38.019735 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.019515 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/485ab2d2-0fbc-4d2d-95b0-d60732668829-dbus\") pod \"global-pull-secret-syncer-mcz4r\" (UID: \"485ab2d2-0fbc-4d2d-95b0-d60732668829\") " pod="kube-system/global-pull-secret-syncer-mcz4r" Jul 14 11:11:38.019735 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.019655 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-var-lib-openvswitch\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.019735 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.019682 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/720aefb6-81a1-44d1-a01f-4bc07ff30465-ovnkube-config\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.019735 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.019704 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/720aefb6-81a1-44d1-a01f-4bc07ff30465-env-overrides\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.019735 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.019724 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/485ab2d2-0fbc-4d2d-95b0-d60732668829-dbus\") pod \"global-pull-secret-syncer-mcz4r\" (UID: \"485ab2d2-0fbc-4d2d-95b0-d60732668829\") " pod="kube-system/global-pull-secret-syncer-mcz4r" Jul 14 11:11:38.020293 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.019727 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c428ac6b-bf9d-4d77-8554-c2c09614b02c-serviceca\") pod \"node-ca-qmwvf\" (UID: \"c428ac6b-bf9d-4d77-8554-c2c09614b02c\") " pod="openshift-image-registry/node-ca-qmwvf" Jul 14 11:11:38.020293 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.019775 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7fa811e8-b74b-4cf5-ab86-0570d535e142-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v2tgd\" (UID: \"7fa811e8-b74b-4cf5-ab86-0570d535e142\") " pod="openshift-multus/multus-additional-cni-plugins-v2tgd" Jul 14 11:11:38.020293 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.019825 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/720aefb6-81a1-44d1-a01f-4bc07ff30465-ovnkube-script-lib\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.020293 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.019860 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f8cdb4dc-f26c-4e5a-92a6-888681827bda-socket-dir\") pod \"aws-ebs-csi-driver-node-wshj6\" (UID: \"f8cdb4dc-f26c-4e5a-92a6-888681827bda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wshj6" Jul 14 11:11:38.020293 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.019885 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f8cdb4dc-f26c-4e5a-92a6-888681827bda-etc-selinux\") pod \"aws-ebs-csi-driver-node-wshj6\" (UID: \"f8cdb4dc-f26c-4e5a-92a6-888681827bda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wshj6" Jul 14 11:11:38.020293 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.019908 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7fa811e8-b74b-4cf5-ab86-0570d535e142-cni-binary-copy\") pod \"multus-additional-cni-plugins-v2tgd\" (UID: \"7fa811e8-b74b-4cf5-ab86-0570d535e142\") " pod="openshift-multus/multus-additional-cni-plugins-v2tgd" Jul 14 11:11:38.020293 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.019932 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-host-run-netns\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.020293 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.019956 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-host-cni-netd\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.020293 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.019996 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb44p\" (UniqueName: \"kubernetes.io/projected/f8cdb4dc-f26c-4e5a-92a6-888681827bda-kube-api-access-cb44p\") pod \"aws-ebs-csi-driver-node-wshj6\" (UID: \"f8cdb4dc-f26c-4e5a-92a6-888681827bda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wshj6" Jul 14 11:11:38.020293 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.020023 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpx7t\" (UniqueName: \"kubernetes.io/projected/7fa811e8-b74b-4cf5-ab86-0570d535e142-kube-api-access-jpx7t\") pod \"multus-additional-cni-plugins-v2tgd\" (UID: \"7fa811e8-b74b-4cf5-ab86-0570d535e142\") " pod="openshift-multus/multus-additional-cni-plugins-v2tgd" Jul 14 11:11:38.020293 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.020046 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-host-kubelet\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.020293 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.020074 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-etc-openvswitch\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.020293 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.020115 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-run-ovn\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.020293 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.020138 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-node-log\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.020293 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.020174 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f8cdb4dc-f26c-4e5a-92a6-888681827bda-registration-dir\") pod \"aws-ebs-csi-driver-node-wshj6\" (UID: \"f8cdb4dc-f26c-4e5a-92a6-888681827bda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wshj6" Jul 14 11:11:38.020293 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.020199 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7fa811e8-b74b-4cf5-ab86-0570d535e142-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v2tgd\" (UID: \"7fa811e8-b74b-4cf5-ab86-0570d535e142\") " pod="openshift-multus/multus-additional-cni-plugins-v2tgd" Jul 14 11:11:38.020293 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.020215 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c428ac6b-bf9d-4d77-8554-c2c09614b02c-serviceca\") pod \"node-ca-qmwvf\" (UID: \"c428ac6b-bf9d-4d77-8554-c2c09614b02c\") " pod="openshift-image-registry/node-ca-qmwvf" Jul 14 11:11:38.021162 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.020235 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-systemd-units\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.021162 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.020319 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-run-openvswitch\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.021162 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.020368 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-host-run-ovn-kubernetes\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.021162 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.020402 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f8cdb4dc-f26c-4e5a-92a6-888681827bda-device-dir\") pod \"aws-ebs-csi-driver-node-wshj6\" (UID: \"f8cdb4dc-f26c-4e5a-92a6-888681827bda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wshj6" Jul 14 11:11:38.021162 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.020427 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5e0333e8-ff9a-4d6b-a66a-d3c651db407d-konnectivity-ca\") pod \"konnectivity-agent-kd42k\" (UID: \"5e0333e8-ff9a-4d6b-a66a-d3c651db407d\") " pod="kube-system/konnectivity-agent-kd42k" Jul 14 11:11:38.021162 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.020464 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7fa811e8-b74b-4cf5-ab86-0570d535e142-os-release\") pod \"multus-additional-cni-plugins-v2tgd\" (UID: \"7fa811e8-b74b-4cf5-ab86-0570d535e142\") " pod="openshift-multus/multus-additional-cni-plugins-v2tgd" Jul 14 11:11:38.021162 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.020488 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7fa811e8-b74b-4cf5-ab86-0570d535e142-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v2tgd\" (UID: \"7fa811e8-b74b-4cf5-ab86-0570d535e142\") " pod="openshift-multus/multus-additional-cni-plugins-v2tgd" Jul 14 11:11:38.021162 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.020514 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/485ab2d2-0fbc-4d2d-95b0-d60732668829-original-pull-secret\") pod \"global-pull-secret-syncer-mcz4r\" (UID: \"485ab2d2-0fbc-4d2d-95b0-d60732668829\") " pod="kube-system/global-pull-secret-syncer-mcz4r" Jul 14 11:11:38.021162 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.020564 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5e0333e8-ff9a-4d6b-a66a-d3c651db407d-agent-certs\") pod \"konnectivity-agent-kd42k\" (UID: \"5e0333e8-ff9a-4d6b-a66a-d3c651db407d\") " pod="kube-system/konnectivity-agent-kd42k" Jul 14 11:11:38.021162 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.020597 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.021162 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.020624 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/485ab2d2-0fbc-4d2d-95b0-d60732668829-kubelet-config\") pod \"global-pull-secret-syncer-mcz4r\" (UID: \"485ab2d2-0fbc-4d2d-95b0-d60732668829\") " pod="kube-system/global-pull-secret-syncer-mcz4r" Jul 14 11:11:38.021162 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.020655 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-host-slash\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.021162 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.020680 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghwwr\" (UniqueName: \"kubernetes.io/projected/c428ac6b-bf9d-4d77-8554-c2c09614b02c-kube-api-access-ghwwr\") pod \"node-ca-qmwvf\" (UID: \"c428ac6b-bf9d-4d77-8554-c2c09614b02c\") " pod="openshift-image-registry/node-ca-qmwvf" Jul 14 11:11:38.021162 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.020719 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-run-systemd\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.021162 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.020755 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/720aefb6-81a1-44d1-a01f-4bc07ff30465-ovn-node-metrics-cert\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.021162 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.020815 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7fa811e8-b74b-4cf5-ab86-0570d535e142-cnibin\") pod \"multus-additional-cni-plugins-v2tgd\" (UID: \"7fa811e8-b74b-4cf5-ab86-0570d535e142\") " pod="openshift-multus/multus-additional-cni-plugins-v2tgd" Jul 14 11:11:38.021162 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.020849 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/720aefb6-81a1-44d1-a01f-4bc07ff30465-ovnkube-config\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.021929 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.020871 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-log-socket\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.021929 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.020900 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-var-lib-openvswitch\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.021929 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.020998 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f8cdb4dc-f26c-4e5a-92a6-888681827bda-device-dir\") pod \"aws-ebs-csi-driver-node-wshj6\" (UID: \"f8cdb4dc-f26c-4e5a-92a6-888681827bda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wshj6" Jul 14 11:11:38.021929 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.021090 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7fa811e8-b74b-4cf5-ab86-0570d535e142-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v2tgd\" (UID: \"7fa811e8-b74b-4cf5-ab86-0570d535e142\") " pod="openshift-multus/multus-additional-cni-plugins-v2tgd" Jul 14 11:11:38.021929 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.021379 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5e0333e8-ff9a-4d6b-a66a-d3c651db407d-konnectivity-ca\") pod \"konnectivity-agent-kd42k\" (UID: \"5e0333e8-ff9a-4d6b-a66a-d3c651db407d\") " pod="kube-system/konnectivity-agent-kd42k" Jul 14 11:11:38.021929 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.021421 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-host-cni-netd\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.021929 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.021461 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7fa811e8-b74b-4cf5-ab86-0570d535e142-os-release\") pod \"multus-additional-cni-plugins-v2tgd\" (UID: \"7fa811e8-b74b-4cf5-ab86-0570d535e142\") " pod="openshift-multus/multus-additional-cni-plugins-v2tgd" Jul 14 11:11:38.021929 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.021531 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f8cdb4dc-f26c-4e5a-92a6-888681827bda-socket-dir\") pod \"aws-ebs-csi-driver-node-wshj6\" (UID: \"f8cdb4dc-f26c-4e5a-92a6-888681827bda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wshj6" Jul 14 11:11:38.021929 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.020598 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/720aefb6-81a1-44d1-a01f-4bc07ff30465-env-overrides\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.021929 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.021576 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7fa811e8-b74b-4cf5-ab86-0570d535e142-cnibin\") pod \"multus-additional-cni-plugins-v2tgd\" (UID: \"7fa811e8-b74b-4cf5-ab86-0570d535e142\") " pod="openshift-multus/multus-additional-cni-plugins-v2tgd" Jul 14 11:11:38.021929 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.021618 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7fa811e8-b74b-4cf5-ab86-0570d535e142-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v2tgd\" (UID: \"7fa811e8-b74b-4cf5-ab86-0570d535e142\") " pod="openshift-multus/multus-additional-cni-plugins-v2tgd" Jul 14 11:11:38.021929 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.021628 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-run-systemd\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.021929 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.021619 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/720aefb6-81a1-44d1-a01f-4bc07ff30465-ovnkube-script-lib\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.021929 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.021634 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-etc-openvswitch\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.021929 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.021651 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f8cdb4dc-f26c-4e5a-92a6-888681827bda-registration-dir\") pod \"aws-ebs-csi-driver-node-wshj6\" (UID: \"f8cdb4dc-f26c-4e5a-92a6-888681827bda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wshj6" Jul 14 11:11:38.021929 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.021658 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-host-run-ovn-kubernetes\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.021929 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.021654 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-run-openvswitch\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.022849 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.021676 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.022849 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.021695 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/485ab2d2-0fbc-4d2d-95b0-d60732668829-kubelet-config\") pod \"global-pull-secret-syncer-mcz4r\" (UID: \"485ab2d2-0fbc-4d2d-95b0-d60732668829\") " pod="kube-system/global-pull-secret-syncer-mcz4r" Jul 14 11:11:38.022849 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.021712 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-host-kubelet\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.022849 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.021717 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-host-run-netns\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.022849 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:38.021746 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:38.022849 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:38.021844 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/485ab2d2-0fbc-4d2d-95b0-d60732668829-original-pull-secret podName:485ab2d2-0fbc-4d2d-95b0-d60732668829 nodeName:}" failed. No retries permitted until 2026-07-14 11:11:38.521830558 +0000 UTC m=+3.095210911 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/485ab2d2-0fbc-4d2d-95b0-d60732668829-original-pull-secret") pod "global-pull-secret-syncer-mcz4r" (UID: "485ab2d2-0fbc-4d2d-95b0-d60732668829") : object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:38.022849 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.021856 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f8cdb4dc-f26c-4e5a-92a6-888681827bda-etc-selinux\") pod \"aws-ebs-csi-driver-node-wshj6\" (UID: \"f8cdb4dc-f26c-4e5a-92a6-888681827bda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wshj6" Jul 14 11:11:38.022849 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.021899 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-systemd-units\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.022849 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.021682 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-host-slash\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.022849 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.021929 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-run-ovn\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.022849 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.021959 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-log-socket\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.022849 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.022042 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/720aefb6-81a1-44d1-a01f-4bc07ff30465-node-log\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.022849 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.022363 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7fa811e8-b74b-4cf5-ab86-0570d535e142-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v2tgd\" (UID: \"7fa811e8-b74b-4cf5-ab86-0570d535e142\") " pod="openshift-multus/multus-additional-cni-plugins-v2tgd" Jul 14 11:11:38.022849 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.022418 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7fa811e8-b74b-4cf5-ab86-0570d535e142-cni-binary-copy\") pod \"multus-additional-cni-plugins-v2tgd\" (UID: \"7fa811e8-b74b-4cf5-ab86-0570d535e142\") " pod="openshift-multus/multus-additional-cni-plugins-v2tgd" Jul 14 11:11:38.024994 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.024955 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/720aefb6-81a1-44d1-a01f-4bc07ff30465-ovn-node-metrics-cert\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.026211 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.026183 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5e0333e8-ff9a-4d6b-a66a-d3c651db407d-agent-certs\") pod \"konnectivity-agent-kd42k\" (UID: \"5e0333e8-ff9a-4d6b-a66a-d3c651db407d\") " pod="kube-system/konnectivity-agent-kd42k" Jul 14 11:11:38.040067 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.040035 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsmsv\" (UniqueName: \"kubernetes.io/projected/720aefb6-81a1-44d1-a01f-4bc07ff30465-kube-api-access-bsmsv\") pod \"ovnkube-node-rvhwc\" (UID: \"720aefb6-81a1-44d1-a01f-4bc07ff30465\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.043634 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.043601 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpx7t\" (UniqueName: \"kubernetes.io/projected/7fa811e8-b74b-4cf5-ab86-0570d535e142-kube-api-access-jpx7t\") pod \"multus-additional-cni-plugins-v2tgd\" (UID: \"7fa811e8-b74b-4cf5-ab86-0570d535e142\") " pod="openshift-multus/multus-additional-cni-plugins-v2tgd" Jul 14 11:11:38.048551 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.048505 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb44p\" (UniqueName: \"kubernetes.io/projected/f8cdb4dc-f26c-4e5a-92a6-888681827bda-kube-api-access-cb44p\") pod \"aws-ebs-csi-driver-node-wshj6\" (UID: \"f8cdb4dc-f26c-4e5a-92a6-888681827bda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wshj6" Jul 14 11:11:38.048705 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.048660 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghwwr\" (UniqueName: \"kubernetes.io/projected/c428ac6b-bf9d-4d77-8554-c2c09614b02c-kube-api-access-ghwwr\") pod \"node-ca-qmwvf\" (UID: \"c428ac6b-bf9d-4d77-8554-c2c09614b02c\") " pod="openshift-image-registry/node-ca-qmwvf" Jul 14 11:11:38.113379 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.113332 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kn68m" Jul 14 11:11:38.125262 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.125225 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-khg77" Jul 14 11:11:38.133446 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.133417 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rf5p6" Jul 14 11:11:38.140521 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.140494 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9fwbj" Jul 14 11:11:38.148985 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.148949 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v2tgd" Jul 14 11:11:38.156087 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.156055 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:11:38.164074 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.164044 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kd42k" Jul 14 11:11:38.170849 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.170811 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wshj6" Jul 14 11:11:38.177620 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.177596 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qmwvf" Jul 14 11:11:38.424145 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.424048 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8792ce35-00f9-4101-aab2-346a02150768-metrics-certs\") pod \"network-metrics-daemon-pql69\" (UID: \"8792ce35-00f9-4101-aab2-346a02150768\") " pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:11:38.424290 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:38.424163 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:38.424290 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:38.424235 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8792ce35-00f9-4101-aab2-346a02150768-metrics-certs podName:8792ce35-00f9-4101-aab2-346a02150768 nodeName:}" failed. No retries permitted until 2026-07-14 11:11:39.424216563 +0000 UTC m=+3.997596933 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8792ce35-00f9-4101-aab2-346a02150768-metrics-certs") pod "network-metrics-daemon-pql69" (UID: "8792ce35-00f9-4101-aab2-346a02150768") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:38.525207 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.525166 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdxlj\" (UniqueName: \"kubernetes.io/projected/62c5ec52-328c-4c4c-85ad-ecfe23a6e93e-kube-api-access-wdxlj\") pod \"network-check-target-8hpw4\" (UID: \"62c5ec52-328c-4c4c-85ad-ecfe23a6e93e\") " pod="openshift-network-diagnostics/network-check-target-8hpw4" Jul 14 11:11:38.525207 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.525206 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/485ab2d2-0fbc-4d2d-95b0-d60732668829-original-pull-secret\") pod \"global-pull-secret-syncer-mcz4r\" (UID: \"485ab2d2-0fbc-4d2d-95b0-d60732668829\") " pod="kube-system/global-pull-secret-syncer-mcz4r" Jul 14 11:11:38.525430 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:38.525303 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:38.525430 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:38.525324 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 11:11:38.525430 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:38.525349 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 11:11:38.525430 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:38.525357 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/485ab2d2-0fbc-4d2d-95b0-d60732668829-original-pull-secret podName:485ab2d2-0fbc-4d2d-95b0-d60732668829 nodeName:}" failed. No retries permitted until 2026-07-14 11:11:39.525342328 +0000 UTC m=+4.098722680 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/485ab2d2-0fbc-4d2d-95b0-d60732668829-original-pull-secret") pod "global-pull-secret-syncer-mcz4r" (UID: "485ab2d2-0fbc-4d2d-95b0-d60732668829") : object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:38.525430 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:38.525359 2576 projected.go:196] Error preparing data for projected volume kube-api-access-wdxlj for pod openshift-network-diagnostics/network-check-target-8hpw4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:38.525430 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:38.525401 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62c5ec52-328c-4c4c-85ad-ecfe23a6e93e-kube-api-access-wdxlj podName:62c5ec52-328c-4c4c-85ad-ecfe23a6e93e nodeName:}" failed. No retries permitted until 2026-07-14 11:11:39.5253902 +0000 UTC m=+4.098770551 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wdxlj" (UniqueName: "kubernetes.io/projected/62c5ec52-328c-4c4c-85ad-ecfe23a6e93e-kube-api-access-wdxlj") pod "network-check-target-8hpw4" (UID: "62c5ec52-328c-4c4c-85ad-ecfe23a6e93e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:38.877499 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:38.877465 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fa811e8_b74b_4cf5_ab86_0570d535e142.slice/crio-033f096a7c509b8fa36966f5d80f32da3ed37de5b334ebb8d4981c2931ffafda WatchSource:0}: Error finding container 033f096a7c509b8fa36966f5d80f32da3ed37de5b334ebb8d4981c2931ffafda: Status 404 returned error can't find the container with id 033f096a7c509b8fa36966f5d80f32da3ed37de5b334ebb8d4981c2931ffafda Jul 14 11:11:38.879866 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:38.879834 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cb4cc75_45c5_4e00_8434_71d348adcb4d.slice/crio-a9536a18f2477d367d033e95db172f016908c793da288aa7b8189e860b4ca390 WatchSource:0}: Error finding container a9536a18f2477d367d033e95db172f016908c793da288aa7b8189e860b4ca390: Status 404 returned error can't find the container with id a9536a18f2477d367d033e95db172f016908c793da288aa7b8189e860b4ca390 Jul 14 11:11:38.884241 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:38.884184 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dde3a96_cce6_4b23_aa81_61c89f0a836d.slice/crio-852b9c20f92ddd79e96dbb7f5558d84591ddabe9f8a8fc7b27c8d987856f9811 WatchSource:0}: Error finding container 852b9c20f92ddd79e96dbb7f5558d84591ddabe9f8a8fc7b27c8d987856f9811: Status 404 returned error can't find the container with id 852b9c20f92ddd79e96dbb7f5558d84591ddabe9f8a8fc7b27c8d987856f9811 Jul 14 11:11:38.885600 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:38.885525 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode02a70bf_1675_40bd_b486_2a13f65e845b.slice/crio-ec5caa5747f79af61d66fab10e882db1aa3b7389a64a8284f14bc52e47808a4e WatchSource:0}: Error finding container ec5caa5747f79af61d66fab10e882db1aa3b7389a64a8284f14bc52e47808a4e: Status 404 returned error can't find the container with id ec5caa5747f79af61d66fab10e882db1aa3b7389a64a8284f14bc52e47808a4e Jul 14 11:11:38.887132 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:38.887020 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e0333e8_ff9a_4d6b_a66a_d3c651db407d.slice/crio-7fcb883d4aab2d149bf1f33d545bd4b07ff564087478d4c295e579a1380735bc WatchSource:0}: Error finding container 7fcb883d4aab2d149bf1f33d545bd4b07ff564087478d4c295e579a1380735bc: Status 404 returned error can't find the container with id 7fcb883d4aab2d149bf1f33d545bd4b07ff564087478d4c295e579a1380735bc Jul 14 11:11:38.888274 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:38.888245 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dccf5ba_e3dd_49e4_a4a2_357fd2ba9f31.slice/crio-4cb0c31366ac75f98cf8d5367c29a2c2ca4813d8d377eabfcdd0155f46c0a3c6 WatchSource:0}: Error finding container 4cb0c31366ac75f98cf8d5367c29a2c2ca4813d8d377eabfcdd0155f46c0a3c6: Status 404 returned error can't find the container with id 4cb0c31366ac75f98cf8d5367c29a2c2ca4813d8d377eabfcdd0155f46c0a3c6 Jul 14 11:11:38.889949 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:38.889927 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod720aefb6_81a1_44d1_a01f_4bc07ff30465.slice/crio-a3403e616f3ce8a8a3e1cf83aad1094bf43bf3e59eb5c9344fe76940c98f72de WatchSource:0}: Error finding container a3403e616f3ce8a8a3e1cf83aad1094bf43bf3e59eb5c9344fe76940c98f72de: Status 404 returned error can't find the container with id a3403e616f3ce8a8a3e1cf83aad1094bf43bf3e59eb5c9344fe76940c98f72de Jul 14 11:11:38.892019 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:11:38.891848 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc428ac6b_bf9d_4d77_8554_c2c09614b02c.slice/crio-94dca4671242595353a2f7449960bac321339291c45c24248d32cf9a7d1c8db2 WatchSource:0}: Error finding container 94dca4671242595353a2f7449960bac321339291c45c24248d32cf9a7d1c8db2: Status 404 returned error can't find the container with id 94dca4671242595353a2f7449960bac321339291c45c24248d32cf9a7d1c8db2 Jul 14 11:11:38.892174 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.892141 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 11:06:37 +0000 UTC" deadline="2028-04-04 12:04:32.431848812 +0000 UTC" Jul 14 11:11:38.892278 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.892176 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15120h52m53.53967821s" Jul 14 11:11:38.955320 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.955115 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcz4r" Jul 14 11:11:38.955505 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.955180 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hpw4" Jul 14 11:11:38.955505 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:38.955426 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mcz4r" podUID="485ab2d2-0fbc-4d2d-95b0-d60732668829" Jul 14 11:11:38.955604 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:38.955497 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hpw4" podUID="62c5ec52-328c-4c4c-85ad-ecfe23a6e93e" Jul 14 11:11:38.963893 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.963856 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rf5p6" event={"ID":"8cb4cc75-45c5-4e00-8434-71d348adcb4d","Type":"ContainerStarted","Data":"a9536a18f2477d367d033e95db172f016908c793da288aa7b8189e860b4ca390"} Jul 14 11:11:38.965058 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.965033 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wshj6" event={"ID":"f8cdb4dc-f26c-4e5a-92a6-888681827bda","Type":"ContainerStarted","Data":"4fa5bab158074ced1b3a1d0fef0080239e329da9323b319f813aac924bd5788a"} Jul 14 11:11:38.968171 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.968141 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" event={"ID":"720aefb6-81a1-44d1-a01f-4bc07ff30465","Type":"ContainerStarted","Data":"a3403e616f3ce8a8a3e1cf83aad1094bf43bf3e59eb5c9344fe76940c98f72de"} Jul 14 11:11:38.969787 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.969764 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9fwbj" event={"ID":"6dde3a96-cce6-4b23-aa81-61c89f0a836d","Type":"ContainerStarted","Data":"852b9c20f92ddd79e96dbb7f5558d84591ddabe9f8a8fc7b27c8d987856f9811"} Jul 14 11:11:38.970892 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.970868 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v2tgd" event={"ID":"7fa811e8-b74b-4cf5-ab86-0570d535e142","Type":"ContainerStarted","Data":"033f096a7c509b8fa36966f5d80f32da3ed37de5b334ebb8d4981c2931ffafda"} Jul 14 11:11:38.980714 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.980680 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qmwvf" event={"ID":"c428ac6b-bf9d-4d77-8554-c2c09614b02c","Type":"ContainerStarted","Data":"94dca4671242595353a2f7449960bac321339291c45c24248d32cf9a7d1c8db2"} Jul 14 11:11:38.985854 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.985817 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-khg77" event={"ID":"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31","Type":"ContainerStarted","Data":"4cb0c31366ac75f98cf8d5367c29a2c2ca4813d8d377eabfcdd0155f46c0a3c6"} Jul 14 11:11:38.987004 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.986966 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kd42k" event={"ID":"5e0333e8-ff9a-4d6b-a66a-d3c651db407d","Type":"ContainerStarted","Data":"7fcb883d4aab2d149bf1f33d545bd4b07ff564087478d4c295e579a1380735bc"} Jul 14 11:11:38.988695 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:38.988659 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kn68m" event={"ID":"e02a70bf-1675-40bd-b486-2a13f65e845b","Type":"ContainerStarted","Data":"ec5caa5747f79af61d66fab10e882db1aa3b7389a64a8284f14bc52e47808a4e"} Jul 14 11:11:39.432838 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:39.431673 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8792ce35-00f9-4101-aab2-346a02150768-metrics-certs\") pod \"network-metrics-daemon-pql69\" (UID: \"8792ce35-00f9-4101-aab2-346a02150768\") " pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:11:39.432838 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:39.431913 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:39.432838 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:39.431978 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8792ce35-00f9-4101-aab2-346a02150768-metrics-certs podName:8792ce35-00f9-4101-aab2-346a02150768 nodeName:}" failed. No retries permitted until 2026-07-14 11:11:41.431960413 +0000 UTC m=+6.005340771 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8792ce35-00f9-4101-aab2-346a02150768-metrics-certs") pod "network-metrics-daemon-pql69" (UID: "8792ce35-00f9-4101-aab2-346a02150768") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:39.532208 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:39.532170 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdxlj\" (UniqueName: \"kubernetes.io/projected/62c5ec52-328c-4c4c-85ad-ecfe23a6e93e-kube-api-access-wdxlj\") pod \"network-check-target-8hpw4\" (UID: \"62c5ec52-328c-4c4c-85ad-ecfe23a6e93e\") " pod="openshift-network-diagnostics/network-check-target-8hpw4" Jul 14 11:11:39.532399 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:39.532220 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/485ab2d2-0fbc-4d2d-95b0-d60732668829-original-pull-secret\") pod \"global-pull-secret-syncer-mcz4r\" (UID: \"485ab2d2-0fbc-4d2d-95b0-d60732668829\") " pod="kube-system/global-pull-secret-syncer-mcz4r" Jul 14 11:11:39.532399 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:39.532375 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:39.532515 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:39.532437 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/485ab2d2-0fbc-4d2d-95b0-d60732668829-original-pull-secret podName:485ab2d2-0fbc-4d2d-95b0-d60732668829 nodeName:}" failed. No retries permitted until 2026-07-14 11:11:41.532417019 +0000 UTC m=+6.105797373 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/485ab2d2-0fbc-4d2d-95b0-d60732668829-original-pull-secret") pod "global-pull-secret-syncer-mcz4r" (UID: "485ab2d2-0fbc-4d2d-95b0-d60732668829") : object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:39.532615 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:39.532555 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 11:11:39.532615 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:39.532573 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 11:11:39.532615 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:39.532587 2576 projected.go:196] Error preparing data for projected volume kube-api-access-wdxlj for pod openshift-network-diagnostics/network-check-target-8hpw4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:39.532752 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:39.532629 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62c5ec52-328c-4c4c-85ad-ecfe23a6e93e-kube-api-access-wdxlj podName:62c5ec52-328c-4c4c-85ad-ecfe23a6e93e nodeName:}" failed. No retries permitted until 2026-07-14 11:11:41.532615761 +0000 UTC m=+6.105996113 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wdxlj" (UniqueName: "kubernetes.io/projected/62c5ec52-328c-4c4c-85ad-ecfe23a6e93e-kube-api-access-wdxlj") pod "network-check-target-8hpw4" (UID: "62c5ec52-328c-4c4c-85ad-ecfe23a6e93e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:39.892802 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:39.892644 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 11:06:37 +0000 UTC" deadline="2028-03-23 18:24:30.856430118 +0000 UTC" Jul 14 11:11:39.892802 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:39.892713 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14839h12m50.963720903s" Jul 14 11:11:39.957688 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:39.957145 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:11:39.957688 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:39.957289 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pql69" podUID="8792ce35-00f9-4101-aab2-346a02150768" Jul 14 11:11:40.005218 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:40.005180 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-35.ec2.internal" event={"ID":"c51082c0153c21c37ec0e44752612da3","Type":"ContainerStarted","Data":"0f666412b33cfd7f5e1370b3e440fd4674ecb00687ee6e8f6d4adfe38fa7d154"} Jul 14 11:11:40.013569 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:40.013203 2576 generic.go:356] "Generic (PLEG): container finished" podID="05132bffdc399194f7afbfef4cacafcb" containerID="fc5b099f8a81078d05a5bd22844b5e9861e964c42a27d3ae236f7f8d146ac61b" exitCode=0 Jul 14 11:11:40.013569 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:40.013258 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-35.ec2.internal" event={"ID":"05132bffdc399194f7afbfef4cacafcb","Type":"ContainerDied","Data":"fc5b099f8a81078d05a5bd22844b5e9861e964c42a27d3ae236f7f8d146ac61b"} Jul 14 11:11:40.035524 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:40.035465 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-35.ec2.internal" podStartSLOduration=3.035442561 podStartE2EDuration="3.035442561s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:11:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:11:38.992265585 +0000 UTC m=+3.565645981" watchObservedRunningTime="2026-07-14 11:11:40.035442561 +0000 UTC m=+4.608822936" Jul 14 11:11:40.955142 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:40.955107 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hpw4" Jul 14 11:11:40.955682 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:40.955239 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hpw4" podUID="62c5ec52-328c-4c4c-85ad-ecfe23a6e93e" Jul 14 11:11:40.955682 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:40.955583 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcz4r" Jul 14 11:11:40.955682 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:40.955648 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mcz4r" podUID="485ab2d2-0fbc-4d2d-95b0-d60732668829" Jul 14 11:11:41.046393 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:41.046325 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-35.ec2.internal" event={"ID":"05132bffdc399194f7afbfef4cacafcb","Type":"ContainerStarted","Data":"41f7a5e9b8a2fb2a43983efcddbba530d7d28722272d03649a99ee5db88c4f3b"} Jul 14 11:11:41.450343 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:41.450247 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8792ce35-00f9-4101-aab2-346a02150768-metrics-certs\") pod \"network-metrics-daemon-pql69\" (UID: \"8792ce35-00f9-4101-aab2-346a02150768\") " pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:11:41.450650 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:41.450415 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:41.450650 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:41.450485 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8792ce35-00f9-4101-aab2-346a02150768-metrics-certs podName:8792ce35-00f9-4101-aab2-346a02150768 nodeName:}" failed. No retries permitted until 2026-07-14 11:11:45.450461724 +0000 UTC m=+10.023842096 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8792ce35-00f9-4101-aab2-346a02150768-metrics-certs") pod "network-metrics-daemon-pql69" (UID: "8792ce35-00f9-4101-aab2-346a02150768") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:41.550922 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:41.550878 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdxlj\" (UniqueName: \"kubernetes.io/projected/62c5ec52-328c-4c4c-85ad-ecfe23a6e93e-kube-api-access-wdxlj\") pod \"network-check-target-8hpw4\" (UID: \"62c5ec52-328c-4c4c-85ad-ecfe23a6e93e\") " pod="openshift-network-diagnostics/network-check-target-8hpw4" Jul 14 11:11:41.551099 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:41.550935 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/485ab2d2-0fbc-4d2d-95b0-d60732668829-original-pull-secret\") pod \"global-pull-secret-syncer-mcz4r\" (UID: \"485ab2d2-0fbc-4d2d-95b0-d60732668829\") " pod="kube-system/global-pull-secret-syncer-mcz4r" Jul 14 11:11:41.551099 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:41.551057 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:41.551229 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:41.551131 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/485ab2d2-0fbc-4d2d-95b0-d60732668829-original-pull-secret podName:485ab2d2-0fbc-4d2d-95b0-d60732668829 nodeName:}" failed. No retries permitted until 2026-07-14 11:11:45.551110276 +0000 UTC m=+10.124490643 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/485ab2d2-0fbc-4d2d-95b0-d60732668829-original-pull-secret") pod "global-pull-secret-syncer-mcz4r" (UID: "485ab2d2-0fbc-4d2d-95b0-d60732668829") : object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:41.551709 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:41.551581 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 11:11:41.551709 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:41.551607 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 11:11:41.551709 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:41.551620 2576 projected.go:196] Error preparing data for projected volume kube-api-access-wdxlj for pod openshift-network-diagnostics/network-check-target-8hpw4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:41.551709 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:41.551669 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62c5ec52-328c-4c4c-85ad-ecfe23a6e93e-kube-api-access-wdxlj podName:62c5ec52-328c-4c4c-85ad-ecfe23a6e93e nodeName:}" failed. No retries permitted until 2026-07-14 11:11:45.551652825 +0000 UTC m=+10.125033179 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wdxlj" (UniqueName: "kubernetes.io/projected/62c5ec52-328c-4c4c-85ad-ecfe23a6e93e-kube-api-access-wdxlj") pod "network-check-target-8hpw4" (UID: "62c5ec52-328c-4c4c-85ad-ecfe23a6e93e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:41.954661 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:41.954633 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:11:41.954825 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:41.954767 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pql69" podUID="8792ce35-00f9-4101-aab2-346a02150768" Jul 14 11:11:42.954648 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:42.954606 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcz4r" Jul 14 11:11:42.955158 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:42.954753 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mcz4r" podUID="485ab2d2-0fbc-4d2d-95b0-d60732668829" Jul 14 11:11:42.955158 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:42.955148 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hpw4" Jul 14 11:11:42.955293 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:42.955252 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hpw4" podUID="62c5ec52-328c-4c4c-85ad-ecfe23a6e93e" Jul 14 11:11:43.954743 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:43.954696 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:11:43.955197 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:43.954851 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pql69" podUID="8792ce35-00f9-4101-aab2-346a02150768" Jul 14 11:11:44.955465 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:44.955038 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hpw4" Jul 14 11:11:44.955465 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:44.955081 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcz4r" Jul 14 11:11:44.955465 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:44.955199 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hpw4" podUID="62c5ec52-328c-4c4c-85ad-ecfe23a6e93e" Jul 14 11:11:44.955465 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:44.955325 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mcz4r" podUID="485ab2d2-0fbc-4d2d-95b0-d60732668829" Jul 14 11:11:45.485871 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:45.485823 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8792ce35-00f9-4101-aab2-346a02150768-metrics-certs\") pod \"network-metrics-daemon-pql69\" (UID: \"8792ce35-00f9-4101-aab2-346a02150768\") " pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:11:45.486109 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:45.486062 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:45.486246 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:45.486188 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8792ce35-00f9-4101-aab2-346a02150768-metrics-certs podName:8792ce35-00f9-4101-aab2-346a02150768 nodeName:}" failed. No retries permitted until 2026-07-14 11:11:53.486164283 +0000 UTC m=+18.059544636 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8792ce35-00f9-4101-aab2-346a02150768-metrics-certs") pod "network-metrics-daemon-pql69" (UID: "8792ce35-00f9-4101-aab2-346a02150768") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:45.586816 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:45.586773 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdxlj\" (UniqueName: \"kubernetes.io/projected/62c5ec52-328c-4c4c-85ad-ecfe23a6e93e-kube-api-access-wdxlj\") pod \"network-check-target-8hpw4\" (UID: \"62c5ec52-328c-4c4c-85ad-ecfe23a6e93e\") " pod="openshift-network-diagnostics/network-check-target-8hpw4" Jul 14 11:11:45.587008 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:45.586833 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/485ab2d2-0fbc-4d2d-95b0-d60732668829-original-pull-secret\") pod \"global-pull-secret-syncer-mcz4r\" (UID: \"485ab2d2-0fbc-4d2d-95b0-d60732668829\") " pod="kube-system/global-pull-secret-syncer-mcz4r" Jul 14 11:11:45.587008 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:45.586921 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 11:11:45.587008 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:45.586944 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 11:11:45.587008 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:45.586959 2576 projected.go:196] Error preparing data for projected volume kube-api-access-wdxlj for pod openshift-network-diagnostics/network-check-target-8hpw4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:45.587224 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:45.587011 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62c5ec52-328c-4c4c-85ad-ecfe23a6e93e-kube-api-access-wdxlj podName:62c5ec52-328c-4c4c-85ad-ecfe23a6e93e nodeName:}" failed. No retries permitted until 2026-07-14 11:11:53.586998458 +0000 UTC m=+18.160378809 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wdxlj" (UniqueName: "kubernetes.io/projected/62c5ec52-328c-4c4c-85ad-ecfe23a6e93e-kube-api-access-wdxlj") pod "network-check-target-8hpw4" (UID: "62c5ec52-328c-4c4c-85ad-ecfe23a6e93e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:45.587224 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:45.587020 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:45.587224 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:45.587095 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/485ab2d2-0fbc-4d2d-95b0-d60732668829-original-pull-secret podName:485ab2d2-0fbc-4d2d-95b0-d60732668829 nodeName:}" failed. No retries permitted until 2026-07-14 11:11:53.587072582 +0000 UTC m=+18.160452936 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/485ab2d2-0fbc-4d2d-95b0-d60732668829-original-pull-secret") pod "global-pull-secret-syncer-mcz4r" (UID: "485ab2d2-0fbc-4d2d-95b0-d60732668829") : object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:45.956911 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:45.956834 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:11:45.957258 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:45.956937 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pql69" podUID="8792ce35-00f9-4101-aab2-346a02150768" Jul 14 11:11:46.955879 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:46.955202 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcz4r" Jul 14 11:11:46.955879 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:46.955341 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mcz4r" podUID="485ab2d2-0fbc-4d2d-95b0-d60732668829" Jul 14 11:11:46.955879 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:46.955740 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hpw4" Jul 14 11:11:46.955879 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:46.955827 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hpw4" podUID="62c5ec52-328c-4c4c-85ad-ecfe23a6e93e" Jul 14 11:11:47.955104 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:47.955068 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:11:47.955608 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:47.955219 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pql69" podUID="8792ce35-00f9-4101-aab2-346a02150768" Jul 14 11:11:48.954719 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:48.954679 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcz4r" Jul 14 11:11:48.954896 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:48.954683 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hpw4" Jul 14 11:11:48.954896 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:48.954837 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mcz4r" podUID="485ab2d2-0fbc-4d2d-95b0-d60732668829" Jul 14 11:11:48.954896 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:48.954876 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hpw4" podUID="62c5ec52-328c-4c4c-85ad-ecfe23a6e93e" Jul 14 11:11:49.955253 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:49.955218 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:11:49.955609 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:49.955404 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pql69" podUID="8792ce35-00f9-4101-aab2-346a02150768" Jul 14 11:11:50.954866 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:50.954828 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hpw4" Jul 14 11:11:50.955047 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:50.954828 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcz4r" Jul 14 11:11:50.955047 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:50.954961 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hpw4" podUID="62c5ec52-328c-4c4c-85ad-ecfe23a6e93e" Jul 14 11:11:50.955141 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:50.955065 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mcz4r" podUID="485ab2d2-0fbc-4d2d-95b0-d60732668829" Jul 14 11:11:51.955362 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:51.955328 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:11:51.955834 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:51.955468 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pql69" podUID="8792ce35-00f9-4101-aab2-346a02150768" Jul 14 11:11:52.954994 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:52.954953 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcz4r" Jul 14 11:11:52.955247 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:52.954955 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hpw4" Jul 14 11:11:52.955247 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:52.955103 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mcz4r" podUID="485ab2d2-0fbc-4d2d-95b0-d60732668829" Jul 14 11:11:52.955247 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:52.955173 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hpw4" podUID="62c5ec52-328c-4c4c-85ad-ecfe23a6e93e" Jul 14 11:11:53.546324 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:53.546275 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8792ce35-00f9-4101-aab2-346a02150768-metrics-certs\") pod \"network-metrics-daemon-pql69\" (UID: \"8792ce35-00f9-4101-aab2-346a02150768\") " pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:11:53.546929 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:53.546469 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:53.546929 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:53.546559 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8792ce35-00f9-4101-aab2-346a02150768-metrics-certs podName:8792ce35-00f9-4101-aab2-346a02150768 nodeName:}" failed. No retries permitted until 2026-07-14 11:12:09.546522477 +0000 UTC m=+34.119902847 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8792ce35-00f9-4101-aab2-346a02150768-metrics-certs") pod "network-metrics-daemon-pql69" (UID: "8792ce35-00f9-4101-aab2-346a02150768") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:53.646872 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:53.646827 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdxlj\" (UniqueName: \"kubernetes.io/projected/62c5ec52-328c-4c4c-85ad-ecfe23a6e93e-kube-api-access-wdxlj\") pod \"network-check-target-8hpw4\" (UID: \"62c5ec52-328c-4c4c-85ad-ecfe23a6e93e\") " pod="openshift-network-diagnostics/network-check-target-8hpw4" Jul 14 11:11:53.647079 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:53.646882 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/485ab2d2-0fbc-4d2d-95b0-d60732668829-original-pull-secret\") pod \"global-pull-secret-syncer-mcz4r\" (UID: \"485ab2d2-0fbc-4d2d-95b0-d60732668829\") " pod="kube-system/global-pull-secret-syncer-mcz4r" Jul 14 11:11:53.647079 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:53.646987 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:53.647079 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:53.646999 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 11:11:53.647079 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:53.647021 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 11:11:53.647079 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:53.647032 2576 projected.go:196] Error preparing data for projected volume kube-api-access-wdxlj for pod openshift-network-diagnostics/network-check-target-8hpw4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:53.647079 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:53.647057 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/485ab2d2-0fbc-4d2d-95b0-d60732668829-original-pull-secret podName:485ab2d2-0fbc-4d2d-95b0-d60732668829 nodeName:}" failed. No retries permitted until 2026-07-14 11:12:09.647038889 +0000 UTC m=+34.220419244 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/485ab2d2-0fbc-4d2d-95b0-d60732668829-original-pull-secret") pod "global-pull-secret-syncer-mcz4r" (UID: "485ab2d2-0fbc-4d2d-95b0-d60732668829") : object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:53.647079 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:53.647075 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62c5ec52-328c-4c4c-85ad-ecfe23a6e93e-kube-api-access-wdxlj podName:62c5ec52-328c-4c4c-85ad-ecfe23a6e93e nodeName:}" failed. No retries permitted until 2026-07-14 11:12:09.647063371 +0000 UTC m=+34.220443722 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wdxlj" (UniqueName: "kubernetes.io/projected/62c5ec52-328c-4c4c-85ad-ecfe23a6e93e-kube-api-access-wdxlj") pod "network-check-target-8hpw4" (UID: "62c5ec52-328c-4c4c-85ad-ecfe23a6e93e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:53.958050 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:53.957979 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:11:53.958221 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:53.958091 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pql69" podUID="8792ce35-00f9-4101-aab2-346a02150768" Jul 14 11:11:54.955071 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:54.955026 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcz4r" Jul 14 11:11:54.955522 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:54.955038 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hpw4" Jul 14 11:11:54.955522 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:54.955174 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mcz4r" podUID="485ab2d2-0fbc-4d2d-95b0-d60732668829" Jul 14 11:11:54.955522 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:54.955243 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hpw4" podUID="62c5ec52-328c-4c4c-85ad-ecfe23a6e93e" Jul 14 11:11:55.955523 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:55.955486 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:11:55.955982 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:55.955619 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pql69" podUID="8792ce35-00f9-4101-aab2-346a02150768" Jul 14 11:11:56.955283 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:56.955244 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcz4r" Jul 14 11:11:56.955482 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:56.955253 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hpw4" Jul 14 11:11:56.955482 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:56.955385 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mcz4r" podUID="485ab2d2-0fbc-4d2d-95b0-d60732668829" Jul 14 11:11:56.955482 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:56.955463 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hpw4" podUID="62c5ec52-328c-4c4c-85ad-ecfe23a6e93e" Jul 14 11:11:57.955489 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:57.955454 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:11:57.955758 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:57.955621 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pql69" podUID="8792ce35-00f9-4101-aab2-346a02150768" Jul 14 11:11:58.955596 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:58.955241 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hpw4" Jul 14 11:11:58.955774 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:58.955232 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcz4r" Jul 14 11:11:58.955774 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:58.955697 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hpw4" podUID="62c5ec52-328c-4c4c-85ad-ecfe23a6e93e" Jul 14 11:11:58.955774 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:58.955734 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mcz4r" podUID="485ab2d2-0fbc-4d2d-95b0-d60732668829" Jul 14 11:11:59.088184 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:59.088139 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qmwvf" event={"ID":"c428ac6b-bf9d-4d77-8554-c2c09614b02c","Type":"ContainerStarted","Data":"9af7258f91323facb8022592fa1f6f46d033798753b0e2662f0bc0ea60d50767"} Jul 14 11:11:59.089798 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:59.089764 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-khg77" event={"ID":"7dccf5ba-e3dd-49e4-a4a2-357fd2ba9f31","Type":"ContainerStarted","Data":"a39c5939765e119b983f1e7a2ca09954b6ebeda0601bb8af069e45159366a2e6"} Jul 14 11:11:59.091614 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:59.091579 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kd42k" event={"ID":"5e0333e8-ff9a-4d6b-a66a-d3c651db407d","Type":"ContainerStarted","Data":"6270f1740a5874805d1c74fce5a0ca803b24ce02bfd865579f16015156d2113f"} Jul 14 11:11:59.093390 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:59.093345 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rf5p6" event={"ID":"8cb4cc75-45c5-4e00-8434-71d348adcb4d","Type":"ContainerStarted","Data":"71dc7d70b6ed95f3d09d7fd7103ae8f8f0ecc8b7fec3d67222a2db88bbbe578a"} Jul 14 11:11:59.096327 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:59.096285 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wshj6" event={"ID":"f8cdb4dc-f26c-4e5a-92a6-888681827bda","Type":"ContainerStarted","Data":"b775cd935d63e7479ec59b327b0d7bb20a45f8406885a942ee1ccb62c376d63c"} Jul 14 11:11:59.100140 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:59.100115 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvhwc_720aefb6-81a1-44d1-a01f-4bc07ff30465/ovn-acl-logging/0.log" Jul 14 11:11:59.100530 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:59.100489 2576 generic.go:356] "Generic (PLEG): container finished" podID="720aefb6-81a1-44d1-a01f-4bc07ff30465" containerID="b57e51ffd329d7fb336449c741f617540165e894ebf5e76389288a14bf311c9f" exitCode=1 Jul 14 11:11:59.100661 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:59.100569 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" event={"ID":"720aefb6-81a1-44d1-a01f-4bc07ff30465","Type":"ContainerStarted","Data":"79f10b438ea12b09f2469edc444d55ddb8cd342d20f88f2b7bc26f609e046f68"} Jul 14 11:11:59.100661 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:59.100655 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" event={"ID":"720aefb6-81a1-44d1-a01f-4bc07ff30465","Type":"ContainerStarted","Data":"e57932d21a05b133f3a274646013d869d0591fadf79edd130cf763e7c4e41cf0"} Jul 14 11:11:59.100771 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:59.100704 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" event={"ID":"720aefb6-81a1-44d1-a01f-4bc07ff30465","Type":"ContainerStarted","Data":"6a3e4bf8c54c98c08bec81bd7bd9fae38422b3e9f2d74381cbc20a7b11a42ae1"} Jul 14 11:11:59.100771 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:59.100749 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" event={"ID":"720aefb6-81a1-44d1-a01f-4bc07ff30465","Type":"ContainerStarted","Data":"6becba0f0f925fb5b4238b1964d3153cf9df52bc08a760a50ff5684f2d920914"} Jul 14 11:11:59.100859 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:59.100791 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" event={"ID":"720aefb6-81a1-44d1-a01f-4bc07ff30465","Type":"ContainerDied","Data":"b57e51ffd329d7fb336449c741f617540165e894ebf5e76389288a14bf311c9f"} Jul 14 11:11:59.100859 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:59.100841 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" event={"ID":"720aefb6-81a1-44d1-a01f-4bc07ff30465","Type":"ContainerStarted","Data":"c3e3f3ccdd813c626d38855528022c7d9ba2696ec7020b27dcca4367fb164d7c"} Jul 14 11:11:59.102247 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:59.102220 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9fwbj" event={"ID":"6dde3a96-cce6-4b23-aa81-61c89f0a836d","Type":"ContainerStarted","Data":"b2062826ff64fb37817f80e4f5fbb2223c32c3cd004410dfdeada4a8374ae081"} Jul 14 11:11:59.103915 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:59.103888 2576 generic.go:356] "Generic (PLEG): container finished" podID="7fa811e8-b74b-4cf5-ab86-0570d535e142" containerID="ae1053d661269fedcdfc1505570cfba81db5f1ea094c10272cbace8da5c38511" exitCode=0 Jul 14 11:11:59.104019 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:59.103928 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v2tgd" event={"ID":"7fa811e8-b74b-4cf5-ab86-0570d535e142","Type":"ContainerDied","Data":"ae1053d661269fedcdfc1505570cfba81db5f1ea094c10272cbace8da5c38511"} Jul 14 11:11:59.108507 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:59.108475 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qmwvf" podStartSLOduration=3.97229075 podStartE2EDuration="23.108463786s" totalImagesPullingTime="19.136173036s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:11:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:11:59.108210734 +0000 UTC m=+23.681591119" watchObservedRunningTime="2026-07-14 11:11:59.108463786 +0000 UTC m=+23.681844159" Jul 14 11:11:59.108610 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:59.108558 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-35.ec2.internal" podStartSLOduration=22.108552148 podStartE2EDuration="22.108552148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:11:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:11:41.065271222 +0000 UTC m=+5.638651598" watchObservedRunningTime="2026-07-14 11:11:59.108552148 +0000 UTC m=+23.681932513" Jul 14 11:11:59.135237 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:59.135182 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-khg77" podStartSLOduration=3.9912911170000003 podStartE2EDuration="23.135166875s" totalImagesPullingTime="19.143875758s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:11:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:11:59.134993196 +0000 UTC m=+23.708373569" watchObservedRunningTime="2026-07-14 11:11:59.135166875 +0000 UTC m=+23.708547248" Jul 14 11:11:59.194691 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:59.194641 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rf5p6" podStartSLOduration=4.044515175 podStartE2EDuration="23.194625008s" totalImagesPullingTime="19.150109833s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:11:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:11:59.19432333 +0000 UTC m=+23.767703705" watchObservedRunningTime="2026-07-14 11:11:59.194625008 +0000 UTC m=+23.768005381" Jul 14 11:11:59.213550 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:59.213488 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9fwbj" podStartSLOduration=3.996770399 podStartE2EDuration="23.213470298s" totalImagesPullingTime="19.216699899s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:11:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:11:59.213038093 +0000 UTC m=+23.786418468" watchObservedRunningTime="2026-07-14 11:11:59.213470298 +0000 UTC m=+23.786850666" Jul 14 11:11:59.230475 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:59.230423 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kd42k" podStartSLOduration=12.181709415 podStartE2EDuration="23.230406399s" totalImagesPullingTime="11.048696984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:11:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:11:59.230271843 +0000 UTC m=+23.803652216" watchObservedRunningTime="2026-07-14 11:11:59.230406399 +0000 UTC m=+23.803786830" Jul 14 11:11:59.663088 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:59.663065 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 14 11:11:59.878555 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:59.878428 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T11:11:59.66308474Z","UUID":"5a608612-414d-4166-9e08-79e08069dbc2","Handler":null,"Name":"","Endpoint":""} Jul 14 11:11:59.880298 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:59.880271 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 14 11:11:59.880446 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:59.880309 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 14 11:11:59.954960 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:11:59.954928 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:11:59.955149 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:11:59.955068 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pql69" podUID="8792ce35-00f9-4101-aab2-346a02150768" Jul 14 11:12:00.108663 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:00.108626 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kn68m" event={"ID":"e02a70bf-1675-40bd-b486-2a13f65e845b","Type":"ContainerStarted","Data":"63abada6423b60c5a8548ba99b3acc717f26e5f9920478741699f910b3a84e10"} Jul 14 11:12:00.110833 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:00.110798 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wshj6" event={"ID":"f8cdb4dc-f26c-4e5a-92a6-888681827bda","Type":"ContainerStarted","Data":"9d0a7cd4eaab5d64e82b9d4d0523231f070583a45c247ded7160f673c96e2a3b"} Jul 14 11:12:00.840154 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:00.840107 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kd42k" Jul 14 11:12:00.841509 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:00.841481 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kd42k" Jul 14 11:12:00.870083 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:00.870005 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kn68m" podStartSLOduration=6.725047999 podStartE2EDuration="25.869982115s" totalImagesPullingTime="19.144934116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:11:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:12:00.133742022 +0000 UTC m=+24.707122395" watchObservedRunningTime="2026-07-14 11:12:00.869982115 +0000 UTC m=+25.443362487" Jul 14 11:12:00.954984 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:00.954900 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcz4r" Jul 14 11:12:00.954984 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:00.954943 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hpw4" Jul 14 11:12:00.955326 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:00.955039 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mcz4r" podUID="485ab2d2-0fbc-4d2d-95b0-d60732668829" Jul 14 11:12:00.955326 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:00.955162 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hpw4" podUID="62c5ec52-328c-4c4c-85ad-ecfe23a6e93e" Jul 14 11:12:01.115851 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:01.115806 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wshj6" event={"ID":"f8cdb4dc-f26c-4e5a-92a6-888681827bda","Type":"ContainerStarted","Data":"0d870358ed4a7efe2c0933257d1c6f516e24f13109b5a7f3d526f024eac160cf"} Jul 14 11:12:01.119700 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:01.119670 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvhwc_720aefb6-81a1-44d1-a01f-4bc07ff30465/ovn-acl-logging/0.log" Jul 14 11:12:01.120221 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:01.120189 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" event={"ID":"720aefb6-81a1-44d1-a01f-4bc07ff30465","Type":"ContainerStarted","Data":"b6456d6dc3592fee19895d11e76365e37ae5baccfd75e8aec5279c462fd1c433"} Jul 14 11:12:01.120599 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:01.120574 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kd42k" Jul 14 11:12:01.121175 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:01.121147 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kd42k" Jul 14 11:12:01.158501 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:01.158451 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wshj6" podStartSLOduration=3.732015987 podStartE2EDuration="25.158433834s" totalImagesPullingTime="21.426417847s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:11:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:12:01.138905362 +0000 UTC m=+25.712285737" watchObservedRunningTime="2026-07-14 11:12:01.158433834 +0000 UTC m=+25.731814264" Jul 14 11:12:01.954607 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:01.954571 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:12:01.954811 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:01.954722 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pql69" podUID="8792ce35-00f9-4101-aab2-346a02150768" Jul 14 11:12:02.955503 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:02.955246 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hpw4" Jul 14 11:12:02.955925 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:02.955272 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcz4r" Jul 14 11:12:02.955925 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:02.955629 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hpw4" podUID="62c5ec52-328c-4c4c-85ad-ecfe23a6e93e" Jul 14 11:12:02.955925 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:02.955675 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mcz4r" podUID="485ab2d2-0fbc-4d2d-95b0-d60732668829" Jul 14 11:12:03.955024 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:03.954740 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:12:03.955194 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:03.955042 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pql69" podUID="8792ce35-00f9-4101-aab2-346a02150768" Jul 14 11:12:04.130222 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:04.130197 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvhwc_720aefb6-81a1-44d1-a01f-4bc07ff30465/ovn-acl-logging/0.log" Jul 14 11:12:04.131096 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:04.130580 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" event={"ID":"720aefb6-81a1-44d1-a01f-4bc07ff30465","Type":"ContainerStarted","Data":"41e61e738cf9fbd0bb7565e3d14291bc019e1490c6ca16a7439670d01d10ddb6"} Jul 14 11:12:04.131096 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:04.130931 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:12:04.131195 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:04.131110 2576 scope.go:117] "RemoveContainer" containerID="b57e51ffd329d7fb336449c741f617540165e894ebf5e76389288a14bf311c9f" Jul 14 11:12:04.132876 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:04.132848 2576 generic.go:356] "Generic (PLEG): container finished" podID="7fa811e8-b74b-4cf5-ab86-0570d535e142" containerID="65a64f054b87f424776b4e27310df19f7b8e69a179cf15c745435d5448b6f865" exitCode=0 Jul 14 11:12:04.132984 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:04.132890 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v2tgd" event={"ID":"7fa811e8-b74b-4cf5-ab86-0570d535e142","Type":"ContainerDied","Data":"65a64f054b87f424776b4e27310df19f7b8e69a179cf15c745435d5448b6f865"} Jul 14 11:12:04.151638 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:04.151611 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:12:04.955462 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:04.955427 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hpw4" Jul 14 11:12:04.955709 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:04.955437 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcz4r" Jul 14 11:12:04.955709 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:04.955532 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hpw4" podUID="62c5ec52-328c-4c4c-85ad-ecfe23a6e93e" Jul 14 11:12:04.955709 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:04.955658 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mcz4r" podUID="485ab2d2-0fbc-4d2d-95b0-d60732668829" Jul 14 11:12:05.140204 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:05.140179 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvhwc_720aefb6-81a1-44d1-a01f-4bc07ff30465/ovn-acl-logging/0.log" Jul 14 11:12:05.140775 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:05.140729 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" event={"ID":"720aefb6-81a1-44d1-a01f-4bc07ff30465","Type":"ContainerStarted","Data":"4417aa661079456f431809005d2e23de6d5ae2ca656f513e6839147e5b4ccf19"} Jul 14 11:12:05.141126 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:05.141069 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:12:05.141210 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:05.141148 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:12:05.164561 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:05.164507 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:12:05.175873 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:05.175832 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" podStartSLOduration=9.968356035 podStartE2EDuration="29.17581586s" totalImagesPullingTime="19.207459825s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:11:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:12:05.175442734 +0000 UTC m=+29.748823154" watchObservedRunningTime="2026-07-14 11:12:05.17581586 +0000 UTC m=+29.749196234" Jul 14 11:12:05.318230 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:05.318196 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mcz4r"] Jul 14 11:12:05.318394 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:05.318306 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcz4r" Jul 14 11:12:05.318435 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:05.318404 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mcz4r" podUID="485ab2d2-0fbc-4d2d-95b0-d60732668829" Jul 14 11:12:05.328485 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:05.328448 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8hpw4"] Jul 14 11:12:05.328684 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:05.328583 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hpw4" Jul 14 11:12:05.328754 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:05.328704 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hpw4" podUID="62c5ec52-328c-4c4c-85ad-ecfe23a6e93e" Jul 14 11:12:05.329115 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:05.329062 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pql69"] Jul 14 11:12:05.329189 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:05.329176 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:12:05.329289 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:05.329270 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pql69" podUID="8792ce35-00f9-4101-aab2-346a02150768" Jul 14 11:12:06.145338 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:06.145300 2576 generic.go:356] "Generic (PLEG): container finished" podID="7fa811e8-b74b-4cf5-ab86-0570d535e142" containerID="011ec35b5f3244d8a63bd44c2db8a0ec068d062b22bfaa87867d6bd4eb32376c" exitCode=0 Jul 14 11:12:06.145940 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:06.145387 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v2tgd" event={"ID":"7fa811e8-b74b-4cf5-ab86-0570d535e142","Type":"ContainerDied","Data":"011ec35b5f3244d8a63bd44c2db8a0ec068d062b22bfaa87867d6bd4eb32376c"} Jul 14 11:12:06.955046 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:06.954847 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hpw4" Jul 14 11:12:06.955232 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:06.954847 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:12:06.955232 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:06.955117 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hpw4" podUID="62c5ec52-328c-4c4c-85ad-ecfe23a6e93e" Jul 14 11:12:06.955232 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:06.954847 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcz4r" Jul 14 11:12:06.955232 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:06.955199 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pql69" podUID="8792ce35-00f9-4101-aab2-346a02150768" Jul 14 11:12:06.955359 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:06.955259 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mcz4r" podUID="485ab2d2-0fbc-4d2d-95b0-d60732668829" Jul 14 11:12:07.151087 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:07.151046 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v2tgd" event={"ID":"7fa811e8-b74b-4cf5-ab86-0570d535e142","Type":"ContainerStarted","Data":"ed6599496d4c374f1a14e71310643c5330609d136532ed8ad06c7befbb9a4490"} Jul 14 11:12:08.156320 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:08.156284 2576 generic.go:356] "Generic (PLEG): container finished" podID="7fa811e8-b74b-4cf5-ab86-0570d535e142" containerID="ed6599496d4c374f1a14e71310643c5330609d136532ed8ad06c7befbb9a4490" exitCode=0 Jul 14 11:12:08.156914 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:08.156347 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v2tgd" event={"ID":"7fa811e8-b74b-4cf5-ab86-0570d535e142","Type":"ContainerDied","Data":"ed6599496d4c374f1a14e71310643c5330609d136532ed8ad06c7befbb9a4490"} Jul 14 11:12:08.954988 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:08.954946 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcz4r" Jul 14 11:12:08.954988 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:08.954977 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hpw4" Jul 14 11:12:08.955267 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:08.954950 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:12:08.955267 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:08.955083 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mcz4r" podUID="485ab2d2-0fbc-4d2d-95b0-d60732668829" Jul 14 11:12:08.955267 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:08.955166 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pql69" podUID="8792ce35-00f9-4101-aab2-346a02150768" Jul 14 11:12:08.955267 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:08.955245 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hpw4" podUID="62c5ec52-328c-4c4c-85ad-ecfe23a6e93e" Jul 14 11:12:09.569079 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:09.569031 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8792ce35-00f9-4101-aab2-346a02150768-metrics-certs\") pod \"network-metrics-daemon-pql69\" (UID: \"8792ce35-00f9-4101-aab2-346a02150768\") " pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:12:09.569674 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:09.569215 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:12:09.569674 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:09.569347 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8792ce35-00f9-4101-aab2-346a02150768-metrics-certs podName:8792ce35-00f9-4101-aab2-346a02150768 nodeName:}" failed. No retries permitted until 2026-07-14 11:12:41.569276568 +0000 UTC m=+66.142656940 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8792ce35-00f9-4101-aab2-346a02150768-metrics-certs") pod "network-metrics-daemon-pql69" (UID: "8792ce35-00f9-4101-aab2-346a02150768") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:12:09.669974 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:09.669887 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdxlj\" (UniqueName: \"kubernetes.io/projected/62c5ec52-328c-4c4c-85ad-ecfe23a6e93e-kube-api-access-wdxlj\") pod \"network-check-target-8hpw4\" (UID: \"62c5ec52-328c-4c4c-85ad-ecfe23a6e93e\") " pod="openshift-network-diagnostics/network-check-target-8hpw4" Jul 14 11:12:09.669974 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:09.669926 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/485ab2d2-0fbc-4d2d-95b0-d60732668829-original-pull-secret\") pod \"global-pull-secret-syncer-mcz4r\" (UID: \"485ab2d2-0fbc-4d2d-95b0-d60732668829\") " pod="kube-system/global-pull-secret-syncer-mcz4r" Jul 14 11:12:09.670213 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:09.670066 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 11:12:09.670213 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:09.670073 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 11:12:09.670213 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:09.670100 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 11:12:09.670213 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:09.670113 2576 projected.go:196] Error preparing data for projected volume kube-api-access-wdxlj for pod openshift-network-diagnostics/network-check-target-8hpw4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:12:09.670213 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:09.670137 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/485ab2d2-0fbc-4d2d-95b0-d60732668829-original-pull-secret podName:485ab2d2-0fbc-4d2d-95b0-d60732668829 nodeName:}" failed. No retries permitted until 2026-07-14 11:12:41.670116349 +0000 UTC m=+66.243496704 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/485ab2d2-0fbc-4d2d-95b0-d60732668829-original-pull-secret") pod "global-pull-secret-syncer-mcz4r" (UID: "485ab2d2-0fbc-4d2d-95b0-d60732668829") : object "kube-system"/"original-pull-secret" not registered Jul 14 11:12:09.670213 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:09.670167 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/62c5ec52-328c-4c4c-85ad-ecfe23a6e93e-kube-api-access-wdxlj podName:62c5ec52-328c-4c4c-85ad-ecfe23a6e93e nodeName:}" failed. No retries permitted until 2026-07-14 11:12:41.670147549 +0000 UTC m=+66.243527902 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wdxlj" (UniqueName: "kubernetes.io/projected/62c5ec52-328c-4c4c-85ad-ecfe23a6e93e-kube-api-access-wdxlj") pod "network-check-target-8hpw4" (UID: "62c5ec52-328c-4c4c-85ad-ecfe23a6e93e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:12:10.769131 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:10.769098 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-35.ec2.internal" event="NodeReady" Jul 14 11:12:10.769675 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:10.769252 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 14 11:12:10.820192 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:10.820153 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cf5nb"] Jul 14 11:12:10.822726 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:10.822685 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cf5nb" Jul 14 11:12:10.823444 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:10.823413 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tgz82"] Jul 14 11:12:10.825387 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:10.825358 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tgz82" Jul 14 11:12:10.826510 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:10.826011 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-78vw8\"" Jul 14 11:12:10.826510 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:10.826053 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 14 11:12:10.826510 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:10.826011 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 14 11:12:10.826510 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:10.826334 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 14 11:12:10.827981 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:10.827960 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 14 11:12:10.828144 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:10.827960 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 14 11:12:10.828981 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:10.828960 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9dwb8\"" Jul 14 11:12:10.833978 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:10.833485 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cf5nb"] Jul 14 11:12:10.839050 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:10.839007 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tgz82"] Jul 14 11:12:10.955011 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:10.954920 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcz4r" Jul 14 11:12:10.955184 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:10.954928 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hpw4" Jul 14 11:12:10.955184 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:10.954928 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:12:10.958508 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:10.958482 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qblx9\"" Jul 14 11:12:10.958508 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:10.958498 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 11:12:10.958714 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:10.958566 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 11:12:10.958714 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:10.958487 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-56vkg\"" Jul 14 11:12:10.958714 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:10.958533 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 11:12:10.958714 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:10.958489 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 11:12:10.980290 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:10.980212 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3c2af027-67fa-46e8-8502-7b584d80674e-config-volume\") pod \"dns-default-tgz82\" (UID: \"3c2af027-67fa-46e8-8502-7b584d80674e\") " pod="openshift-dns/dns-default-tgz82" Jul 14 11:12:10.980383 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:10.980305 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c2af027-67fa-46e8-8502-7b584d80674e-tmp-dir\") pod \"dns-default-tgz82\" (UID: \"3c2af027-67fa-46e8-8502-7b584d80674e\") " pod="openshift-dns/dns-default-tgz82" Jul 14 11:12:10.980383 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:10.980346 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f8a832e-cf67-47c0-817f-caf7db077628-cert\") pod \"ingress-canary-cf5nb\" (UID: \"0f8a832e-cf67-47c0-817f-caf7db077628\") " pod="openshift-ingress-canary/ingress-canary-cf5nb" Jul 14 11:12:10.980489 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:10.980467 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c2af027-67fa-46e8-8502-7b584d80674e-metrics-tls\") pod \"dns-default-tgz82\" (UID: \"3c2af027-67fa-46e8-8502-7b584d80674e\") " pod="openshift-dns/dns-default-tgz82" Jul 14 11:12:10.980571 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:10.980502 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcp2z\" (UniqueName: \"kubernetes.io/projected/3c2af027-67fa-46e8-8502-7b584d80674e-kube-api-access-tcp2z\") pod \"dns-default-tgz82\" (UID: \"3c2af027-67fa-46e8-8502-7b584d80674e\") " pod="openshift-dns/dns-default-tgz82" Jul 14 11:12:10.980571 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:10.980559 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2vhc\" (UniqueName: \"kubernetes.io/projected/0f8a832e-cf67-47c0-817f-caf7db077628-kube-api-access-k2vhc\") pod \"ingress-canary-cf5nb\" (UID: \"0f8a832e-cf67-47c0-817f-caf7db077628\") " pod="openshift-ingress-canary/ingress-canary-cf5nb" Jul 14 11:12:11.081825 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:11.081783 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3c2af027-67fa-46e8-8502-7b584d80674e-config-volume\") pod \"dns-default-tgz82\" (UID: \"3c2af027-67fa-46e8-8502-7b584d80674e\") " pod="openshift-dns/dns-default-tgz82" Jul 14 11:12:11.082019 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:11.081894 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c2af027-67fa-46e8-8502-7b584d80674e-tmp-dir\") pod \"dns-default-tgz82\" (UID: \"3c2af027-67fa-46e8-8502-7b584d80674e\") " pod="openshift-dns/dns-default-tgz82" Jul 14 11:12:11.082019 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:11.081936 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f8a832e-cf67-47c0-817f-caf7db077628-cert\") pod \"ingress-canary-cf5nb\" (UID: \"0f8a832e-cf67-47c0-817f-caf7db077628\") " pod="openshift-ingress-canary/ingress-canary-cf5nb" Jul 14 11:12:11.082147 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:11.082126 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c2af027-67fa-46e8-8502-7b584d80674e-metrics-tls\") pod \"dns-default-tgz82\" (UID: \"3c2af027-67fa-46e8-8502-7b584d80674e\") " pod="openshift-dns/dns-default-tgz82" Jul 14 11:12:11.082202 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:11.082157 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcp2z\" (UniqueName: \"kubernetes.io/projected/3c2af027-67fa-46e8-8502-7b584d80674e-kube-api-access-tcp2z\") pod \"dns-default-tgz82\" (UID: \"3c2af027-67fa-46e8-8502-7b584d80674e\") " pod="openshift-dns/dns-default-tgz82" Jul 14 11:12:11.082202 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:11.082180 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2vhc\" (UniqueName: \"kubernetes.io/projected/0f8a832e-cf67-47c0-817f-caf7db077628-kube-api-access-k2vhc\") pod \"ingress-canary-cf5nb\" (UID: \"0f8a832e-cf67-47c0-817f-caf7db077628\") " pod="openshift-ingress-canary/ingress-canary-cf5nb" Jul 14 11:12:11.082303 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:11.082272 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 11:12:11.082369 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:11.082295 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c2af027-67fa-46e8-8502-7b584d80674e-tmp-dir\") pod \"dns-default-tgz82\" (UID: \"3c2af027-67fa-46e8-8502-7b584d80674e\") " pod="openshift-dns/dns-default-tgz82" Jul 14 11:12:11.082369 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:11.082355 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c2af027-67fa-46e8-8502-7b584d80674e-metrics-tls podName:3c2af027-67fa-46e8-8502-7b584d80674e nodeName:}" failed. No retries permitted until 2026-07-14 11:12:11.582328236 +0000 UTC m=+36.155708591 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c2af027-67fa-46e8-8502-7b584d80674e-metrics-tls") pod "dns-default-tgz82" (UID: "3c2af027-67fa-46e8-8502-7b584d80674e") : secret "dns-default-metrics-tls" not found Jul 14 11:12:11.082481 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:11.082439 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3c2af027-67fa-46e8-8502-7b584d80674e-config-volume\") pod \"dns-default-tgz82\" (UID: \"3c2af027-67fa-46e8-8502-7b584d80674e\") " pod="openshift-dns/dns-default-tgz82" Jul 14 11:12:11.087264 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:11.087238 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f8a832e-cf67-47c0-817f-caf7db077628-cert\") pod \"ingress-canary-cf5nb\" (UID: \"0f8a832e-cf67-47c0-817f-caf7db077628\") " pod="openshift-ingress-canary/ingress-canary-cf5nb" Jul 14 11:12:11.092979 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:11.092947 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2vhc\" (UniqueName: \"kubernetes.io/projected/0f8a832e-cf67-47c0-817f-caf7db077628-kube-api-access-k2vhc\") pod \"ingress-canary-cf5nb\" (UID: \"0f8a832e-cf67-47c0-817f-caf7db077628\") " pod="openshift-ingress-canary/ingress-canary-cf5nb" Jul 14 11:12:11.093641 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:11.093616 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcp2z\" (UniqueName: \"kubernetes.io/projected/3c2af027-67fa-46e8-8502-7b584d80674e-kube-api-access-tcp2z\") pod \"dns-default-tgz82\" (UID: \"3c2af027-67fa-46e8-8502-7b584d80674e\") " pod="openshift-dns/dns-default-tgz82" Jul 14 11:12:11.136848 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:11.136806 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cf5nb" Jul 14 11:12:11.586751 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:11.586701 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c2af027-67fa-46e8-8502-7b584d80674e-metrics-tls\") pod \"dns-default-tgz82\" (UID: \"3c2af027-67fa-46e8-8502-7b584d80674e\") " pod="openshift-dns/dns-default-tgz82" Jul 14 11:12:11.586920 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:11.586847 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 11:12:11.586920 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:11.586917 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c2af027-67fa-46e8-8502-7b584d80674e-metrics-tls podName:3c2af027-67fa-46e8-8502-7b584d80674e nodeName:}" failed. No retries permitted until 2026-07-14 11:12:12.586899234 +0000 UTC m=+37.160279602 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c2af027-67fa-46e8-8502-7b584d80674e-metrics-tls") pod "dns-default-tgz82" (UID: "3c2af027-67fa-46e8-8502-7b584d80674e") : secret "dns-default-metrics-tls" not found Jul 14 11:12:12.333138 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:12.332872 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cf5nb"] Jul 14 11:12:12.337606 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:12:12.337572 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f8a832e_cf67_47c0_817f_caf7db077628.slice/crio-522b9d04863a596f4ccb70d99da415772c52bece564eb40eefde91ec64ab6634 WatchSource:0}: Error finding container 522b9d04863a596f4ccb70d99da415772c52bece564eb40eefde91ec64ab6634: Status 404 returned error can't find the container with id 522b9d04863a596f4ccb70d99da415772c52bece564eb40eefde91ec64ab6634 Jul 14 11:12:12.595069 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:12.595025 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c2af027-67fa-46e8-8502-7b584d80674e-metrics-tls\") pod \"dns-default-tgz82\" (UID: \"3c2af027-67fa-46e8-8502-7b584d80674e\") " pod="openshift-dns/dns-default-tgz82" Jul 14 11:12:12.595271 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:12.595140 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 11:12:12.595271 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:12.595201 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c2af027-67fa-46e8-8502-7b584d80674e-metrics-tls podName:3c2af027-67fa-46e8-8502-7b584d80674e nodeName:}" failed. No retries permitted until 2026-07-14 11:12:14.59518257 +0000 UTC m=+39.168562923 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c2af027-67fa-46e8-8502-7b584d80674e-metrics-tls") pod "dns-default-tgz82" (UID: "3c2af027-67fa-46e8-8502-7b584d80674e") : secret "dns-default-metrics-tls" not found Jul 14 11:12:13.172813 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:13.172771 2576 generic.go:356] "Generic (PLEG): container finished" podID="7fa811e8-b74b-4cf5-ab86-0570d535e142" containerID="9f2717734aada4269bc4692cc73a1b41a7d94910f521a448e572c76f22cdeaae" exitCode=0 Jul 14 11:12:13.173010 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:13.172866 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v2tgd" event={"ID":"7fa811e8-b74b-4cf5-ab86-0570d535e142","Type":"ContainerDied","Data":"9f2717734aada4269bc4692cc73a1b41a7d94910f521a448e572c76f22cdeaae"} Jul 14 11:12:13.174577 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:13.174529 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cf5nb" event={"ID":"0f8a832e-cf67-47c0-817f-caf7db077628","Type":"ContainerStarted","Data":"522b9d04863a596f4ccb70d99da415772c52bece564eb40eefde91ec64ab6634"} Jul 14 11:12:14.181612 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:14.181577 2576 generic.go:356] "Generic (PLEG): container finished" podID="7fa811e8-b74b-4cf5-ab86-0570d535e142" containerID="0ad22411b00c675e42e353dba0d052b6d66af5fb4deb41c0d589e637d374dbd3" exitCode=0 Jul 14 11:12:14.182040 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:14.181658 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v2tgd" event={"ID":"7fa811e8-b74b-4cf5-ab86-0570d535e142","Type":"ContainerDied","Data":"0ad22411b00c675e42e353dba0d052b6d66af5fb4deb41c0d589e637d374dbd3"} Jul 14 11:12:14.611996 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:14.611798 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c2af027-67fa-46e8-8502-7b584d80674e-metrics-tls\") pod \"dns-default-tgz82\" (UID: \"3c2af027-67fa-46e8-8502-7b584d80674e\") " pod="openshift-dns/dns-default-tgz82" Jul 14 11:12:14.611996 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:14.611952 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 11:12:14.612226 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:14.612062 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c2af027-67fa-46e8-8502-7b584d80674e-metrics-tls podName:3c2af027-67fa-46e8-8502-7b584d80674e nodeName:}" failed. No retries permitted until 2026-07-14 11:12:18.612040922 +0000 UTC m=+43.185421287 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c2af027-67fa-46e8-8502-7b584d80674e-metrics-tls") pod "dns-default-tgz82" (UID: "3c2af027-67fa-46e8-8502-7b584d80674e") : secret "dns-default-metrics-tls" not found Jul 14 11:12:15.187711 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:15.187615 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v2tgd" event={"ID":"7fa811e8-b74b-4cf5-ab86-0570d535e142","Type":"ContainerStarted","Data":"06d48ac1ccf7ea1311b6e4ac8439bf67c6834de5f110983abbc612c8122579bc"} Jul 14 11:12:15.189122 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:15.189094 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cf5nb" event={"ID":"0f8a832e-cf67-47c0-817f-caf7db077628","Type":"ContainerStarted","Data":"58f2c28ab12649f41787f4d43b66a68691e2e9f1410822a687a766bece4006e8"} Jul 14 11:12:15.213375 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:15.213316 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-v2tgd" podStartSLOduration=9.829084765 podStartE2EDuration="39.213298582s" totalImagesPullingTime="29.384213817s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:11:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:12:15.212797243 +0000 UTC m=+39.786177617" watchObservedRunningTime="2026-07-14 11:12:15.213298582 +0000 UTC m=+39.786678955" Jul 14 11:12:15.229581 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:15.229491 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cf5nb" podStartSLOduration=3.155707899 podStartE2EDuration="5.229470561s" totalImagesPullingTime="2.073762662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:12:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:12:15.229162845 +0000 UTC m=+39.802543238" watchObservedRunningTime="2026-07-14 11:12:15.229470561 +0000 UTC m=+39.802850937" Jul 14 11:12:18.638797 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:18.638750 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c2af027-67fa-46e8-8502-7b584d80674e-metrics-tls\") pod \"dns-default-tgz82\" (UID: \"3c2af027-67fa-46e8-8502-7b584d80674e\") " pod="openshift-dns/dns-default-tgz82" Jul 14 11:12:18.639339 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:18.638877 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 11:12:18.639339 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:18.638932 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c2af027-67fa-46e8-8502-7b584d80674e-metrics-tls podName:3c2af027-67fa-46e8-8502-7b584d80674e nodeName:}" failed. No retries permitted until 2026-07-14 11:12:26.638917921 +0000 UTC m=+51.212298273 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c2af027-67fa-46e8-8502-7b584d80674e-metrics-tls") pod "dns-default-tgz82" (UID: "3c2af027-67fa-46e8-8502-7b584d80674e") : secret "dns-default-metrics-tls" not found Jul 14 11:12:26.699924 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:26.699878 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c2af027-67fa-46e8-8502-7b584d80674e-metrics-tls\") pod \"dns-default-tgz82\" (UID: \"3c2af027-67fa-46e8-8502-7b584d80674e\") " pod="openshift-dns/dns-default-tgz82" Jul 14 11:12:26.700410 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:26.700037 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 11:12:26.700410 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:26.700107 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c2af027-67fa-46e8-8502-7b584d80674e-metrics-tls podName:3c2af027-67fa-46e8-8502-7b584d80674e nodeName:}" failed. No retries permitted until 2026-07-14 11:12:42.700090715 +0000 UTC m=+67.273471066 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c2af027-67fa-46e8-8502-7b584d80674e-metrics-tls") pod "dns-default-tgz82" (UID: "3c2af027-67fa-46e8-8502-7b584d80674e") : secret "dns-default-metrics-tls" not found Jul 14 11:12:37.170209 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:37.170175 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rvhwc" Jul 14 11:12:41.608832 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:41.608779 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8792ce35-00f9-4101-aab2-346a02150768-metrics-certs\") pod \"network-metrics-daemon-pql69\" (UID: \"8792ce35-00f9-4101-aab2-346a02150768\") " pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:12:41.612059 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:41.612037 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 11:12:41.619593 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:41.619565 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 14 11:12:41.619659 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:41.619645 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8792ce35-00f9-4101-aab2-346a02150768-metrics-certs podName:8792ce35-00f9-4101-aab2-346a02150768 nodeName:}" failed. No retries permitted until 2026-07-14 11:13:45.619624255 +0000 UTC m=+130.193004606 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8792ce35-00f9-4101-aab2-346a02150768-metrics-certs") pod "network-metrics-daemon-pql69" (UID: "8792ce35-00f9-4101-aab2-346a02150768") : secret "metrics-daemon-secret" not found Jul 14 11:12:41.709994 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:41.709940 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdxlj\" (UniqueName: \"kubernetes.io/projected/62c5ec52-328c-4c4c-85ad-ecfe23a6e93e-kube-api-access-wdxlj\") pod \"network-check-target-8hpw4\" (UID: \"62c5ec52-328c-4c4c-85ad-ecfe23a6e93e\") " pod="openshift-network-diagnostics/network-check-target-8hpw4" Jul 14 11:12:41.709994 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:41.709999 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/485ab2d2-0fbc-4d2d-95b0-d60732668829-original-pull-secret\") pod \"global-pull-secret-syncer-mcz4r\" (UID: \"485ab2d2-0fbc-4d2d-95b0-d60732668829\") " pod="kube-system/global-pull-secret-syncer-mcz4r" Jul 14 11:12:41.713682 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:41.713660 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 11:12:41.714299 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:41.714271 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 11:12:41.725088 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:41.725053 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/485ab2d2-0fbc-4d2d-95b0-d60732668829-original-pull-secret\") pod \"global-pull-secret-syncer-mcz4r\" (UID: \"485ab2d2-0fbc-4d2d-95b0-d60732668829\") " pod="kube-system/global-pull-secret-syncer-mcz4r" Jul 14 11:12:41.725394 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:41.725373 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 11:12:41.734632 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:41.734604 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdxlj\" (UniqueName: \"kubernetes.io/projected/62c5ec52-328c-4c4c-85ad-ecfe23a6e93e-kube-api-access-wdxlj\") pod \"network-check-target-8hpw4\" (UID: \"62c5ec52-328c-4c4c-85ad-ecfe23a6e93e\") " pod="openshift-network-diagnostics/network-check-target-8hpw4" Jul 14 11:12:41.867155 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:41.867064 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcz4r" Jul 14 11:12:41.882361 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:41.882328 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-56vkg\"" Jul 14 11:12:41.889023 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:41.888995 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hpw4" Jul 14 11:12:42.014079 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:42.014049 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mcz4r"] Jul 14 11:12:42.017949 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:12:42.017914 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod485ab2d2_0fbc_4d2d_95b0_d60732668829.slice/crio-e7ef5366efeddfda03faa78c5601e60344b8349e292420ae7bc89571ead4b4ce WatchSource:0}: Error finding container e7ef5366efeddfda03faa78c5601e60344b8349e292420ae7bc89571ead4b4ce: Status 404 returned error can't find the container with id e7ef5366efeddfda03faa78c5601e60344b8349e292420ae7bc89571ead4b4ce Jul 14 11:12:42.042140 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:42.042107 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8hpw4"] Jul 14 11:12:42.045961 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:12:42.045918 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62c5ec52_328c_4c4c_85ad_ecfe23a6e93e.slice/crio-e68c6691a0be3bc7496bf05767fa0411d14b91bea7c3c1e45fbb6eda2fc986a3 WatchSource:0}: Error finding container e68c6691a0be3bc7496bf05767fa0411d14b91bea7c3c1e45fbb6eda2fc986a3: Status 404 returned error can't find the container with id e68c6691a0be3bc7496bf05767fa0411d14b91bea7c3c1e45fbb6eda2fc986a3 Jul 14 11:12:42.255333 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:42.255284 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8hpw4" event={"ID":"62c5ec52-328c-4c4c-85ad-ecfe23a6e93e","Type":"ContainerStarted","Data":"e68c6691a0be3bc7496bf05767fa0411d14b91bea7c3c1e45fbb6eda2fc986a3"} Jul 14 11:12:42.256346 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:42.256319 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mcz4r" event={"ID":"485ab2d2-0fbc-4d2d-95b0-d60732668829","Type":"ContainerStarted","Data":"e7ef5366efeddfda03faa78c5601e60344b8349e292420ae7bc89571ead4b4ce"} Jul 14 11:12:42.716807 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:42.716770 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c2af027-67fa-46e8-8502-7b584d80674e-metrics-tls\") pod \"dns-default-tgz82\" (UID: \"3c2af027-67fa-46e8-8502-7b584d80674e\") " pod="openshift-dns/dns-default-tgz82" Jul 14 11:12:42.717385 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:42.716944 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 11:12:42.717385 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:12:42.717048 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c2af027-67fa-46e8-8502-7b584d80674e-metrics-tls podName:3c2af027-67fa-46e8-8502-7b584d80674e nodeName:}" failed. No retries permitted until 2026-07-14 11:13:14.717011218 +0000 UTC m=+99.290391573 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c2af027-67fa-46e8-8502-7b584d80674e-metrics-tls") pod "dns-default-tgz82" (UID: "3c2af027-67fa-46e8-8502-7b584d80674e") : secret "dns-default-metrics-tls" not found Jul 14 11:12:47.270706 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:47.270665 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8hpw4" event={"ID":"62c5ec52-328c-4c4c-85ad-ecfe23a6e93e","Type":"ContainerStarted","Data":"e9fb26dc20530bf05d23b10b91a7f4d7f778026beb2d9f1fa57cb739e49bf741"} Jul 14 11:12:47.271205 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:47.270769 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8hpw4" Jul 14 11:12:47.272154 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:47.272123 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mcz4r" event={"ID":"485ab2d2-0fbc-4d2d-95b0-d60732668829","Type":"ContainerStarted","Data":"9e3c649f7e6d3c0cec3929d5c8b11339e2b2cd5793bc8a496d019de378cafdf9"} Jul 14 11:12:47.288709 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:47.288652 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8hpw4" podStartSLOduration=66.832592216 podStartE2EDuration="1m11.288636548s" totalImagesPullingTime="4.456044332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:11:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:12:47.286980559 +0000 UTC m=+71.860360952" watchObservedRunningTime="2026-07-14 11:12:47.288636548 +0000 UTC m=+71.862016922" Jul 14 11:12:57.190768 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:57.190619 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mcz4r" podStartSLOduration=76.703794384 podStartE2EDuration="1m21.190601574s" totalImagesPullingTime="4.48680719s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:11:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:12:47.304408505 +0000 UTC m=+71.877788879" watchObservedRunningTime="2026-07-14 11:12:57.190601574 +0000 UTC m=+81.763981997" Jul 14 11:12:57.191137 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:57.191055 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc886f7cd-hpplr"] Jul 14 11:12:57.193836 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:57.193817 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc886f7cd-hpplr" Jul 14 11:12:57.196832 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:57.196799 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-w6qdd\"" Jul 14 11:12:57.196959 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:57.196799 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 14 11:12:57.197849 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:57.197825 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 14 11:12:57.198026 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:57.198010 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 14 11:12:57.198101 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:57.198033 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 14 11:12:57.208230 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:57.208201 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc886f7cd-hpplr"] Jul 14 11:12:57.218645 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:57.218614 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56l48\" (UniqueName: \"kubernetes.io/projected/bb1e6fac-6c4a-4078-99a7-1fc8e1d00358-kube-api-access-56l48\") pod \"managed-serviceaccount-addon-agent-5bc886f7cd-hpplr\" (UID: \"bb1e6fac-6c4a-4078-99a7-1fc8e1d00358\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc886f7cd-hpplr" Jul 14 11:12:57.218825 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:57.218659 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bb1e6fac-6c4a-4078-99a7-1fc8e1d00358-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5bc886f7cd-hpplr\" (UID: \"bb1e6fac-6c4a-4078-99a7-1fc8e1d00358\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc886f7cd-hpplr" Jul 14 11:12:57.319878 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:57.319836 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56l48\" (UniqueName: \"kubernetes.io/projected/bb1e6fac-6c4a-4078-99a7-1fc8e1d00358-kube-api-access-56l48\") pod \"managed-serviceaccount-addon-agent-5bc886f7cd-hpplr\" (UID: \"bb1e6fac-6c4a-4078-99a7-1fc8e1d00358\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc886f7cd-hpplr" Jul 14 11:12:57.319878 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:57.319885 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bb1e6fac-6c4a-4078-99a7-1fc8e1d00358-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5bc886f7cd-hpplr\" (UID: \"bb1e6fac-6c4a-4078-99a7-1fc8e1d00358\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc886f7cd-hpplr" Jul 14 11:12:57.322570 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:57.322514 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bb1e6fac-6c4a-4078-99a7-1fc8e1d00358-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5bc886f7cd-hpplr\" (UID: \"bb1e6fac-6c4a-4078-99a7-1fc8e1d00358\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc886f7cd-hpplr" Jul 14 11:12:57.328894 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:57.328865 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56l48\" (UniqueName: \"kubernetes.io/projected/bb1e6fac-6c4a-4078-99a7-1fc8e1d00358-kube-api-access-56l48\") pod \"managed-serviceaccount-addon-agent-5bc886f7cd-hpplr\" (UID: \"bb1e6fac-6c4a-4078-99a7-1fc8e1d00358\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc886f7cd-hpplr" Jul 14 11:12:57.517475 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:57.517424 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc886f7cd-hpplr" Jul 14 11:12:57.652083 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:57.652058 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc886f7cd-hpplr"] Jul 14 11:12:57.654684 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:12:57.654650 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb1e6fac_6c4a_4078_99a7_1fc8e1d00358.slice/crio-98fb4093a72853fd6b46cc501befd0cdcff69245bc040ee81d3e9e094dbaed5f WatchSource:0}: Error finding container 98fb4093a72853fd6b46cc501befd0cdcff69245bc040ee81d3e9e094dbaed5f: Status 404 returned error can't find the container with id 98fb4093a72853fd6b46cc501befd0cdcff69245bc040ee81d3e9e094dbaed5f Jul 14 11:12:58.301951 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:12:58.301901 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc886f7cd-hpplr" event={"ID":"bb1e6fac-6c4a-4078-99a7-1fc8e1d00358","Type":"ContainerStarted","Data":"98fb4093a72853fd6b46cc501befd0cdcff69245bc040ee81d3e9e094dbaed5f"} Jul 14 11:13:00.308705 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:13:00.308665 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc886f7cd-hpplr" event={"ID":"bb1e6fac-6c4a-4078-99a7-1fc8e1d00358","Type":"ContainerStarted","Data":"5bcca0e191aaa048222c352f178c6d531c1b0feb01717fc4042874c72338bcfb"} Jul 14 11:13:00.339477 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:13:00.339421 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc886f7cd-hpplr" podStartSLOduration=1.12318119 podStartE2EDuration="3.339404314s" totalImagesPullingTime="2.216223124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:12:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:13:00.336196646 +0000 UTC m=+84.909577020" watchObservedRunningTime="2026-07-14 11:13:00.339404314 +0000 UTC m=+84.912784714" Jul 14 11:13:14.746014 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:13:14.745973 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c2af027-67fa-46e8-8502-7b584d80674e-metrics-tls\") pod \"dns-default-tgz82\" (UID: \"3c2af027-67fa-46e8-8502-7b584d80674e\") " pod="openshift-dns/dns-default-tgz82" Jul 14 11:13:14.746568 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:13:14.746128 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 11:13:14.746568 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:13:14.746213 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c2af027-67fa-46e8-8502-7b584d80674e-metrics-tls podName:3c2af027-67fa-46e8-8502-7b584d80674e nodeName:}" failed. No retries permitted until 2026-07-14 11:14:18.74619711 +0000 UTC m=+163.319577463 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c2af027-67fa-46e8-8502-7b584d80674e-metrics-tls") pod "dns-default-tgz82" (UID: "3c2af027-67fa-46e8-8502-7b584d80674e") : secret "dns-default-metrics-tls" not found Jul 14 11:13:18.276448 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:13:18.276417 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8hpw4" Jul 14 11:13:45.668423 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:13:45.668364 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8792ce35-00f9-4101-aab2-346a02150768-metrics-certs\") pod \"network-metrics-daemon-pql69\" (UID: \"8792ce35-00f9-4101-aab2-346a02150768\") " pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:13:45.668933 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:13:45.668562 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 14 11:13:45.668933 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:13:45.668641 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8792ce35-00f9-4101-aab2-346a02150768-metrics-certs podName:8792ce35-00f9-4101-aab2-346a02150768 nodeName:}" failed. No retries permitted until 2026-07-14 11:15:47.668624887 +0000 UTC m=+252.242005239 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8792ce35-00f9-4101-aab2-346a02150768-metrics-certs") pod "network-metrics-daemon-pql69" (UID: "8792ce35-00f9-4101-aab2-346a02150768") : secret "metrics-daemon-secret" not found Jul 14 11:14:13.844411 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:14:13.844344 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-tgz82" podUID="3c2af027-67fa-46e8-8502-7b584d80674e" Jul 14 11:14:13.983428 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:14:13.983376 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-pql69" podUID="8792ce35-00f9-4101-aab2-346a02150768" Jul 14 11:14:14.486898 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:14:14.486866 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tgz82" Jul 14 11:14:18.799430 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:14:18.799385 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c2af027-67fa-46e8-8502-7b584d80674e-metrics-tls\") pod \"dns-default-tgz82\" (UID: \"3c2af027-67fa-46e8-8502-7b584d80674e\") " pod="openshift-dns/dns-default-tgz82" Jul 14 11:14:18.799949 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:14:18.799533 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 11:14:18.799949 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:14:18.799626 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c2af027-67fa-46e8-8502-7b584d80674e-metrics-tls podName:3c2af027-67fa-46e8-8502-7b584d80674e nodeName:}" failed. No retries permitted until 2026-07-14 11:16:20.79960612 +0000 UTC m=+285.372986474 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c2af027-67fa-46e8-8502-7b584d80674e-metrics-tls") pod "dns-default-tgz82" (UID: "3c2af027-67fa-46e8-8502-7b584d80674e") : secret "dns-default-metrics-tls" not found Jul 14 11:14:24.954591 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:14:24.954527 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:15:00.599596 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:00.599527 2576 generic.go:356] "Generic (PLEG): container finished" podID="bb1e6fac-6c4a-4078-99a7-1fc8e1d00358" containerID="5bcca0e191aaa048222c352f178c6d531c1b0feb01717fc4042874c72338bcfb" exitCode=255 Jul 14 11:15:00.600012 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:00.599602 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc886f7cd-hpplr" event={"ID":"bb1e6fac-6c4a-4078-99a7-1fc8e1d00358","Type":"ContainerDied","Data":"5bcca0e191aaa048222c352f178c6d531c1b0feb01717fc4042874c72338bcfb"} Jul 14 11:15:00.605317 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:00.605302 2576 scope.go:117] "RemoveContainer" containerID="5bcca0e191aaa048222c352f178c6d531c1b0feb01717fc4042874c72338bcfb" Jul 14 11:15:01.603854 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:01.603821 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bc886f7cd-hpplr" event={"ID":"bb1e6fac-6c4a-4078-99a7-1fc8e1d00358","Type":"ContainerStarted","Data":"633f1a59ab7b9cda17873b911b479de622deeb2c6fd85b4bec7c0a36658f6e4d"} Jul 14 11:15:43.507399 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.507360 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-rjdxb"] Jul 14 11:15:43.510318 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.510289 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-rjdxb" Jul 14 11:15:43.510483 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.510362 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-xdbds"] Jul 14 11:15:43.513275 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.513256 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5656bffcc-jsbjr"] Jul 14 11:15:43.513415 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.513390 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-xdbds" Jul 14 11:15:43.513768 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.513725 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-pppdm\"" Jul 14 11:15:43.515975 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.515956 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 14 11:15:43.516288 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.516266 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s5kt6"] Jul 14 11:15:43.516385 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.516370 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" Jul 14 11:15:43.516604 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.516583 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 14 11:15:43.516774 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.516752 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 14 11:15:43.516982 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.516964 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 14 11:15:43.517472 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.517310 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-kk5rg\"" Jul 14 11:15:43.519302 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.519282 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5f9bb8c67d-6vnpr"] Jul 14 11:15:43.519379 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.519371 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s5kt6" Jul 14 11:15:43.520776 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.520756 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 14 11:15:43.520867 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.520818 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 14 11:15:43.521049 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.521033 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 14 11:15:43.521195 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.521179 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-z7n4f\"" Jul 14 11:15:43.522165 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.522148 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 14 11:15:43.522362 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.522347 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5f9bb8c67d-6vnpr" Jul 14 11:15:43.526067 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.525002 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-9n2fl\"" Jul 14 11:15:43.526067 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.525169 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 14 11:15:43.526067 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.525499 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 14 11:15:43.526067 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.525620 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 14 11:15:43.526067 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.525988 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-rjdxb"] Jul 14 11:15:43.526067 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.526045 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 14 11:15:43.526963 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.526095 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 14 11:15:43.526963 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.526514 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 14 11:15:43.526963 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.526824 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hr4kp\"" Jul 14 11:15:43.528735 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.528713 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 14 11:15:43.529646 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.529627 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 14 11:15:43.530268 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.529792 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 14 11:15:43.531209 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.531192 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s5kt6"] Jul 14 11:15:43.532463 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.532443 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-xdbds"] Jul 14 11:15:43.535156 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.535137 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5656bffcc-jsbjr"] Jul 14 11:15:43.536306 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.536282 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5f9bb8c67d-6vnpr"] Jul 14 11:15:43.604507 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.604471 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zvcpj"] Jul 14 11:15:43.607421 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.607404 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zvcpj" Jul 14 11:15:43.610157 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.610134 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b815a14c-5f38-46e4-b867-8e15735d9d50-registry-tls\") pod \"image-registry-5656bffcc-jsbjr\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" Jul 14 11:15:43.610258 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.610159 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3128342d-d07b-428a-9e8c-9fd701bf417d-tmp\") pod \"insights-operator-68d9dd94cf-xdbds\" (UID: \"3128342d-d07b-428a-9e8c-9fd701bf417d\") " pod="openshift-insights/insights-operator-68d9dd94cf-xdbds" Jul 14 11:15:43.610258 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.610178 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4pj2\" (UniqueName: \"kubernetes.io/projected/3128342d-d07b-428a-9e8c-9fd701bf417d-kube-api-access-v4pj2\") pod \"insights-operator-68d9dd94cf-xdbds\" (UID: \"3128342d-d07b-428a-9e8c-9fd701bf417d\") " pod="openshift-insights/insights-operator-68d9dd94cf-xdbds" Jul 14 11:15:43.610258 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.610207 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ca5d6937-4feb-431e-b78b-fe1f595d8b36-stats-auth\") pod \"router-default-5f9bb8c67d-6vnpr\" (UID: \"ca5d6937-4feb-431e-b78b-fe1f595d8b36\") " pod="openshift-ingress/router-default-5f9bb8c67d-6vnpr" Jul 14 11:15:43.610258 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.610223 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ca5d6937-4feb-431e-b78b-fe1f595d8b36-default-certificate\") pod \"router-default-5f9bb8c67d-6vnpr\" (UID: \"ca5d6937-4feb-431e-b78b-fe1f595d8b36\") " pod="openshift-ingress/router-default-5f9bb8c67d-6vnpr" Jul 14 11:15:43.610258 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.610239 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b815a14c-5f38-46e4-b867-8e15735d9d50-bound-sa-token\") pod \"image-registry-5656bffcc-jsbjr\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" Jul 14 11:15:43.610258 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.610255 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b815a14c-5f38-46e4-b867-8e15735d9d50-installation-pull-secrets\") pod \"image-registry-5656bffcc-jsbjr\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" Jul 14 11:15:43.610439 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.610269 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b815a14c-5f38-46e4-b867-8e15735d9d50-ca-trust-extracted\") pod \"image-registry-5656bffcc-jsbjr\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" Jul 14 11:15:43.610439 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.610282 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 14 11:15:43.610439 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.610298 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mdfl\" (UniqueName: \"kubernetes.io/projected/ca5d6937-4feb-431e-b78b-fe1f595d8b36-kube-api-access-2mdfl\") pod \"router-default-5f9bb8c67d-6vnpr\" (UID: \"ca5d6937-4feb-431e-b78b-fe1f595d8b36\") " pod="openshift-ingress/router-default-5f9bb8c67d-6vnpr" Jul 14 11:15:43.610439 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.610315 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt5zf\" (UniqueName: \"kubernetes.io/projected/b4ba5f01-0389-4753-901e-b85b472fd231-kube-api-access-qt5zf\") pod \"network-check-source-869dcfcdcd-rjdxb\" (UID: \"b4ba5f01-0389-4753-901e-b85b472fd231\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-rjdxb" Jul 14 11:15:43.610439 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.610333 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3128342d-d07b-428a-9e8c-9fd701bf417d-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-xdbds\" (UID: \"3128342d-d07b-428a-9e8c-9fd701bf417d\") " pod="openshift-insights/insights-operator-68d9dd94cf-xdbds" Jul 14 11:15:43.610439 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.610353 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca5d6937-4feb-431e-b78b-fe1f595d8b36-service-ca-bundle\") pod \"router-default-5f9bb8c67d-6vnpr\" (UID: \"ca5d6937-4feb-431e-b78b-fe1f595d8b36\") " pod="openshift-ingress/router-default-5f9bb8c67d-6vnpr" Jul 14 11:15:43.610439 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.610361 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 14 11:15:43.610439 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.610367 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3128342d-d07b-428a-9e8c-9fd701bf417d-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-xdbds\" (UID: \"3128342d-d07b-428a-9e8c-9fd701bf417d\") " pod="openshift-insights/insights-operator-68d9dd94cf-xdbds" Jul 14 11:15:43.610439 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.610383 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7fzz\" (UniqueName: \"kubernetes.io/projected/b815a14c-5f38-46e4-b867-8e15735d9d50-kube-api-access-g7fzz\") pod \"image-registry-5656bffcc-jsbjr\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" Jul 14 11:15:43.610439 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.610401 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3128342d-d07b-428a-9e8c-9fd701bf417d-serving-cert\") pod \"insights-operator-68d9dd94cf-xdbds\" (UID: \"3128342d-d07b-428a-9e8c-9fd701bf417d\") " pod="openshift-insights/insights-operator-68d9dd94cf-xdbds" Jul 14 11:15:43.610439 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.610416 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca5d6937-4feb-431e-b78b-fe1f595d8b36-metrics-certs\") pod \"router-default-5f9bb8c67d-6vnpr\" (UID: \"ca5d6937-4feb-431e-b78b-fe1f595d8b36\") " pod="openshift-ingress/router-default-5f9bb8c67d-6vnpr" Jul 14 11:15:43.610439 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.610441 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b815a14c-5f38-46e4-b867-8e15735d9d50-image-registry-private-configuration\") pod \"image-registry-5656bffcc-jsbjr\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" Jul 14 11:15:43.610809 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.610457 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b815a14c-5f38-46e4-b867-8e15735d9d50-trusted-ca\") pod \"image-registry-5656bffcc-jsbjr\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" Jul 14 11:15:43.610809 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.610473 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5vkl\" (UniqueName: \"kubernetes.io/projected/308849f7-66e5-4f4a-99c2-480719fa57f6-kube-api-access-k5vkl\") pod \"volume-data-source-validator-78495597f6-s5kt6\" (UID: \"308849f7-66e5-4f4a-99c2-480719fa57f6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s5kt6" Jul 14 11:15:43.610809 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.610284 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 14 11:15:43.610809 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.610588 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3128342d-d07b-428a-9e8c-9fd701bf417d-snapshots\") pod \"insights-operator-68d9dd94cf-xdbds\" (UID: \"3128342d-d07b-428a-9e8c-9fd701bf417d\") " pod="openshift-insights/insights-operator-68d9dd94cf-xdbds" Jul 14 11:15:43.610809 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.610623 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b815a14c-5f38-46e4-b867-8e15735d9d50-registry-certificates\") pod \"image-registry-5656bffcc-jsbjr\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" Jul 14 11:15:43.610809 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.610645 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-x2nkh\"" Jul 14 11:15:43.610809 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.610736 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 14 11:15:43.623530 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.623502 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zvcpj"] Jul 14 11:15:43.711303 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.711256 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4pj2\" (UniqueName: \"kubernetes.io/projected/3128342d-d07b-428a-9e8c-9fd701bf417d-kube-api-access-v4pj2\") pod \"insights-operator-68d9dd94cf-xdbds\" (UID: \"3128342d-d07b-428a-9e8c-9fd701bf417d\") " pod="openshift-insights/insights-operator-68d9dd94cf-xdbds" Jul 14 11:15:43.711303 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.711311 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ca5d6937-4feb-431e-b78b-fe1f595d8b36-stats-auth\") pod \"router-default-5f9bb8c67d-6vnpr\" (UID: \"ca5d6937-4feb-431e-b78b-fe1f595d8b36\") " pod="openshift-ingress/router-default-5f9bb8c67d-6vnpr" Jul 14 11:15:43.711579 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.711335 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ca5d6937-4feb-431e-b78b-fe1f595d8b36-default-certificate\") pod \"router-default-5f9bb8c67d-6vnpr\" (UID: \"ca5d6937-4feb-431e-b78b-fe1f595d8b36\") " pod="openshift-ingress/router-default-5f9bb8c67d-6vnpr" Jul 14 11:15:43.711579 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.711359 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b815a14c-5f38-46e4-b867-8e15735d9d50-bound-sa-token\") pod \"image-registry-5656bffcc-jsbjr\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" Jul 14 11:15:43.711579 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.711381 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b815a14c-5f38-46e4-b867-8e15735d9d50-installation-pull-secrets\") pod \"image-registry-5656bffcc-jsbjr\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" Jul 14 11:15:43.711579 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.711401 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b815a14c-5f38-46e4-b867-8e15735d9d50-ca-trust-extracted\") pod \"image-registry-5656bffcc-jsbjr\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" Jul 14 11:15:43.711579 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.711459 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mdfl\" (UniqueName: \"kubernetes.io/projected/ca5d6937-4feb-431e-b78b-fe1f595d8b36-kube-api-access-2mdfl\") pod \"router-default-5f9bb8c67d-6vnpr\" (UID: \"ca5d6937-4feb-431e-b78b-fe1f595d8b36\") " pod="openshift-ingress/router-default-5f9bb8c67d-6vnpr" Jul 14 11:15:43.711579 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.711487 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt5zf\" (UniqueName: \"kubernetes.io/projected/b4ba5f01-0389-4753-901e-b85b472fd231-kube-api-access-qt5zf\") pod \"network-check-source-869dcfcdcd-rjdxb\" (UID: \"b4ba5f01-0389-4753-901e-b85b472fd231\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-rjdxb" Jul 14 11:15:43.711579 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.711509 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3128342d-d07b-428a-9e8c-9fd701bf417d-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-xdbds\" (UID: \"3128342d-d07b-428a-9e8c-9fd701bf417d\") " pod="openshift-insights/insights-operator-68d9dd94cf-xdbds" Jul 14 11:15:43.711579 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.711563 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb86h\" (UniqueName: \"kubernetes.io/projected/3ce79a00-8cf5-4047-b927-cbdea4048663-kube-api-access-jb86h\") pod \"kube-storage-version-migrator-operator-799cb7f958-zvcpj\" (UID: \"3ce79a00-8cf5-4047-b927-cbdea4048663\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zvcpj" Jul 14 11:15:43.712119 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.711600 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca5d6937-4feb-431e-b78b-fe1f595d8b36-service-ca-bundle\") pod \"router-default-5f9bb8c67d-6vnpr\" (UID: \"ca5d6937-4feb-431e-b78b-fe1f595d8b36\") " pod="openshift-ingress/router-default-5f9bb8c67d-6vnpr" Jul 14 11:15:43.712119 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.711628 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3128342d-d07b-428a-9e8c-9fd701bf417d-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-xdbds\" (UID: \"3128342d-d07b-428a-9e8c-9fd701bf417d\") " pod="openshift-insights/insights-operator-68d9dd94cf-xdbds" Jul 14 11:15:43.712119 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.711655 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7fzz\" (UniqueName: \"kubernetes.io/projected/b815a14c-5f38-46e4-b867-8e15735d9d50-kube-api-access-g7fzz\") pod \"image-registry-5656bffcc-jsbjr\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" Jul 14 11:15:43.712119 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.711683 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3128342d-d07b-428a-9e8c-9fd701bf417d-serving-cert\") pod \"insights-operator-68d9dd94cf-xdbds\" (UID: \"3128342d-d07b-428a-9e8c-9fd701bf417d\") " pod="openshift-insights/insights-operator-68d9dd94cf-xdbds" Jul 14 11:15:43.712119 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.711709 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca5d6937-4feb-431e-b78b-fe1f595d8b36-metrics-certs\") pod \"router-default-5f9bb8c67d-6vnpr\" (UID: \"ca5d6937-4feb-431e-b78b-fe1f595d8b36\") " pod="openshift-ingress/router-default-5f9bb8c67d-6vnpr" Jul 14 11:15:43.712119 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.711734 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3ce79a00-8cf5-4047-b927-cbdea4048663-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-zvcpj\" (UID: \"3ce79a00-8cf5-4047-b927-cbdea4048663\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zvcpj" Jul 14 11:15:43.712119 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.711773 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b815a14c-5f38-46e4-b867-8e15735d9d50-image-registry-private-configuration\") pod \"image-registry-5656bffcc-jsbjr\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" Jul 14 11:15:43.712119 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.711799 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b815a14c-5f38-46e4-b867-8e15735d9d50-trusted-ca\") pod \"image-registry-5656bffcc-jsbjr\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" Jul 14 11:15:43.712119 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.711826 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5vkl\" (UniqueName: \"kubernetes.io/projected/308849f7-66e5-4f4a-99c2-480719fa57f6-kube-api-access-k5vkl\") pod \"volume-data-source-validator-78495597f6-s5kt6\" (UID: \"308849f7-66e5-4f4a-99c2-480719fa57f6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s5kt6" Jul 14 11:15:43.712119 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:43.711857 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca5d6937-4feb-431e-b78b-fe1f595d8b36-service-ca-bundle podName:ca5d6937-4feb-431e-b78b-fe1f595d8b36 nodeName:}" failed. No retries permitted until 2026-07-14 11:15:44.211822801 +0000 UTC m=+248.785203153 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ca5d6937-4feb-431e-b78b-fe1f595d8b36-service-ca-bundle") pod "router-default-5f9bb8c67d-6vnpr" (UID: "ca5d6937-4feb-431e-b78b-fe1f595d8b36") : configmap references non-existent config key: service-ca.crt Jul 14 11:15:43.712119 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.711873 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b815a14c-5f38-46e4-b867-8e15735d9d50-ca-trust-extracted\") pod \"image-registry-5656bffcc-jsbjr\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" Jul 14 11:15:43.712119 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.711915 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3ce79a00-8cf5-4047-b927-cbdea4048663-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-zvcpj\" (UID: \"3ce79a00-8cf5-4047-b927-cbdea4048663\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zvcpj" Jul 14 11:15:43.712119 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.711963 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3128342d-d07b-428a-9e8c-9fd701bf417d-snapshots\") pod \"insights-operator-68d9dd94cf-xdbds\" (UID: \"3128342d-d07b-428a-9e8c-9fd701bf417d\") " pod="openshift-insights/insights-operator-68d9dd94cf-xdbds" Jul 14 11:15:43.712119 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.712002 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b815a14c-5f38-46e4-b867-8e15735d9d50-registry-certificates\") pod \"image-registry-5656bffcc-jsbjr\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" Jul 14 11:15:43.712119 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.712045 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b815a14c-5f38-46e4-b867-8e15735d9d50-registry-tls\") pod \"image-registry-5656bffcc-jsbjr\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" Jul 14 11:15:43.712874 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.712093 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3128342d-d07b-428a-9e8c-9fd701bf417d-tmp\") pod \"insights-operator-68d9dd94cf-xdbds\" (UID: \"3128342d-d07b-428a-9e8c-9fd701bf417d\") " pod="openshift-insights/insights-operator-68d9dd94cf-xdbds" Jul 14 11:15:43.712874 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:43.712131 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 11:15:43.712874 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:43.712146 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5656bffcc-jsbjr: secret "image-registry-tls" not found Jul 14 11:15:43.712874 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:43.712191 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b815a14c-5f38-46e4-b867-8e15735d9d50-registry-tls podName:b815a14c-5f38-46e4-b867-8e15735d9d50 nodeName:}" failed. No retries permitted until 2026-07-14 11:15:44.212174608 +0000 UTC m=+248.785554976 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b815a14c-5f38-46e4-b867-8e15735d9d50-registry-tls") pod "image-registry-5656bffcc-jsbjr" (UID: "b815a14c-5f38-46e4-b867-8e15735d9d50") : secret "image-registry-tls" not found Jul 14 11:15:43.712874 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.712398 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3128342d-d07b-428a-9e8c-9fd701bf417d-tmp\") pod \"insights-operator-68d9dd94cf-xdbds\" (UID: \"3128342d-d07b-428a-9e8c-9fd701bf417d\") " pod="openshift-insights/insights-operator-68d9dd94cf-xdbds" Jul 14 11:15:43.712874 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.712522 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3128342d-d07b-428a-9e8c-9fd701bf417d-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-xdbds\" (UID: \"3128342d-d07b-428a-9e8c-9fd701bf417d\") " pod="openshift-insights/insights-operator-68d9dd94cf-xdbds" Jul 14 11:15:43.713177 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.712998 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3128342d-d07b-428a-9e8c-9fd701bf417d-snapshots\") pod \"insights-operator-68d9dd94cf-xdbds\" (UID: \"3128342d-d07b-428a-9e8c-9fd701bf417d\") " pod="openshift-insights/insights-operator-68d9dd94cf-xdbds" Jul 14 11:15:43.713177 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.712997 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3128342d-d07b-428a-9e8c-9fd701bf417d-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-xdbds\" (UID: \"3128342d-d07b-428a-9e8c-9fd701bf417d\") " pod="openshift-insights/insights-operator-68d9dd94cf-xdbds" Jul 14 11:15:43.713177 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:43.713101 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 11:15:43.713177 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:43.713144 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca5d6937-4feb-431e-b78b-fe1f595d8b36-metrics-certs podName:ca5d6937-4feb-431e-b78b-fe1f595d8b36 nodeName:}" failed. No retries permitted until 2026-07-14 11:15:44.213129185 +0000 UTC m=+248.786509538 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca5d6937-4feb-431e-b78b-fe1f595d8b36-metrics-certs") pod "router-default-5f9bb8c67d-6vnpr" (UID: "ca5d6937-4feb-431e-b78b-fe1f595d8b36") : secret "router-metrics-certs-default" not found Jul 14 11:15:43.713561 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.713509 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b815a14c-5f38-46e4-b867-8e15735d9d50-registry-certificates\") pod \"image-registry-5656bffcc-jsbjr\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" Jul 14 11:15:43.713819 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.713798 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b815a14c-5f38-46e4-b867-8e15735d9d50-trusted-ca\") pod \"image-registry-5656bffcc-jsbjr\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" Jul 14 11:15:43.714722 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.714699 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ca5d6937-4feb-431e-b78b-fe1f595d8b36-stats-auth\") pod \"router-default-5f9bb8c67d-6vnpr\" (UID: \"ca5d6937-4feb-431e-b78b-fe1f595d8b36\") " pod="openshift-ingress/router-default-5f9bb8c67d-6vnpr" Jul 14 11:15:43.714840 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.714708 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ca5d6937-4feb-431e-b78b-fe1f595d8b36-default-certificate\") pod \"router-default-5f9bb8c67d-6vnpr\" (UID: \"ca5d6937-4feb-431e-b78b-fe1f595d8b36\") " pod="openshift-ingress/router-default-5f9bb8c67d-6vnpr" Jul 14 11:15:43.714949 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.714933 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b815a14c-5f38-46e4-b867-8e15735d9d50-installation-pull-secrets\") pod \"image-registry-5656bffcc-jsbjr\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" Jul 14 11:15:43.715196 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.715174 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b815a14c-5f38-46e4-b867-8e15735d9d50-image-registry-private-configuration\") pod \"image-registry-5656bffcc-jsbjr\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" Jul 14 11:15:43.715382 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.715361 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3128342d-d07b-428a-9e8c-9fd701bf417d-serving-cert\") pod \"insights-operator-68d9dd94cf-xdbds\" (UID: \"3128342d-d07b-428a-9e8c-9fd701bf417d\") " pod="openshift-insights/insights-operator-68d9dd94cf-xdbds" Jul 14 11:15:43.725007 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.724626 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7fzz\" (UniqueName: \"kubernetes.io/projected/b815a14c-5f38-46e4-b867-8e15735d9d50-kube-api-access-g7fzz\") pod \"image-registry-5656bffcc-jsbjr\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" Jul 14 11:15:43.725168 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.725062 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mdfl\" (UniqueName: \"kubernetes.io/projected/ca5d6937-4feb-431e-b78b-fe1f595d8b36-kube-api-access-2mdfl\") pod \"router-default-5f9bb8c67d-6vnpr\" (UID: \"ca5d6937-4feb-431e-b78b-fe1f595d8b36\") " pod="openshift-ingress/router-default-5f9bb8c67d-6vnpr" Jul 14 11:15:43.726701 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.726671 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt5zf\" (UniqueName: \"kubernetes.io/projected/b4ba5f01-0389-4753-901e-b85b472fd231-kube-api-access-qt5zf\") pod \"network-check-source-869dcfcdcd-rjdxb\" (UID: \"b4ba5f01-0389-4753-901e-b85b472fd231\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-rjdxb" Jul 14 11:15:43.726701 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.726675 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b815a14c-5f38-46e4-b867-8e15735d9d50-bound-sa-token\") pod \"image-registry-5656bffcc-jsbjr\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" Jul 14 11:15:43.726885 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.726777 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4pj2\" (UniqueName: \"kubernetes.io/projected/3128342d-d07b-428a-9e8c-9fd701bf417d-kube-api-access-v4pj2\") pod \"insights-operator-68d9dd94cf-xdbds\" (UID: \"3128342d-d07b-428a-9e8c-9fd701bf417d\") " pod="openshift-insights/insights-operator-68d9dd94cf-xdbds" Jul 14 11:15:43.727179 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.727156 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5vkl\" (UniqueName: \"kubernetes.io/projected/308849f7-66e5-4f4a-99c2-480719fa57f6-kube-api-access-k5vkl\") pod \"volume-data-source-validator-78495597f6-s5kt6\" (UID: \"308849f7-66e5-4f4a-99c2-480719fa57f6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s5kt6" Jul 14 11:15:43.813003 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.812912 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb86h\" (UniqueName: \"kubernetes.io/projected/3ce79a00-8cf5-4047-b927-cbdea4048663-kube-api-access-jb86h\") pod \"kube-storage-version-migrator-operator-799cb7f958-zvcpj\" (UID: \"3ce79a00-8cf5-4047-b927-cbdea4048663\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zvcpj" Jul 14 11:15:43.813003 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.812975 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3ce79a00-8cf5-4047-b927-cbdea4048663-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-zvcpj\" (UID: \"3ce79a00-8cf5-4047-b927-cbdea4048663\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zvcpj" Jul 14 11:15:43.813228 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.813171 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3ce79a00-8cf5-4047-b927-cbdea4048663-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-zvcpj\" (UID: \"3ce79a00-8cf5-4047-b927-cbdea4048663\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zvcpj" Jul 14 11:15:43.813563 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.813519 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3ce79a00-8cf5-4047-b927-cbdea4048663-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-zvcpj\" (UID: \"3ce79a00-8cf5-4047-b927-cbdea4048663\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zvcpj" Jul 14 11:15:43.815699 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.815680 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3ce79a00-8cf5-4047-b927-cbdea4048663-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-zvcpj\" (UID: \"3ce79a00-8cf5-4047-b927-cbdea4048663\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zvcpj" Jul 14 11:15:43.820401 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.820378 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-rjdxb" Jul 14 11:15:43.822785 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.822762 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb86h\" (UniqueName: \"kubernetes.io/projected/3ce79a00-8cf5-4047-b927-cbdea4048663-kube-api-access-jb86h\") pod \"kube-storage-version-migrator-operator-799cb7f958-zvcpj\" (UID: \"3ce79a00-8cf5-4047-b927-cbdea4048663\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zvcpj" Jul 14 11:15:43.830033 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.830011 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-xdbds" Jul 14 11:15:43.845157 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.845124 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s5kt6" Jul 14 11:15:43.916447 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.916129 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zvcpj" Jul 14 11:15:43.981524 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.981299 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-rjdxb"] Jul 14 11:15:43.983092 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:15:43.983062 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4ba5f01_0389_4753_901e_b85b472fd231.slice/crio-4451924c60c50f27f66eb6de7b5891b28cc3ef1c99124474784f40698e5ba736 WatchSource:0}: Error finding container 4451924c60c50f27f66eb6de7b5891b28cc3ef1c99124474784f40698e5ba736: Status 404 returned error can't find the container with id 4451924c60c50f27f66eb6de7b5891b28cc3ef1c99124474784f40698e5ba736 Jul 14 11:15:43.997679 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:43.997651 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-xdbds"] Jul 14 11:15:44.000727 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:15:44.000665 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3128342d_d07b_428a_9e8c_9fd701bf417d.slice/crio-dde5392f48330738265b310aa87f1a2204acd67719b3d67c7c4107cb4238c9f6 WatchSource:0}: Error finding container dde5392f48330738265b310aa87f1a2204acd67719b3d67c7c4107cb4238c9f6: Status 404 returned error can't find the container with id dde5392f48330738265b310aa87f1a2204acd67719b3d67c7c4107cb4238c9f6 Jul 14 11:15:44.024279 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:44.024254 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s5kt6"] Jul 14 11:15:44.025163 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:15:44.025113 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod308849f7_66e5_4f4a_99c2_480719fa57f6.slice/crio-2d1dd2227fde8b0bbc146190213f3aa72987183a5d24127e754b65a45f9d83a3 WatchSource:0}: Error finding container 2d1dd2227fde8b0bbc146190213f3aa72987183a5d24127e754b65a45f9d83a3: Status 404 returned error can't find the container with id 2d1dd2227fde8b0bbc146190213f3aa72987183a5d24127e754b65a45f9d83a3 Jul 14 11:15:44.068629 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:44.068530 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zvcpj"] Jul 14 11:15:44.071727 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:15:44.071700 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ce79a00_8cf5_4047_b927_cbdea4048663.slice/crio-14326960d3d5f14dafc7cd38eeb52242069cc40e202b2fbb5f710cc50ae4a55e WatchSource:0}: Error finding container 14326960d3d5f14dafc7cd38eeb52242069cc40e202b2fbb5f710cc50ae4a55e: Status 404 returned error can't find the container with id 14326960d3d5f14dafc7cd38eeb52242069cc40e202b2fbb5f710cc50ae4a55e Jul 14 11:15:44.217366 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:44.217332 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b815a14c-5f38-46e4-b867-8e15735d9d50-registry-tls\") pod \"image-registry-5656bffcc-jsbjr\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" Jul 14 11:15:44.217573 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:44.217397 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca5d6937-4feb-431e-b78b-fe1f595d8b36-service-ca-bundle\") pod \"router-default-5f9bb8c67d-6vnpr\" (UID: \"ca5d6937-4feb-431e-b78b-fe1f595d8b36\") " pod="openshift-ingress/router-default-5f9bb8c67d-6vnpr" Jul 14 11:15:44.217573 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:44.217419 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca5d6937-4feb-431e-b78b-fe1f595d8b36-metrics-certs\") pod \"router-default-5f9bb8c67d-6vnpr\" (UID: \"ca5d6937-4feb-431e-b78b-fe1f595d8b36\") " pod="openshift-ingress/router-default-5f9bb8c67d-6vnpr" Jul 14 11:15:44.217573 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:44.217502 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 11:15:44.217573 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:44.217510 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 11:15:44.217573 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:44.217523 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5656bffcc-jsbjr: secret "image-registry-tls" not found Jul 14 11:15:44.217781 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:44.217597 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b815a14c-5f38-46e4-b867-8e15735d9d50-registry-tls podName:b815a14c-5f38-46e4-b867-8e15735d9d50 nodeName:}" failed. No retries permitted until 2026-07-14 11:15:45.217580981 +0000 UTC m=+249.790961332 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b815a14c-5f38-46e4-b867-8e15735d9d50-registry-tls") pod "image-registry-5656bffcc-jsbjr" (UID: "b815a14c-5f38-46e4-b867-8e15735d9d50") : secret "image-registry-tls" not found Jul 14 11:15:44.217781 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:44.217613 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca5d6937-4feb-431e-b78b-fe1f595d8b36-metrics-certs podName:ca5d6937-4feb-431e-b78b-fe1f595d8b36 nodeName:}" failed. No retries permitted until 2026-07-14 11:15:45.217607641 +0000 UTC m=+249.790987992 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca5d6937-4feb-431e-b78b-fe1f595d8b36-metrics-certs") pod "router-default-5f9bb8c67d-6vnpr" (UID: "ca5d6937-4feb-431e-b78b-fe1f595d8b36") : secret "router-metrics-certs-default" not found Jul 14 11:15:44.217781 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:44.217624 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca5d6937-4feb-431e-b78b-fe1f595d8b36-service-ca-bundle podName:ca5d6937-4feb-431e-b78b-fe1f595d8b36 nodeName:}" failed. No retries permitted until 2026-07-14 11:15:45.217618516 +0000 UTC m=+249.790998868 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ca5d6937-4feb-431e-b78b-fe1f595d8b36-service-ca-bundle") pod "router-default-5f9bb8c67d-6vnpr" (UID: "ca5d6937-4feb-431e-b78b-fe1f595d8b36") : configmap references non-existent config key: service-ca.crt Jul 14 11:15:44.728976 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:44.728370 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-rjdxb" event={"ID":"b4ba5f01-0389-4753-901e-b85b472fd231","Type":"ContainerStarted","Data":"c9e9b61903d906ed5004f6a85c1b266d1e126b058c9beeab0b6b6bcd3c1a3155"} Jul 14 11:15:44.728976 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:44.728436 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-rjdxb" event={"ID":"b4ba5f01-0389-4753-901e-b85b472fd231","Type":"ContainerStarted","Data":"4451924c60c50f27f66eb6de7b5891b28cc3ef1c99124474784f40698e5ba736"} Jul 14 11:15:44.730827 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:44.730716 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zvcpj" event={"ID":"3ce79a00-8cf5-4047-b927-cbdea4048663","Type":"ContainerStarted","Data":"14326960d3d5f14dafc7cd38eeb52242069cc40e202b2fbb5f710cc50ae4a55e"} Jul 14 11:15:44.733462 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:44.733433 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s5kt6" event={"ID":"308849f7-66e5-4f4a-99c2-480719fa57f6","Type":"ContainerStarted","Data":"2d1dd2227fde8b0bbc146190213f3aa72987183a5d24127e754b65a45f9d83a3"} Jul 14 11:15:44.738150 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:44.738113 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-xdbds" event={"ID":"3128342d-d07b-428a-9e8c-9fd701bf417d","Type":"ContainerStarted","Data":"dde5392f48330738265b310aa87f1a2204acd67719b3d67c7c4107cb4238c9f6"} Jul 14 11:15:44.746397 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:44.746336 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-rjdxb" podStartSLOduration=1.746314441 podStartE2EDuration="1.746314441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:15:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:15:44.744508103 +0000 UTC m=+249.317888504" watchObservedRunningTime="2026-07-14 11:15:44.746314441 +0000 UTC m=+249.319694816" Jul 14 11:15:45.227415 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:45.227364 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b815a14c-5f38-46e4-b867-8e15735d9d50-registry-tls\") pod \"image-registry-5656bffcc-jsbjr\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" Jul 14 11:15:45.227636 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:45.227469 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca5d6937-4feb-431e-b78b-fe1f595d8b36-service-ca-bundle\") pod \"router-default-5f9bb8c67d-6vnpr\" (UID: \"ca5d6937-4feb-431e-b78b-fe1f595d8b36\") " pod="openshift-ingress/router-default-5f9bb8c67d-6vnpr" Jul 14 11:15:45.227636 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:45.227504 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca5d6937-4feb-431e-b78b-fe1f595d8b36-metrics-certs\") pod \"router-default-5f9bb8c67d-6vnpr\" (UID: \"ca5d6937-4feb-431e-b78b-fe1f595d8b36\") " pod="openshift-ingress/router-default-5f9bb8c67d-6vnpr" Jul 14 11:15:45.227636 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:45.227518 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 11:15:45.227636 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:45.227562 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5656bffcc-jsbjr: secret "image-registry-tls" not found Jul 14 11:15:45.227636 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:45.227626 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b815a14c-5f38-46e4-b867-8e15735d9d50-registry-tls podName:b815a14c-5f38-46e4-b867-8e15735d9d50 nodeName:}" failed. No retries permitted until 2026-07-14 11:15:47.227605123 +0000 UTC m=+251.800985499 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b815a14c-5f38-46e4-b867-8e15735d9d50-registry-tls") pod "image-registry-5656bffcc-jsbjr" (UID: "b815a14c-5f38-46e4-b867-8e15735d9d50") : secret "image-registry-tls" not found Jul 14 11:15:45.227885 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:45.227651 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 11:15:45.227885 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:45.227703 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca5d6937-4feb-431e-b78b-fe1f595d8b36-metrics-certs podName:ca5d6937-4feb-431e-b78b-fe1f595d8b36 nodeName:}" failed. No retries permitted until 2026-07-14 11:15:47.227688247 +0000 UTC m=+251.801068604 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca5d6937-4feb-431e-b78b-fe1f595d8b36-metrics-certs") pod "router-default-5f9bb8c67d-6vnpr" (UID: "ca5d6937-4feb-431e-b78b-fe1f595d8b36") : secret "router-metrics-certs-default" not found Jul 14 11:15:45.227885 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:45.227772 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca5d6937-4feb-431e-b78b-fe1f595d8b36-service-ca-bundle podName:ca5d6937-4feb-431e-b78b-fe1f595d8b36 nodeName:}" failed. No retries permitted until 2026-07-14 11:15:47.227761855 +0000 UTC m=+251.801142214 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ca5d6937-4feb-431e-b78b-fe1f595d8b36-service-ca-bundle") pod "router-default-5f9bb8c67d-6vnpr" (UID: "ca5d6937-4feb-431e-b78b-fe1f595d8b36") : configmap references non-existent config key: service-ca.crt Jul 14 11:15:45.743601 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:45.743397 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s5kt6" event={"ID":"308849f7-66e5-4f4a-99c2-480719fa57f6","Type":"ContainerStarted","Data":"95803befa08cc283d9b5b89752101706ea70b9b3b60f112c09118a81504cb87a"} Jul 14 11:15:45.762484 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:45.762420 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s5kt6" podStartSLOduration=1.353497486 podStartE2EDuration="2.762401314s" totalImagesPullingTime="1.408903828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:15:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:15:45.760776968 +0000 UTC m=+250.334157369" watchObservedRunningTime="2026-07-14 11:15:45.762401314 +0000 UTC m=+250.335781688" Jul 14 11:15:46.748186 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:46.748147 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zvcpj" event={"ID":"3ce79a00-8cf5-4047-b927-cbdea4048663","Type":"ContainerStarted","Data":"90c45b000e93c829a840da2ec646b440e37c2210238bb659ef9967f8bea0e828"} Jul 14 11:15:46.749722 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:46.749696 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-xdbds" event={"ID":"3128342d-d07b-428a-9e8c-9fd701bf417d","Type":"ContainerStarted","Data":"6c2a4666a4954ea56908380e672775d1a736248a84bb600b24f6faf152267d0c"} Jul 14 11:15:46.767854 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:46.767795 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zvcpj" podStartSLOduration=1.244761236 podStartE2EDuration="3.767774305s" totalImagesPullingTime="2.523013069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:15:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:15:46.766690619 +0000 UTC m=+251.340071010" watchObservedRunningTime="2026-07-14 11:15:46.767774305 +0000 UTC m=+251.341154680" Jul 14 11:15:46.788437 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:46.788381 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-xdbds" podStartSLOduration=1.19841541 podStartE2EDuration="3.788365991s" totalImagesPullingTime="2.589950581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:15:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:15:46.787348437 +0000 UTC m=+251.360728813" watchObservedRunningTime="2026-07-14 11:15:46.788365991 +0000 UTC m=+251.361746365" Jul 14 11:15:47.248322 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:47.248271 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca5d6937-4feb-431e-b78b-fe1f595d8b36-service-ca-bundle\") pod \"router-default-5f9bb8c67d-6vnpr\" (UID: \"ca5d6937-4feb-431e-b78b-fe1f595d8b36\") " pod="openshift-ingress/router-default-5f9bb8c67d-6vnpr" Jul 14 11:15:47.248322 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:47.248323 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca5d6937-4feb-431e-b78b-fe1f595d8b36-metrics-certs\") pod \"router-default-5f9bb8c67d-6vnpr\" (UID: \"ca5d6937-4feb-431e-b78b-fe1f595d8b36\") " pod="openshift-ingress/router-default-5f9bb8c67d-6vnpr" Jul 14 11:15:47.248617 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:47.248362 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b815a14c-5f38-46e4-b867-8e15735d9d50-registry-tls\") pod \"image-registry-5656bffcc-jsbjr\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" Jul 14 11:15:47.248617 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:47.248454 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 11:15:47.248617 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:47.248464 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5656bffcc-jsbjr: secret "image-registry-tls" not found Jul 14 11:15:47.248617 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:47.248498 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca5d6937-4feb-431e-b78b-fe1f595d8b36-service-ca-bundle podName:ca5d6937-4feb-431e-b78b-fe1f595d8b36 nodeName:}" failed. No retries permitted until 2026-07-14 11:15:51.248473373 +0000 UTC m=+255.821853738 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ca5d6937-4feb-431e-b78b-fe1f595d8b36-service-ca-bundle") pod "router-default-5f9bb8c67d-6vnpr" (UID: "ca5d6937-4feb-431e-b78b-fe1f595d8b36") : configmap references non-existent config key: service-ca.crt Jul 14 11:15:47.248617 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:47.248514 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 11:15:47.248617 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:47.248531 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b815a14c-5f38-46e4-b867-8e15735d9d50-registry-tls podName:b815a14c-5f38-46e4-b867-8e15735d9d50 nodeName:}" failed. No retries permitted until 2026-07-14 11:15:51.248519879 +0000 UTC m=+255.821900235 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b815a14c-5f38-46e4-b867-8e15735d9d50-registry-tls") pod "image-registry-5656bffcc-jsbjr" (UID: "b815a14c-5f38-46e4-b867-8e15735d9d50") : secret "image-registry-tls" not found Jul 14 11:15:47.248617 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:47.248587 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca5d6937-4feb-431e-b78b-fe1f595d8b36-metrics-certs podName:ca5d6937-4feb-431e-b78b-fe1f595d8b36 nodeName:}" failed. No retries permitted until 2026-07-14 11:15:51.248569521 +0000 UTC m=+255.821949878 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca5d6937-4feb-431e-b78b-fe1f595d8b36-metrics-certs") pod "router-default-5f9bb8c67d-6vnpr" (UID: "ca5d6937-4feb-431e-b78b-fe1f595d8b36") : secret "router-metrics-certs-default" not found Jul 14 11:15:47.385741 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:47.385704 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-m7vpc"] Jul 14 11:15:47.389313 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:47.389284 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m7vpc" Jul 14 11:15:47.391859 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:47.391834 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 14 11:15:47.392248 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:47.392229 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-v758q\"" Jul 14 11:15:47.393905 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:47.393889 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 14 11:15:47.403890 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:47.403865 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m7vpc"] Jul 14 11:15:47.449361 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:47.449331 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m7vpc\" (UID: \"bcbcb21e-9bb2-474f-b0f3-b8bad02f3084\") " pod="openshift-insights/insights-runtime-extractor-m7vpc" Jul 14 11:15:47.449361 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:47.449365 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-data-volume\") pod \"insights-runtime-extractor-m7vpc\" (UID: \"bcbcb21e-9bb2-474f-b0f3-b8bad02f3084\") " pod="openshift-insights/insights-runtime-extractor-m7vpc" Jul 14 11:15:47.449584 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:47.449440 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m7vpc\" (UID: \"bcbcb21e-9bb2-474f-b0f3-b8bad02f3084\") " pod="openshift-insights/insights-runtime-extractor-m7vpc" Jul 14 11:15:47.449584 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:47.449524 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxmzh\" (UniqueName: \"kubernetes.io/projected/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-kube-api-access-xxmzh\") pod \"insights-runtime-extractor-m7vpc\" (UID: \"bcbcb21e-9bb2-474f-b0f3-b8bad02f3084\") " pod="openshift-insights/insights-runtime-extractor-m7vpc" Jul 14 11:15:47.449584 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:47.449567 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-crio-socket\") pod \"insights-runtime-extractor-m7vpc\" (UID: \"bcbcb21e-9bb2-474f-b0f3-b8bad02f3084\") " pod="openshift-insights/insights-runtime-extractor-m7vpc" Jul 14 11:15:47.550942 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:47.550855 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-data-volume\") pod \"insights-runtime-extractor-m7vpc\" (UID: \"bcbcb21e-9bb2-474f-b0f3-b8bad02f3084\") " pod="openshift-insights/insights-runtime-extractor-m7vpc" Jul 14 11:15:47.550942 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:47.550919 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m7vpc\" (UID: \"bcbcb21e-9bb2-474f-b0f3-b8bad02f3084\") " pod="openshift-insights/insights-runtime-extractor-m7vpc" Jul 14 11:15:47.551168 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:47.550957 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxmzh\" (UniqueName: \"kubernetes.io/projected/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-kube-api-access-xxmzh\") pod \"insights-runtime-extractor-m7vpc\" (UID: \"bcbcb21e-9bb2-474f-b0f3-b8bad02f3084\") " pod="openshift-insights/insights-runtime-extractor-m7vpc" Jul 14 11:15:47.551168 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:47.550976 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-crio-socket\") pod \"insights-runtime-extractor-m7vpc\" (UID: \"bcbcb21e-9bb2-474f-b0f3-b8bad02f3084\") " pod="openshift-insights/insights-runtime-extractor-m7vpc" Jul 14 11:15:47.551168 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:47.551018 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m7vpc\" (UID: \"bcbcb21e-9bb2-474f-b0f3-b8bad02f3084\") " pod="openshift-insights/insights-runtime-extractor-m7vpc" Jul 14 11:15:47.551168 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:47.551092 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 11:15:47.551168 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:47.551096 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 11:15:47.551168 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:47.551117 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-crio-socket\") pod \"insights-runtime-extractor-m7vpc\" (UID: \"bcbcb21e-9bb2-474f-b0f3-b8bad02f3084\") " pod="openshift-insights/insights-runtime-extractor-m7vpc" Jul 14 11:15:47.551168 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:47.551151 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-kube-rbac-proxy-cm podName:bcbcb21e-9bb2-474f-b0f3-b8bad02f3084 nodeName:}" failed. No retries permitted until 2026-07-14 11:15:48.051135257 +0000 UTC m=+252.624515615 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m7vpc" (UID: "bcbcb21e-9bb2-474f-b0f3-b8bad02f3084") : configmap "kube-rbac-proxy" not found Jul 14 11:15:47.551168 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:47.551165 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-insights-runtime-extractor-tls podName:bcbcb21e-9bb2-474f-b0f3-b8bad02f3084 nodeName:}" failed. No retries permitted until 2026-07-14 11:15:48.051159323 +0000 UTC m=+252.624539674 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m7vpc" (UID: "bcbcb21e-9bb2-474f-b0f3-b8bad02f3084") : secret "insights-runtime-extractor-tls" not found Jul 14 11:15:47.551516 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:47.551265 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-data-volume\") pod \"insights-runtime-extractor-m7vpc\" (UID: \"bcbcb21e-9bb2-474f-b0f3-b8bad02f3084\") " pod="openshift-insights/insights-runtime-extractor-m7vpc" Jul 14 11:15:47.560762 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:47.560729 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxmzh\" (UniqueName: \"kubernetes.io/projected/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-kube-api-access-xxmzh\") pod \"insights-runtime-extractor-m7vpc\" (UID: \"bcbcb21e-9bb2-474f-b0f3-b8bad02f3084\") " pod="openshift-insights/insights-runtime-extractor-m7vpc" Jul 14 11:15:47.752384 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:47.752351 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8792ce35-00f9-4101-aab2-346a02150768-metrics-certs\") pod \"network-metrics-daemon-pql69\" (UID: \"8792ce35-00f9-4101-aab2-346a02150768\") " pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:15:47.752906 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:47.752473 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 14 11:15:47.752906 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:47.752553 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8792ce35-00f9-4101-aab2-346a02150768-metrics-certs podName:8792ce35-00f9-4101-aab2-346a02150768 nodeName:}" failed. No retries permitted until 2026-07-14 11:17:49.75252282 +0000 UTC m=+374.325903174 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8792ce35-00f9-4101-aab2-346a02150768-metrics-certs") pod "network-metrics-daemon-pql69" (UID: "8792ce35-00f9-4101-aab2-346a02150768") : secret "metrics-daemon-secret" not found Jul 14 11:15:48.054949 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:48.054902 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m7vpc\" (UID: \"bcbcb21e-9bb2-474f-b0f3-b8bad02f3084\") " pod="openshift-insights/insights-runtime-extractor-m7vpc" Jul 14 11:15:48.055157 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:48.054988 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m7vpc\" (UID: \"bcbcb21e-9bb2-474f-b0f3-b8bad02f3084\") " pod="openshift-insights/insights-runtime-extractor-m7vpc" Jul 14 11:15:48.055157 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:48.055004 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 11:15:48.055157 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:48.055080 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-kube-rbac-proxy-cm podName:bcbcb21e-9bb2-474f-b0f3-b8bad02f3084 nodeName:}" failed. No retries permitted until 2026-07-14 11:15:49.055060241 +0000 UTC m=+253.628440593 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m7vpc" (UID: "bcbcb21e-9bb2-474f-b0f3-b8bad02f3084") : configmap "kube-rbac-proxy" not found Jul 14 11:15:48.055157 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:48.055127 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 11:15:48.055307 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:48.055178 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-insights-runtime-extractor-tls podName:bcbcb21e-9bb2-474f-b0f3-b8bad02f3084 nodeName:}" failed. No retries permitted until 2026-07-14 11:15:49.055166209 +0000 UTC m=+253.628546561 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m7vpc" (UID: "bcbcb21e-9bb2-474f-b0f3-b8bad02f3084") : secret "insights-runtime-extractor-tls" not found Jul 14 11:15:49.061662 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:49.061613 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m7vpc\" (UID: \"bcbcb21e-9bb2-474f-b0f3-b8bad02f3084\") " pod="openshift-insights/insights-runtime-extractor-m7vpc" Jul 14 11:15:49.062080 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:49.061684 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m7vpc\" (UID: \"bcbcb21e-9bb2-474f-b0f3-b8bad02f3084\") " pod="openshift-insights/insights-runtime-extractor-m7vpc" Jul 14 11:15:49.062080 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:49.061756 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 11:15:49.062080 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:49.061789 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 11:15:49.062080 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:49.061834 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-kube-rbac-proxy-cm podName:bcbcb21e-9bb2-474f-b0f3-b8bad02f3084 nodeName:}" failed. No retries permitted until 2026-07-14 11:15:51.061816121 +0000 UTC m=+255.635196475 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m7vpc" (UID: "bcbcb21e-9bb2-474f-b0f3-b8bad02f3084") : configmap "kube-rbac-proxy" not found Jul 14 11:15:49.062080 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:49.061853 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-insights-runtime-extractor-tls podName:bcbcb21e-9bb2-474f-b0f3-b8bad02f3084 nodeName:}" failed. No retries permitted until 2026-07-14 11:15:51.061844096 +0000 UTC m=+255.635224448 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m7vpc" (UID: "bcbcb21e-9bb2-474f-b0f3-b8bad02f3084") : secret "insights-runtime-extractor-tls" not found Jul 14 11:15:49.356285 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:49.356205 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rf5p6_8cb4cc75-45c5-4e00-8434-71d348adcb4d/dns-node-resolver/0.log" Jul 14 11:15:50.552823 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:50.552793 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qmwvf_c428ac6b-bf9d-4d77-8554-c2c09614b02c/node-ca/0.log" Jul 14 11:15:50.951006 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:50.950918 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cf5nb_0f8a832e-cf67-47c0-817f-caf7db077628/serve-healthcheck-canary/0.log" Jul 14 11:15:51.078036 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:51.077983 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m7vpc\" (UID: \"bcbcb21e-9bb2-474f-b0f3-b8bad02f3084\") " pod="openshift-insights/insights-runtime-extractor-m7vpc" Jul 14 11:15:51.078262 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:51.078061 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m7vpc\" (UID: \"bcbcb21e-9bb2-474f-b0f3-b8bad02f3084\") " pod="openshift-insights/insights-runtime-extractor-m7vpc" Jul 14 11:15:51.078262 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:51.078113 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 11:15:51.078262 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:51.078182 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-kube-rbac-proxy-cm podName:bcbcb21e-9bb2-474f-b0f3-b8bad02f3084 nodeName:}" failed. No retries permitted until 2026-07-14 11:15:55.078165629 +0000 UTC m=+259.651545984 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m7vpc" (UID: "bcbcb21e-9bb2-474f-b0f3-b8bad02f3084") : configmap "kube-rbac-proxy" not found Jul 14 11:15:51.078262 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:51.078230 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 11:15:51.078438 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:51.078306 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-insights-runtime-extractor-tls podName:bcbcb21e-9bb2-474f-b0f3-b8bad02f3084 nodeName:}" failed. No retries permitted until 2026-07-14 11:15:55.078290234 +0000 UTC m=+259.651670586 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m7vpc" (UID: "bcbcb21e-9bb2-474f-b0f3-b8bad02f3084") : secret "insights-runtime-extractor-tls" not found Jul 14 11:15:51.279674 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:51.279636 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca5d6937-4feb-431e-b78b-fe1f595d8b36-service-ca-bundle\") pod \"router-default-5f9bb8c67d-6vnpr\" (UID: \"ca5d6937-4feb-431e-b78b-fe1f595d8b36\") " pod="openshift-ingress/router-default-5f9bb8c67d-6vnpr" Jul 14 11:15:51.279877 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:51.279694 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca5d6937-4feb-431e-b78b-fe1f595d8b36-metrics-certs\") pod \"router-default-5f9bb8c67d-6vnpr\" (UID: \"ca5d6937-4feb-431e-b78b-fe1f595d8b36\") " pod="openshift-ingress/router-default-5f9bb8c67d-6vnpr" Jul 14 11:15:51.279877 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:51.279753 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b815a14c-5f38-46e4-b867-8e15735d9d50-registry-tls\") pod \"image-registry-5656bffcc-jsbjr\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" Jul 14 11:15:51.279877 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:51.279813 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca5d6937-4feb-431e-b78b-fe1f595d8b36-service-ca-bundle podName:ca5d6937-4feb-431e-b78b-fe1f595d8b36 nodeName:}" failed. No retries permitted until 2026-07-14 11:15:59.279794031 +0000 UTC m=+263.853174383 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ca5d6937-4feb-431e-b78b-fe1f595d8b36-service-ca-bundle") pod "router-default-5f9bb8c67d-6vnpr" (UID: "ca5d6937-4feb-431e-b78b-fe1f595d8b36") : configmap references non-existent config key: service-ca.crt Jul 14 11:15:51.280018 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:51.279880 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 11:15:51.280018 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:51.279878 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 11:15:51.280018 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:51.279894 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5656bffcc-jsbjr: secret "image-registry-tls" not found Jul 14 11:15:51.280018 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:51.279944 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b815a14c-5f38-46e4-b867-8e15735d9d50-registry-tls podName:b815a14c-5f38-46e4-b867-8e15735d9d50 nodeName:}" failed. No retries permitted until 2026-07-14 11:15:59.279932115 +0000 UTC m=+263.853312469 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b815a14c-5f38-46e4-b867-8e15735d9d50-registry-tls") pod "image-registry-5656bffcc-jsbjr" (UID: "b815a14c-5f38-46e4-b867-8e15735d9d50") : secret "image-registry-tls" not found Jul 14 11:15:51.280018 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:51.279961 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca5d6937-4feb-431e-b78b-fe1f595d8b36-metrics-certs podName:ca5d6937-4feb-431e-b78b-fe1f595d8b36 nodeName:}" failed. No retries permitted until 2026-07-14 11:15:59.279952425 +0000 UTC m=+263.853332780 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca5d6937-4feb-431e-b78b-fe1f595d8b36-metrics-certs") pod "router-default-5f9bb8c67d-6vnpr" (UID: "ca5d6937-4feb-431e-b78b-fe1f595d8b36") : secret "router-metrics-certs-default" not found Jul 14 11:15:55.112218 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:55.112179 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m7vpc\" (UID: \"bcbcb21e-9bb2-474f-b0f3-b8bad02f3084\") " pod="openshift-insights/insights-runtime-extractor-m7vpc" Jul 14 11:15:55.112653 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:55.112241 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m7vpc\" (UID: \"bcbcb21e-9bb2-474f-b0f3-b8bad02f3084\") " pod="openshift-insights/insights-runtime-extractor-m7vpc" Jul 14 11:15:55.112653 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:55.112314 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 11:15:55.112653 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:55.112332 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 11:15:55.112653 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:55.112386 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-insights-runtime-extractor-tls podName:bcbcb21e-9bb2-474f-b0f3-b8bad02f3084 nodeName:}" failed. No retries permitted until 2026-07-14 11:16:03.112371998 +0000 UTC m=+267.685752350 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m7vpc" (UID: "bcbcb21e-9bb2-474f-b0f3-b8bad02f3084") : secret "insights-runtime-extractor-tls" not found Jul 14 11:15:55.112653 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:15:55.112400 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-kube-rbac-proxy-cm podName:bcbcb21e-9bb2-474f-b0f3-b8bad02f3084 nodeName:}" failed. No retries permitted until 2026-07-14 11:16:03.11239342 +0000 UTC m=+267.685773772 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m7vpc" (UID: "bcbcb21e-9bb2-474f-b0f3-b8bad02f3084") : configmap "kube-rbac-proxy" not found Jul 14 11:15:59.350919 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:59.350830 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca5d6937-4feb-431e-b78b-fe1f595d8b36-service-ca-bundle\") pod \"router-default-5f9bb8c67d-6vnpr\" (UID: \"ca5d6937-4feb-431e-b78b-fe1f595d8b36\") " pod="openshift-ingress/router-default-5f9bb8c67d-6vnpr" Jul 14 11:15:59.350919 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:59.350877 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca5d6937-4feb-431e-b78b-fe1f595d8b36-metrics-certs\") pod \"router-default-5f9bb8c67d-6vnpr\" (UID: \"ca5d6937-4feb-431e-b78b-fe1f595d8b36\") " pod="openshift-ingress/router-default-5f9bb8c67d-6vnpr" Jul 14 11:15:59.350919 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:59.350911 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b815a14c-5f38-46e4-b867-8e15735d9d50-registry-tls\") pod \"image-registry-5656bffcc-jsbjr\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" Jul 14 11:15:59.351449 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:59.351429 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca5d6937-4feb-431e-b78b-fe1f595d8b36-service-ca-bundle\") pod \"router-default-5f9bb8c67d-6vnpr\" (UID: \"ca5d6937-4feb-431e-b78b-fe1f595d8b36\") " pod="openshift-ingress/router-default-5f9bb8c67d-6vnpr" Jul 14 11:15:59.353406 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:59.353386 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b815a14c-5f38-46e4-b867-8e15735d9d50-registry-tls\") pod \"image-registry-5656bffcc-jsbjr\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" Jul 14 11:15:59.353473 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:59.353455 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca5d6937-4feb-431e-b78b-fe1f595d8b36-metrics-certs\") pod \"router-default-5f9bb8c67d-6vnpr\" (UID: \"ca5d6937-4feb-431e-b78b-fe1f595d8b36\") " pod="openshift-ingress/router-default-5f9bb8c67d-6vnpr" Jul 14 11:15:59.438443 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:59.438409 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" Jul 14 11:15:59.450660 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:59.450632 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5f9bb8c67d-6vnpr" Jul 14 11:15:59.589145 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:59.589100 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5656bffcc-jsbjr"] Jul 14 11:15:59.593221 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:15:59.593186 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb815a14c_5f38_46e4_b867_8e15735d9d50.slice/crio-9c194f9fdf0a04248fa7136131b98880ff655d48977a15e098e8ee4915f782f2 WatchSource:0}: Error finding container 9c194f9fdf0a04248fa7136131b98880ff655d48977a15e098e8ee4915f782f2: Status 404 returned error can't find the container with id 9c194f9fdf0a04248fa7136131b98880ff655d48977a15e098e8ee4915f782f2 Jul 14 11:15:59.607313 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:59.607247 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5f9bb8c67d-6vnpr"] Jul 14 11:15:59.610051 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:15:59.609978 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca5d6937_4feb_431e_b78b_fe1f595d8b36.slice/crio-2bbb8e33e9caeaf531f8855127f9e4f849b6404e3463dfcc29a1f0292addb306 WatchSource:0}: Error finding container 2bbb8e33e9caeaf531f8855127f9e4f849b6404e3463dfcc29a1f0292addb306: Status 404 returned error can't find the container with id 2bbb8e33e9caeaf531f8855127f9e4f849b6404e3463dfcc29a1f0292addb306 Jul 14 11:15:59.793711 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:59.793673 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5f9bb8c67d-6vnpr" event={"ID":"ca5d6937-4feb-431e-b78b-fe1f595d8b36","Type":"ContainerStarted","Data":"8f629a94d885c56c9d6cdf33502b5c00cd4c50fde49587c05e549403bb9c9146"} Jul 14 11:15:59.793881 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:59.793774 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5f9bb8c67d-6vnpr" event={"ID":"ca5d6937-4feb-431e-b78b-fe1f595d8b36","Type":"ContainerStarted","Data":"2bbb8e33e9caeaf531f8855127f9e4f849b6404e3463dfcc29a1f0292addb306"} Jul 14 11:15:59.795329 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:59.795297 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" event={"ID":"b815a14c-5f38-46e4-b867-8e15735d9d50","Type":"ContainerStarted","Data":"31d4a3f6395f3d8e52ef6986d97d18febae31754fa8e42d5a4096ce84786caa5"} Jul 14 11:15:59.795446 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:59.795350 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" event={"ID":"b815a14c-5f38-46e4-b867-8e15735d9d50","Type":"ContainerStarted","Data":"9c194f9fdf0a04248fa7136131b98880ff655d48977a15e098e8ee4915f782f2"} Jul 14 11:15:59.795446 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:59.795406 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" Jul 14 11:15:59.814283 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:59.814226 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5f9bb8c67d-6vnpr" podStartSLOduration=16.814209504 podStartE2EDuration="16.814209504s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:15:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:15:59.81367345 +0000 UTC m=+264.387053869" watchObservedRunningTime="2026-07-14 11:15:59.814209504 +0000 UTC m=+264.387589877" Jul 14 11:15:59.834524 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:15:59.834461 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" podStartSLOduration=16.83444174 podStartE2EDuration="16.83444174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:15:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:15:59.833373021 +0000 UTC m=+264.406753415" watchObservedRunningTime="2026-07-14 11:15:59.83444174 +0000 UTC m=+264.407822114" Jul 14 11:16:00.451237 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:00.451199 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5f9bb8c67d-6vnpr" Jul 14 11:16:00.453902 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:00.453879 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5f9bb8c67d-6vnpr" Jul 14 11:16:00.799014 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:00.798978 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5f9bb8c67d-6vnpr" Jul 14 11:16:00.800013 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:00.799991 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5f9bb8c67d-6vnpr" Jul 14 11:16:03.183827 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:03.183784 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m7vpc\" (UID: \"bcbcb21e-9bb2-474f-b0f3-b8bad02f3084\") " pod="openshift-insights/insights-runtime-extractor-m7vpc" Jul 14 11:16:03.184230 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:03.183855 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m7vpc\" (UID: \"bcbcb21e-9bb2-474f-b0f3-b8bad02f3084\") " pod="openshift-insights/insights-runtime-extractor-m7vpc" Jul 14 11:16:03.184349 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:03.184327 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m7vpc\" (UID: \"bcbcb21e-9bb2-474f-b0f3-b8bad02f3084\") " pod="openshift-insights/insights-runtime-extractor-m7vpc" Jul 14 11:16:03.186332 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:03.186310 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bcbcb21e-9bb2-474f-b0f3-b8bad02f3084-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m7vpc\" (UID: \"bcbcb21e-9bb2-474f-b0f3-b8bad02f3084\") " pod="openshift-insights/insights-runtime-extractor-m7vpc" Jul 14 11:16:03.299070 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:03.299033 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m7vpc" Jul 14 11:16:03.444256 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:03.444159 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m7vpc"] Jul 14 11:16:03.448374 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:16:03.448348 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcbcb21e_9bb2_474f_b0f3_b8bad02f3084.slice/crio-1e0f0e63d43973a9c2bb3deab91c11ee5afec99b16e6f1a230b55a66d067280f WatchSource:0}: Error finding container 1e0f0e63d43973a9c2bb3deab91c11ee5afec99b16e6f1a230b55a66d067280f: Status 404 returned error can't find the container with id 1e0f0e63d43973a9c2bb3deab91c11ee5afec99b16e6f1a230b55a66d067280f Jul 14 11:16:03.810033 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:03.809996 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m7vpc" event={"ID":"bcbcb21e-9bb2-474f-b0f3-b8bad02f3084","Type":"ContainerStarted","Data":"1e0f0e63d43973a9c2bb3deab91c11ee5afec99b16e6f1a230b55a66d067280f"} Jul 14 11:16:07.828526 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:07.828492 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m7vpc" event={"ID":"bcbcb21e-9bb2-474f-b0f3-b8bad02f3084","Type":"ContainerStarted","Data":"2cb8823b1430193620679aa65fb14278ecea64193fd7fc64c367e15db65e185e"} Jul 14 11:16:08.834629 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:08.834583 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m7vpc" event={"ID":"bcbcb21e-9bb2-474f-b0f3-b8bad02f3084","Type":"ContainerStarted","Data":"1c41c38b4d491ed5be2e4548594a0d3dd38f7c22814fc0710b62f79563d3b3a8"} Jul 14 11:16:09.368977 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:09.368937 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4zk2f"] Jul 14 11:16:09.373522 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:09.373491 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4zk2f" Jul 14 11:16:09.378973 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:09.378942 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-jxz9d\"" Jul 14 11:16:09.379155 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:09.378942 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 14 11:16:09.393099 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:09.393070 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4zk2f"] Jul 14 11:16:09.403737 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:09.403704 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5656bffcc-jsbjr"] Jul 14 11:16:09.439992 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:09.439955 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f90bde1d-5f1f-4fff-a833-bb7e0dc48154-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-4zk2f\" (UID: \"f90bde1d-5f1f-4fff-a833-bb7e0dc48154\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4zk2f" Jul 14 11:16:09.541246 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:09.541200 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f90bde1d-5f1f-4fff-a833-bb7e0dc48154-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-4zk2f\" (UID: \"f90bde1d-5f1f-4fff-a833-bb7e0dc48154\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4zk2f" Jul 14 11:16:09.544205 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:09.544174 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f90bde1d-5f1f-4fff-a833-bb7e0dc48154-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-4zk2f\" (UID: \"f90bde1d-5f1f-4fff-a833-bb7e0dc48154\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4zk2f" Jul 14 11:16:09.686405 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:09.686319 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4zk2f" Jul 14 11:16:10.540068 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:10.540034 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4zk2f"] Jul 14 11:16:10.544424 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:16:10.544396 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf90bde1d_5f1f_4fff_a833_bb7e0dc48154.slice/crio-bd6fe7b48e100b276b5ef9f320b5f5d9747f8161f172e718d3465f4b784106e2 WatchSource:0}: Error finding container bd6fe7b48e100b276b5ef9f320b5f5d9747f8161f172e718d3465f4b784106e2: Status 404 returned error can't find the container with id bd6fe7b48e100b276b5ef9f320b5f5d9747f8161f172e718d3465f4b784106e2 Jul 14 11:16:10.847748 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:10.847706 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m7vpc" event={"ID":"bcbcb21e-9bb2-474f-b0f3-b8bad02f3084","Type":"ContainerStarted","Data":"14a477b6edde1fdad3989dda297f15d8e1b9671e2404da4a476f3feea1c04d86"} Jul 14 11:16:10.848859 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:10.848836 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4zk2f" event={"ID":"f90bde1d-5f1f-4fff-a833-bb7e0dc48154","Type":"ContainerStarted","Data":"bd6fe7b48e100b276b5ef9f320b5f5d9747f8161f172e718d3465f4b784106e2"} Jul 14 11:16:10.870359 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:10.870306 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-m7vpc" podStartSLOduration=17.006657453 podStartE2EDuration="23.870289765s" totalImagesPullingTime="6.863632312s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:15:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:16:10.868966539 +0000 UTC m=+275.442346936" watchObservedRunningTime="2026-07-14 11:16:10.870289765 +0000 UTC m=+275.443670139" Jul 14 11:16:11.853582 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:11.853462 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4zk2f" event={"ID":"f90bde1d-5f1f-4fff-a833-bb7e0dc48154","Type":"ContainerStarted","Data":"4d6e531f18dff672b38acb7b5d16feb8afceea1f90249d4fa948b8d9acf5ec9f"} Jul 14 11:16:11.853928 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:11.853871 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4zk2f" Jul 14 11:16:11.858327 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:11.858299 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4zk2f" Jul 14 11:16:11.871252 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:11.871201 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4zk2f" podStartSLOduration=1.8126616119999999 podStartE2EDuration="2.871182424s" totalImagesPullingTime="1.058520812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:16:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:16:11.870356325 +0000 UTC m=+276.443736724" watchObservedRunningTime="2026-07-14 11:16:11.871182424 +0000 UTC m=+276.444562798" Jul 14 11:16:12.405434 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:12.405396 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-c579z"] Jul 14 11:16:12.408806 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:12.408789 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-c579z" Jul 14 11:16:12.411664 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:12.411635 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 14 11:16:12.411767 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:12.411666 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 14 11:16:12.411767 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:12.411677 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 14 11:16:12.412893 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:12.412879 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 14 11:16:12.412977 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:12.412932 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-2dnqq\"" Jul 14 11:16:12.413210 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:12.413194 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 14 11:16:12.422442 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:12.422419 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-c579z"] Jul 14 11:16:12.467799 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:12.467762 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/26c04831-fe7d-4d29-9bf3-e51b5ac0cba1-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-c579z\" (UID: \"26c04831-fe7d-4d29-9bf3-e51b5ac0cba1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-c579z" Jul 14 11:16:12.468022 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:12.467822 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rhx9\" (UniqueName: \"kubernetes.io/projected/26c04831-fe7d-4d29-9bf3-e51b5ac0cba1-kube-api-access-8rhx9\") pod \"prometheus-operator-64785b6675-c579z\" (UID: \"26c04831-fe7d-4d29-9bf3-e51b5ac0cba1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-c579z" Jul 14 11:16:12.468022 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:12.467852 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26c04831-fe7d-4d29-9bf3-e51b5ac0cba1-metrics-client-ca\") pod \"prometheus-operator-64785b6675-c579z\" (UID: \"26c04831-fe7d-4d29-9bf3-e51b5ac0cba1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-c579z" Jul 14 11:16:12.468022 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:12.467964 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/26c04831-fe7d-4d29-9bf3-e51b5ac0cba1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-c579z\" (UID: \"26c04831-fe7d-4d29-9bf3-e51b5ac0cba1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-c579z" Jul 14 11:16:12.568801 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:12.568761 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rhx9\" (UniqueName: \"kubernetes.io/projected/26c04831-fe7d-4d29-9bf3-e51b5ac0cba1-kube-api-access-8rhx9\") pod \"prometheus-operator-64785b6675-c579z\" (UID: \"26c04831-fe7d-4d29-9bf3-e51b5ac0cba1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-c579z" Jul 14 11:16:12.568977 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:12.568814 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26c04831-fe7d-4d29-9bf3-e51b5ac0cba1-metrics-client-ca\") pod \"prometheus-operator-64785b6675-c579z\" (UID: \"26c04831-fe7d-4d29-9bf3-e51b5ac0cba1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-c579z" Jul 14 11:16:12.568977 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:12.568860 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/26c04831-fe7d-4d29-9bf3-e51b5ac0cba1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-c579z\" (UID: \"26c04831-fe7d-4d29-9bf3-e51b5ac0cba1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-c579z" Jul 14 11:16:12.568977 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:12.568881 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/26c04831-fe7d-4d29-9bf3-e51b5ac0cba1-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-c579z\" (UID: \"26c04831-fe7d-4d29-9bf3-e51b5ac0cba1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-c579z" Jul 14 11:16:12.569088 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:16:12.568989 2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 14 11:16:12.569088 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:16:12.569057 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26c04831-fe7d-4d29-9bf3-e51b5ac0cba1-prometheus-operator-tls podName:26c04831-fe7d-4d29-9bf3-e51b5ac0cba1 nodeName:}" failed. No retries permitted until 2026-07-14 11:16:13.0690395 +0000 UTC m=+277.642419852 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/26c04831-fe7d-4d29-9bf3-e51b5ac0cba1-prometheus-operator-tls") pod "prometheus-operator-64785b6675-c579z" (UID: "26c04831-fe7d-4d29-9bf3-e51b5ac0cba1") : secret "prometheus-operator-tls" not found Jul 14 11:16:12.569478 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:12.569459 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26c04831-fe7d-4d29-9bf3-e51b5ac0cba1-metrics-client-ca\") pod \"prometheus-operator-64785b6675-c579z\" (UID: \"26c04831-fe7d-4d29-9bf3-e51b5ac0cba1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-c579z" Jul 14 11:16:12.571476 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:12.571455 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/26c04831-fe7d-4d29-9bf3-e51b5ac0cba1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-c579z\" (UID: \"26c04831-fe7d-4d29-9bf3-e51b5ac0cba1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-c579z" Jul 14 11:16:12.578232 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:12.578199 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rhx9\" (UniqueName: \"kubernetes.io/projected/26c04831-fe7d-4d29-9bf3-e51b5ac0cba1-kube-api-access-8rhx9\") pod \"prometheus-operator-64785b6675-c579z\" (UID: \"26c04831-fe7d-4d29-9bf3-e51b5ac0cba1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-c579z" Jul 14 11:16:13.072420 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:13.072377 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/26c04831-fe7d-4d29-9bf3-e51b5ac0cba1-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-c579z\" (UID: \"26c04831-fe7d-4d29-9bf3-e51b5ac0cba1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-c579z" Jul 14 11:16:13.074981 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:13.074943 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/26c04831-fe7d-4d29-9bf3-e51b5ac0cba1-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-c579z\" (UID: \"26c04831-fe7d-4d29-9bf3-e51b5ac0cba1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-c579z" Jul 14 11:16:13.318384 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:13.318346 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-c579z" Jul 14 11:16:13.475157 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:13.475125 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-c579z"] Jul 14 11:16:13.478034 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:16:13.477999 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26c04831_fe7d_4d29_9bf3_e51b5ac0cba1.slice/crio-8de048e80591f4415213bd565f2372ec3a06d078f4f57b0b047d68348d262217 WatchSource:0}: Error finding container 8de048e80591f4415213bd565f2372ec3a06d078f4f57b0b047d68348d262217: Status 404 returned error can't find the container with id 8de048e80591f4415213bd565f2372ec3a06d078f4f57b0b047d68348d262217 Jul 14 11:16:13.863406 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:13.863359 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-c579z" event={"ID":"26c04831-fe7d-4d29-9bf3-e51b5ac0cba1","Type":"ContainerStarted","Data":"8de048e80591f4415213bd565f2372ec3a06d078f4f57b0b047d68348d262217"} Jul 14 11:16:15.877152 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:15.877116 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-c579z" event={"ID":"26c04831-fe7d-4d29-9bf3-e51b5ac0cba1","Type":"ContainerStarted","Data":"eec16e0d3be7e4acb4cdee33d2266d59146c8bfd1ef74ada8b65cb6c3c35b39c"} Jul 14 11:16:15.877600 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:15.877168 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-c579z" event={"ID":"26c04831-fe7d-4d29-9bf3-e51b5ac0cba1","Type":"ContainerStarted","Data":"fdcb4b98919b08e165b8794cab2b2d7f79dab7976f46cf66696572c242c32ede"} Jul 14 11:16:15.901333 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:15.901269 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-c579z" podStartSLOduration=2.351627898 podStartE2EDuration="3.901249028s" totalImagesPullingTime="1.54962113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:16:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:16:15.901053616 +0000 UTC m=+280.474434002" watchObservedRunningTime="2026-07-14 11:16:15.901249028 +0000 UTC m=+280.474629403" Jul 14 11:16:17.487746 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:16:17.487703 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-tgz82" podUID="3c2af027-67fa-46e8-8502-7b584d80674e" Jul 14 11:16:17.775573 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:17.775469 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-8fksf"] Jul 14 11:16:17.778868 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:17.778845 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8fksf" Jul 14 11:16:17.793408 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:17.793379 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 14 11:16:17.793642 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:17.793622 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 14 11:16:17.793933 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:17.793917 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-sm46c\"" Jul 14 11:16:17.797789 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:17.797765 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-8fksf"] Jul 14 11:16:17.840968 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:17.840929 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cnlp8"] Jul 14 11:16:17.844148 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:17.844120 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cnlp8" Jul 14 11:16:17.847096 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:17.847066 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 14 11:16:17.847231 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:17.847122 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f9kn4\"" Jul 14 11:16:17.847231 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:17.847078 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 14 11:16:17.847231 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:17.847081 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 14 11:16:17.884485 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:17.884455 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tgz82" Jul 14 11:16:17.928231 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:17.928198 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d82e707-afa5-4354-80b7-623b97b5208b-metrics-client-ca\") pod \"node-exporter-cnlp8\" (UID: \"9d82e707-afa5-4354-80b7-623b97b5208b\") " pod="openshift-monitoring/node-exporter-cnlp8" Jul 14 11:16:17.928347 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:17.928237 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5rv9\" (UniqueName: \"kubernetes.io/projected/9d82e707-afa5-4354-80b7-623b97b5208b-kube-api-access-z5rv9\") pod \"node-exporter-cnlp8\" (UID: \"9d82e707-afa5-4354-80b7-623b97b5208b\") " pod="openshift-monitoring/node-exporter-cnlp8" Jul 14 11:16:17.928347 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:17.928271 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9d82e707-afa5-4354-80b7-623b97b5208b-node-exporter-wtmp\") pod \"node-exporter-cnlp8\" (UID: \"9d82e707-afa5-4354-80b7-623b97b5208b\") " pod="openshift-monitoring/node-exporter-cnlp8" Jul 14 11:16:17.928438 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:17.928354 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10775e6e-386a-4d84-b634-95dd74f20e7f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-8fksf\" (UID: \"10775e6e-386a-4d84-b634-95dd74f20e7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8fksf" Jul 14 11:16:17.928438 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:17.928387 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/10775e6e-386a-4d84-b634-95dd74f20e7f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-8fksf\" (UID: \"10775e6e-386a-4d84-b634-95dd74f20e7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8fksf" Jul 14 11:16:17.928438 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:17.928408 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10775e6e-386a-4d84-b634-95dd74f20e7f-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-8fksf\" (UID: \"10775e6e-386a-4d84-b634-95dd74f20e7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8fksf" Jul 14 11:16:17.928438 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:17.928436 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9d82e707-afa5-4354-80b7-623b97b5208b-node-exporter-textfile\") pod \"node-exporter-cnlp8\" (UID: \"9d82e707-afa5-4354-80b7-623b97b5208b\") " pod="openshift-monitoring/node-exporter-cnlp8" Jul 14 11:16:17.928683 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:17.928464 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9d82e707-afa5-4354-80b7-623b97b5208b-node-exporter-tls\") pod \"node-exporter-cnlp8\" (UID: \"9d82e707-afa5-4354-80b7-623b97b5208b\") " pod="openshift-monitoring/node-exporter-cnlp8" Jul 14 11:16:17.928683 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:17.928502 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d82e707-afa5-4354-80b7-623b97b5208b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cnlp8\" (UID: \"9d82e707-afa5-4354-80b7-623b97b5208b\") " pod="openshift-monitoring/node-exporter-cnlp8" Jul 14 11:16:17.928683 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:17.928588 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d82e707-afa5-4354-80b7-623b97b5208b-sys\") pod \"node-exporter-cnlp8\" (UID: \"9d82e707-afa5-4354-80b7-623b97b5208b\") " pod="openshift-monitoring/node-exporter-cnlp8" Jul 14 11:16:17.928683 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:17.928638 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9d82e707-afa5-4354-80b7-623b97b5208b-root\") pod \"node-exporter-cnlp8\" (UID: \"9d82e707-afa5-4354-80b7-623b97b5208b\") " pod="openshift-monitoring/node-exporter-cnlp8" Jul 14 11:16:17.928683 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:17.928668 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9d82e707-afa5-4354-80b7-623b97b5208b-node-exporter-accelerators-collector-config\") pod \"node-exporter-cnlp8\" (UID: \"9d82e707-afa5-4354-80b7-623b97b5208b\") " pod="openshift-monitoring/node-exporter-cnlp8" Jul 14 11:16:17.928861 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:17.928695 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrxv9\" (UniqueName: \"kubernetes.io/projected/10775e6e-386a-4d84-b634-95dd74f20e7f-kube-api-access-wrxv9\") pod \"openshift-state-metrics-84bd68b896-8fksf\" (UID: \"10775e6e-386a-4d84-b634-95dd74f20e7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8fksf" Jul 14 11:16:18.029172 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.029073 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9d82e707-afa5-4354-80b7-623b97b5208b-node-exporter-tls\") pod \"node-exporter-cnlp8\" (UID: \"9d82e707-afa5-4354-80b7-623b97b5208b\") " pod="openshift-monitoring/node-exporter-cnlp8" Jul 14 11:16:18.029172 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.029115 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d82e707-afa5-4354-80b7-623b97b5208b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cnlp8\" (UID: \"9d82e707-afa5-4354-80b7-623b97b5208b\") " pod="openshift-monitoring/node-exporter-cnlp8" Jul 14 11:16:18.029172 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.029137 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d82e707-afa5-4354-80b7-623b97b5208b-sys\") pod \"node-exporter-cnlp8\" (UID: \"9d82e707-afa5-4354-80b7-623b97b5208b\") " pod="openshift-monitoring/node-exporter-cnlp8" Jul 14 11:16:18.029172 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.029176 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9d82e707-afa5-4354-80b7-623b97b5208b-root\") pod \"node-exporter-cnlp8\" (UID: \"9d82e707-afa5-4354-80b7-623b97b5208b\") " pod="openshift-monitoring/node-exporter-cnlp8" Jul 14 11:16:18.029503 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.029201 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9d82e707-afa5-4354-80b7-623b97b5208b-node-exporter-accelerators-collector-config\") pod \"node-exporter-cnlp8\" (UID: \"9d82e707-afa5-4354-80b7-623b97b5208b\") " pod="openshift-monitoring/node-exporter-cnlp8" Jul 14 11:16:18.029503 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.029225 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrxv9\" (UniqueName: \"kubernetes.io/projected/10775e6e-386a-4d84-b634-95dd74f20e7f-kube-api-access-wrxv9\") pod \"openshift-state-metrics-84bd68b896-8fksf\" (UID: \"10775e6e-386a-4d84-b634-95dd74f20e7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8fksf" Jul 14 11:16:18.029503 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.029241 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d82e707-afa5-4354-80b7-623b97b5208b-sys\") pod \"node-exporter-cnlp8\" (UID: \"9d82e707-afa5-4354-80b7-623b97b5208b\") " pod="openshift-monitoring/node-exporter-cnlp8" Jul 14 11:16:18.029503 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.029285 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9d82e707-afa5-4354-80b7-623b97b5208b-root\") pod \"node-exporter-cnlp8\" (UID: \"9d82e707-afa5-4354-80b7-623b97b5208b\") " pod="openshift-monitoring/node-exporter-cnlp8" Jul 14 11:16:18.029503 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.029408 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d82e707-afa5-4354-80b7-623b97b5208b-metrics-client-ca\") pod \"node-exporter-cnlp8\" (UID: \"9d82e707-afa5-4354-80b7-623b97b5208b\") " pod="openshift-monitoring/node-exporter-cnlp8" Jul 14 11:16:18.029503 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.029459 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5rv9\" (UniqueName: \"kubernetes.io/projected/9d82e707-afa5-4354-80b7-623b97b5208b-kube-api-access-z5rv9\") pod \"node-exporter-cnlp8\" (UID: \"9d82e707-afa5-4354-80b7-623b97b5208b\") " pod="openshift-monitoring/node-exporter-cnlp8" Jul 14 11:16:18.029845 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.029515 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9d82e707-afa5-4354-80b7-623b97b5208b-node-exporter-wtmp\") pod \"node-exporter-cnlp8\" (UID: \"9d82e707-afa5-4354-80b7-623b97b5208b\") " pod="openshift-monitoring/node-exporter-cnlp8" Jul 14 11:16:18.029845 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.029600 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10775e6e-386a-4d84-b634-95dd74f20e7f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-8fksf\" (UID: \"10775e6e-386a-4d84-b634-95dd74f20e7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8fksf" Jul 14 11:16:18.029845 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.029637 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/10775e6e-386a-4d84-b634-95dd74f20e7f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-8fksf\" (UID: \"10775e6e-386a-4d84-b634-95dd74f20e7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8fksf" Jul 14 11:16:18.029845 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.029661 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10775e6e-386a-4d84-b634-95dd74f20e7f-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-8fksf\" (UID: \"10775e6e-386a-4d84-b634-95dd74f20e7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8fksf" Jul 14 11:16:18.029845 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.029690 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9d82e707-afa5-4354-80b7-623b97b5208b-node-exporter-textfile\") pod \"node-exporter-cnlp8\" (UID: \"9d82e707-afa5-4354-80b7-623b97b5208b\") " pod="openshift-monitoring/node-exporter-cnlp8" Jul 14 11:16:18.030100 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.029989 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9d82e707-afa5-4354-80b7-623b97b5208b-node-exporter-accelerators-collector-config\") pod \"node-exporter-cnlp8\" (UID: \"9d82e707-afa5-4354-80b7-623b97b5208b\") " pod="openshift-monitoring/node-exporter-cnlp8" Jul 14 11:16:18.030100 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.029997 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9d82e707-afa5-4354-80b7-623b97b5208b-node-exporter-textfile\") pod \"node-exporter-cnlp8\" (UID: \"9d82e707-afa5-4354-80b7-623b97b5208b\") " pod="openshift-monitoring/node-exporter-cnlp8" Jul 14 11:16:18.030100 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.029993 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d82e707-afa5-4354-80b7-623b97b5208b-metrics-client-ca\") pod \"node-exporter-cnlp8\" (UID: \"9d82e707-afa5-4354-80b7-623b97b5208b\") " pod="openshift-monitoring/node-exporter-cnlp8" Jul 14 11:16:18.030100 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:16:18.030084 2576 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 14 11:16:18.030263 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.030108 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9d82e707-afa5-4354-80b7-623b97b5208b-node-exporter-wtmp\") pod \"node-exporter-cnlp8\" (UID: \"9d82e707-afa5-4354-80b7-623b97b5208b\") " pod="openshift-monitoring/node-exporter-cnlp8" Jul 14 11:16:18.030263 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:16:18.030151 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10775e6e-386a-4d84-b634-95dd74f20e7f-openshift-state-metrics-tls podName:10775e6e-386a-4d84-b634-95dd74f20e7f nodeName:}" failed. No retries permitted until 2026-07-14 11:16:18.530129685 +0000 UTC m=+283.103510044 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/10775e6e-386a-4d84-b634-95dd74f20e7f-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-8fksf" (UID: "10775e6e-386a-4d84-b634-95dd74f20e7f") : secret "openshift-state-metrics-tls" not found Jul 14 11:16:18.030906 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.030883 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10775e6e-386a-4d84-b634-95dd74f20e7f-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-8fksf\" (UID: \"10775e6e-386a-4d84-b634-95dd74f20e7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8fksf" Jul 14 11:16:18.032287 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.032264 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10775e6e-386a-4d84-b634-95dd74f20e7f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-8fksf\" (UID: \"10775e6e-386a-4d84-b634-95dd74f20e7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8fksf" Jul 14 11:16:18.032400 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.032384 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9d82e707-afa5-4354-80b7-623b97b5208b-node-exporter-tls\") pod \"node-exporter-cnlp8\" (UID: \"9d82e707-afa5-4354-80b7-623b97b5208b\") " pod="openshift-monitoring/node-exporter-cnlp8" Jul 14 11:16:18.032488 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.032469 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d82e707-afa5-4354-80b7-623b97b5208b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cnlp8\" (UID: \"9d82e707-afa5-4354-80b7-623b97b5208b\") " pod="openshift-monitoring/node-exporter-cnlp8" Jul 14 11:16:18.041702 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.041672 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrxv9\" (UniqueName: \"kubernetes.io/projected/10775e6e-386a-4d84-b634-95dd74f20e7f-kube-api-access-wrxv9\") pod \"openshift-state-metrics-84bd68b896-8fksf\" (UID: \"10775e6e-386a-4d84-b634-95dd74f20e7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8fksf" Jul 14 11:16:18.042043 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.042027 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5rv9\" (UniqueName: \"kubernetes.io/projected/9d82e707-afa5-4354-80b7-623b97b5208b-kube-api-access-z5rv9\") pod \"node-exporter-cnlp8\" (UID: \"9d82e707-afa5-4354-80b7-623b97b5208b\") " pod="openshift-monitoring/node-exporter-cnlp8" Jul 14 11:16:18.153959 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.153913 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cnlp8" Jul 14 11:16:18.166264 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:16:18.166233 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d82e707_afa5_4354_80b7_623b97b5208b.slice/crio-6ec1d4a7a31b63f83876c39f961179529b5ca751af3dd6320df43fef6f4817f5 WatchSource:0}: Error finding container 6ec1d4a7a31b63f83876c39f961179529b5ca751af3dd6320df43fef6f4817f5: Status 404 returned error can't find the container with id 6ec1d4a7a31b63f83876c39f961179529b5ca751af3dd6320df43fef6f4817f5 Jul 14 11:16:18.253582 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.253378 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cdd9ccdd8-j6rpr"] Jul 14 11:16:18.258254 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.258232 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cdd9ccdd8-j6rpr" Jul 14 11:16:18.261439 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.261402 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 14 11:16:18.261439 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.261402 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 14 11:16:18.261719 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.261703 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-dc9x4\"" Jul 14 11:16:18.261811 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.261735 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 14 11:16:18.261873 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.261806 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 14 11:16:18.261943 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.261926 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 14 11:16:18.262067 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.262051 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 14 11:16:18.262146 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.262093 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 14 11:16:18.264140 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.264118 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cdd9ccdd8-j6rpr"] Jul 14 11:16:18.433526 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.433422 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9275be4d-5287-4387-9b22-0d877b068367-console-serving-cert\") pod \"console-5cdd9ccdd8-j6rpr\" (UID: \"9275be4d-5287-4387-9b22-0d877b068367\") " pod="openshift-console/console-5cdd9ccdd8-j6rpr" Jul 14 11:16:18.433526 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.433488 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9275be4d-5287-4387-9b22-0d877b068367-console-oauth-config\") pod \"console-5cdd9ccdd8-j6rpr\" (UID: \"9275be4d-5287-4387-9b22-0d877b068367\") " pod="openshift-console/console-5cdd9ccdd8-j6rpr" Jul 14 11:16:18.433526 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.433509 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltjx7\" (UniqueName: \"kubernetes.io/projected/9275be4d-5287-4387-9b22-0d877b068367-kube-api-access-ltjx7\") pod \"console-5cdd9ccdd8-j6rpr\" (UID: \"9275be4d-5287-4387-9b22-0d877b068367\") " pod="openshift-console/console-5cdd9ccdd8-j6rpr" Jul 14 11:16:18.433797 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.433602 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9275be4d-5287-4387-9b22-0d877b068367-console-config\") pod \"console-5cdd9ccdd8-j6rpr\" (UID: \"9275be4d-5287-4387-9b22-0d877b068367\") " pod="openshift-console/console-5cdd9ccdd8-j6rpr" Jul 14 11:16:18.433797 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.433639 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9275be4d-5287-4387-9b22-0d877b068367-service-ca\") pod \"console-5cdd9ccdd8-j6rpr\" (UID: \"9275be4d-5287-4387-9b22-0d877b068367\") " pod="openshift-console/console-5cdd9ccdd8-j6rpr" Jul 14 11:16:18.433797 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.433671 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9275be4d-5287-4387-9b22-0d877b068367-oauth-serving-cert\") pod \"console-5cdd9ccdd8-j6rpr\" (UID: \"9275be4d-5287-4387-9b22-0d877b068367\") " pod="openshift-console/console-5cdd9ccdd8-j6rpr" Jul 14 11:16:18.534105 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.534074 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9275be4d-5287-4387-9b22-0d877b068367-console-serving-cert\") pod \"console-5cdd9ccdd8-j6rpr\" (UID: \"9275be4d-5287-4387-9b22-0d877b068367\") " pod="openshift-console/console-5cdd9ccdd8-j6rpr" Jul 14 11:16:18.534634 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.534118 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/10775e6e-386a-4d84-b634-95dd74f20e7f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-8fksf\" (UID: \"10775e6e-386a-4d84-b634-95dd74f20e7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8fksf" Jul 14 11:16:18.534634 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.534137 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9275be4d-5287-4387-9b22-0d877b068367-console-oauth-config\") pod \"console-5cdd9ccdd8-j6rpr\" (UID: \"9275be4d-5287-4387-9b22-0d877b068367\") " pod="openshift-console/console-5cdd9ccdd8-j6rpr" Jul 14 11:16:18.534634 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.534157 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltjx7\" (UniqueName: \"kubernetes.io/projected/9275be4d-5287-4387-9b22-0d877b068367-kube-api-access-ltjx7\") pod \"console-5cdd9ccdd8-j6rpr\" (UID: \"9275be4d-5287-4387-9b22-0d877b068367\") " pod="openshift-console/console-5cdd9ccdd8-j6rpr" Jul 14 11:16:18.534634 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.534178 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9275be4d-5287-4387-9b22-0d877b068367-console-config\") pod \"console-5cdd9ccdd8-j6rpr\" (UID: \"9275be4d-5287-4387-9b22-0d877b068367\") " pod="openshift-console/console-5cdd9ccdd8-j6rpr" Jul 14 11:16:18.534634 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.534203 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9275be4d-5287-4387-9b22-0d877b068367-service-ca\") pod \"console-5cdd9ccdd8-j6rpr\" (UID: \"9275be4d-5287-4387-9b22-0d877b068367\") " pod="openshift-console/console-5cdd9ccdd8-j6rpr" Jul 14 11:16:18.534634 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.534235 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9275be4d-5287-4387-9b22-0d877b068367-oauth-serving-cert\") pod \"console-5cdd9ccdd8-j6rpr\" (UID: \"9275be4d-5287-4387-9b22-0d877b068367\") " pod="openshift-console/console-5cdd9ccdd8-j6rpr" Jul 14 11:16:18.535122 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.535056 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9275be4d-5287-4387-9b22-0d877b068367-oauth-serving-cert\") pod \"console-5cdd9ccdd8-j6rpr\" (UID: \"9275be4d-5287-4387-9b22-0d877b068367\") " pod="openshift-console/console-5cdd9ccdd8-j6rpr" Jul 14 11:16:18.535122 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.535056 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9275be4d-5287-4387-9b22-0d877b068367-service-ca\") pod \"console-5cdd9ccdd8-j6rpr\" (UID: \"9275be4d-5287-4387-9b22-0d877b068367\") " pod="openshift-console/console-5cdd9ccdd8-j6rpr" Jul 14 11:16:18.535238 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.535174 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9275be4d-5287-4387-9b22-0d877b068367-console-config\") pod \"console-5cdd9ccdd8-j6rpr\" (UID: \"9275be4d-5287-4387-9b22-0d877b068367\") " pod="openshift-console/console-5cdd9ccdd8-j6rpr" Jul 14 11:16:18.537111 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.537089 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9275be4d-5287-4387-9b22-0d877b068367-console-oauth-config\") pod \"console-5cdd9ccdd8-j6rpr\" (UID: \"9275be4d-5287-4387-9b22-0d877b068367\") " pod="openshift-console/console-5cdd9ccdd8-j6rpr" Jul 14 11:16:18.537222 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.537166 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9275be4d-5287-4387-9b22-0d877b068367-console-serving-cert\") pod \"console-5cdd9ccdd8-j6rpr\" (UID: \"9275be4d-5287-4387-9b22-0d877b068367\") " pod="openshift-console/console-5cdd9ccdd8-j6rpr" Jul 14 11:16:18.537222 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.537188 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/10775e6e-386a-4d84-b634-95dd74f20e7f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-8fksf\" (UID: \"10775e6e-386a-4d84-b634-95dd74f20e7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8fksf" Jul 14 11:16:18.556498 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.556462 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltjx7\" (UniqueName: \"kubernetes.io/projected/9275be4d-5287-4387-9b22-0d877b068367-kube-api-access-ltjx7\") pod \"console-5cdd9ccdd8-j6rpr\" (UID: \"9275be4d-5287-4387-9b22-0d877b068367\") " pod="openshift-console/console-5cdd9ccdd8-j6rpr" Jul 14 11:16:18.569503 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.569456 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cdd9ccdd8-j6rpr" Jul 14 11:16:18.688004 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.687907 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8fksf" Jul 14 11:16:18.774415 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.774376 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cdd9ccdd8-j6rpr"] Jul 14 11:16:18.777614 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:16:18.777576 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9275be4d_5287_4387_9b22_0d877b068367.slice/crio-64a0739c92f4ea859e3eac864abf8dd450eb4bc2e677d1f5c9c30f7b216c9800 WatchSource:0}: Error finding container 64a0739c92f4ea859e3eac864abf8dd450eb4bc2e677d1f5c9c30f7b216c9800: Status 404 returned error can't find the container with id 64a0739c92f4ea859e3eac864abf8dd450eb4bc2e677d1f5c9c30f7b216c9800 Jul 14 11:16:18.889367 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.889338 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-8fksf"] Jul 14 11:16:18.890605 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.890565 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cdd9ccdd8-j6rpr" event={"ID":"9275be4d-5287-4387-9b22-0d877b068367","Type":"ContainerStarted","Data":"64a0739c92f4ea859e3eac864abf8dd450eb4bc2e677d1f5c9c30f7b216c9800"} Jul 14 11:16:18.891868 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:18.891841 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cnlp8" event={"ID":"9d82e707-afa5-4354-80b7-623b97b5208b","Type":"ContainerStarted","Data":"6ec1d4a7a31b63f83876c39f961179529b5ca751af3dd6320df43fef6f4817f5"} Jul 14 11:16:19.040112 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:16:19.040080 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10775e6e_386a_4d84_b634_95dd74f20e7f.slice/crio-5f01b433f4c9e7887378506e8ef60dea5a69c2907f124e5bb962cd46ef237b70 WatchSource:0}: Error finding container 5f01b433f4c9e7887378506e8ef60dea5a69c2907f124e5bb962cd46ef237b70: Status 404 returned error can't find the container with id 5f01b433f4c9e7887378506e8ef60dea5a69c2907f124e5bb962cd46ef237b70 Jul 14 11:16:19.409561 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:19.409448 2576 patch_prober.go:28] interesting pod/image-registry-5656bffcc-jsbjr container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 14 11:16:19.409561 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:19.409513 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" podUID="b815a14c-5f38-46e4-b867-8e15735d9d50" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 11:16:19.899362 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:19.899311 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8fksf" event={"ID":"10775e6e-386a-4d84-b634-95dd74f20e7f","Type":"ContainerStarted","Data":"12a2c600de1aef1996d702b0c47f5b6b4d731efe965603bb625c865a41eeb2ca"} Jul 14 11:16:19.899861 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:19.899469 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8fksf" event={"ID":"10775e6e-386a-4d84-b634-95dd74f20e7f","Type":"ContainerStarted","Data":"fbfe59e20ac98f065983a56a39b65c353bfe9fc450ccbce7419c0ed448e845e2"} Jul 14 11:16:19.899861 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:19.899502 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8fksf" event={"ID":"10775e6e-386a-4d84-b634-95dd74f20e7f","Type":"ContainerStarted","Data":"5f01b433f4c9e7887378506e8ef60dea5a69c2907f124e5bb962cd46ef237b70"} Jul 14 11:16:19.901420 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:19.901389 2576 generic.go:356] "Generic (PLEG): container finished" podID="9d82e707-afa5-4354-80b7-623b97b5208b" containerID="999de32b6f93bbef08d7e99a5c78ef04347dee84e0bf59db5cd6f315e9a58446" exitCode=0 Jul 14 11:16:19.901570 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:19.901487 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cnlp8" event={"ID":"9d82e707-afa5-4354-80b7-623b97b5208b","Type":"ContainerDied","Data":"999de32b6f93bbef08d7e99a5c78ef04347dee84e0bf59db5cd6f315e9a58446"} Jul 14 11:16:20.856504 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:20.856470 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c2af027-67fa-46e8-8502-7b584d80674e-metrics-tls\") pod \"dns-default-tgz82\" (UID: \"3c2af027-67fa-46e8-8502-7b584d80674e\") " pod="openshift-dns/dns-default-tgz82" Jul 14 11:16:20.859121 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:20.859096 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c2af027-67fa-46e8-8502-7b584d80674e-metrics-tls\") pod \"dns-default-tgz82\" (UID: \"3c2af027-67fa-46e8-8502-7b584d80674e\") " pod="openshift-dns/dns-default-tgz82" Jul 14 11:16:20.888037 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:20.888000 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9dwb8\"" Jul 14 11:16:20.895521 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:20.895488 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tgz82" Jul 14 11:16:20.907208 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:20.907169 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8fksf" event={"ID":"10775e6e-386a-4d84-b634-95dd74f20e7f","Type":"ContainerStarted","Data":"73ee0d952f040d318adf119904a27d3ea081f74fc95fd61c4dcb7c79085a3899"} Jul 14 11:16:20.909168 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:20.909135 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cnlp8" event={"ID":"9d82e707-afa5-4354-80b7-623b97b5208b","Type":"ContainerStarted","Data":"aa2818f974483ea438e20e997b9e7fcd97e9d95a1f765919c9861301ff15db17"} Jul 14 11:16:20.909282 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:20.909187 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cnlp8" event={"ID":"9d82e707-afa5-4354-80b7-623b97b5208b","Type":"ContainerStarted","Data":"f359135a368260fad3e25e7ff91404c97b342b18381243a1dfe82cf78f36b70f"} Jul 14 11:16:20.935340 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:20.935287 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-8fksf" podStartSLOduration=2.414840792 podStartE2EDuration="3.935262923s" totalImagesPullingTime="1.520422131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:16:20.933817056 +0000 UTC m=+285.507197457" watchObservedRunningTime="2026-07-14 11:16:20.935262923 +0000 UTC m=+285.508643375" Jul 14 11:16:21.069111 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.069053 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cnlp8" podStartSLOduration=3.071628117 podStartE2EDuration="4.069025331s" totalImagesPullingTime="918.976412ms" totalInitContainerRuntime="78.420802ms" isStatefulPod=true podCreationTimestamp="2026-07-14 11:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:16:20.961813737 +0000 UTC m=+285.535194131" watchObservedRunningTime="2026-07-14 11:16:21.069025331 +0000 UTC m=+285.642405706" Jul 14 11:16:21.070088 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.070065 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7f745c758c-xtfkr"] Jul 14 11:16:21.073141 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.073117 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f745c758c-xtfkr" Jul 14 11:16:21.076026 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.075949 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tgz82"] Jul 14 11:16:21.076166 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.076149 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 14 11:16:21.079614 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.078503 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 14 11:16:21.079614 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.078726 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8pj4qit9m7ihl\"" Jul 14 11:16:21.079614 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.078753 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 14 11:16:21.079614 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.079166 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-6fhfg\"" Jul 14 11:16:21.079614 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.079209 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 14 11:16:21.079614 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.079587 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 14 11:16:21.093725 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.093695 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f745c758c-xtfkr"] Jul 14 11:16:21.158660 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.158613 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40c059fb-01e5-4bdb-845e-c4188e213a41-metrics-client-ca\") pod \"thanos-querier-7f745c758c-xtfkr\" (UID: \"40c059fb-01e5-4bdb-845e-c4188e213a41\") " pod="openshift-monitoring/thanos-querier-7f745c758c-xtfkr" Jul 14 11:16:21.158862 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.158685 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/40c059fb-01e5-4bdb-845e-c4188e213a41-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f745c758c-xtfkr\" (UID: \"40c059fb-01e5-4bdb-845e-c4188e213a41\") " pod="openshift-monitoring/thanos-querier-7f745c758c-xtfkr" Jul 14 11:16:21.158862 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.158765 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/40c059fb-01e5-4bdb-845e-c4188e213a41-secret-grpc-tls\") pod \"thanos-querier-7f745c758c-xtfkr\" (UID: \"40c059fb-01e5-4bdb-845e-c4188e213a41\") " pod="openshift-monitoring/thanos-querier-7f745c758c-xtfkr" Jul 14 11:16:21.158862 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.158810 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/40c059fb-01e5-4bdb-845e-c4188e213a41-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f745c758c-xtfkr\" (UID: \"40c059fb-01e5-4bdb-845e-c4188e213a41\") " pod="openshift-monitoring/thanos-querier-7f745c758c-xtfkr" Jul 14 11:16:21.158862 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.158855 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpmjj\" (UniqueName: \"kubernetes.io/projected/40c059fb-01e5-4bdb-845e-c4188e213a41-kube-api-access-gpmjj\") pod \"thanos-querier-7f745c758c-xtfkr\" (UID: \"40c059fb-01e5-4bdb-845e-c4188e213a41\") " pod="openshift-monitoring/thanos-querier-7f745c758c-xtfkr" Jul 14 11:16:21.159059 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.158963 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/40c059fb-01e5-4bdb-845e-c4188e213a41-secret-thanos-querier-tls\") pod \"thanos-querier-7f745c758c-xtfkr\" (UID: \"40c059fb-01e5-4bdb-845e-c4188e213a41\") " pod="openshift-monitoring/thanos-querier-7f745c758c-xtfkr" Jul 14 11:16:21.159059 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.159025 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40c059fb-01e5-4bdb-845e-c4188e213a41-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f745c758c-xtfkr\" (UID: \"40c059fb-01e5-4bdb-845e-c4188e213a41\") " pod="openshift-monitoring/thanos-querier-7f745c758c-xtfkr" Jul 14 11:16:21.159165 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.159065 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40c059fb-01e5-4bdb-845e-c4188e213a41-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f745c758c-xtfkr\" (UID: \"40c059fb-01e5-4bdb-845e-c4188e213a41\") " pod="openshift-monitoring/thanos-querier-7f745c758c-xtfkr" Jul 14 11:16:21.260445 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.260350 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/40c059fb-01e5-4bdb-845e-c4188e213a41-secret-grpc-tls\") pod \"thanos-querier-7f745c758c-xtfkr\" (UID: \"40c059fb-01e5-4bdb-845e-c4188e213a41\") " pod="openshift-monitoring/thanos-querier-7f745c758c-xtfkr" Jul 14 11:16:21.260445 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.260395 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/40c059fb-01e5-4bdb-845e-c4188e213a41-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f745c758c-xtfkr\" (UID: \"40c059fb-01e5-4bdb-845e-c4188e213a41\") " pod="openshift-monitoring/thanos-querier-7f745c758c-xtfkr" Jul 14 11:16:21.260718 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.260600 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpmjj\" (UniqueName: \"kubernetes.io/projected/40c059fb-01e5-4bdb-845e-c4188e213a41-kube-api-access-gpmjj\") pod \"thanos-querier-7f745c758c-xtfkr\" (UID: \"40c059fb-01e5-4bdb-845e-c4188e213a41\") " pod="openshift-monitoring/thanos-querier-7f745c758c-xtfkr" Jul 14 11:16:21.260718 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.260664 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/40c059fb-01e5-4bdb-845e-c4188e213a41-secret-thanos-querier-tls\") pod \"thanos-querier-7f745c758c-xtfkr\" (UID: \"40c059fb-01e5-4bdb-845e-c4188e213a41\") " pod="openshift-monitoring/thanos-querier-7f745c758c-xtfkr" Jul 14 11:16:21.260718 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.260712 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40c059fb-01e5-4bdb-845e-c4188e213a41-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f745c758c-xtfkr\" (UID: \"40c059fb-01e5-4bdb-845e-c4188e213a41\") " pod="openshift-monitoring/thanos-querier-7f745c758c-xtfkr" Jul 14 11:16:21.260880 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.260750 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40c059fb-01e5-4bdb-845e-c4188e213a41-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f745c758c-xtfkr\" (UID: \"40c059fb-01e5-4bdb-845e-c4188e213a41\") " pod="openshift-monitoring/thanos-querier-7f745c758c-xtfkr" Jul 14 11:16:21.260880 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.260804 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40c059fb-01e5-4bdb-845e-c4188e213a41-metrics-client-ca\") pod \"thanos-querier-7f745c758c-xtfkr\" (UID: \"40c059fb-01e5-4bdb-845e-c4188e213a41\") " pod="openshift-monitoring/thanos-querier-7f745c758c-xtfkr" Jul 14 11:16:21.260880 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.260843 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/40c059fb-01e5-4bdb-845e-c4188e213a41-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f745c758c-xtfkr\" (UID: \"40c059fb-01e5-4bdb-845e-c4188e213a41\") " pod="openshift-monitoring/thanos-querier-7f745c758c-xtfkr" Jul 14 11:16:21.261964 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.261936 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40c059fb-01e5-4bdb-845e-c4188e213a41-metrics-client-ca\") pod \"thanos-querier-7f745c758c-xtfkr\" (UID: \"40c059fb-01e5-4bdb-845e-c4188e213a41\") " pod="openshift-monitoring/thanos-querier-7f745c758c-xtfkr" Jul 14 11:16:21.263803 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.263777 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/40c059fb-01e5-4bdb-845e-c4188e213a41-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f745c758c-xtfkr\" (UID: \"40c059fb-01e5-4bdb-845e-c4188e213a41\") " pod="openshift-monitoring/thanos-querier-7f745c758c-xtfkr" Jul 14 11:16:21.264366 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.264179 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/40c059fb-01e5-4bdb-845e-c4188e213a41-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f745c758c-xtfkr\" (UID: \"40c059fb-01e5-4bdb-845e-c4188e213a41\") " pod="openshift-monitoring/thanos-querier-7f745c758c-xtfkr" Jul 14 11:16:21.264366 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.264299 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40c059fb-01e5-4bdb-845e-c4188e213a41-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f745c758c-xtfkr\" (UID: \"40c059fb-01e5-4bdb-845e-c4188e213a41\") " pod="openshift-monitoring/thanos-querier-7f745c758c-xtfkr" Jul 14 11:16:21.264564 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.264512 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40c059fb-01e5-4bdb-845e-c4188e213a41-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f745c758c-xtfkr\" (UID: \"40c059fb-01e5-4bdb-845e-c4188e213a41\") " pod="openshift-monitoring/thanos-querier-7f745c758c-xtfkr" Jul 14 11:16:21.264893 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.264872 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/40c059fb-01e5-4bdb-845e-c4188e213a41-secret-thanos-querier-tls\") pod \"thanos-querier-7f745c758c-xtfkr\" (UID: \"40c059fb-01e5-4bdb-845e-c4188e213a41\") " pod="openshift-monitoring/thanos-querier-7f745c758c-xtfkr" Jul 14 11:16:21.265059 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.265038 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/40c059fb-01e5-4bdb-845e-c4188e213a41-secret-grpc-tls\") pod \"thanos-querier-7f745c758c-xtfkr\" (UID: \"40c059fb-01e5-4bdb-845e-c4188e213a41\") " pod="openshift-monitoring/thanos-querier-7f745c758c-xtfkr" Jul 14 11:16:21.271743 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.271718 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpmjj\" (UniqueName: \"kubernetes.io/projected/40c059fb-01e5-4bdb-845e-c4188e213a41-kube-api-access-gpmjj\") pod \"thanos-querier-7f745c758c-xtfkr\" (UID: \"40c059fb-01e5-4bdb-845e-c4188e213a41\") " pod="openshift-monitoring/thanos-querier-7f745c758c-xtfkr" Jul 14 11:16:21.397004 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.396959 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f745c758c-xtfkr" Jul 14 11:16:21.915028 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:21.914989 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tgz82" event={"ID":"3c2af027-67fa-46e8-8502-7b584d80674e","Type":"ContainerStarted","Data":"85a997dbbac811193b8d7d6747e654f8c8fdd9447d85f042934e4547c2d7e25e"} Jul 14 11:16:22.295872 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:22.295846 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f745c758c-xtfkr"] Jul 14 11:16:22.298611 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:16:22.298558 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40c059fb_01e5_4bdb_845e_c4188e213a41.slice/crio-3a783bb161f8c5fb1006ceb5554841263c635a8dbea57c24b0df586f60e1a006 WatchSource:0}: Error finding container 3a783bb161f8c5fb1006ceb5554841263c635a8dbea57c24b0df586f60e1a006: Status 404 returned error can't find the container with id 3a783bb161f8c5fb1006ceb5554841263c635a8dbea57c24b0df586f60e1a006 Jul 14 11:16:22.526827 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:22.526791 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-s6dd5"] Jul 14 11:16:22.530688 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:22.530659 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-s6dd5" Jul 14 11:16:22.533867 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:22.533796 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-gb2dj\"" Jul 14 11:16:22.534050 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:22.533958 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 14 11:16:22.542952 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:22.542906 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-s6dd5"] Jul 14 11:16:22.675566 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:22.675510 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0862349d-af9b-45f6-8227-6ab44f85edcc-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-s6dd5\" (UID: \"0862349d-af9b-45f6-8227-6ab44f85edcc\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-s6dd5" Jul 14 11:16:22.675753 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:22.675586 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdpxs\" (UniqueName: \"kubernetes.io/projected/0862349d-af9b-45f6-8227-6ab44f85edcc-kube-api-access-hdpxs\") pod \"monitoring-plugin-5f68df7f58-s6dd5\" (UID: \"0862349d-af9b-45f6-8227-6ab44f85edcc\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-s6dd5" Jul 14 11:16:22.777170 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:22.777074 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0862349d-af9b-45f6-8227-6ab44f85edcc-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-s6dd5\" (UID: \"0862349d-af9b-45f6-8227-6ab44f85edcc\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-s6dd5" Jul 14 11:16:22.777170 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:22.777121 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdpxs\" (UniqueName: \"kubernetes.io/projected/0862349d-af9b-45f6-8227-6ab44f85edcc-kube-api-access-hdpxs\") pod \"monitoring-plugin-5f68df7f58-s6dd5\" (UID: \"0862349d-af9b-45f6-8227-6ab44f85edcc\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-s6dd5" Jul 14 11:16:22.780611 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:22.780582 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0862349d-af9b-45f6-8227-6ab44f85edcc-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-s6dd5\" (UID: \"0862349d-af9b-45f6-8227-6ab44f85edcc\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-s6dd5" Jul 14 11:16:22.787206 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:22.787171 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdpxs\" (UniqueName: \"kubernetes.io/projected/0862349d-af9b-45f6-8227-6ab44f85edcc-kube-api-access-hdpxs\") pod \"monitoring-plugin-5f68df7f58-s6dd5\" (UID: \"0862349d-af9b-45f6-8227-6ab44f85edcc\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-s6dd5" Jul 14 11:16:22.844744 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:22.844706 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-s6dd5" Jul 14 11:16:22.920521 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:22.920476 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cdd9ccdd8-j6rpr" event={"ID":"9275be4d-5287-4387-9b22-0d877b068367","Type":"ContainerStarted","Data":"24acfb1a870c90d2975fe2884a43c11a1ea1d7ca319106c04f8c455fa9f7e13c"} Jul 14 11:16:22.921901 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:22.921876 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f745c758c-xtfkr" event={"ID":"40c059fb-01e5-4bdb-845e-c4188e213a41","Type":"ContainerStarted","Data":"3a783bb161f8c5fb1006ceb5554841263c635a8dbea57c24b0df586f60e1a006"} Jul 14 11:16:23.511863 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:23.511766 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cdd9ccdd8-j6rpr" podStartSLOduration=2.081580903 podStartE2EDuration="5.511741796s" totalImagesPullingTime="3.430160893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:16:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:16:22.94204403 +0000 UTC m=+287.515424434" watchObservedRunningTime="2026-07-14 11:16:23.511741796 +0000 UTC m=+288.085122171" Jul 14 11:16:23.513148 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:23.513083 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-s6dd5"] Jul 14 11:16:23.517846 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:16:23.517817 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0862349d_af9b_45f6_8227_6ab44f85edcc.slice/crio-56b2a5b1c26569ff3a43d5af5e7dd8c4fdc077d8b451fa1b9aa6326e74a4f3e1 WatchSource:0}: Error finding container 56b2a5b1c26569ff3a43d5af5e7dd8c4fdc077d8b451fa1b9aa6326e74a4f3e1: Status 404 returned error can't find the container with id 56b2a5b1c26569ff3a43d5af5e7dd8c4fdc077d8b451fa1b9aa6326e74a4f3e1 Jul 14 11:16:23.929414 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:23.929311 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-s6dd5" event={"ID":"0862349d-af9b-45f6-8227-6ab44f85edcc","Type":"ContainerStarted","Data":"56b2a5b1c26569ff3a43d5af5e7dd8c4fdc077d8b451fa1b9aa6326e74a4f3e1"} Jul 14 11:16:23.933791 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:23.933748 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tgz82" event={"ID":"3c2af027-67fa-46e8-8502-7b584d80674e","Type":"ContainerStarted","Data":"9ea6bf03906ecbd999df3faad32068866f3cab9721419d3a0d2a3f0770316fbd"} Jul 14 11:16:23.933990 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:23.933804 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tgz82" event={"ID":"3c2af027-67fa-46e8-8502-7b584d80674e","Type":"ContainerStarted","Data":"5d13b609b70aa3edbc91b8b2aa2cbd42e04bae0dedfa7322568dcff2a4d2defe"} Jul 14 11:16:23.954688 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:23.954623 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tgz82" podStartSLOduration=251.634877216 podStartE2EDuration="4m13.954597246s" totalImagesPullingTime="2.31972003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:12:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:16:23.953384187 +0000 UTC m=+288.526764569" watchObservedRunningTime="2026-07-14 11:16:23.954597246 +0000 UTC m=+288.527977622" Jul 14 11:16:24.940136 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:24.940025 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f745c758c-xtfkr" event={"ID":"40c059fb-01e5-4bdb-845e-c4188e213a41","Type":"ContainerStarted","Data":"1e736680fc7a1272fbccd968d8acb84805d744c4216fd59baea136523aebe765"} Jul 14 11:16:24.940481 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:24.940151 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f745c758c-xtfkr" event={"ID":"40c059fb-01e5-4bdb-845e-c4188e213a41","Type":"ContainerStarted","Data":"545a10327747dba2cffe156a7fc2c30d83032cd9bb8995b8ceb333db114580f4"} Jul 14 11:16:24.940481 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:24.940186 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tgz82" Jul 14 11:16:24.940481 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:24.940209 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f745c758c-xtfkr" event={"ID":"40c059fb-01e5-4bdb-845e-c4188e213a41","Type":"ContainerStarted","Data":"08a7155167aae4c5fb311ff1c194880bc0c2807ebbec37679032a4e93128f7e4"} Jul 14 11:16:25.946308 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:25.946269 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-s6dd5" event={"ID":"0862349d-af9b-45f6-8227-6ab44f85edcc","Type":"ContainerStarted","Data":"72a67253111e6e8b9f5ce6d336579e95e45c1b4268f123638f553306909feeb9"} Jul 14 11:16:25.946913 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:25.946884 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-s6dd5" Jul 14 11:16:25.952708 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:25.952676 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-s6dd5" Jul 14 11:16:25.970942 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:25.970887 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-s6dd5" podStartSLOduration=2.031055862 podStartE2EDuration="3.970868555s" totalImagesPullingTime="1.939812693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:16:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:16:25.969512012 +0000 UTC m=+290.542892396" watchObservedRunningTime="2026-07-14 11:16:25.970868555 +0000 UTC m=+290.544248929" Jul 14 11:16:26.953025 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:26.952988 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f745c758c-xtfkr" event={"ID":"40c059fb-01e5-4bdb-845e-c4188e213a41","Type":"ContainerStarted","Data":"e75f16d995c188c80f8ea92731c15a784a617338a11e19e93c4d2c29d4e6f1f8"} Jul 14 11:16:26.953446 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:26.953058 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f745c758c-xtfkr" event={"ID":"40c059fb-01e5-4bdb-845e-c4188e213a41","Type":"ContainerStarted","Data":"a6b601c3ac8c149dc7f51b82129d2420e98e1f65575d807a7cfe5ecca733122d"} Jul 14 11:16:26.953446 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:26.953085 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f745c758c-xtfkr" event={"ID":"40c059fb-01e5-4bdb-845e-c4188e213a41","Type":"ContainerStarted","Data":"178a9766836bd4f29e6c8282b963abe3cbb9cc59b16a1b35e457bed8d15d08e2"} Jul 14 11:16:26.953446 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:26.953181 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7f745c758c-xtfkr" Jul 14 11:16:26.978283 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:26.978223 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7f745c758c-xtfkr" podStartSLOduration=2.499403059 podStartE2EDuration="5.97820276s" totalImagesPullingTime="3.478799701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:16:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:16:26.976124311 +0000 UTC m=+291.549504684" watchObservedRunningTime="2026-07-14 11:16:26.97820276 +0000 UTC m=+291.551583177" Jul 14 11:16:27.955286 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:16:27.955223 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-pql69" podUID="8792ce35-00f9-4101-aab2-346a02150768" Jul 14 11:16:28.570456 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:28.570408 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cdd9ccdd8-j6rpr" Jul 14 11:16:28.570677 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:28.570489 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cdd9ccdd8-j6rpr" Jul 14 11:16:28.575600 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:28.575574 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cdd9ccdd8-j6rpr" Jul 14 11:16:28.965355 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:28.965326 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cdd9ccdd8-j6rpr" Jul 14 11:16:29.412060 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:29.411976 2576 patch_prober.go:28] interesting pod/image-registry-5656bffcc-jsbjr container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 14 11:16:29.412060 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:29.412031 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" podUID="b815a14c-5f38-46e4-b867-8e15735d9d50" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 11:16:32.965307 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:32.965279 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7f745c758c-xtfkr" Jul 14 11:16:34.427490 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:34.427449 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" podUID="b815a14c-5f38-46e4-b867-8e15735d9d50" containerName="registry" containerID="cri-o://31d4a3f6395f3d8e52ef6986d97d18febae31754fa8e42d5a4096ce84786caa5" gracePeriod=30 Jul 14 11:16:34.672139 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:34.672106 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" Jul 14 11:16:34.688695 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:34.688604 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b815a14c-5f38-46e4-b867-8e15735d9d50-image-registry-private-configuration\") pod \"b815a14c-5f38-46e4-b867-8e15735d9d50\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " Jul 14 11:16:34.688695 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:34.688688 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b815a14c-5f38-46e4-b867-8e15735d9d50-installation-pull-secrets\") pod \"b815a14c-5f38-46e4-b867-8e15735d9d50\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " Jul 14 11:16:34.688911 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:34.688732 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b815a14c-5f38-46e4-b867-8e15735d9d50-ca-trust-extracted\") pod \"b815a14c-5f38-46e4-b867-8e15735d9d50\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " Jul 14 11:16:34.688911 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:34.688771 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b815a14c-5f38-46e4-b867-8e15735d9d50-registry-certificates\") pod \"b815a14c-5f38-46e4-b867-8e15735d9d50\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " Jul 14 11:16:34.688911 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:34.688803 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b815a14c-5f38-46e4-b867-8e15735d9d50-registry-tls\") pod \"b815a14c-5f38-46e4-b867-8e15735d9d50\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " Jul 14 11:16:34.688911 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:34.688843 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b815a14c-5f38-46e4-b867-8e15735d9d50-bound-sa-token\") pod \"b815a14c-5f38-46e4-b867-8e15735d9d50\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " Jul 14 11:16:34.688911 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:34.688866 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7fzz\" (UniqueName: \"kubernetes.io/projected/b815a14c-5f38-46e4-b867-8e15735d9d50-kube-api-access-g7fzz\") pod \"b815a14c-5f38-46e4-b867-8e15735d9d50\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " Jul 14 11:16:34.688911 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:34.688902 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b815a14c-5f38-46e4-b867-8e15735d9d50-trusted-ca\") pod \"b815a14c-5f38-46e4-b867-8e15735d9d50\" (UID: \"b815a14c-5f38-46e4-b867-8e15735d9d50\") " Jul 14 11:16:34.689267 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:34.689208 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b815a14c-5f38-46e4-b867-8e15735d9d50-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b815a14c-5f38-46e4-b867-8e15735d9d50" (UID: "b815a14c-5f38-46e4-b867-8e15735d9d50"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:16:34.689769 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:34.689739 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b815a14c-5f38-46e4-b867-8e15735d9d50-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b815a14c-5f38-46e4-b867-8e15735d9d50" (UID: "b815a14c-5f38-46e4-b867-8e15735d9d50"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:16:34.691337 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:34.691303 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b815a14c-5f38-46e4-b867-8e15735d9d50-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b815a14c-5f38-46e4-b867-8e15735d9d50" (UID: "b815a14c-5f38-46e4-b867-8e15735d9d50"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:16:34.691337 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:34.691319 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b815a14c-5f38-46e4-b867-8e15735d9d50-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b815a14c-5f38-46e4-b867-8e15735d9d50" (UID: "b815a14c-5f38-46e4-b867-8e15735d9d50"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:16:34.691618 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:34.691595 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b815a14c-5f38-46e4-b867-8e15735d9d50-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b815a14c-5f38-46e4-b867-8e15735d9d50" (UID: "b815a14c-5f38-46e4-b867-8e15735d9d50"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:16:34.691696 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:34.691663 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b815a14c-5f38-46e4-b867-8e15735d9d50-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b815a14c-5f38-46e4-b867-8e15735d9d50" (UID: "b815a14c-5f38-46e4-b867-8e15735d9d50"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:16:34.691869 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:34.691847 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b815a14c-5f38-46e4-b867-8e15735d9d50-kube-api-access-g7fzz" (OuterVolumeSpecName: "kube-api-access-g7fzz") pod "b815a14c-5f38-46e4-b867-8e15735d9d50" (UID: "b815a14c-5f38-46e4-b867-8e15735d9d50"). InnerVolumeSpecName "kube-api-access-g7fzz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:16:34.699070 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:34.699036 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b815a14c-5f38-46e4-b867-8e15735d9d50-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b815a14c-5f38-46e4-b867-8e15735d9d50" (UID: "b815a14c-5f38-46e4-b867-8e15735d9d50"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 11:16:34.789899 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:34.789843 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7fzz\" (UniqueName: \"kubernetes.io/projected/b815a14c-5f38-46e4-b867-8e15735d9d50-kube-api-access-g7fzz\") on node \"ip-10-0-139-35.ec2.internal\" DevicePath \"\"" Jul 14 11:16:34.789899 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:34.789886 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b815a14c-5f38-46e4-b867-8e15735d9d50-trusted-ca\") on node \"ip-10-0-139-35.ec2.internal\" DevicePath \"\"" Jul 14 11:16:34.789899 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:34.789900 2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b815a14c-5f38-46e4-b867-8e15735d9d50-image-registry-private-configuration\") on node \"ip-10-0-139-35.ec2.internal\" DevicePath \"\"" Jul 14 11:16:34.790156 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:34.789913 2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b815a14c-5f38-46e4-b867-8e15735d9d50-installation-pull-secrets\") on node \"ip-10-0-139-35.ec2.internal\" DevicePath \"\"" Jul 14 11:16:34.790156 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:34.789926 2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b815a14c-5f38-46e4-b867-8e15735d9d50-ca-trust-extracted\") on node \"ip-10-0-139-35.ec2.internal\" DevicePath \"\"" Jul 14 11:16:34.790156 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:34.789937 2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b815a14c-5f38-46e4-b867-8e15735d9d50-registry-certificates\") on node \"ip-10-0-139-35.ec2.internal\" DevicePath \"\"" Jul 14 11:16:34.790156 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:34.789949 2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b815a14c-5f38-46e4-b867-8e15735d9d50-registry-tls\") on node \"ip-10-0-139-35.ec2.internal\" DevicePath \"\"" Jul 14 11:16:34.790156 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:34.789959 2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b815a14c-5f38-46e4-b867-8e15735d9d50-bound-sa-token\") on node \"ip-10-0-139-35.ec2.internal\" DevicePath \"\"" Jul 14 11:16:34.948705 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:34.948611 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tgz82" Jul 14 11:16:34.986307 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:34.986269 2576 generic.go:356] "Generic (PLEG): container finished" podID="b815a14c-5f38-46e4-b867-8e15735d9d50" containerID="31d4a3f6395f3d8e52ef6986d97d18febae31754fa8e42d5a4096ce84786caa5" exitCode=0 Jul 14 11:16:34.986453 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:34.986329 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" Jul 14 11:16:34.986453 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:34.986357 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" event={"ID":"b815a14c-5f38-46e4-b867-8e15735d9d50","Type":"ContainerDied","Data":"31d4a3f6395f3d8e52ef6986d97d18febae31754fa8e42d5a4096ce84786caa5"} Jul 14 11:16:34.986453 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:34.986417 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5656bffcc-jsbjr" event={"ID":"b815a14c-5f38-46e4-b867-8e15735d9d50","Type":"ContainerDied","Data":"9c194f9fdf0a04248fa7136131b98880ff655d48977a15e098e8ee4915f782f2"} Jul 14 11:16:34.986453 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:34.986447 2576 scope.go:117] "RemoveContainer" containerID="31d4a3f6395f3d8e52ef6986d97d18febae31754fa8e42d5a4096ce84786caa5" Jul 14 11:16:34.997206 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:34.997177 2576 scope.go:117] "RemoveContainer" containerID="31d4a3f6395f3d8e52ef6986d97d18febae31754fa8e42d5a4096ce84786caa5" Jul 14 11:16:34.997531 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:16:34.997510 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31d4a3f6395f3d8e52ef6986d97d18febae31754fa8e42d5a4096ce84786caa5\": container with ID starting with 31d4a3f6395f3d8e52ef6986d97d18febae31754fa8e42d5a4096ce84786caa5 not found: ID does not exist" containerID="31d4a3f6395f3d8e52ef6986d97d18febae31754fa8e42d5a4096ce84786caa5" Jul 14 11:16:34.997622 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:34.997564 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31d4a3f6395f3d8e52ef6986d97d18febae31754fa8e42d5a4096ce84786caa5"} err="failed to get container status \"31d4a3f6395f3d8e52ef6986d97d18febae31754fa8e42d5a4096ce84786caa5\": rpc error: code = NotFound desc = could not find container \"31d4a3f6395f3d8e52ef6986d97d18febae31754fa8e42d5a4096ce84786caa5\": container with ID starting with 31d4a3f6395f3d8e52ef6986d97d18febae31754fa8e42d5a4096ce84786caa5 not found: ID does not exist" Jul 14 11:16:35.010028 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:35.010004 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5656bffcc-jsbjr"] Jul 14 11:16:35.014405 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:35.014379 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5656bffcc-jsbjr"] Jul 14 11:16:35.828119 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:35.828088 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvhwc_720aefb6-81a1-44d1-a01f-4bc07ff30465/ovn-acl-logging/0.log" Jul 14 11:16:35.828906 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:35.828881 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvhwc_720aefb6-81a1-44d1-a01f-4bc07ff30465/ovn-acl-logging/0.log" Jul 14 11:16:35.840286 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:35.840256 2576 kubelet.go:1648] "Image garbage collection succeeded" Jul 14 11:16:35.960172 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:35.960033 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b815a14c-5f38-46e4-b867-8e15735d9d50" path="/var/lib/kubelet/pods/b815a14c-5f38-46e4-b867-8e15735d9d50/volumes" Jul 14 11:16:39.312194 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:39.312159 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cdd9ccdd8-j6rpr"] Jul 14 11:16:39.963508 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:39.963471 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:16:57.069062 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:57.069027 2576 generic.go:356] "Generic (PLEG): container finished" podID="3128342d-d07b-428a-9e8c-9fd701bf417d" containerID="6c2a4666a4954ea56908380e672775d1a736248a84bb600b24f6faf152267d0c" exitCode=0 Jul 14 11:16:57.069473 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:57.069104 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-xdbds" event={"ID":"3128342d-d07b-428a-9e8c-9fd701bf417d","Type":"ContainerDied","Data":"6c2a4666a4954ea56908380e672775d1a736248a84bb600b24f6faf152267d0c"} Jul 14 11:16:57.069473 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:57.069448 2576 scope.go:117] "RemoveContainer" containerID="6c2a4666a4954ea56908380e672775d1a736248a84bb600b24f6faf152267d0c" Jul 14 11:16:58.075005 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:16:58.074967 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-xdbds" event={"ID":"3128342d-d07b-428a-9e8c-9fd701bf417d","Type":"ContainerStarted","Data":"258e8ead009dd5e960aef5c24654a634a57b5fb89cbd4550aaee25520af839d5"} Jul 14 11:17:04.339467 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:04.339401 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5cdd9ccdd8-j6rpr" podUID="9275be4d-5287-4387-9b22-0d877b068367" containerName="console" containerID="cri-o://24acfb1a870c90d2975fe2884a43c11a1ea1d7ca319106c04f8c455fa9f7e13c" gracePeriod=15 Jul 14 11:17:04.597147 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:04.597082 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cdd9ccdd8-j6rpr" Jul 14 11:17:04.749997 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:04.749955 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9275be4d-5287-4387-9b22-0d877b068367-console-serving-cert\") pod \"9275be4d-5287-4387-9b22-0d877b068367\" (UID: \"9275be4d-5287-4387-9b22-0d877b068367\") " Jul 14 11:17:04.749997 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:04.749997 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9275be4d-5287-4387-9b22-0d877b068367-service-ca\") pod \"9275be4d-5287-4387-9b22-0d877b068367\" (UID: \"9275be4d-5287-4387-9b22-0d877b068367\") " Jul 14 11:17:04.750242 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:04.750050 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9275be4d-5287-4387-9b22-0d877b068367-console-oauth-config\") pod \"9275be4d-5287-4387-9b22-0d877b068367\" (UID: \"9275be4d-5287-4387-9b22-0d877b068367\") " Jul 14 11:17:04.750242 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:04.750071 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9275be4d-5287-4387-9b22-0d877b068367-oauth-serving-cert\") pod \"9275be4d-5287-4387-9b22-0d877b068367\" (UID: \"9275be4d-5287-4387-9b22-0d877b068367\") " Jul 14 11:17:04.750242 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:04.750107 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9275be4d-5287-4387-9b22-0d877b068367-console-config\") pod \"9275be4d-5287-4387-9b22-0d877b068367\" (UID: \"9275be4d-5287-4387-9b22-0d877b068367\") " Jul 14 11:17:04.750242 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:04.750166 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltjx7\" (UniqueName: \"kubernetes.io/projected/9275be4d-5287-4387-9b22-0d877b068367-kube-api-access-ltjx7\") pod \"9275be4d-5287-4387-9b22-0d877b068367\" (UID: \"9275be4d-5287-4387-9b22-0d877b068367\") " Jul 14 11:17:04.750593 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:04.750551 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9275be4d-5287-4387-9b22-0d877b068367-console-config" (OuterVolumeSpecName: "console-config") pod "9275be4d-5287-4387-9b22-0d877b068367" (UID: "9275be4d-5287-4387-9b22-0d877b068367"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:17:04.750593 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:04.750579 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9275be4d-5287-4387-9b22-0d877b068367-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9275be4d-5287-4387-9b22-0d877b068367" (UID: "9275be4d-5287-4387-9b22-0d877b068367"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:17:04.750713 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:04.750572 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9275be4d-5287-4387-9b22-0d877b068367-service-ca" (OuterVolumeSpecName: "service-ca") pod "9275be4d-5287-4387-9b22-0d877b068367" (UID: "9275be4d-5287-4387-9b22-0d877b068367"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:17:04.752522 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:04.752497 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9275be4d-5287-4387-9b22-0d877b068367-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9275be4d-5287-4387-9b22-0d877b068367" (UID: "9275be4d-5287-4387-9b22-0d877b068367"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:17:04.752640 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:04.752568 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9275be4d-5287-4387-9b22-0d877b068367-kube-api-access-ltjx7" (OuterVolumeSpecName: "kube-api-access-ltjx7") pod "9275be4d-5287-4387-9b22-0d877b068367" (UID: "9275be4d-5287-4387-9b22-0d877b068367"). InnerVolumeSpecName "kube-api-access-ltjx7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:17:04.752702 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:04.752638 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9275be4d-5287-4387-9b22-0d877b068367-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9275be4d-5287-4387-9b22-0d877b068367" (UID: "9275be4d-5287-4387-9b22-0d877b068367"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:17:04.850909 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:04.850822 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltjx7\" (UniqueName: \"kubernetes.io/projected/9275be4d-5287-4387-9b22-0d877b068367-kube-api-access-ltjx7\") on node \"ip-10-0-139-35.ec2.internal\" DevicePath \"\"" Jul 14 11:17:04.850909 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:04.850853 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9275be4d-5287-4387-9b22-0d877b068367-console-serving-cert\") on node \"ip-10-0-139-35.ec2.internal\" DevicePath \"\"" Jul 14 11:17:04.850909 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:04.850864 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9275be4d-5287-4387-9b22-0d877b068367-service-ca\") on node \"ip-10-0-139-35.ec2.internal\" DevicePath \"\"" Jul 14 11:17:04.850909 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:04.850877 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9275be4d-5287-4387-9b22-0d877b068367-console-oauth-config\") on node \"ip-10-0-139-35.ec2.internal\" DevicePath \"\"" Jul 14 11:17:04.850909 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:04.850886 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9275be4d-5287-4387-9b22-0d877b068367-oauth-serving-cert\") on node \"ip-10-0-139-35.ec2.internal\" DevicePath \"\"" Jul 14 11:17:04.850909 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:04.850895 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9275be4d-5287-4387-9b22-0d877b068367-console-config\") on node \"ip-10-0-139-35.ec2.internal\" DevicePath \"\"" Jul 14 11:17:05.101484 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:05.101389 2576 generic.go:356] "Generic (PLEG): container finished" podID="9275be4d-5287-4387-9b22-0d877b068367" containerID="24acfb1a870c90d2975fe2884a43c11a1ea1d7ca319106c04f8c455fa9f7e13c" exitCode=0 Jul 14 11:17:05.101484 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:05.101427 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cdd9ccdd8-j6rpr" event={"ID":"9275be4d-5287-4387-9b22-0d877b068367","Type":"ContainerDied","Data":"24acfb1a870c90d2975fe2884a43c11a1ea1d7ca319106c04f8c455fa9f7e13c"} Jul 14 11:17:05.101484 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:05.101443 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cdd9ccdd8-j6rpr" Jul 14 11:17:05.101484 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:05.101486 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cdd9ccdd8-j6rpr" event={"ID":"9275be4d-5287-4387-9b22-0d877b068367","Type":"ContainerDied","Data":"64a0739c92f4ea859e3eac864abf8dd450eb4bc2e677d1f5c9c30f7b216c9800"} Jul 14 11:17:05.101837 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:05.101507 2576 scope.go:117] "RemoveContainer" containerID="24acfb1a870c90d2975fe2884a43c11a1ea1d7ca319106c04f8c455fa9f7e13c" Jul 14 11:17:05.110693 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:05.110674 2576 scope.go:117] "RemoveContainer" containerID="24acfb1a870c90d2975fe2884a43c11a1ea1d7ca319106c04f8c455fa9f7e13c" Jul 14 11:17:05.110980 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:17:05.110960 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24acfb1a870c90d2975fe2884a43c11a1ea1d7ca319106c04f8c455fa9f7e13c\": container with ID starting with 24acfb1a870c90d2975fe2884a43c11a1ea1d7ca319106c04f8c455fa9f7e13c not found: ID does not exist" containerID="24acfb1a870c90d2975fe2884a43c11a1ea1d7ca319106c04f8c455fa9f7e13c" Jul 14 11:17:05.111028 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:05.110990 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24acfb1a870c90d2975fe2884a43c11a1ea1d7ca319106c04f8c455fa9f7e13c"} err="failed to get container status \"24acfb1a870c90d2975fe2884a43c11a1ea1d7ca319106c04f8c455fa9f7e13c\": rpc error: code = NotFound desc = could not find container \"24acfb1a870c90d2975fe2884a43c11a1ea1d7ca319106c04f8c455fa9f7e13c\": container with ID starting with 24acfb1a870c90d2975fe2884a43c11a1ea1d7ca319106c04f8c455fa9f7e13c not found: ID does not exist" Jul 14 11:17:05.124779 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:05.124733 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cdd9ccdd8-j6rpr"] Jul 14 11:17:05.128459 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:05.128422 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cdd9ccdd8-j6rpr"] Jul 14 11:17:05.960918 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:05.960885 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9275be4d-5287-4387-9b22-0d877b068367" path="/var/lib/kubelet/pods/9275be4d-5287-4387-9b22-0d877b068367/volumes" Jul 14 11:17:08.115740 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:08.115706 2576 generic.go:356] "Generic (PLEG): container finished" podID="3ce79a00-8cf5-4047-b927-cbdea4048663" containerID="90c45b000e93c829a840da2ec646b440e37c2210238bb659ef9967f8bea0e828" exitCode=0 Jul 14 11:17:08.115740 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:08.115754 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zvcpj" event={"ID":"3ce79a00-8cf5-4047-b927-cbdea4048663","Type":"ContainerDied","Data":"90c45b000e93c829a840da2ec646b440e37c2210238bb659ef9967f8bea0e828"} Jul 14 11:17:08.116251 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:08.116110 2576 scope.go:117] "RemoveContainer" containerID="90c45b000e93c829a840da2ec646b440e37c2210238bb659ef9967f8bea0e828" Jul 14 11:17:09.123011 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:09.122977 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-zvcpj" event={"ID":"3ce79a00-8cf5-4047-b927-cbdea4048663","Type":"ContainerStarted","Data":"fb4f7194f7e228332ba26ba522d85e651e1ef827e0e4f0a11befc0e37dfc7714"} Jul 14 11:17:46.237731 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.237691 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6db976f7f4-nctrc"] Jul 14 11:17:46.238187 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.237988 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9275be4d-5287-4387-9b22-0d877b068367" containerName="console" Jul 14 11:17:46.238187 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.237998 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9275be4d-5287-4387-9b22-0d877b068367" containerName="console" Jul 14 11:17:46.238187 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.238013 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b815a14c-5f38-46e4-b867-8e15735d9d50" containerName="registry" Jul 14 11:17:46.238187 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.238018 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b815a14c-5f38-46e4-b867-8e15735d9d50" containerName="registry" Jul 14 11:17:46.238187 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.238063 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9275be4d-5287-4387-9b22-0d877b068367" containerName="console" Jul 14 11:17:46.238187 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.238072 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b815a14c-5f38-46e4-b867-8e15735d9d50" containerName="registry" Jul 14 11:17:46.242776 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.242746 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6db976f7f4-nctrc" Jul 14 11:17:46.245405 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.245366 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 14 11:17:46.245590 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.245432 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 14 11:17:46.245590 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.245441 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 14 11:17:46.245590 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.245509 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 14 11:17:46.245590 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.245432 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 14 11:17:46.245821 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.245673 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-pflxp\"" Jul 14 11:17:46.250707 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.250687 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 14 11:17:46.255172 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.255096 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6db976f7f4-nctrc"] Jul 14 11:17:46.299520 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.299477 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b4c5e1d-f72e-470c-b75e-922f128e5f9f-metrics-client-ca\") pod \"telemeter-client-6db976f7f4-nctrc\" (UID: \"0b4c5e1d-f72e-470c-b75e-922f128e5f9f\") " pod="openshift-monitoring/telemeter-client-6db976f7f4-nctrc" Jul 14 11:17:46.299520 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.299516 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b4c5e1d-f72e-470c-b75e-922f128e5f9f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6db976f7f4-nctrc\" (UID: \"0b4c5e1d-f72e-470c-b75e-922f128e5f9f\") " pod="openshift-monitoring/telemeter-client-6db976f7f4-nctrc" Jul 14 11:17:46.299735 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.299566 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0b4c5e1d-f72e-470c-b75e-922f128e5f9f-federate-client-tls\") pod \"telemeter-client-6db976f7f4-nctrc\" (UID: \"0b4c5e1d-f72e-470c-b75e-922f128e5f9f\") " pod="openshift-monitoring/telemeter-client-6db976f7f4-nctrc" Jul 14 11:17:46.299735 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.299631 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0b4c5e1d-f72e-470c-b75e-922f128e5f9f-secret-telemeter-client\") pod \"telemeter-client-6db976f7f4-nctrc\" (UID: \"0b4c5e1d-f72e-470c-b75e-922f128e5f9f\") " pod="openshift-monitoring/telemeter-client-6db976f7f4-nctrc" Jul 14 11:17:46.299735 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.299664 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b4c5e1d-f72e-470c-b75e-922f128e5f9f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6db976f7f4-nctrc\" (UID: \"0b4c5e1d-f72e-470c-b75e-922f128e5f9f\") " pod="openshift-monitoring/telemeter-client-6db976f7f4-nctrc" Jul 14 11:17:46.299735 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.299688 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0b4c5e1d-f72e-470c-b75e-922f128e5f9f-telemeter-client-tls\") pod \"telemeter-client-6db976f7f4-nctrc\" (UID: \"0b4c5e1d-f72e-470c-b75e-922f128e5f9f\") " pod="openshift-monitoring/telemeter-client-6db976f7f4-nctrc" Jul 14 11:17:46.299735 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.299708 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b4c5e1d-f72e-470c-b75e-922f128e5f9f-serving-certs-ca-bundle\") pod \"telemeter-client-6db976f7f4-nctrc\" (UID: \"0b4c5e1d-f72e-470c-b75e-922f128e5f9f\") " pod="openshift-monitoring/telemeter-client-6db976f7f4-nctrc" Jul 14 11:17:46.299883 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.299744 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4ppw\" (UniqueName: \"kubernetes.io/projected/0b4c5e1d-f72e-470c-b75e-922f128e5f9f-kube-api-access-g4ppw\") pod \"telemeter-client-6db976f7f4-nctrc\" (UID: \"0b4c5e1d-f72e-470c-b75e-922f128e5f9f\") " pod="openshift-monitoring/telemeter-client-6db976f7f4-nctrc" Jul 14 11:17:46.400974 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.400936 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b4c5e1d-f72e-470c-b75e-922f128e5f9f-metrics-client-ca\") pod \"telemeter-client-6db976f7f4-nctrc\" (UID: \"0b4c5e1d-f72e-470c-b75e-922f128e5f9f\") " pod="openshift-monitoring/telemeter-client-6db976f7f4-nctrc" Jul 14 11:17:46.400974 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.400977 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b4c5e1d-f72e-470c-b75e-922f128e5f9f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6db976f7f4-nctrc\" (UID: \"0b4c5e1d-f72e-470c-b75e-922f128e5f9f\") " pod="openshift-monitoring/telemeter-client-6db976f7f4-nctrc" Jul 14 11:17:46.400974 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.400995 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0b4c5e1d-f72e-470c-b75e-922f128e5f9f-federate-client-tls\") pod \"telemeter-client-6db976f7f4-nctrc\" (UID: \"0b4c5e1d-f72e-470c-b75e-922f128e5f9f\") " pod="openshift-monitoring/telemeter-client-6db976f7f4-nctrc" Jul 14 11:17:46.401291 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.401015 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0b4c5e1d-f72e-470c-b75e-922f128e5f9f-secret-telemeter-client\") pod \"telemeter-client-6db976f7f4-nctrc\" (UID: \"0b4c5e1d-f72e-470c-b75e-922f128e5f9f\") " pod="openshift-monitoring/telemeter-client-6db976f7f4-nctrc" Jul 14 11:17:46.401291 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.401031 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b4c5e1d-f72e-470c-b75e-922f128e5f9f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6db976f7f4-nctrc\" (UID: \"0b4c5e1d-f72e-470c-b75e-922f128e5f9f\") " pod="openshift-monitoring/telemeter-client-6db976f7f4-nctrc" Jul 14 11:17:46.401291 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.401049 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0b4c5e1d-f72e-470c-b75e-922f128e5f9f-telemeter-client-tls\") pod \"telemeter-client-6db976f7f4-nctrc\" (UID: \"0b4c5e1d-f72e-470c-b75e-922f128e5f9f\") " pod="openshift-monitoring/telemeter-client-6db976f7f4-nctrc" Jul 14 11:17:46.401291 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.401072 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b4c5e1d-f72e-470c-b75e-922f128e5f9f-serving-certs-ca-bundle\") pod \"telemeter-client-6db976f7f4-nctrc\" (UID: \"0b4c5e1d-f72e-470c-b75e-922f128e5f9f\") " pod="openshift-monitoring/telemeter-client-6db976f7f4-nctrc" Jul 14 11:17:46.401291 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.401096 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4ppw\" (UniqueName: \"kubernetes.io/projected/0b4c5e1d-f72e-470c-b75e-922f128e5f9f-kube-api-access-g4ppw\") pod \"telemeter-client-6db976f7f4-nctrc\" (UID: \"0b4c5e1d-f72e-470c-b75e-922f128e5f9f\") " pod="openshift-monitoring/telemeter-client-6db976f7f4-nctrc" Jul 14 11:17:46.401873 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.401844 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b4c5e1d-f72e-470c-b75e-922f128e5f9f-metrics-client-ca\") pod \"telemeter-client-6db976f7f4-nctrc\" (UID: \"0b4c5e1d-f72e-470c-b75e-922f128e5f9f\") " pod="openshift-monitoring/telemeter-client-6db976f7f4-nctrc" Jul 14 11:17:46.402077 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.401909 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b4c5e1d-f72e-470c-b75e-922f128e5f9f-serving-certs-ca-bundle\") pod \"telemeter-client-6db976f7f4-nctrc\" (UID: \"0b4c5e1d-f72e-470c-b75e-922f128e5f9f\") " pod="openshift-monitoring/telemeter-client-6db976f7f4-nctrc" Jul 14 11:17:46.402195 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.402173 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b4c5e1d-f72e-470c-b75e-922f128e5f9f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6db976f7f4-nctrc\" (UID: \"0b4c5e1d-f72e-470c-b75e-922f128e5f9f\") " pod="openshift-monitoring/telemeter-client-6db976f7f4-nctrc" Jul 14 11:17:46.404590 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.404564 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b4c5e1d-f72e-470c-b75e-922f128e5f9f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6db976f7f4-nctrc\" (UID: \"0b4c5e1d-f72e-470c-b75e-922f128e5f9f\") " pod="openshift-monitoring/telemeter-client-6db976f7f4-nctrc" Jul 14 11:17:46.404846 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.404822 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0b4c5e1d-f72e-470c-b75e-922f128e5f9f-federate-client-tls\") pod \"telemeter-client-6db976f7f4-nctrc\" (UID: \"0b4c5e1d-f72e-470c-b75e-922f128e5f9f\") " pod="openshift-monitoring/telemeter-client-6db976f7f4-nctrc" Jul 14 11:17:46.405270 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.405246 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0b4c5e1d-f72e-470c-b75e-922f128e5f9f-telemeter-client-tls\") pod \"telemeter-client-6db976f7f4-nctrc\" (UID: \"0b4c5e1d-f72e-470c-b75e-922f128e5f9f\") " pod="openshift-monitoring/telemeter-client-6db976f7f4-nctrc" Jul 14 11:17:46.405640 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.405614 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0b4c5e1d-f72e-470c-b75e-922f128e5f9f-secret-telemeter-client\") pod \"telemeter-client-6db976f7f4-nctrc\" (UID: \"0b4c5e1d-f72e-470c-b75e-922f128e5f9f\") " pod="openshift-monitoring/telemeter-client-6db976f7f4-nctrc" Jul 14 11:17:46.412918 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.412889 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4ppw\" (UniqueName: \"kubernetes.io/projected/0b4c5e1d-f72e-470c-b75e-922f128e5f9f-kube-api-access-g4ppw\") pod \"telemeter-client-6db976f7f4-nctrc\" (UID: \"0b4c5e1d-f72e-470c-b75e-922f128e5f9f\") " pod="openshift-monitoring/telemeter-client-6db976f7f4-nctrc" Jul 14 11:17:46.555496 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.555137 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6db976f7f4-nctrc" Jul 14 11:17:46.717840 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.717738 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6db976f7f4-nctrc"] Jul 14 11:17:46.725439 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:46.725409 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 11:17:47.274602 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:47.274555 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6db976f7f4-nctrc" event={"ID":"0b4c5e1d-f72e-470c-b75e-922f128e5f9f","Type":"ContainerStarted","Data":"ab5435e9feaa696e80a0d4ce25e59cbd22f6eecd466d221e3d25a9095588775b"} Jul 14 11:17:49.283604 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:49.283566 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6db976f7f4-nctrc" event={"ID":"0b4c5e1d-f72e-470c-b75e-922f128e5f9f","Type":"ContainerStarted","Data":"458707d728d09ffee527962523f7da2947a38551c38483845d2b8d298e4b336f"} Jul 14 11:17:49.832063 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:49.832028 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8792ce35-00f9-4101-aab2-346a02150768-metrics-certs\") pod \"network-metrics-daemon-pql69\" (UID: \"8792ce35-00f9-4101-aab2-346a02150768\") " pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:17:49.834812 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:49.834778 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8792ce35-00f9-4101-aab2-346a02150768-metrics-certs\") pod \"network-metrics-daemon-pql69\" (UID: \"8792ce35-00f9-4101-aab2-346a02150768\") " pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:17:49.867784 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:49.867749 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qblx9\"" Jul 14 11:17:49.875821 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:49.875793 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pql69" Jul 14 11:17:50.017571 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:50.017513 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pql69"] Jul 14 11:17:50.020116 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:17:50.020087 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8792ce35_00f9_4101_aab2_346a02150768.slice/crio-230c09547fd37712b169c11d27e62b8226dce06b4b466f30acef612ae0e053a8 WatchSource:0}: Error finding container 230c09547fd37712b169c11d27e62b8226dce06b4b466f30acef612ae0e053a8: Status 404 returned error can't find the container with id 230c09547fd37712b169c11d27e62b8226dce06b4b466f30acef612ae0e053a8 Jul 14 11:17:50.290123 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:50.290007 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6db976f7f4-nctrc" event={"ID":"0b4c5e1d-f72e-470c-b75e-922f128e5f9f","Type":"ContainerStarted","Data":"94f76d6e056dcb145ac84e11217103f920d29d63640331023de6749214e70bf5"} Jul 14 11:17:50.290123 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:50.290086 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6db976f7f4-nctrc" event={"ID":"0b4c5e1d-f72e-470c-b75e-922f128e5f9f","Type":"ContainerStarted","Data":"11c852689db38be91b2779faf94457dcc32bfb1fe241475ecbc487da87a3ae09"} Jul 14 11:17:50.291141 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:50.291118 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pql69" event={"ID":"8792ce35-00f9-4101-aab2-346a02150768","Type":"ContainerStarted","Data":"230c09547fd37712b169c11d27e62b8226dce06b4b466f30acef612ae0e053a8"} Jul 14 11:17:50.318189 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:50.318132 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6db976f7f4-nctrc" podStartSLOduration=1.4019511040000001 podStartE2EDuration="4.3181145s" totalImagesPullingTime="2.916163396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:17:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:17:50.316820718 +0000 UTC m=+374.890201091" watchObservedRunningTime="2026-07-14 11:17:50.3181145 +0000 UTC m=+374.891494875" Jul 14 11:17:51.297044 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:51.296943 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pql69" event={"ID":"8792ce35-00f9-4101-aab2-346a02150768","Type":"ContainerStarted","Data":"f469b2e7db78a08e89e2b5cee1f64a97105fb100cc36e7ea87cd147299454d35"} Jul 14 11:17:51.297477 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:51.297047 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pql69" event={"ID":"8792ce35-00f9-4101-aab2-346a02150768","Type":"ContainerStarted","Data":"114ced87425680b7000ea508c3059937b76cda77ed3fdbaee4267662091dd30f"} Jul 14 11:17:51.317265 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:17:51.317206 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pql69" podStartSLOduration=374.345147894 podStartE2EDuration="6m15.317187341s" totalImagesPullingTime="972.039447ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:11:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:17:51.316740112 +0000 UTC m=+375.890120512" watchObservedRunningTime="2026-07-14 11:17:51.317187341 +0000 UTC m=+375.890567715" Jul 14 11:21:06.839037 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:06.838998 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-knlcg"] Jul 14 11:21:06.842198 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:06.842174 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-knlcg" Jul 14 11:21:06.845446 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:06.845423 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-vfqz6\"" Jul 14 11:21:06.845604 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:06.845426 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 14 11:21:06.845604 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:06.845459 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 14 11:21:06.856654 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:06.856626 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-knlcg"] Jul 14 11:21:06.974793 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:06.974748 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r9sq\" (UniqueName: \"kubernetes.io/projected/c328c079-4642-46ee-83c2-4bed4459141d-kube-api-access-7r9sq\") pod \"cert-manager-operator-controller-manager-55c444bf86-knlcg\" (UID: \"c328c079-4642-46ee-83c2-4bed4459141d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-knlcg" Jul 14 11:21:06.974793 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:06.974797 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c328c079-4642-46ee-83c2-4bed4459141d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-knlcg\" (UID: \"c328c079-4642-46ee-83c2-4bed4459141d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-knlcg" Jul 14 11:21:07.075759 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:07.075711 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7r9sq\" (UniqueName: \"kubernetes.io/projected/c328c079-4642-46ee-83c2-4bed4459141d-kube-api-access-7r9sq\") pod \"cert-manager-operator-controller-manager-55c444bf86-knlcg\" (UID: \"c328c079-4642-46ee-83c2-4bed4459141d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-knlcg" Jul 14 11:21:07.075759 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:07.075764 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c328c079-4642-46ee-83c2-4bed4459141d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-knlcg\" (UID: \"c328c079-4642-46ee-83c2-4bed4459141d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-knlcg" Jul 14 11:21:07.076198 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:07.076178 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c328c079-4642-46ee-83c2-4bed4459141d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-knlcg\" (UID: \"c328c079-4642-46ee-83c2-4bed4459141d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-knlcg" Jul 14 11:21:07.085904 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:07.085868 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r9sq\" (UniqueName: \"kubernetes.io/projected/c328c079-4642-46ee-83c2-4bed4459141d-kube-api-access-7r9sq\") pod \"cert-manager-operator-controller-manager-55c444bf86-knlcg\" (UID: \"c328c079-4642-46ee-83c2-4bed4459141d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-knlcg" Jul 14 11:21:07.152083 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:07.151972 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-knlcg" Jul 14 11:21:07.316081 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:07.316050 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-knlcg"] Jul 14 11:21:07.318133 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:21:07.318104 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc328c079_4642_46ee_83c2_4bed4459141d.slice/crio-def637a5144a28f25b851e540f5c9c91f221aa5587eab3d72c541d031397f863 WatchSource:0}: Error finding container def637a5144a28f25b851e540f5c9c91f221aa5587eab3d72c541d031397f863: Status 404 returned error can't find the container with id def637a5144a28f25b851e540f5c9c91f221aa5587eab3d72c541d031397f863 Jul 14 11:21:08.066291 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:08.066250 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-knlcg" event={"ID":"c328c079-4642-46ee-83c2-4bed4459141d","Type":"ContainerStarted","Data":"def637a5144a28f25b851e540f5c9c91f221aa5587eab3d72c541d031397f863"} Jul 14 11:21:11.082128 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:11.082083 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-knlcg" event={"ID":"c328c079-4642-46ee-83c2-4bed4459141d","Type":"ContainerStarted","Data":"3590770eb38f67e2a2cb978bb8fdf31d412954f87bb7fa7b888f2a0309f4a72a"} Jul 14 11:21:11.115607 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:11.115529 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-knlcg" podStartSLOduration=2.3558999 podStartE2EDuration="5.115510433s" totalImagesPullingTime="2.759610533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:21:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:21:11.113344593 +0000 UTC m=+575.686724964" watchObservedRunningTime="2026-07-14 11:21:11.115510433 +0000 UTC m=+575.688890807" Jul 14 11:21:13.620612 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:13.620571 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-smbfh"] Jul 14 11:21:13.624052 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:13.624029 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-smbfh" Jul 14 11:21:13.629470 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:13.629442 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 14 11:21:13.630614 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:13.630593 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 14 11:21:13.630816 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:13.630798 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-7tslr\"" Jul 14 11:21:13.658665 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:13.658631 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-smbfh"] Jul 14 11:21:13.737147 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:13.737105 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk6rq\" (UniqueName: \"kubernetes.io/projected/bba1e86f-5861-47e3-8382-d80ac6d51ee4-kube-api-access-bk6rq\") pod \"cert-manager-cainjector-559cdd8c87-smbfh\" (UID: \"bba1e86f-5861-47e3-8382-d80ac6d51ee4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-smbfh" Jul 14 11:21:13.737147 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:13.737153 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bba1e86f-5861-47e3-8382-d80ac6d51ee4-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-smbfh\" (UID: \"bba1e86f-5861-47e3-8382-d80ac6d51ee4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-smbfh" Jul 14 11:21:13.838307 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:13.838260 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk6rq\" (UniqueName: \"kubernetes.io/projected/bba1e86f-5861-47e3-8382-d80ac6d51ee4-kube-api-access-bk6rq\") pod \"cert-manager-cainjector-559cdd8c87-smbfh\" (UID: \"bba1e86f-5861-47e3-8382-d80ac6d51ee4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-smbfh" Jul 14 11:21:13.838507 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:13.838320 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bba1e86f-5861-47e3-8382-d80ac6d51ee4-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-smbfh\" (UID: \"bba1e86f-5861-47e3-8382-d80ac6d51ee4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-smbfh" Jul 14 11:21:13.851468 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:13.851431 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bba1e86f-5861-47e3-8382-d80ac6d51ee4-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-smbfh\" (UID: \"bba1e86f-5861-47e3-8382-d80ac6d51ee4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-smbfh" Jul 14 11:21:13.853178 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:13.853151 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk6rq\" (UniqueName: \"kubernetes.io/projected/bba1e86f-5861-47e3-8382-d80ac6d51ee4-kube-api-access-bk6rq\") pod \"cert-manager-cainjector-559cdd8c87-smbfh\" (UID: \"bba1e86f-5861-47e3-8382-d80ac6d51ee4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-smbfh" Jul 14 11:21:13.933644 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:13.933515 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-smbfh" Jul 14 11:21:14.069301 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:14.069276 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-smbfh"] Jul 14 11:21:14.071474 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:21:14.071444 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbba1e86f_5861_47e3_8382_d80ac6d51ee4.slice/crio-42d681f566bb8c7245fac9cdc994eb2dc4fada4276ef8f925d72972eaec77859 WatchSource:0}: Error finding container 42d681f566bb8c7245fac9cdc994eb2dc4fada4276ef8f925d72972eaec77859: Status 404 returned error can't find the container with id 42d681f566bb8c7245fac9cdc994eb2dc4fada4276ef8f925d72972eaec77859 Jul 14 11:21:14.096045 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:14.096012 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-smbfh" event={"ID":"bba1e86f-5861-47e3-8382-d80ac6d51ee4","Type":"ContainerStarted","Data":"42d681f566bb8c7245fac9cdc994eb2dc4fada4276ef8f925d72972eaec77859"} Jul 14 11:21:17.112046 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:17.111946 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-smbfh" event={"ID":"bba1e86f-5861-47e3-8382-d80ac6d51ee4","Type":"ContainerStarted","Data":"eea3b721abf2807767eb89a7ec8517ac25e275ef0bfb86edbad805ee28fba565"} Jul 14 11:21:17.963772 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:17.963712 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-smbfh" podStartSLOduration=2.236059229 podStartE2EDuration="4.963688876s" totalImagesPullingTime="2.727629647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:21:17.156811813 +0000 UTC m=+581.730192187" watchObservedRunningTime="2026-07-14 11:21:17.963688876 +0000 UTC m=+582.537069251" Jul 14 11:21:17.964757 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:17.964727 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-nz54b"] Jul 14 11:21:17.969463 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:17.969438 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-nz54b" Jul 14 11:21:17.972308 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:17.972284 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-jfglq\"" Jul 14 11:21:17.972877 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:17.972855 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09fff33d-8baa-41ad-8695-5854fe72acbc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-nz54b\" (UID: \"09fff33d-8baa-41ad-8695-5854fe72acbc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nz54b" Jul 14 11:21:17.972993 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:17.972904 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jz4q\" (UniqueName: \"kubernetes.io/projected/09fff33d-8baa-41ad-8695-5854fe72acbc-kube-api-access-2jz4q\") pod \"cert-manager-webhook-6486ffd997-nz54b\" (UID: \"09fff33d-8baa-41ad-8695-5854fe72acbc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nz54b" Jul 14 11:21:17.975004 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:17.974981 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-nz54b"] Jul 14 11:21:18.073889 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:18.073846 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09fff33d-8baa-41ad-8695-5854fe72acbc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-nz54b\" (UID: \"09fff33d-8baa-41ad-8695-5854fe72acbc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nz54b" Jul 14 11:21:18.074075 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:18.073913 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jz4q\" (UniqueName: \"kubernetes.io/projected/09fff33d-8baa-41ad-8695-5854fe72acbc-kube-api-access-2jz4q\") pod \"cert-manager-webhook-6486ffd997-nz54b\" (UID: \"09fff33d-8baa-41ad-8695-5854fe72acbc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nz54b" Jul 14 11:21:18.082972 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:18.082945 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09fff33d-8baa-41ad-8695-5854fe72acbc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-nz54b\" (UID: \"09fff33d-8baa-41ad-8695-5854fe72acbc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nz54b" Jul 14 11:21:18.082972 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:18.082964 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jz4q\" (UniqueName: \"kubernetes.io/projected/09fff33d-8baa-41ad-8695-5854fe72acbc-kube-api-access-2jz4q\") pod \"cert-manager-webhook-6486ffd997-nz54b\" (UID: \"09fff33d-8baa-41ad-8695-5854fe72acbc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nz54b" Jul 14 11:21:18.279348 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:18.279258 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-nz54b" Jul 14 11:21:18.420654 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:18.420618 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-nz54b"] Jul 14 11:21:18.423496 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:21:18.423470 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09fff33d_8baa_41ad_8695_5854fe72acbc.slice/crio-8497a88510f21fd7f96da156c251ec8f0aa6aed0796ccc660ef0a6fd72a33ac8 WatchSource:0}: Error finding container 8497a88510f21fd7f96da156c251ec8f0aa6aed0796ccc660ef0a6fd72a33ac8: Status 404 returned error can't find the container with id 8497a88510f21fd7f96da156c251ec8f0aa6aed0796ccc660ef0a6fd72a33ac8 Jul 14 11:21:19.122984 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:19.122944 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-nz54b" event={"ID":"09fff33d-8baa-41ad-8695-5854fe72acbc","Type":"ContainerStarted","Data":"9b1b3f1d58d39ff6db1363ea248fd3142bccaf48813caa63b0b7b63e5165f13f"} Jul 14 11:21:19.123187 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:19.122995 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-nz54b" Jul 14 11:21:19.123187 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:19.123012 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-nz54b" event={"ID":"09fff33d-8baa-41ad-8695-5854fe72acbc","Type":"ContainerStarted","Data":"8497a88510f21fd7f96da156c251ec8f0aa6aed0796ccc660ef0a6fd72a33ac8"} Jul 14 11:21:19.173887 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:19.173836 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-nz54b" podStartSLOduration=2.173819064 podStartE2EDuration="2.173819064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:21:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:21:19.169610961 +0000 UTC m=+583.742991336" watchObservedRunningTime="2026-07-14 11:21:19.173819064 +0000 UTC m=+583.747199437" Jul 14 11:21:25.129871 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:25.129835 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-nz54b" Jul 14 11:21:35.868372 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:35.868338 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvhwc_720aefb6-81a1-44d1-a01f-4bc07ff30465/ovn-acl-logging/0.log" Jul 14 11:21:35.868876 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:35.868856 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvhwc_720aefb6-81a1-44d1-a01f-4bc07ff30465/ovn-acl-logging/0.log" Jul 14 11:21:45.306389 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:45.306348 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bf58df976-brhns"] Jul 14 11:21:45.309754 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:45.309736 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-brhns" Jul 14 11:21:45.313656 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:45.313633 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 14 11:21:45.314288 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:45.314269 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 14 11:21:45.314386 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:45.314288 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 14 11:21:45.314748 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:45.314735 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-j5tr7\"" Jul 14 11:21:45.314961 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:45.314949 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 14 11:21:45.343384 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:45.343353 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bf58df976-brhns"] Jul 14 11:21:45.400806 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:45.400773 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e15a2d7c-1f99-4d13-bf06-d95892717484-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bf58df976-brhns\" (UID: \"e15a2d7c-1f99-4d13-bf06-d95892717484\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-brhns" Jul 14 11:21:45.400996 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:45.400828 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e15a2d7c-1f99-4d13-bf06-d95892717484-manifests\") pod \"opendatahub-operator-controller-manager-5bf58df976-brhns\" (UID: \"e15a2d7c-1f99-4d13-bf06-d95892717484\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-brhns" Jul 14 11:21:45.400996 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:45.400926 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e15a2d7c-1f99-4d13-bf06-d95892717484-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bf58df976-brhns\" (UID: \"e15a2d7c-1f99-4d13-bf06-d95892717484\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-brhns" Jul 14 11:21:45.400996 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:45.400970 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e15a2d7c-1f99-4d13-bf06-d95892717484-tmp\") pod \"opendatahub-operator-controller-manager-5bf58df976-brhns\" (UID: \"e15a2d7c-1f99-4d13-bf06-d95892717484\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-brhns" Jul 14 11:21:45.400996 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:45.400985 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9swmn\" (UniqueName: \"kubernetes.io/projected/e15a2d7c-1f99-4d13-bf06-d95892717484-kube-api-access-9swmn\") pod \"opendatahub-operator-controller-manager-5bf58df976-brhns\" (UID: \"e15a2d7c-1f99-4d13-bf06-d95892717484\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-brhns" Jul 14 11:21:45.502276 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:45.502239 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e15a2d7c-1f99-4d13-bf06-d95892717484-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bf58df976-brhns\" (UID: \"e15a2d7c-1f99-4d13-bf06-d95892717484\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-brhns" Jul 14 11:21:45.502276 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:45.502282 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e15a2d7c-1f99-4d13-bf06-d95892717484-manifests\") pod \"opendatahub-operator-controller-manager-5bf58df976-brhns\" (UID: \"e15a2d7c-1f99-4d13-bf06-d95892717484\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-brhns" Jul 14 11:21:45.502583 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:45.502412 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e15a2d7c-1f99-4d13-bf06-d95892717484-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bf58df976-brhns\" (UID: \"e15a2d7c-1f99-4d13-bf06-d95892717484\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-brhns" Jul 14 11:21:45.502583 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:45.502463 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e15a2d7c-1f99-4d13-bf06-d95892717484-tmp\") pod \"opendatahub-operator-controller-manager-5bf58df976-brhns\" (UID: \"e15a2d7c-1f99-4d13-bf06-d95892717484\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-brhns" Jul 14 11:21:45.502583 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:45.502488 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9swmn\" (UniqueName: \"kubernetes.io/projected/e15a2d7c-1f99-4d13-bf06-d95892717484-kube-api-access-9swmn\") pod \"opendatahub-operator-controller-manager-5bf58df976-brhns\" (UID: \"e15a2d7c-1f99-4d13-bf06-d95892717484\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-brhns" Jul 14 11:21:45.502780 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:45.502757 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e15a2d7c-1f99-4d13-bf06-d95892717484-manifests\") pod \"opendatahub-operator-controller-manager-5bf58df976-brhns\" (UID: \"e15a2d7c-1f99-4d13-bf06-d95892717484\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-brhns" Jul 14 11:21:45.504876 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:45.504848 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e15a2d7c-1f99-4d13-bf06-d95892717484-tmp\") pod \"opendatahub-operator-controller-manager-5bf58df976-brhns\" (UID: \"e15a2d7c-1f99-4d13-bf06-d95892717484\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-brhns" Jul 14 11:21:45.504994 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:45.504977 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e15a2d7c-1f99-4d13-bf06-d95892717484-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bf58df976-brhns\" (UID: \"e15a2d7c-1f99-4d13-bf06-d95892717484\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-brhns" Jul 14 11:21:45.505052 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:45.505031 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e15a2d7c-1f99-4d13-bf06-d95892717484-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bf58df976-brhns\" (UID: \"e15a2d7c-1f99-4d13-bf06-d95892717484\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-brhns" Jul 14 11:21:45.515013 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:45.514986 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9swmn\" (UniqueName: \"kubernetes.io/projected/e15a2d7c-1f99-4d13-bf06-d95892717484-kube-api-access-9swmn\") pod \"opendatahub-operator-controller-manager-5bf58df976-brhns\" (UID: \"e15a2d7c-1f99-4d13-bf06-d95892717484\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-brhns" Jul 14 11:21:45.620296 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:45.620195 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-brhns" Jul 14 11:21:45.774359 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:45.774320 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bf58df976-brhns"] Jul 14 11:21:45.777164 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:21:45.777142 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode15a2d7c_1f99_4d13_bf06_d95892717484.slice/crio-f2baedf7b1ec058aff32a3dd79cccbba5c127f6eee335ba35972215e6eb6ed7d WatchSource:0}: Error finding container f2baedf7b1ec058aff32a3dd79cccbba5c127f6eee335ba35972215e6eb6ed7d: Status 404 returned error can't find the container with id f2baedf7b1ec058aff32a3dd79cccbba5c127f6eee335ba35972215e6eb6ed7d Jul 14 11:21:46.241620 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:46.241580 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-brhns" event={"ID":"e15a2d7c-1f99-4d13-bf06-d95892717484","Type":"ContainerStarted","Data":"f2baedf7b1ec058aff32a3dd79cccbba5c127f6eee335ba35972215e6eb6ed7d"} Jul 14 11:21:50.264857 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:50.264816 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-brhns" event={"ID":"e15a2d7c-1f99-4d13-bf06-d95892717484","Type":"ContainerStarted","Data":"e083131b3198d0c430f5f6eac0f50dc0e2082690e69dcdb4524486a35714e534"} Jul 14 11:21:51.270579 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:51.270510 2576 generic.go:356] "Generic (PLEG): container finished" podID="e15a2d7c-1f99-4d13-bf06-d95892717484" containerID="e083131b3198d0c430f5f6eac0f50dc0e2082690e69dcdb4524486a35714e534" exitCode=0 Jul 14 11:21:51.270977 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:51.270604 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-brhns" event={"ID":"e15a2d7c-1f99-4d13-bf06-d95892717484","Type":"ContainerDied","Data":"e083131b3198d0c430f5f6eac0f50dc0e2082690e69dcdb4524486a35714e534"} Jul 14 11:21:52.277059 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:52.277021 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-brhns" event={"ID":"e15a2d7c-1f99-4d13-bf06-d95892717484","Type":"ContainerStarted","Data":"6248ac2965509caea8055e0733d0ab8de4278c12c8739f008ceaf3977a877706"} Jul 14 11:21:52.277501 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:52.277123 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-brhns" Jul 14 11:21:52.300595 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:21:52.300501 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-brhns" podStartSLOduration=2.112082091 podStartE2EDuration="7.300483428s" totalImagesPullingTime="4.140005851s" totalInitContainerRuntime="1.048395486s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:21:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:21:52.298444741 +0000 UTC m=+616.871825134" watchObservedRunningTime="2026-07-14 11:21:52.300483428 +0000 UTC m=+616.873863801" Jul 14 11:22:03.284604 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:03.284509 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-brhns" Jul 14 11:22:08.692910 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:08.692869 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6b948bb5ff-l5kvc"] Jul 14 11:22:08.696149 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:08.696124 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6b948bb5ff-l5kvc" Jul 14 11:22:08.699792 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:08.699765 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 14 11:22:08.699935 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:08.699855 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-j4jds\"" Jul 14 11:22:08.700954 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:08.700936 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 14 11:22:08.708334 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:08.708310 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6b948bb5ff-l5kvc"] Jul 14 11:22:08.796748 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:08.796710 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jpkt7"] Jul 14 11:22:08.799943 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:08.799926 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-jpkt7" Jul 14 11:22:08.803002 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:08.802980 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 14 11:22:08.803244 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:08.803228 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-vmhmj\"" Jul 14 11:22:08.806174 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:08.806142 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v2xd\" (UniqueName: \"kubernetes.io/projected/f77b4fd2-69eb-44c7-9dea-3dee79258cec-kube-api-access-8v2xd\") pod \"kube-auth-proxy-6b948bb5ff-l5kvc\" (UID: \"f77b4fd2-69eb-44c7-9dea-3dee79258cec\") " pod="openshift-ingress/kube-auth-proxy-6b948bb5ff-l5kvc" Jul 14 11:22:08.806282 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:08.806183 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f77b4fd2-69eb-44c7-9dea-3dee79258cec-tmp\") pod \"kube-auth-proxy-6b948bb5ff-l5kvc\" (UID: \"f77b4fd2-69eb-44c7-9dea-3dee79258cec\") " pod="openshift-ingress/kube-auth-proxy-6b948bb5ff-l5kvc" Jul 14 11:22:08.806282 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:08.806221 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f77b4fd2-69eb-44c7-9dea-3dee79258cec-tls-certs\") pod \"kube-auth-proxy-6b948bb5ff-l5kvc\" (UID: \"f77b4fd2-69eb-44c7-9dea-3dee79258cec\") " pod="openshift-ingress/kube-auth-proxy-6b948bb5ff-l5kvc" Jul 14 11:22:08.821983 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:08.821947 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jpkt7"] Jul 14 11:22:08.907258 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:08.907215 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6hkr\" (UniqueName: \"kubernetes.io/projected/de199871-dbb3-4814-bf72-dacd4247230b-kube-api-access-g6hkr\") pod \"odh-model-controller-7998c67dc4-jpkt7\" (UID: \"de199871-dbb3-4814-bf72-dacd4247230b\") " pod="opendatahub/odh-model-controller-7998c67dc4-jpkt7" Jul 14 11:22:08.907467 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:08.907278 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v2xd\" (UniqueName: \"kubernetes.io/projected/f77b4fd2-69eb-44c7-9dea-3dee79258cec-kube-api-access-8v2xd\") pod \"kube-auth-proxy-6b948bb5ff-l5kvc\" (UID: \"f77b4fd2-69eb-44c7-9dea-3dee79258cec\") " pod="openshift-ingress/kube-auth-proxy-6b948bb5ff-l5kvc" Jul 14 11:22:08.907467 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:08.907353 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f77b4fd2-69eb-44c7-9dea-3dee79258cec-tmp\") pod \"kube-auth-proxy-6b948bb5ff-l5kvc\" (UID: \"f77b4fd2-69eb-44c7-9dea-3dee79258cec\") " pod="openshift-ingress/kube-auth-proxy-6b948bb5ff-l5kvc" Jul 14 11:22:08.907467 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:08.907395 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de199871-dbb3-4814-bf72-dacd4247230b-cert\") pod \"odh-model-controller-7998c67dc4-jpkt7\" (UID: \"de199871-dbb3-4814-bf72-dacd4247230b\") " pod="opendatahub/odh-model-controller-7998c67dc4-jpkt7" Jul 14 11:22:08.907467 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:08.907440 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f77b4fd2-69eb-44c7-9dea-3dee79258cec-tls-certs\") pod \"kube-auth-proxy-6b948bb5ff-l5kvc\" (UID: \"f77b4fd2-69eb-44c7-9dea-3dee79258cec\") " pod="openshift-ingress/kube-auth-proxy-6b948bb5ff-l5kvc" Jul 14 11:22:08.909699 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:08.909674 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f77b4fd2-69eb-44c7-9dea-3dee79258cec-tmp\") pod \"kube-auth-proxy-6b948bb5ff-l5kvc\" (UID: \"f77b4fd2-69eb-44c7-9dea-3dee79258cec\") " pod="openshift-ingress/kube-auth-proxy-6b948bb5ff-l5kvc" Jul 14 11:22:08.909939 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:08.909915 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f77b4fd2-69eb-44c7-9dea-3dee79258cec-tls-certs\") pod \"kube-auth-proxy-6b948bb5ff-l5kvc\" (UID: \"f77b4fd2-69eb-44c7-9dea-3dee79258cec\") " pod="openshift-ingress/kube-auth-proxy-6b948bb5ff-l5kvc" Jul 14 11:22:08.917105 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:08.917073 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v2xd\" (UniqueName: \"kubernetes.io/projected/f77b4fd2-69eb-44c7-9dea-3dee79258cec-kube-api-access-8v2xd\") pod \"kube-auth-proxy-6b948bb5ff-l5kvc\" (UID: \"f77b4fd2-69eb-44c7-9dea-3dee79258cec\") " pod="openshift-ingress/kube-auth-proxy-6b948bb5ff-l5kvc" Jul 14 11:22:09.006049 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:09.006002 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6b948bb5ff-l5kvc" Jul 14 11:22:09.008385 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:09.008360 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6hkr\" (UniqueName: \"kubernetes.io/projected/de199871-dbb3-4814-bf72-dacd4247230b-kube-api-access-g6hkr\") pod \"odh-model-controller-7998c67dc4-jpkt7\" (UID: \"de199871-dbb3-4814-bf72-dacd4247230b\") " pod="opendatahub/odh-model-controller-7998c67dc4-jpkt7" Jul 14 11:22:09.008505 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:09.008438 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de199871-dbb3-4814-bf72-dacd4247230b-cert\") pod \"odh-model-controller-7998c67dc4-jpkt7\" (UID: \"de199871-dbb3-4814-bf72-dacd4247230b\") " pod="opendatahub/odh-model-controller-7998c67dc4-jpkt7" Jul 14 11:22:09.008589 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:22:09.008561 2576 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 14 11:22:09.008655 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:22:09.008629 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de199871-dbb3-4814-bf72-dacd4247230b-cert podName:de199871-dbb3-4814-bf72-dacd4247230b nodeName:}" failed. No retries permitted until 2026-07-14 11:22:09.508614783 +0000 UTC m=+634.081995135 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/de199871-dbb3-4814-bf72-dacd4247230b-cert") pod "odh-model-controller-7998c67dc4-jpkt7" (UID: "de199871-dbb3-4814-bf72-dacd4247230b") : secret "odh-model-controller-webhook-cert" not found Jul 14 11:22:09.040230 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:09.040194 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6hkr\" (UniqueName: \"kubernetes.io/projected/de199871-dbb3-4814-bf72-dacd4247230b-kube-api-access-g6hkr\") pod \"odh-model-controller-7998c67dc4-jpkt7\" (UID: \"de199871-dbb3-4814-bf72-dacd4247230b\") " pod="opendatahub/odh-model-controller-7998c67dc4-jpkt7" Jul 14 11:22:09.162711 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:09.162644 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6b948bb5ff-l5kvc"] Jul 14 11:22:09.165042 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:22:09.165007 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf77b4fd2_69eb_44c7_9dea_3dee79258cec.slice/crio-ee9c5d87aacee9a659c0346f589b4dbeff33e4946a37e161c750e7f0ccbc2541 WatchSource:0}: Error finding container ee9c5d87aacee9a659c0346f589b4dbeff33e4946a37e161c750e7f0ccbc2541: Status 404 returned error can't find the container with id ee9c5d87aacee9a659c0346f589b4dbeff33e4946a37e161c750e7f0ccbc2541 Jul 14 11:22:09.354412 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:09.354324 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6b948bb5ff-l5kvc" event={"ID":"f77b4fd2-69eb-44c7-9dea-3dee79258cec","Type":"ContainerStarted","Data":"ee9c5d87aacee9a659c0346f589b4dbeff33e4946a37e161c750e7f0ccbc2541"} Jul 14 11:22:09.512998 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:09.512944 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de199871-dbb3-4814-bf72-dacd4247230b-cert\") pod \"odh-model-controller-7998c67dc4-jpkt7\" (UID: \"de199871-dbb3-4814-bf72-dacd4247230b\") " pod="opendatahub/odh-model-controller-7998c67dc4-jpkt7" Jul 14 11:22:09.515826 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:09.515802 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de199871-dbb3-4814-bf72-dacd4247230b-cert\") pod \"odh-model-controller-7998c67dc4-jpkt7\" (UID: \"de199871-dbb3-4814-bf72-dacd4247230b\") " pod="opendatahub/odh-model-controller-7998c67dc4-jpkt7" Jul 14 11:22:09.710309 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:09.710214 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-jpkt7" Jul 14 11:22:09.875786 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:09.875162 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-whlln"] Jul 14 11:22:09.878971 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:09.878943 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-whlln" Jul 14 11:22:09.882251 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:09.882221 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 14 11:22:09.882678 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:09.882658 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-6n2t9\"" Jul 14 11:22:09.904976 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:09.904697 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-whlln"] Jul 14 11:22:09.906962 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:09.906748 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jpkt7"] Jul 14 11:22:09.910867 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:22:09.910836 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde199871_dbb3_4814_bf72_dacd4247230b.slice/crio-4041bcf902c0a9ea045c5a17ea78ff10a48ed50b011616c04cda853196ea8423 WatchSource:0}: Error finding container 4041bcf902c0a9ea045c5a17ea78ff10a48ed50b011616c04cda853196ea8423: Status 404 returned error can't find the container with id 4041bcf902c0a9ea045c5a17ea78ff10a48ed50b011616c04cda853196ea8423 Jul 14 11:22:10.016637 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.016595 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/196ab9de-acb8-4bb7-858a-47ea9bd46804-tls-certs\") pod \"model-serving-api-54d89bd5fc-whlln\" (UID: \"196ab9de-acb8-4bb7-858a-47ea9bd46804\") " pod="opendatahub/model-serving-api-54d89bd5fc-whlln" Jul 14 11:22:10.016850 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.016736 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgzdr\" (UniqueName: \"kubernetes.io/projected/196ab9de-acb8-4bb7-858a-47ea9bd46804-kube-api-access-xgzdr\") pod \"model-serving-api-54d89bd5fc-whlln\" (UID: \"196ab9de-acb8-4bb7-858a-47ea9bd46804\") " pod="opendatahub/model-serving-api-54d89bd5fc-whlln" Jul 14 11:22:10.117860 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.117819 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/196ab9de-acb8-4bb7-858a-47ea9bd46804-tls-certs\") pod \"model-serving-api-54d89bd5fc-whlln\" (UID: \"196ab9de-acb8-4bb7-858a-47ea9bd46804\") " pod="opendatahub/model-serving-api-54d89bd5fc-whlln" Jul 14 11:22:10.118075 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.117901 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgzdr\" (UniqueName: \"kubernetes.io/projected/196ab9de-acb8-4bb7-858a-47ea9bd46804-kube-api-access-xgzdr\") pod \"model-serving-api-54d89bd5fc-whlln\" (UID: \"196ab9de-acb8-4bb7-858a-47ea9bd46804\") " pod="opendatahub/model-serving-api-54d89bd5fc-whlln" Jul 14 11:22:10.118075 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:22:10.117956 2576 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 14 11:22:10.118075 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:22:10.118042 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/196ab9de-acb8-4bb7-858a-47ea9bd46804-tls-certs podName:196ab9de-acb8-4bb7-858a-47ea9bd46804 nodeName:}" failed. No retries permitted until 2026-07-14 11:22:10.618019001 +0000 UTC m=+635.191399353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/196ab9de-acb8-4bb7-858a-47ea9bd46804-tls-certs") pod "model-serving-api-54d89bd5fc-whlln" (UID: "196ab9de-acb8-4bb7-858a-47ea9bd46804") : secret "model-serving-api-tls" not found Jul 14 11:22:10.138436 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.138399 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgzdr\" (UniqueName: \"kubernetes.io/projected/196ab9de-acb8-4bb7-858a-47ea9bd46804-kube-api-access-xgzdr\") pod \"model-serving-api-54d89bd5fc-whlln\" (UID: \"196ab9de-acb8-4bb7-858a-47ea9bd46804\") " pod="opendatahub/model-serving-api-54d89bd5fc-whlln" Jul 14 11:22:10.360346 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.360246 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-jpkt7" event={"ID":"de199871-dbb3-4814-bf72-dacd4247230b","Type":"ContainerStarted","Data":"4041bcf902c0a9ea045c5a17ea78ff10a48ed50b011616c04cda853196ea8423"} Jul 14 11:22:10.622719 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.622628 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/196ab9de-acb8-4bb7-858a-47ea9bd46804-tls-certs\") pod \"model-serving-api-54d89bd5fc-whlln\" (UID: \"196ab9de-acb8-4bb7-858a-47ea9bd46804\") " pod="opendatahub/model-serving-api-54d89bd5fc-whlln" Jul 14 11:22:10.625721 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.625689 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/196ab9de-acb8-4bb7-858a-47ea9bd46804-tls-certs\") pod \"model-serving-api-54d89bd5fc-whlln\" (UID: \"196ab9de-acb8-4bb7-858a-47ea9bd46804\") " pod="opendatahub/model-serving-api-54d89bd5fc-whlln" Jul 14 11:22:10.759219 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.759178 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9"] Jul 14 11:22:10.762709 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.762687 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9" Jul 14 11:22:10.766956 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.766931 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 14 11:22:10.766956 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.766950 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 14 11:22:10.767167 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.766932 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 14 11:22:10.767167 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.767025 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-98q88\"" Jul 14 11:22:10.767281 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.767267 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 14 11:22:10.786251 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.786170 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9"] Jul 14 11:22:10.793754 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.793708 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-whlln" Jul 14 11:22:10.824956 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.824925 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e7b3dd56-03ff-45f5-bbb2-63779b4df149-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-bnwc9\" (UID: \"e7b3dd56-03ff-45f5-bbb2-63779b4df149\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9" Jul 14 11:22:10.825132 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.824972 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7b3dd56-03ff-45f5-bbb2-63779b4df149-local-certs\") pod \"istiod-openshift-gateway-7574459656-bnwc9\" (UID: \"e7b3dd56-03ff-45f5-bbb2-63779b4df149\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9" Jul 14 11:22:10.825132 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.824997 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e7b3dd56-03ff-45f5-bbb2-63779b4df149-cacerts\") pod \"istiod-openshift-gateway-7574459656-bnwc9\" (UID: \"e7b3dd56-03ff-45f5-bbb2-63779b4df149\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9" Jul 14 11:22:10.825132 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.825114 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e7b3dd56-03ff-45f5-bbb2-63779b4df149-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-bnwc9\" (UID: \"e7b3dd56-03ff-45f5-bbb2-63779b4df149\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9" Jul 14 11:22:10.825308 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.825160 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggfq7\" (UniqueName: \"kubernetes.io/projected/e7b3dd56-03ff-45f5-bbb2-63779b4df149-kube-api-access-ggfq7\") pod \"istiod-openshift-gateway-7574459656-bnwc9\" (UID: \"e7b3dd56-03ff-45f5-bbb2-63779b4df149\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9" Jul 14 11:22:10.825308 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.825194 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7b3dd56-03ff-45f5-bbb2-63779b4df149-istio-token\") pod \"istiod-openshift-gateway-7574459656-bnwc9\" (UID: \"e7b3dd56-03ff-45f5-bbb2-63779b4df149\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9" Jul 14 11:22:10.825308 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.825221 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7b3dd56-03ff-45f5-bbb2-63779b4df149-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-bnwc9\" (UID: \"e7b3dd56-03ff-45f5-bbb2-63779b4df149\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9" Jul 14 11:22:10.927181 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.926366 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e7b3dd56-03ff-45f5-bbb2-63779b4df149-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-bnwc9\" (UID: \"e7b3dd56-03ff-45f5-bbb2-63779b4df149\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9" Jul 14 11:22:10.927181 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.926428 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7b3dd56-03ff-45f5-bbb2-63779b4df149-local-certs\") pod \"istiod-openshift-gateway-7574459656-bnwc9\" (UID: \"e7b3dd56-03ff-45f5-bbb2-63779b4df149\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9" Jul 14 11:22:10.927181 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.926453 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e7b3dd56-03ff-45f5-bbb2-63779b4df149-cacerts\") pod \"istiod-openshift-gateway-7574459656-bnwc9\" (UID: \"e7b3dd56-03ff-45f5-bbb2-63779b4df149\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9" Jul 14 11:22:10.927181 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.926532 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e7b3dd56-03ff-45f5-bbb2-63779b4df149-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-bnwc9\" (UID: \"e7b3dd56-03ff-45f5-bbb2-63779b4df149\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9" Jul 14 11:22:10.927181 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.926594 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggfq7\" (UniqueName: \"kubernetes.io/projected/e7b3dd56-03ff-45f5-bbb2-63779b4df149-kube-api-access-ggfq7\") pod \"istiod-openshift-gateway-7574459656-bnwc9\" (UID: \"e7b3dd56-03ff-45f5-bbb2-63779b4df149\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9" Jul 14 11:22:10.927181 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.926624 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7b3dd56-03ff-45f5-bbb2-63779b4df149-istio-token\") pod \"istiod-openshift-gateway-7574459656-bnwc9\" (UID: \"e7b3dd56-03ff-45f5-bbb2-63779b4df149\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9" Jul 14 11:22:10.927181 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.926648 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7b3dd56-03ff-45f5-bbb2-63779b4df149-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-bnwc9\" (UID: \"e7b3dd56-03ff-45f5-bbb2-63779b4df149\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9" Jul 14 11:22:10.929214 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.928620 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e7b3dd56-03ff-45f5-bbb2-63779b4df149-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-bnwc9\" (UID: \"e7b3dd56-03ff-45f5-bbb2-63779b4df149\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9" Jul 14 11:22:10.931181 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.931120 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7b3dd56-03ff-45f5-bbb2-63779b4df149-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-bnwc9\" (UID: \"e7b3dd56-03ff-45f5-bbb2-63779b4df149\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9" Jul 14 11:22:10.932616 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.932164 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e7b3dd56-03ff-45f5-bbb2-63779b4df149-cacerts\") pod \"istiod-openshift-gateway-7574459656-bnwc9\" (UID: \"e7b3dd56-03ff-45f5-bbb2-63779b4df149\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9" Jul 14 11:22:10.932616 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.932562 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e7b3dd56-03ff-45f5-bbb2-63779b4df149-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-bnwc9\" (UID: \"e7b3dd56-03ff-45f5-bbb2-63779b4df149\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9" Jul 14 11:22:10.934646 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.934605 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7b3dd56-03ff-45f5-bbb2-63779b4df149-local-certs\") pod \"istiod-openshift-gateway-7574459656-bnwc9\" (UID: \"e7b3dd56-03ff-45f5-bbb2-63779b4df149\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9" Jul 14 11:22:10.938329 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.938300 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7b3dd56-03ff-45f5-bbb2-63779b4df149-istio-token\") pod \"istiod-openshift-gateway-7574459656-bnwc9\" (UID: \"e7b3dd56-03ff-45f5-bbb2-63779b4df149\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9" Jul 14 11:22:10.939421 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.939378 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggfq7\" (UniqueName: \"kubernetes.io/projected/e7b3dd56-03ff-45f5-bbb2-63779b4df149-kube-api-access-ggfq7\") pod \"istiod-openshift-gateway-7574459656-bnwc9\" (UID: \"e7b3dd56-03ff-45f5-bbb2-63779b4df149\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9" Jul 14 11:22:10.981034 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:10.980997 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-whlln"] Jul 14 11:22:10.985775 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:22:10.985286 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod196ab9de_acb8_4bb7_858a_47ea9bd46804.slice/crio-2758485361c6470fb74f6e59feef83d83ffe1907c75a1e9030d1dde1d44cb689 WatchSource:0}: Error finding container 2758485361c6470fb74f6e59feef83d83ffe1907c75a1e9030d1dde1d44cb689: Status 404 returned error can't find the container with id 2758485361c6470fb74f6e59feef83d83ffe1907c75a1e9030d1dde1d44cb689 Jul 14 11:22:11.073419 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:11.073376 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9" Jul 14 11:22:11.275047 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:11.274921 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9"] Jul 14 11:22:11.280318 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:22:11.280277 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7b3dd56_03ff_45f5_bbb2_63779b4df149.slice/crio-a59586c83a1c80f9fd55ca0cef01a29a04f4fcee557ab3674cf197c77ef8c845 WatchSource:0}: Error finding container a59586c83a1c80f9fd55ca0cef01a29a04f4fcee557ab3674cf197c77ef8c845: Status 404 returned error can't find the container with id a59586c83a1c80f9fd55ca0cef01a29a04f4fcee557ab3674cf197c77ef8c845 Jul 14 11:22:11.368198 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:11.368107 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-whlln" event={"ID":"196ab9de-acb8-4bb7-858a-47ea9bd46804","Type":"ContainerStarted","Data":"2758485361c6470fb74f6e59feef83d83ffe1907c75a1e9030d1dde1d44cb689"} Jul 14 11:22:11.370696 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:11.370655 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9" event={"ID":"e7b3dd56-03ff-45f5-bbb2-63779b4df149","Type":"ContainerStarted","Data":"a59586c83a1c80f9fd55ca0cef01a29a04f4fcee557ab3674cf197c77ef8c845"} Jul 14 11:22:14.394490 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:14.394433 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6b948bb5ff-l5kvc" event={"ID":"f77b4fd2-69eb-44c7-9dea-3dee79258cec","Type":"ContainerStarted","Data":"c916428e5512b35520c98441cf9a8f3118cd213fe394115c9829b41add9f34f4"} Jul 14 11:22:14.396315 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:14.396276 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-jpkt7" event={"ID":"de199871-dbb3-4814-bf72-dacd4247230b","Type":"ContainerStarted","Data":"be0a9aba7272154e32c0ae977e58e438537cc5005028a82911049828adf79558"} Jul 14 11:22:14.396458 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:14.396350 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-jpkt7" Jul 14 11:22:14.398027 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:14.397998 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-whlln" event={"ID":"196ab9de-acb8-4bb7-858a-47ea9bd46804","Type":"ContainerStarted","Data":"38ad7582be28882ca8033d5f0174f32234a1c59bc0a5b9e51b8302f7069ec29b"} Jul 14 11:22:14.398181 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:14.398068 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-whlln" Jul 14 11:22:14.412889 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:14.412826 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6b948bb5ff-l5kvc" podStartSLOduration=1.353624989 podStartE2EDuration="6.412804867s" totalImagesPullingTime="5.059179878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:22:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:22:14.412119228 +0000 UTC m=+638.985499603" watchObservedRunningTime="2026-07-14 11:22:14.412804867 +0000 UTC m=+638.986185242" Jul 14 11:22:14.431260 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:14.431187 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-whlln" podStartSLOduration=2.190161152 podStartE2EDuration="5.431159938s" totalImagesPullingTime="3.240998786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:22:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:22:14.428768226 +0000 UTC m=+639.002148625" watchObservedRunningTime="2026-07-14 11:22:14.431159938 +0000 UTC m=+639.004540344" Jul 14 11:22:14.446808 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:14.446700 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-jpkt7" podStartSLOduration=2.127442182 podStartE2EDuration="6.446679831s" totalImagesPullingTime="4.319237649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:22:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:22:14.445684579 +0000 UTC m=+639.019064954" watchObservedRunningTime="2026-07-14 11:22:14.446679831 +0000 UTC m=+639.020060206" Jul 14 11:22:15.586472 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:15.586432 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 14 11:22:15.586792 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:15.586514 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 14 11:22:16.410291 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.410236 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9" event={"ID":"e7b3dd56-03ff-45f5-bbb2-63779b4df149","Type":"ContainerStarted","Data":"40f6e52315960799d8e9a155abe61aa7c3afcc8ac5b7ed251df52a99b3a02b6f"} Jul 14 11:22:16.410630 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.410392 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9" Jul 14 11:22:16.412206 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.412178 2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-bnwc9 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 14 11:22:16.412329 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.412229 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9" podUID="e7b3dd56-03ff-45f5-bbb2-63779b4df149" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 11:22:16.446524 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.446443 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9" podStartSLOduration=2.14371213 podStartE2EDuration="6.446426583s" totalImagesPullingTime="4.302714453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:22:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:22:16.446221318 +0000 UTC m=+641.019601692" watchObservedRunningTime="2026-07-14 11:22:16.446426583 +0000 UTC m=+641.019806957" Jul 14 11:22:16.776189 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.776149 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd"] Jul 14 11:22:16.779753 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.779732 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" Jul 14 11:22:16.783123 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.783101 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-4t8jk\"" Jul 14 11:22:16.797842 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.797808 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd"] Jul 14 11:22:16.850212 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.850171 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf"] Jul 14 11:22:16.853672 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.853654 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf" Jul 14 11:22:16.870667 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.870635 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf"] Jul 14 11:22:16.879384 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.879351 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f53ce79-a85d-4178-ba45-475886350c24-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd\" (UID: \"9f53ce79-a85d-4178-ba45-475886350c24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" Jul 14 11:22:16.879384 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.879388 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/976ae51f-69b8-432d-b4ff-551403684b5b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jsvwf\" (UID: \"976ae51f-69b8-432d-b4ff-551403684b5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf" Jul 14 11:22:16.879683 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.879414 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/976ae51f-69b8-432d-b4ff-551403684b5b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jsvwf\" (UID: \"976ae51f-69b8-432d-b4ff-551403684b5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf" Jul 14 11:22:16.879683 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.879484 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/976ae51f-69b8-432d-b4ff-551403684b5b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jsvwf\" (UID: \"976ae51f-69b8-432d-b4ff-551403684b5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf" Jul 14 11:22:16.879683 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.879521 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/976ae51f-69b8-432d-b4ff-551403684b5b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jsvwf\" (UID: \"976ae51f-69b8-432d-b4ff-551403684b5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf" Jul 14 11:22:16.879683 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.879606 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f53ce79-a85d-4178-ba45-475886350c24-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd\" (UID: \"9f53ce79-a85d-4178-ba45-475886350c24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" Jul 14 11:22:16.879683 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.879629 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/976ae51f-69b8-432d-b4ff-551403684b5b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jsvwf\" (UID: \"976ae51f-69b8-432d-b4ff-551403684b5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf" Jul 14 11:22:16.879683 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.879646 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/976ae51f-69b8-432d-b4ff-551403684b5b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jsvwf\" (UID: \"976ae51f-69b8-432d-b4ff-551403684b5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf" Jul 14 11:22:16.879683 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.879662 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f53ce79-a85d-4178-ba45-475886350c24-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd\" (UID: \"9f53ce79-a85d-4178-ba45-475886350c24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" Jul 14 11:22:16.879683 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.879677 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69pnr\" (UniqueName: \"kubernetes.io/projected/9f53ce79-a85d-4178-ba45-475886350c24-kube-api-access-69pnr\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd\" (UID: \"9f53ce79-a85d-4178-ba45-475886350c24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" Jul 14 11:22:16.880002 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.879723 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/976ae51f-69b8-432d-b4ff-551403684b5b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jsvwf\" (UID: \"976ae51f-69b8-432d-b4ff-551403684b5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf" Jul 14 11:22:16.880002 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.879761 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/976ae51f-69b8-432d-b4ff-551403684b5b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jsvwf\" (UID: \"976ae51f-69b8-432d-b4ff-551403684b5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf" Jul 14 11:22:16.880002 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.879800 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f53ce79-a85d-4178-ba45-475886350c24-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd\" (UID: \"9f53ce79-a85d-4178-ba45-475886350c24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" Jul 14 11:22:16.880002 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.879817 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f53ce79-a85d-4178-ba45-475886350c24-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd\" (UID: \"9f53ce79-a85d-4178-ba45-475886350c24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" Jul 14 11:22:16.880002 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.879833 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f53ce79-a85d-4178-ba45-475886350c24-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd\" (UID: \"9f53ce79-a85d-4178-ba45-475886350c24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" Jul 14 11:22:16.880002 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.879883 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f53ce79-a85d-4178-ba45-475886350c24-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd\" (UID: \"9f53ce79-a85d-4178-ba45-475886350c24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" Jul 14 11:22:16.880002 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.879900 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f53ce79-a85d-4178-ba45-475886350c24-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd\" (UID: \"9f53ce79-a85d-4178-ba45-475886350c24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" Jul 14 11:22:16.880002 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.879916 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qh57\" (UniqueName: \"kubernetes.io/projected/976ae51f-69b8-432d-b4ff-551403684b5b-kube-api-access-6qh57\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jsvwf\" (UID: \"976ae51f-69b8-432d-b4ff-551403684b5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf" Jul 14 11:22:16.980782 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.980739 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f53ce79-a85d-4178-ba45-475886350c24-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd\" (UID: \"9f53ce79-a85d-4178-ba45-475886350c24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" Jul 14 11:22:16.980782 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.980784 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f53ce79-a85d-4178-ba45-475886350c24-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd\" (UID: \"9f53ce79-a85d-4178-ba45-475886350c24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" Jul 14 11:22:16.981103 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.980803 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qh57\" (UniqueName: \"kubernetes.io/projected/976ae51f-69b8-432d-b4ff-551403684b5b-kube-api-access-6qh57\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jsvwf\" (UID: \"976ae51f-69b8-432d-b4ff-551403684b5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf" Jul 14 11:22:16.981103 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.980864 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f53ce79-a85d-4178-ba45-475886350c24-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd\" (UID: \"9f53ce79-a85d-4178-ba45-475886350c24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" Jul 14 11:22:16.981103 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.980993 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/976ae51f-69b8-432d-b4ff-551403684b5b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jsvwf\" (UID: \"976ae51f-69b8-432d-b4ff-551403684b5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf" Jul 14 11:22:16.981103 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.981050 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/976ae51f-69b8-432d-b4ff-551403684b5b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jsvwf\" (UID: \"976ae51f-69b8-432d-b4ff-551403684b5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf" Jul 14 11:22:16.981103 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.981093 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/976ae51f-69b8-432d-b4ff-551403684b5b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jsvwf\" (UID: \"976ae51f-69b8-432d-b4ff-551403684b5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf" Jul 14 11:22:16.981475 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.981119 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/976ae51f-69b8-432d-b4ff-551403684b5b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jsvwf\" (UID: \"976ae51f-69b8-432d-b4ff-551403684b5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf" Jul 14 11:22:16.981475 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.981265 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f53ce79-a85d-4178-ba45-475886350c24-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd\" (UID: \"9f53ce79-a85d-4178-ba45-475886350c24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" Jul 14 11:22:16.981475 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.981304 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/976ae51f-69b8-432d-b4ff-551403684b5b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jsvwf\" (UID: \"976ae51f-69b8-432d-b4ff-551403684b5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf" Jul 14 11:22:16.981475 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.981326 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f53ce79-a85d-4178-ba45-475886350c24-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd\" (UID: \"9f53ce79-a85d-4178-ba45-475886350c24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" Jul 14 11:22:16.981475 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.981340 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/976ae51f-69b8-432d-b4ff-551403684b5b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jsvwf\" (UID: \"976ae51f-69b8-432d-b4ff-551403684b5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf" Jul 14 11:22:16.981475 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.981370 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f53ce79-a85d-4178-ba45-475886350c24-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd\" (UID: \"9f53ce79-a85d-4178-ba45-475886350c24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" Jul 14 11:22:16.981475 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.981394 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69pnr\" (UniqueName: \"kubernetes.io/projected/9f53ce79-a85d-4178-ba45-475886350c24-kube-api-access-69pnr\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd\" (UID: \"9f53ce79-a85d-4178-ba45-475886350c24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" Jul 14 11:22:16.981475 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.981421 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/976ae51f-69b8-432d-b4ff-551403684b5b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jsvwf\" (UID: \"976ae51f-69b8-432d-b4ff-551403684b5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf" Jul 14 11:22:16.981475 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.981445 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/976ae51f-69b8-432d-b4ff-551403684b5b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jsvwf\" (UID: \"976ae51f-69b8-432d-b4ff-551403684b5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf" Jul 14 11:22:16.982138 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.981497 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f53ce79-a85d-4178-ba45-475886350c24-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd\" (UID: \"9f53ce79-a85d-4178-ba45-475886350c24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" Jul 14 11:22:16.982138 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.981526 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f53ce79-a85d-4178-ba45-475886350c24-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd\" (UID: \"9f53ce79-a85d-4178-ba45-475886350c24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" Jul 14 11:22:16.982138 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.981573 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/976ae51f-69b8-432d-b4ff-551403684b5b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jsvwf\" (UID: \"976ae51f-69b8-432d-b4ff-551403684b5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf" Jul 14 11:22:16.982138 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.981589 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f53ce79-a85d-4178-ba45-475886350c24-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd\" (UID: \"9f53ce79-a85d-4178-ba45-475886350c24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" Jul 14 11:22:16.982138 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.981592 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f53ce79-a85d-4178-ba45-475886350c24-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd\" (UID: \"9f53ce79-a85d-4178-ba45-475886350c24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" Jul 14 11:22:16.982138 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.981635 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f53ce79-a85d-4178-ba45-475886350c24-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd\" (UID: \"9f53ce79-a85d-4178-ba45-475886350c24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" Jul 14 11:22:16.982138 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.982088 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f53ce79-a85d-4178-ba45-475886350c24-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd\" (UID: \"9f53ce79-a85d-4178-ba45-475886350c24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" Jul 14 11:22:16.982566 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.982206 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/976ae51f-69b8-432d-b4ff-551403684b5b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jsvwf\" (UID: \"976ae51f-69b8-432d-b4ff-551403684b5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf" Jul 14 11:22:16.982566 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.982455 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/976ae51f-69b8-432d-b4ff-551403684b5b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jsvwf\" (UID: \"976ae51f-69b8-432d-b4ff-551403684b5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf" Jul 14 11:22:16.982741 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.982718 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f53ce79-a85d-4178-ba45-475886350c24-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd\" (UID: \"9f53ce79-a85d-4178-ba45-475886350c24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" Jul 14 11:22:16.982799 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.982741 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/976ae51f-69b8-432d-b4ff-551403684b5b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jsvwf\" (UID: \"976ae51f-69b8-432d-b4ff-551403684b5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf" Jul 14 11:22:16.982852 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.982820 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/976ae51f-69b8-432d-b4ff-551403684b5b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jsvwf\" (UID: \"976ae51f-69b8-432d-b4ff-551403684b5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf" Jul 14 11:22:16.983883 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.983835 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/976ae51f-69b8-432d-b4ff-551403684b5b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jsvwf\" (UID: \"976ae51f-69b8-432d-b4ff-551403684b5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf" Jul 14 11:22:16.984099 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.984078 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f53ce79-a85d-4178-ba45-475886350c24-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd\" (UID: \"9f53ce79-a85d-4178-ba45-475886350c24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" Jul 14 11:22:16.985295 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.985009 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f53ce79-a85d-4178-ba45-475886350c24-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd\" (UID: \"9f53ce79-a85d-4178-ba45-475886350c24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" Jul 14 11:22:16.985295 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.985243 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/976ae51f-69b8-432d-b4ff-551403684b5b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jsvwf\" (UID: \"976ae51f-69b8-432d-b4ff-551403684b5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf" Jul 14 11:22:16.993279 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.993055 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/976ae51f-69b8-432d-b4ff-551403684b5b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jsvwf\" (UID: \"976ae51f-69b8-432d-b4ff-551403684b5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf" Jul 14 11:22:16.993279 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.993147 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69pnr\" (UniqueName: \"kubernetes.io/projected/9f53ce79-a85d-4178-ba45-475886350c24-kube-api-access-69pnr\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd\" (UID: \"9f53ce79-a85d-4178-ba45-475886350c24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" Jul 14 11:22:16.993637 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.993530 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f53ce79-a85d-4178-ba45-475886350c24-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd\" (UID: \"9f53ce79-a85d-4178-ba45-475886350c24\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" Jul 14 11:22:16.993731 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:16.993643 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qh57\" (UniqueName: \"kubernetes.io/projected/976ae51f-69b8-432d-b4ff-551403684b5b-kube-api-access-6qh57\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jsvwf\" (UID: \"976ae51f-69b8-432d-b4ff-551403684b5b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf" Jul 14 11:22:17.089957 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:17.089874 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" Jul 14 11:22:17.166288 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:17.166201 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf" Jul 14 11:22:17.256493 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:17.256462 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd"] Jul 14 11:22:17.264880 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:22:17.264842 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f53ce79_a85d_4178_ba45_475886350c24.slice/crio-a39306cdf2eba5009a996307357588bcc667e0dd8133fdc53f17230098ee401c WatchSource:0}: Error finding container a39306cdf2eba5009a996307357588bcc667e0dd8133fdc53f17230098ee401c: Status 404 returned error can't find the container with id a39306cdf2eba5009a996307357588bcc667e0dd8133fdc53f17230098ee401c Jul 14 11:22:17.346196 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:17.346103 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf"] Jul 14 11:22:17.350286 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:22:17.350257 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod976ae51f_69b8_432d_b4ff_551403684b5b.slice/crio-2f5d6d5e485755aa4470f8c953109823033edf08d3a6b7a1049ba13c271853f0 WatchSource:0}: Error finding container 2f5d6d5e485755aa4470f8c953109823033edf08d3a6b7a1049ba13c271853f0: Status 404 returned error can't find the container with id 2f5d6d5e485755aa4470f8c953109823033edf08d3a6b7a1049ba13c271853f0 Jul 14 11:22:17.417475 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:17.417439 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" event={"ID":"9f53ce79-a85d-4178-ba45-475886350c24","Type":"ContainerStarted","Data":"a39306cdf2eba5009a996307357588bcc667e0dd8133fdc53f17230098ee401c"} Jul 14 11:22:17.418763 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:17.418731 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf" event={"ID":"976ae51f-69b8-432d-b4ff-551403684b5b","Type":"ContainerStarted","Data":"2f5d6d5e485755aa4470f8c953109823033edf08d3a6b7a1049ba13c271853f0"} Jul 14 11:22:17.419654 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:17.419634 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9" Jul 14 11:22:19.792990 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:19.792950 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-gzdvw"] Jul 14 11:22:19.800718 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:19.800686 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gzdvw" Jul 14 11:22:19.805471 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:19.805431 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 14 11:22:19.805660 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:19.805579 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-s6bdc\"" Jul 14 11:22:19.811505 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:19.811478 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-7cpcf"] Jul 14 11:22:19.815096 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:19.815074 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7cpcf" Jul 14 11:22:19.828494 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:19.828089 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 14 11:22:19.828494 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:19.828231 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-2zngj\"" Jul 14 11:22:19.843193 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:19.843144 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-gzdvw"] Jul 14 11:22:19.865207 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:19.865093 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-7cpcf"] Jul 14 11:22:19.916100 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:19.916010 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v6h7\" (UniqueName: \"kubernetes.io/projected/adf43478-0d24-48d3-9487-ac3765a18975-kube-api-access-4v6h7\") pod \"llmisvc-controller-manager-777c6bd7d5-7cpcf\" (UID: \"adf43478-0d24-48d3-9487-ac3765a18975\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7cpcf" Jul 14 11:22:19.916393 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:19.916368 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/adf43478-0d24-48d3-9487-ac3765a18975-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-7cpcf\" (UID: \"adf43478-0d24-48d3-9487-ac3765a18975\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7cpcf" Jul 14 11:22:19.916530 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:19.916402 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7b96a3bb-4f4a-450e-a15c-7840fc08eeaf-cert\") pod \"kserve-controller-manager-d6f4b65b8-gzdvw\" (UID: \"7b96a3bb-4f4a-450e-a15c-7840fc08eeaf\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gzdvw" Jul 14 11:22:19.916530 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:19.916419 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgb56\" (UniqueName: \"kubernetes.io/projected/7b96a3bb-4f4a-450e-a15c-7840fc08eeaf-kube-api-access-sgb56\") pod \"kserve-controller-manager-d6f4b65b8-gzdvw\" (UID: \"7b96a3bb-4f4a-450e-a15c-7840fc08eeaf\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gzdvw" Jul 14 11:22:20.017800 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.017759 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v6h7\" (UniqueName: \"kubernetes.io/projected/adf43478-0d24-48d3-9487-ac3765a18975-kube-api-access-4v6h7\") pod \"llmisvc-controller-manager-777c6bd7d5-7cpcf\" (UID: \"adf43478-0d24-48d3-9487-ac3765a18975\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7cpcf" Jul 14 11:22:20.017800 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.017808 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/adf43478-0d24-48d3-9487-ac3765a18975-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-7cpcf\" (UID: \"adf43478-0d24-48d3-9487-ac3765a18975\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7cpcf" Jul 14 11:22:20.018041 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.017843 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7b96a3bb-4f4a-450e-a15c-7840fc08eeaf-cert\") pod \"kserve-controller-manager-d6f4b65b8-gzdvw\" (UID: \"7b96a3bb-4f4a-450e-a15c-7840fc08eeaf\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gzdvw" Jul 14 11:22:20.018041 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.017862 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgb56\" (UniqueName: \"kubernetes.io/projected/7b96a3bb-4f4a-450e-a15c-7840fc08eeaf-kube-api-access-sgb56\") pod \"kserve-controller-manager-d6f4b65b8-gzdvw\" (UID: \"7b96a3bb-4f4a-450e-a15c-7840fc08eeaf\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gzdvw" Jul 14 11:22:20.020906 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.020870 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/adf43478-0d24-48d3-9487-ac3765a18975-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-7cpcf\" (UID: \"adf43478-0d24-48d3-9487-ac3765a18975\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7cpcf" Jul 14 11:22:20.021078 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.020873 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7b96a3bb-4f4a-450e-a15c-7840fc08eeaf-cert\") pod \"kserve-controller-manager-d6f4b65b8-gzdvw\" (UID: \"7b96a3bb-4f4a-450e-a15c-7840fc08eeaf\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gzdvw" Jul 14 11:22:20.034438 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.034405 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v6h7\" (UniqueName: \"kubernetes.io/projected/adf43478-0d24-48d3-9487-ac3765a18975-kube-api-access-4v6h7\") pod \"llmisvc-controller-manager-777c6bd7d5-7cpcf\" (UID: \"adf43478-0d24-48d3-9487-ac3765a18975\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7cpcf" Jul 14 11:22:20.044439 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.044332 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgb56\" (UniqueName: \"kubernetes.io/projected/7b96a3bb-4f4a-450e-a15c-7840fc08eeaf-kube-api-access-sgb56\") pod \"kserve-controller-manager-d6f4b65b8-gzdvw\" (UID: \"7b96a3bb-4f4a-450e-a15c-7840fc08eeaf\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gzdvw" Jul 14 11:22:20.114012 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.113974 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gzdvw" Jul 14 11:22:20.128608 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.128584 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7cpcf" Jul 14 11:22:20.240558 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.240485 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 14 11:22:20.240693 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.240647 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 14 11:22:20.240766 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.240704 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 14 11:22:20.246837 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.246798 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 14 11:22:20.246938 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.246925 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 14 11:22:20.246996 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.246957 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 14 11:22:20.340010 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.339941 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-gzdvw"] Jul 14 11:22:20.343142 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:22:20.343092 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b96a3bb_4f4a_450e_a15c_7840fc08eeaf.slice/crio-c4d0acda84b277481c3cb388410d077383b214107c578e796b7605e428a33534 WatchSource:0}: Error finding container c4d0acda84b277481c3cb388410d077383b214107c578e796b7605e428a33534: Status 404 returned error can't find the container with id c4d0acda84b277481c3cb388410d077383b214107c578e796b7605e428a33534 Jul 14 11:22:20.349179 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:22:20.349136 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podadf43478_0d24_48d3_9487_ac3765a18975.slice/crio-7da7d89918ac6d313e90460d17b93481361a9f442a6e7e15d57f71ac74c31e20 WatchSource:0}: Error finding container 7da7d89918ac6d313e90460d17b93481361a9f442a6e7e15d57f71ac74c31e20: Status 404 returned error can't find the container with id 7da7d89918ac6d313e90460d17b93481361a9f442a6e7e15d57f71ac74c31e20 Jul 14 11:22:20.350877 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.350842 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-7cpcf"] Jul 14 11:22:20.439449 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.439331 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" event={"ID":"9f53ce79-a85d-4178-ba45-475886350c24","Type":"ContainerStarted","Data":"efea9fcc3b7cfaf47a75e7e6f3b7459e752112053fde7534595b0ef77f6fddd7"} Jul 14 11:22:20.440953 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.440919 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7cpcf" event={"ID":"adf43478-0d24-48d3-9487-ac3765a18975","Type":"ContainerStarted","Data":"7da7d89918ac6d313e90460d17b93481361a9f442a6e7e15d57f71ac74c31e20"} Jul 14 11:22:20.442326 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.442301 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gzdvw" event={"ID":"7b96a3bb-4f4a-450e-a15c-7840fc08eeaf","Type":"ContainerStarted","Data":"c4d0acda84b277481c3cb388410d077383b214107c578e796b7605e428a33534"} Jul 14 11:22:20.443963 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.443929 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf" event={"ID":"976ae51f-69b8-432d-b4ff-551403684b5b","Type":"ContainerStarted","Data":"bf438755af96ba69aa0b76fc275f00ba6269d0241b6ddb1afaf02fb3f79825e8"} Jul 14 11:22:20.476850 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.476786 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" podStartSLOduration=1.503919823 podStartE2EDuration="4.476760761s" totalImagesPullingTime="2.972840938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:22:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:22:20.473810367 +0000 UTC m=+645.047190742" watchObservedRunningTime="2026-07-14 11:22:20.476760761 +0000 UTC m=+645.050141137" Jul 14 11:22:20.502745 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.502685 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf" podStartSLOduration=1.6087606719999998 podStartE2EDuration="4.50266075s" totalImagesPullingTime="2.893900078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:22:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:22:20.501010367 +0000 UTC m=+645.074390742" watchObservedRunningTime="2026-07-14 11:22:20.50266075 +0000 UTC m=+645.076041126" Jul 14 11:22:20.577397 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.577297 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9"] Jul 14 11:22:20.577616 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.577588 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9" podUID="e7b3dd56-03ff-45f5-bbb2-63779b4df149" containerName="discovery" containerID="cri-o://40f6e52315960799d8e9a155abe61aa7c3afcc8ac5b7ed251df52a99b3a02b6f" gracePeriod=30 Jul 14 11:22:20.831712 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.831643 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9" Jul 14 11:22:20.927345 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.927302 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e7b3dd56-03ff-45f5-bbb2-63779b4df149-istio-csr-dns-cert\") pod \"e7b3dd56-03ff-45f5-bbb2-63779b4df149\" (UID: \"e7b3dd56-03ff-45f5-bbb2-63779b4df149\") " Jul 14 11:22:20.927559 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.927391 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7b3dd56-03ff-45f5-bbb2-63779b4df149-istio-kubeconfig\") pod \"e7b3dd56-03ff-45f5-bbb2-63779b4df149\" (UID: \"e7b3dd56-03ff-45f5-bbb2-63779b4df149\") " Jul 14 11:22:20.927559 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.927427 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7b3dd56-03ff-45f5-bbb2-63779b4df149-local-certs\") pod \"e7b3dd56-03ff-45f5-bbb2-63779b4df149\" (UID: \"e7b3dd56-03ff-45f5-bbb2-63779b4df149\") " Jul 14 11:22:20.927559 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.927450 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggfq7\" (UniqueName: \"kubernetes.io/projected/e7b3dd56-03ff-45f5-bbb2-63779b4df149-kube-api-access-ggfq7\") pod \"e7b3dd56-03ff-45f5-bbb2-63779b4df149\" (UID: \"e7b3dd56-03ff-45f5-bbb2-63779b4df149\") " Jul 14 11:22:20.927559 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.927514 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7b3dd56-03ff-45f5-bbb2-63779b4df149-istio-token\") pod \"e7b3dd56-03ff-45f5-bbb2-63779b4df149\" (UID: \"e7b3dd56-03ff-45f5-bbb2-63779b4df149\") " Jul 14 11:22:20.927790 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.927606 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e7b3dd56-03ff-45f5-bbb2-63779b4df149-cacerts\") pod \"e7b3dd56-03ff-45f5-bbb2-63779b4df149\" (UID: \"e7b3dd56-03ff-45f5-bbb2-63779b4df149\") " Jul 14 11:22:20.927790 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.927650 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e7b3dd56-03ff-45f5-bbb2-63779b4df149-istio-csr-ca-configmap\") pod \"e7b3dd56-03ff-45f5-bbb2-63779b4df149\" (UID: \"e7b3dd56-03ff-45f5-bbb2-63779b4df149\") " Jul 14 11:22:20.928389 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.928353 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7b3dd56-03ff-45f5-bbb2-63779b4df149-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "e7b3dd56-03ff-45f5-bbb2-63779b4df149" (UID: "e7b3dd56-03ff-45f5-bbb2-63779b4df149"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:22:20.929971 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.929943 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7b3dd56-03ff-45f5-bbb2-63779b4df149-local-certs" (OuterVolumeSpecName: "local-certs") pod "e7b3dd56-03ff-45f5-bbb2-63779b4df149" (UID: "e7b3dd56-03ff-45f5-bbb2-63779b4df149"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 11:22:20.930083 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.929943 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7b3dd56-03ff-45f5-bbb2-63779b4df149-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "e7b3dd56-03ff-45f5-bbb2-63779b4df149" (UID: "e7b3dd56-03ff-45f5-bbb2-63779b4df149"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:22:20.930197 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.930175 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7b3dd56-03ff-45f5-bbb2-63779b4df149-cacerts" (OuterVolumeSpecName: "cacerts") pod "e7b3dd56-03ff-45f5-bbb2-63779b4df149" (UID: "e7b3dd56-03ff-45f5-bbb2-63779b4df149"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:22:20.930253 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.930237 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7b3dd56-03ff-45f5-bbb2-63779b4df149-kube-api-access-ggfq7" (OuterVolumeSpecName: "kube-api-access-ggfq7") pod "e7b3dd56-03ff-45f5-bbb2-63779b4df149" (UID: "e7b3dd56-03ff-45f5-bbb2-63779b4df149"). InnerVolumeSpecName "kube-api-access-ggfq7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:22:20.930336 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.930317 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7b3dd56-03ff-45f5-bbb2-63779b4df149-istio-token" (OuterVolumeSpecName: "istio-token") pod "e7b3dd56-03ff-45f5-bbb2-63779b4df149" (UID: "e7b3dd56-03ff-45f5-bbb2-63779b4df149"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:22:20.930375 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:20.930349 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7b3dd56-03ff-45f5-bbb2-63779b4df149-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "e7b3dd56-03ff-45f5-bbb2-63779b4df149" (UID: "e7b3dd56-03ff-45f5-bbb2-63779b4df149"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:22:21.028928 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:21.028792 2576 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7b3dd56-03ff-45f5-bbb2-63779b4df149-istio-kubeconfig\") on node \"ip-10-0-139-35.ec2.internal\" DevicePath \"\"" Jul 14 11:22:21.028928 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:21.028828 2576 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7b3dd56-03ff-45f5-bbb2-63779b4df149-local-certs\") on node \"ip-10-0-139-35.ec2.internal\" DevicePath \"\"" Jul 14 11:22:21.028928 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:21.028843 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggfq7\" (UniqueName: \"kubernetes.io/projected/e7b3dd56-03ff-45f5-bbb2-63779b4df149-kube-api-access-ggfq7\") on node \"ip-10-0-139-35.ec2.internal\" DevicePath \"\"" Jul 14 11:22:21.028928 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:21.028858 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7b3dd56-03ff-45f5-bbb2-63779b4df149-istio-token\") on node \"ip-10-0-139-35.ec2.internal\" DevicePath \"\"" Jul 14 11:22:21.028928 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:21.028872 2576 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e7b3dd56-03ff-45f5-bbb2-63779b4df149-cacerts\") on node \"ip-10-0-139-35.ec2.internal\" DevicePath \"\"" Jul 14 11:22:21.028928 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:21.028883 2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e7b3dd56-03ff-45f5-bbb2-63779b4df149-istio-csr-ca-configmap\") on node \"ip-10-0-139-35.ec2.internal\" DevicePath \"\"" Jul 14 11:22:21.028928 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:21.028897 2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e7b3dd56-03ff-45f5-bbb2-63779b4df149-istio-csr-dns-cert\") on node \"ip-10-0-139-35.ec2.internal\" DevicePath \"\"" Jul 14 11:22:21.090461 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:21.090376 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" Jul 14 11:22:21.092011 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:21.091969 2576 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 14 11:22:21.092171 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:21.092034 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" podUID="9f53ce79-a85d-4178-ba45-475886350c24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 14 11:22:21.166719 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:21.166676 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf" Jul 14 11:22:21.172644 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:21.172614 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf" Jul 14 11:22:21.452671 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:21.452574 2576 generic.go:356] "Generic (PLEG): container finished" podID="e7b3dd56-03ff-45f5-bbb2-63779b4df149" containerID="40f6e52315960799d8e9a155abe61aa7c3afcc8ac5b7ed251df52a99b3a02b6f" exitCode=0 Jul 14 11:22:21.456563 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:21.453379 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9" Jul 14 11:22:21.463080 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:21.463044 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9" event={"ID":"e7b3dd56-03ff-45f5-bbb2-63779b4df149","Type":"ContainerDied","Data":"40f6e52315960799d8e9a155abe61aa7c3afcc8ac5b7ed251df52a99b3a02b6f"} Jul 14 11:22:21.465109 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:21.463442 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9" event={"ID":"e7b3dd56-03ff-45f5-bbb2-63779b4df149","Type":"ContainerDied","Data":"a59586c83a1c80f9fd55ca0cef01a29a04f4fcee557ab3674cf197c77ef8c845"} Jul 14 11:22:21.465109 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:21.463487 2576 scope.go:117] "RemoveContainer" containerID="40f6e52315960799d8e9a155abe61aa7c3afcc8ac5b7ed251df52a99b3a02b6f" Jul 14 11:22:21.465109 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:21.464442 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf" Jul 14 11:22:21.466872 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:21.466851 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jsvwf" Jul 14 11:22:21.490336 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:21.490307 2576 scope.go:117] "RemoveContainer" containerID="40f6e52315960799d8e9a155abe61aa7c3afcc8ac5b7ed251df52a99b3a02b6f" Jul 14 11:22:21.490768 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:22:21.490737 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40f6e52315960799d8e9a155abe61aa7c3afcc8ac5b7ed251df52a99b3a02b6f\": container with ID starting with 40f6e52315960799d8e9a155abe61aa7c3afcc8ac5b7ed251df52a99b3a02b6f not found: ID does not exist" containerID="40f6e52315960799d8e9a155abe61aa7c3afcc8ac5b7ed251df52a99b3a02b6f" Jul 14 11:22:21.490876 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:21.490778 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40f6e52315960799d8e9a155abe61aa7c3afcc8ac5b7ed251df52a99b3a02b6f"} err="failed to get container status \"40f6e52315960799d8e9a155abe61aa7c3afcc8ac5b7ed251df52a99b3a02b6f\": rpc error: code = NotFound desc = could not find container \"40f6e52315960799d8e9a155abe61aa7c3afcc8ac5b7ed251df52a99b3a02b6f\": container with ID starting with 40f6e52315960799d8e9a155abe61aa7c3afcc8ac5b7ed251df52a99b3a02b6f not found: ID does not exist" Jul 14 11:22:21.558390 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:21.558344 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9"] Jul 14 11:22:21.572368 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:21.572326 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bnwc9"] Jul 14 11:22:21.659776 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:21.659735 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd"] Jul 14 11:22:21.962682 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:21.962649 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7b3dd56-03ff-45f5-bbb2-63779b4df149" path="/var/lib/kubelet/pods/e7b3dd56-03ff-45f5-bbb2-63779b4df149/volumes" Jul 14 11:22:22.090775 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:22.090735 2576 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 14 11:22:22.090931 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:22.090804 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" podUID="9f53ce79-a85d-4178-ba45-475886350c24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 14 11:22:23.091088 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:23.091052 2576 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 14 11:22:23.091468 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:23.091110 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" podUID="9f53ce79-a85d-4178-ba45-475886350c24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 14 11:22:23.468613 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:23.468573 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gzdvw" event={"ID":"7b96a3bb-4f4a-450e-a15c-7840fc08eeaf","Type":"ContainerStarted","Data":"01021a9f0f831c54b75bf2a63a681a9843e297eaf55f386dfcd534d1d548771f"} Jul 14 11:22:23.468817 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:23.468749 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" podUID="9f53ce79-a85d-4178-ba45-475886350c24" containerName="istio-proxy" containerID="cri-o://efea9fcc3b7cfaf47a75e7e6f3b7459e752112053fde7534595b0ef77f6fddd7" gracePeriod=30 Jul 14 11:22:23.468998 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:23.468949 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gzdvw" Jul 14 11:22:23.529209 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:23.529152 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gzdvw" podStartSLOduration=1.848932083 podStartE2EDuration="4.529133708s" totalImagesPullingTime="2.680201625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:22:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:22:23.529047176 +0000 UTC m=+648.102427580" watchObservedRunningTime="2026-07-14 11:22:23.529133708 +0000 UTC m=+648.102514083" Jul 14 11:22:24.475016 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:24.474979 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7cpcf" event={"ID":"adf43478-0d24-48d3-9487-ac3765a18975","Type":"ContainerStarted","Data":"4eb005fb6b3951cd6ab36a7c52e1ea18f4b5f8d91064672ec06559d204561f30"} Jul 14 11:22:24.475404 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:24.475267 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7cpcf" Jul 14 11:22:24.493020 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:24.492966 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7cpcf" podStartSLOduration=2.047947087 podStartE2EDuration="5.492950556s" totalImagesPullingTime="3.445003469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:22:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:22:24.492117515 +0000 UTC m=+649.065497909" watchObservedRunningTime="2026-07-14 11:22:24.492950556 +0000 UTC m=+649.066330930" Jul 14 11:22:25.406071 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:25.406035 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-jpkt7" Jul 14 11:22:25.407731 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:25.407710 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-whlln" Jul 14 11:22:28.733364 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:28.733294 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" Jul 14 11:22:28.808260 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:28.808222 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f53ce79-a85d-4178-ba45-475886350c24-credential-socket\") pod \"9f53ce79-a85d-4178-ba45-475886350c24\" (UID: \"9f53ce79-a85d-4178-ba45-475886350c24\") " Jul 14 11:22:28.808432 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:28.808284 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69pnr\" (UniqueName: \"kubernetes.io/projected/9f53ce79-a85d-4178-ba45-475886350c24-kube-api-access-69pnr\") pod \"9f53ce79-a85d-4178-ba45-475886350c24\" (UID: \"9f53ce79-a85d-4178-ba45-475886350c24\") " Jul 14 11:22:28.808432 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:28.808322 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f53ce79-a85d-4178-ba45-475886350c24-istiod-ca-cert\") pod \"9f53ce79-a85d-4178-ba45-475886350c24\" (UID: \"9f53ce79-a85d-4178-ba45-475886350c24\") " Jul 14 11:22:28.808432 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:28.808355 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f53ce79-a85d-4178-ba45-475886350c24-istio-token\") pod \"9f53ce79-a85d-4178-ba45-475886350c24\" (UID: \"9f53ce79-a85d-4178-ba45-475886350c24\") " Jul 14 11:22:28.808432 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:28.808412 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f53ce79-a85d-4178-ba45-475886350c24-istio-data\") pod \"9f53ce79-a85d-4178-ba45-475886350c24\" (UID: \"9f53ce79-a85d-4178-ba45-475886350c24\") " Jul 14 11:22:28.808678 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:28.808452 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f53ce79-a85d-4178-ba45-475886350c24-istio-envoy\") pod \"9f53ce79-a85d-4178-ba45-475886350c24\" (UID: \"9f53ce79-a85d-4178-ba45-475886350c24\") " Jul 14 11:22:28.808678 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:28.808474 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f53ce79-a85d-4178-ba45-475886350c24-workload-socket\") pod \"9f53ce79-a85d-4178-ba45-475886350c24\" (UID: \"9f53ce79-a85d-4178-ba45-475886350c24\") " Jul 14 11:22:28.808678 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:28.808507 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f53ce79-a85d-4178-ba45-475886350c24-istio-podinfo\") pod \"9f53ce79-a85d-4178-ba45-475886350c24\" (UID: \"9f53ce79-a85d-4178-ba45-475886350c24\") " Jul 14 11:22:28.808678 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:28.808564 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f53ce79-a85d-4178-ba45-475886350c24-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9f53ce79-a85d-4178-ba45-475886350c24" (UID: "9f53ce79-a85d-4178-ba45-475886350c24"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 11:22:28.808882 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:28.808737 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f53ce79-a85d-4178-ba45-475886350c24-istio-data" (OuterVolumeSpecName: "istio-data") pod "9f53ce79-a85d-4178-ba45-475886350c24" (UID: "9f53ce79-a85d-4178-ba45-475886350c24"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 11:22:28.808882 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:28.808581 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f53ce79-a85d-4178-ba45-475886350c24-workload-certs\") pod \"9f53ce79-a85d-4178-ba45-475886350c24\" (UID: \"9f53ce79-a85d-4178-ba45-475886350c24\") " Jul 14 11:22:28.808882 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:28.808769 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f53ce79-a85d-4178-ba45-475886350c24-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9f53ce79-a85d-4178-ba45-475886350c24" (UID: "9f53ce79-a85d-4178-ba45-475886350c24"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 11:22:28.808882 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:28.808838 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f53ce79-a85d-4178-ba45-475886350c24-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9f53ce79-a85d-4178-ba45-475886350c24" (UID: "9f53ce79-a85d-4178-ba45-475886350c24"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 11:22:28.808882 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:28.808860 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f53ce79-a85d-4178-ba45-475886350c24-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9f53ce79-a85d-4178-ba45-475886350c24" (UID: "9f53ce79-a85d-4178-ba45-475886350c24"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:22:28.809144 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:28.809085 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f53ce79-a85d-4178-ba45-475886350c24-workload-socket\") on node \"ip-10-0-139-35.ec2.internal\" DevicePath \"\"" Jul 14 11:22:28.809144 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:28.809106 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f53ce79-a85d-4178-ba45-475886350c24-workload-certs\") on node \"ip-10-0-139-35.ec2.internal\" DevicePath \"\"" Jul 14 11:22:28.809144 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:28.809121 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f53ce79-a85d-4178-ba45-475886350c24-credential-socket\") on node \"ip-10-0-139-35.ec2.internal\" DevicePath \"\"" Jul 14 11:22:28.809294 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:28.809189 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f53ce79-a85d-4178-ba45-475886350c24-istiod-ca-cert\") on node \"ip-10-0-139-35.ec2.internal\" DevicePath \"\"" Jul 14 11:22:28.809508 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:28.809312 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f53ce79-a85d-4178-ba45-475886350c24-istio-data\") on node \"ip-10-0-139-35.ec2.internal\" DevicePath \"\"" Jul 14 11:22:28.810783 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:28.810756 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f53ce79-a85d-4178-ba45-475886350c24-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9f53ce79-a85d-4178-ba45-475886350c24" (UID: "9f53ce79-a85d-4178-ba45-475886350c24"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 11:22:28.810783 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:28.810775 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f53ce79-a85d-4178-ba45-475886350c24-kube-api-access-69pnr" (OuterVolumeSpecName: "kube-api-access-69pnr") pod "9f53ce79-a85d-4178-ba45-475886350c24" (UID: "9f53ce79-a85d-4178-ba45-475886350c24"). InnerVolumeSpecName "kube-api-access-69pnr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:22:28.810970 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:28.810942 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f53ce79-a85d-4178-ba45-475886350c24-istio-token" (OuterVolumeSpecName: "istio-token") pod "9f53ce79-a85d-4178-ba45-475886350c24" (UID: "9f53ce79-a85d-4178-ba45-475886350c24"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:22:28.811066 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:28.811008 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9f53ce79-a85d-4178-ba45-475886350c24-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9f53ce79-a85d-4178-ba45-475886350c24" (UID: "9f53ce79-a85d-4178-ba45-475886350c24"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 11:22:28.909885 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:28.909847 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f53ce79-a85d-4178-ba45-475886350c24-istio-token\") on node \"ip-10-0-139-35.ec2.internal\" DevicePath \"\"" Jul 14 11:22:28.909885 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:28.909877 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f53ce79-a85d-4178-ba45-475886350c24-istio-envoy\") on node \"ip-10-0-139-35.ec2.internal\" DevicePath \"\"" Jul 14 11:22:28.909885 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:28.909886 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f53ce79-a85d-4178-ba45-475886350c24-istio-podinfo\") on node \"ip-10-0-139-35.ec2.internal\" DevicePath \"\"" Jul 14 11:22:28.910122 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:28.909897 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69pnr\" (UniqueName: \"kubernetes.io/projected/9f53ce79-a85d-4178-ba45-475886350c24-kube-api-access-69pnr\") on node \"ip-10-0-139-35.ec2.internal\" DevicePath \"\"" Jul 14 11:22:29.501441 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:29.501408 2576 generic.go:356] "Generic (PLEG): container finished" podID="9f53ce79-a85d-4178-ba45-475886350c24" containerID="efea9fcc3b7cfaf47a75e7e6f3b7459e752112053fde7534595b0ef77f6fddd7" exitCode=0 Jul 14 11:22:29.501641 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:29.501468 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" Jul 14 11:22:29.501641 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:29.501498 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" event={"ID":"9f53ce79-a85d-4178-ba45-475886350c24","Type":"ContainerDied","Data":"efea9fcc3b7cfaf47a75e7e6f3b7459e752112053fde7534595b0ef77f6fddd7"} Jul 14 11:22:29.501641 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:29.501604 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd" event={"ID":"9f53ce79-a85d-4178-ba45-475886350c24","Type":"ContainerDied","Data":"a39306cdf2eba5009a996307357588bcc667e0dd8133fdc53f17230098ee401c"} Jul 14 11:22:29.501641 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:29.501628 2576 scope.go:117] "RemoveContainer" containerID="efea9fcc3b7cfaf47a75e7e6f3b7459e752112053fde7534595b0ef77f6fddd7" Jul 14 11:22:29.511679 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:29.511656 2576 scope.go:117] "RemoveContainer" containerID="efea9fcc3b7cfaf47a75e7e6f3b7459e752112053fde7534595b0ef77f6fddd7" Jul 14 11:22:29.511979 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:22:29.511957 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efea9fcc3b7cfaf47a75e7e6f3b7459e752112053fde7534595b0ef77f6fddd7\": container with ID starting with efea9fcc3b7cfaf47a75e7e6f3b7459e752112053fde7534595b0ef77f6fddd7 not found: ID does not exist" containerID="efea9fcc3b7cfaf47a75e7e6f3b7459e752112053fde7534595b0ef77f6fddd7" Jul 14 11:22:29.512090 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:29.511987 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efea9fcc3b7cfaf47a75e7e6f3b7459e752112053fde7534595b0ef77f6fddd7"} err="failed to get container status \"efea9fcc3b7cfaf47a75e7e6f3b7459e752112053fde7534595b0ef77f6fddd7\": rpc error: code = NotFound desc = could not find container \"efea9fcc3b7cfaf47a75e7e6f3b7459e752112053fde7534595b0ef77f6fddd7\": container with ID starting with efea9fcc3b7cfaf47a75e7e6f3b7459e752112053fde7534595b0ef77f6fddd7 not found: ID does not exist" Jul 14 11:22:29.525866 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:29.525834 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd"] Jul 14 11:22:29.532614 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:29.532573 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-pjhvd"] Jul 14 11:22:29.960926 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:29.960841 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f53ce79-a85d-4178-ba45-475886350c24" path="/var/lib/kubelet/pods/9f53ce79-a85d-4178-ba45-475886350c24/volumes" Jul 14 11:22:54.480368 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:54.480335 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gzdvw" Jul 14 11:22:55.487986 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:22:55.487953 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-7cpcf" Jul 14 11:23:06.655940 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:06.655904 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bvpxp"] Jul 14 11:23:06.656350 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:06.656282 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f53ce79-a85d-4178-ba45-475886350c24" containerName="istio-proxy" Jul 14 11:23:06.656350 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:06.656293 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f53ce79-a85d-4178-ba45-475886350c24" containerName="istio-proxy" Jul 14 11:23:06.656350 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:06.656310 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7b3dd56-03ff-45f5-bbb2-63779b4df149" containerName="discovery" Jul 14 11:23:06.656350 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:06.656316 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7b3dd56-03ff-45f5-bbb2-63779b4df149" containerName="discovery" Jul 14 11:23:06.656479 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:06.656390 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7b3dd56-03ff-45f5-bbb2-63779b4df149" containerName="discovery" Jul 14 11:23:06.656479 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:06.656399 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f53ce79-a85d-4178-ba45-475886350c24" containerName="istio-proxy" Jul 14 11:23:06.658613 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:06.658585 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bvpxp" Jul 14 11:23:06.661442 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:06.661415 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-46dcl\"" Jul 14 11:23:06.662776 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:06.662754 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 14 11:23:06.662908 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:06.662780 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 14 11:23:06.668653 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:06.668583 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bvpxp"] Jul 14 11:23:06.740658 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:06.740616 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfn56\" (UniqueName: \"kubernetes.io/projected/497aabcd-533c-4d45-9944-298126fc9491-kube-api-access-wfn56\") pod \"kuadrant-operator-catalog-bvpxp\" (UID: \"497aabcd-533c-4d45-9944-298126fc9491\") " pod="kuadrant-system/kuadrant-operator-catalog-bvpxp" Jul 14 11:23:06.841096 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:06.841051 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfn56\" (UniqueName: \"kubernetes.io/projected/497aabcd-533c-4d45-9944-298126fc9491-kube-api-access-wfn56\") pod \"kuadrant-operator-catalog-bvpxp\" (UID: \"497aabcd-533c-4d45-9944-298126fc9491\") " pod="kuadrant-system/kuadrant-operator-catalog-bvpxp" Jul 14 11:23:06.850458 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:06.850420 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfn56\" (UniqueName: \"kubernetes.io/projected/497aabcd-533c-4d45-9944-298126fc9491-kube-api-access-wfn56\") pod \"kuadrant-operator-catalog-bvpxp\" (UID: \"497aabcd-533c-4d45-9944-298126fc9491\") " pod="kuadrant-system/kuadrant-operator-catalog-bvpxp" Jul 14 11:23:06.970518 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:06.970479 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bvpxp" Jul 14 11:23:07.023626 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:07.023526 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bvpxp"] Jul 14 11:23:07.118337 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:07.118306 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bvpxp"] Jul 14 11:23:07.125921 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:23:07.125878 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod497aabcd_533c_4d45_9944_298126fc9491.slice/crio-206e75cb003df418855cece47af997930d1022b472f3e080938b2bf5378404eb WatchSource:0}: Error finding container 206e75cb003df418855cece47af997930d1022b472f3e080938b2bf5378404eb: Status 404 returned error can't find the container with id 206e75cb003df418855cece47af997930d1022b472f3e080938b2bf5378404eb Jul 14 11:23:07.127259 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:07.127242 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 11:23:07.243380 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:07.243272 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d56mc"] Jul 14 11:23:07.246438 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:07.246409 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-d56mc" Jul 14 11:23:07.261055 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:07.261019 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d56mc"] Jul 14 11:23:07.346531 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:07.346488 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2q2c\" (UniqueName: \"kubernetes.io/projected/75cd06e6-934c-4f1e-868f-cae367dea3a7-kube-api-access-z2q2c\") pod \"kuadrant-operator-catalog-d56mc\" (UID: \"75cd06e6-934c-4f1e-868f-cae367dea3a7\") " pod="kuadrant-system/kuadrant-operator-catalog-d56mc" Jul 14 11:23:07.447300 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:07.447263 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2q2c\" (UniqueName: \"kubernetes.io/projected/75cd06e6-934c-4f1e-868f-cae367dea3a7-kube-api-access-z2q2c\") pod \"kuadrant-operator-catalog-d56mc\" (UID: \"75cd06e6-934c-4f1e-868f-cae367dea3a7\") " pod="kuadrant-system/kuadrant-operator-catalog-d56mc" Jul 14 11:23:07.460679 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:07.460650 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2q2c\" (UniqueName: \"kubernetes.io/projected/75cd06e6-934c-4f1e-868f-cae367dea3a7-kube-api-access-z2q2c\") pod \"kuadrant-operator-catalog-d56mc\" (UID: \"75cd06e6-934c-4f1e-868f-cae367dea3a7\") " pod="kuadrant-system/kuadrant-operator-catalog-d56mc" Jul 14 11:23:07.556758 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:07.556665 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-d56mc" Jul 14 11:23:07.691128 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:07.691088 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bvpxp" event={"ID":"497aabcd-533c-4d45-9944-298126fc9491","Type":"ContainerStarted","Data":"206e75cb003df418855cece47af997930d1022b472f3e080938b2bf5378404eb"} Jul 14 11:23:07.706386 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:07.706362 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d56mc"] Jul 14 11:23:07.708819 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:23:07.708793 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75cd06e6_934c_4f1e_868f_cae367dea3a7.slice/crio-16b427885e73f101d62790c3a9b199b8ff278835e7cd28cc7b531433df8d981a WatchSource:0}: Error finding container 16b427885e73f101d62790c3a9b199b8ff278835e7cd28cc7b531433df8d981a: Status 404 returned error can't find the container with id 16b427885e73f101d62790c3a9b199b8ff278835e7cd28cc7b531433df8d981a Jul 14 11:23:08.482859 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:08.482826 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b46b475c5-rwfgn"] Jul 14 11:23:08.486942 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:08.486908 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b46b475c5-rwfgn" Jul 14 11:23:08.489770 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:08.489740 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 14 11:23:08.489940 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:08.489747 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 14 11:23:08.491123 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:08.490894 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-dc9x4\"" Jul 14 11:23:08.491123 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:08.490936 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 14 11:23:08.491123 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:08.490993 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 14 11:23:08.491123 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:08.490942 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 14 11:23:08.491416 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:08.491257 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 14 11:23:08.491416 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:08.491406 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 14 11:23:08.499023 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:08.499003 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 14 11:23:08.507474 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:08.507445 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b46b475c5-rwfgn"] Jul 14 11:23:08.559257 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:08.559208 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/215074c7-0bab-4185-943c-48a7f7377a44-console-oauth-config\") pod \"console-5b46b475c5-rwfgn\" (UID: \"215074c7-0bab-4185-943c-48a7f7377a44\") " pod="openshift-console/console-5b46b475c5-rwfgn" Jul 14 11:23:08.559421 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:08.559281 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/215074c7-0bab-4185-943c-48a7f7377a44-console-serving-cert\") pod \"console-5b46b475c5-rwfgn\" (UID: \"215074c7-0bab-4185-943c-48a7f7377a44\") " pod="openshift-console/console-5b46b475c5-rwfgn" Jul 14 11:23:08.559421 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:08.559319 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/215074c7-0bab-4185-943c-48a7f7377a44-service-ca\") pod \"console-5b46b475c5-rwfgn\" (UID: \"215074c7-0bab-4185-943c-48a7f7377a44\") " pod="openshift-console/console-5b46b475c5-rwfgn" Jul 14 11:23:08.559421 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:08.559352 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/215074c7-0bab-4185-943c-48a7f7377a44-console-config\") pod \"console-5b46b475c5-rwfgn\" (UID: \"215074c7-0bab-4185-943c-48a7f7377a44\") " pod="openshift-console/console-5b46b475c5-rwfgn" Jul 14 11:23:08.559637 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:08.559438 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/215074c7-0bab-4185-943c-48a7f7377a44-trusted-ca-bundle\") pod \"console-5b46b475c5-rwfgn\" (UID: \"215074c7-0bab-4185-943c-48a7f7377a44\") " pod="openshift-console/console-5b46b475c5-rwfgn" Jul 14 11:23:08.559637 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:08.559481 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/215074c7-0bab-4185-943c-48a7f7377a44-oauth-serving-cert\") pod \"console-5b46b475c5-rwfgn\" (UID: \"215074c7-0bab-4185-943c-48a7f7377a44\") " pod="openshift-console/console-5b46b475c5-rwfgn" Jul 14 11:23:08.559637 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:08.559509 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v4ps\" (UniqueName: \"kubernetes.io/projected/215074c7-0bab-4185-943c-48a7f7377a44-kube-api-access-2v4ps\") pod \"console-5b46b475c5-rwfgn\" (UID: \"215074c7-0bab-4185-943c-48a7f7377a44\") " pod="openshift-console/console-5b46b475c5-rwfgn" Jul 14 11:23:08.660601 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:08.660554 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/215074c7-0bab-4185-943c-48a7f7377a44-console-oauth-config\") pod \"console-5b46b475c5-rwfgn\" (UID: \"215074c7-0bab-4185-943c-48a7f7377a44\") " pod="openshift-console/console-5b46b475c5-rwfgn" Jul 14 11:23:08.660830 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:08.660629 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/215074c7-0bab-4185-943c-48a7f7377a44-console-serving-cert\") pod \"console-5b46b475c5-rwfgn\" (UID: \"215074c7-0bab-4185-943c-48a7f7377a44\") " pod="openshift-console/console-5b46b475c5-rwfgn" Jul 14 11:23:08.660830 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:08.660659 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/215074c7-0bab-4185-943c-48a7f7377a44-service-ca\") pod \"console-5b46b475c5-rwfgn\" (UID: \"215074c7-0bab-4185-943c-48a7f7377a44\") " pod="openshift-console/console-5b46b475c5-rwfgn" Jul 14 11:23:08.660830 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:08.660678 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/215074c7-0bab-4185-943c-48a7f7377a44-console-config\") pod \"console-5b46b475c5-rwfgn\" (UID: \"215074c7-0bab-4185-943c-48a7f7377a44\") " pod="openshift-console/console-5b46b475c5-rwfgn" Jul 14 11:23:08.660830 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:08.660721 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/215074c7-0bab-4185-943c-48a7f7377a44-trusted-ca-bundle\") pod \"console-5b46b475c5-rwfgn\" (UID: \"215074c7-0bab-4185-943c-48a7f7377a44\") " pod="openshift-console/console-5b46b475c5-rwfgn" Jul 14 11:23:08.660830 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:08.660756 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/215074c7-0bab-4185-943c-48a7f7377a44-oauth-serving-cert\") pod \"console-5b46b475c5-rwfgn\" (UID: \"215074c7-0bab-4185-943c-48a7f7377a44\") " pod="openshift-console/console-5b46b475c5-rwfgn" Jul 14 11:23:08.661132 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:08.661052 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v4ps\" (UniqueName: \"kubernetes.io/projected/215074c7-0bab-4185-943c-48a7f7377a44-kube-api-access-2v4ps\") pod \"console-5b46b475c5-rwfgn\" (UID: \"215074c7-0bab-4185-943c-48a7f7377a44\") " pod="openshift-console/console-5b46b475c5-rwfgn" Jul 14 11:23:08.661449 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:08.661422 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/215074c7-0bab-4185-943c-48a7f7377a44-oauth-serving-cert\") pod \"console-5b46b475c5-rwfgn\" (UID: \"215074c7-0bab-4185-943c-48a7f7377a44\") " pod="openshift-console/console-5b46b475c5-rwfgn" Jul 14 11:23:08.661449 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:08.661429 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/215074c7-0bab-4185-943c-48a7f7377a44-service-ca\") pod \"console-5b46b475c5-rwfgn\" (UID: \"215074c7-0bab-4185-943c-48a7f7377a44\") " pod="openshift-console/console-5b46b475c5-rwfgn" Jul 14 11:23:08.661867 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:08.661841 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/215074c7-0bab-4185-943c-48a7f7377a44-console-config\") pod \"console-5b46b475c5-rwfgn\" (UID: \"215074c7-0bab-4185-943c-48a7f7377a44\") " pod="openshift-console/console-5b46b475c5-rwfgn" Jul 14 11:23:08.662316 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:08.662274 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/215074c7-0bab-4185-943c-48a7f7377a44-trusted-ca-bundle\") pod \"console-5b46b475c5-rwfgn\" (UID: \"215074c7-0bab-4185-943c-48a7f7377a44\") " pod="openshift-console/console-5b46b475c5-rwfgn" Jul 14 11:23:08.663826 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:08.663806 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/215074c7-0bab-4185-943c-48a7f7377a44-console-serving-cert\") pod \"console-5b46b475c5-rwfgn\" (UID: \"215074c7-0bab-4185-943c-48a7f7377a44\") " pod="openshift-console/console-5b46b475c5-rwfgn" Jul 14 11:23:08.664089 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:08.664064 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/215074c7-0bab-4185-943c-48a7f7377a44-console-oauth-config\") pod \"console-5b46b475c5-rwfgn\" (UID: \"215074c7-0bab-4185-943c-48a7f7377a44\") " pod="openshift-console/console-5b46b475c5-rwfgn" Jul 14 11:23:08.670692 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:08.670656 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v4ps\" (UniqueName: \"kubernetes.io/projected/215074c7-0bab-4185-943c-48a7f7377a44-kube-api-access-2v4ps\") pod \"console-5b46b475c5-rwfgn\" (UID: \"215074c7-0bab-4185-943c-48a7f7377a44\") " pod="openshift-console/console-5b46b475c5-rwfgn" Jul 14 11:23:08.699258 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:08.699208 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-d56mc" event={"ID":"75cd06e6-934c-4f1e-868f-cae367dea3a7","Type":"ContainerStarted","Data":"16b427885e73f101d62790c3a9b199b8ff278835e7cd28cc7b531433df8d981a"} Jul 14 11:23:08.801852 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:08.801699 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b46b475c5-rwfgn" Jul 14 11:23:08.984381 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:08.984268 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b46b475c5-rwfgn"] Jul 14 11:23:08.986730 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:23:08.986701 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod215074c7_0bab_4185_943c_48a7f7377a44.slice/crio-de6bb30646e5a2de8d19bc1273a6efb41d152e6056597e6976cc96d417a71f2b WatchSource:0}: Error finding container de6bb30646e5a2de8d19bc1273a6efb41d152e6056597e6976cc96d417a71f2b: Status 404 returned error can't find the container with id de6bb30646e5a2de8d19bc1273a6efb41d152e6056597e6976cc96d417a71f2b Jul 14 11:23:09.707257 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:09.707159 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-d56mc" event={"ID":"75cd06e6-934c-4f1e-868f-cae367dea3a7","Type":"ContainerStarted","Data":"cb29ec3f57fbc3073b899c4abc88d2e0939b3fa41d4a06e7a3988446c73325e3"} Jul 14 11:23:09.708940 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:09.708913 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b46b475c5-rwfgn" event={"ID":"215074c7-0bab-4185-943c-48a7f7377a44","Type":"ContainerStarted","Data":"ced1dfe4a5955014c02d77d0195c82e55a777182159d04fc29cc264c7f5df9ef"} Jul 14 11:23:09.709062 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:09.708969 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b46b475c5-rwfgn" event={"ID":"215074c7-0bab-4185-943c-48a7f7377a44","Type":"ContainerStarted","Data":"de6bb30646e5a2de8d19bc1273a6efb41d152e6056597e6976cc96d417a71f2b"} Jul 14 11:23:09.711532 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:09.711496 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bvpxp" event={"ID":"497aabcd-533c-4d45-9944-298126fc9491","Type":"ContainerStarted","Data":"f150d426d4e955f676c0528b104f6bc4687b95973f301c6b0bb76abb847e04e4"} Jul 14 11:23:09.711694 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:09.711671 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-bvpxp" podUID="497aabcd-533c-4d45-9944-298126fc9491" containerName="registry-server" containerID="cri-o://f150d426d4e955f676c0528b104f6bc4687b95973f301c6b0bb76abb847e04e4" gracePeriod=2 Jul 14 11:23:09.726880 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:09.726830 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-d56mc" podStartSLOduration=0.905729271 podStartE2EDuration="2.726812712s" totalImagesPullingTime="1.821083441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:23:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:23:09.725216155 +0000 UTC m=+694.298596529" watchObservedRunningTime="2026-07-14 11:23:09.726812712 +0000 UTC m=+694.300193085" Jul 14 11:23:09.746362 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:09.746300 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-bvpxp" podStartSLOduration=1.346404114 podStartE2EDuration="3.746275821s" totalImagesPullingTime="2.399871707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:23:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:23:09.74444373 +0000 UTC m=+694.317824129" watchObservedRunningTime="2026-07-14 11:23:09.746275821 +0000 UTC m=+694.319656197" Jul 14 11:23:09.766460 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:09.766412 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b46b475c5-rwfgn" podStartSLOduration=1.766394757 podStartE2EDuration="1.766394757s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:23:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:23:09.766145867 +0000 UTC m=+694.339526242" watchObservedRunningTime="2026-07-14 11:23:09.766394757 +0000 UTC m=+694.339775131" Jul 14 11:23:09.963356 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:09.963284 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bvpxp" Jul 14 11:23:10.076612 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:10.076514 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfn56\" (UniqueName: \"kubernetes.io/projected/497aabcd-533c-4d45-9944-298126fc9491-kube-api-access-wfn56\") pod \"497aabcd-533c-4d45-9944-298126fc9491\" (UID: \"497aabcd-533c-4d45-9944-298126fc9491\") " Jul 14 11:23:10.078957 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:10.078926 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/497aabcd-533c-4d45-9944-298126fc9491-kube-api-access-wfn56" (OuterVolumeSpecName: "kube-api-access-wfn56") pod "497aabcd-533c-4d45-9944-298126fc9491" (UID: "497aabcd-533c-4d45-9944-298126fc9491"). InnerVolumeSpecName "kube-api-access-wfn56". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:23:10.177246 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:10.177206 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfn56\" (UniqueName: \"kubernetes.io/projected/497aabcd-533c-4d45-9944-298126fc9491-kube-api-access-wfn56\") on node \"ip-10-0-139-35.ec2.internal\" DevicePath \"\"" Jul 14 11:23:10.718020 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:10.717986 2576 generic.go:356] "Generic (PLEG): container finished" podID="497aabcd-533c-4d45-9944-298126fc9491" containerID="f150d426d4e955f676c0528b104f6bc4687b95973f301c6b0bb76abb847e04e4" exitCode=0 Jul 14 11:23:10.718567 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:10.718044 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bvpxp" Jul 14 11:23:10.718567 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:10.718078 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bvpxp" event={"ID":"497aabcd-533c-4d45-9944-298126fc9491","Type":"ContainerDied","Data":"f150d426d4e955f676c0528b104f6bc4687b95973f301c6b0bb76abb847e04e4"} Jul 14 11:23:10.718567 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:10.718138 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bvpxp" event={"ID":"497aabcd-533c-4d45-9944-298126fc9491","Type":"ContainerDied","Data":"206e75cb003df418855cece47af997930d1022b472f3e080938b2bf5378404eb"} Jul 14 11:23:10.718567 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:10.718158 2576 scope.go:117] "RemoveContainer" containerID="f150d426d4e955f676c0528b104f6bc4687b95973f301c6b0bb76abb847e04e4" Jul 14 11:23:10.727967 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:10.727939 2576 scope.go:117] "RemoveContainer" containerID="f150d426d4e955f676c0528b104f6bc4687b95973f301c6b0bb76abb847e04e4" Jul 14 11:23:10.728302 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:23:10.728273 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f150d426d4e955f676c0528b104f6bc4687b95973f301c6b0bb76abb847e04e4\": container with ID starting with f150d426d4e955f676c0528b104f6bc4687b95973f301c6b0bb76abb847e04e4 not found: ID does not exist" containerID="f150d426d4e955f676c0528b104f6bc4687b95973f301c6b0bb76abb847e04e4" Jul 14 11:23:10.728366 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:10.728314 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f150d426d4e955f676c0528b104f6bc4687b95973f301c6b0bb76abb847e04e4"} err="failed to get container status \"f150d426d4e955f676c0528b104f6bc4687b95973f301c6b0bb76abb847e04e4\": rpc error: code = NotFound desc = could not find container \"f150d426d4e955f676c0528b104f6bc4687b95973f301c6b0bb76abb847e04e4\": container with ID starting with f150d426d4e955f676c0528b104f6bc4687b95973f301c6b0bb76abb847e04e4 not found: ID does not exist" Jul 14 11:23:10.739887 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:10.739662 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bvpxp"] Jul 14 11:23:10.741433 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:10.741408 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bvpxp"] Jul 14 11:23:11.961283 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:11.961248 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="497aabcd-533c-4d45-9944-298126fc9491" path="/var/lib/kubelet/pods/497aabcd-533c-4d45-9944-298126fc9491/volumes" Jul 14 11:23:17.557312 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:17.557270 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-d56mc" Jul 14 11:23:17.557867 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:17.557343 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-d56mc" Jul 14 11:23:17.581502 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:17.581473 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-d56mc" Jul 14 11:23:17.776227 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:17.776198 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-d56mc" Jul 14 11:23:18.802036 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:18.801999 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b46b475c5-rwfgn" Jul 14 11:23:18.802453 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:18.802061 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b46b475c5-rwfgn" Jul 14 11:23:18.807014 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:18.806991 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b46b475c5-rwfgn" Jul 14 11:23:19.766131 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:19.766101 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b46b475c5-rwfgn" Jul 14 11:23:33.331723 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:33.331644 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7j94s"] Jul 14 11:23:33.332186 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:33.332021 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="497aabcd-533c-4d45-9944-298126fc9491" containerName="registry-server" Jul 14 11:23:33.332186 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:33.332032 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="497aabcd-533c-4d45-9944-298126fc9491" containerName="registry-server" Jul 14 11:23:33.332186 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:33.332126 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="497aabcd-533c-4d45-9944-298126fc9491" containerName="registry-server" Jul 14 11:23:33.335268 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:33.335248 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7j94s" Jul 14 11:23:33.338204 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:33.338179 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 14 11:23:33.338340 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:33.338243 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-qhbqw\"" Jul 14 11:23:33.346960 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:33.346930 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7j94s"] Jul 14 11:23:33.491955 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:33.491913 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj8k6\" (UniqueName: \"kubernetes.io/projected/2b2e829b-0cf7-4f05-9c10-ab3853766ca1-kube-api-access-kj8k6\") pod \"dns-operator-controller-manager-864dd78c4c-7j94s\" (UID: \"2b2e829b-0cf7-4f05-9c10-ab3853766ca1\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7j94s" Jul 14 11:23:33.593362 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:33.593265 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj8k6\" (UniqueName: \"kubernetes.io/projected/2b2e829b-0cf7-4f05-9c10-ab3853766ca1-kube-api-access-kj8k6\") pod \"dns-operator-controller-manager-864dd78c4c-7j94s\" (UID: \"2b2e829b-0cf7-4f05-9c10-ab3853766ca1\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7j94s" Jul 14 11:23:33.614275 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:33.614237 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj8k6\" (UniqueName: \"kubernetes.io/projected/2b2e829b-0cf7-4f05-9c10-ab3853766ca1-kube-api-access-kj8k6\") pod \"dns-operator-controller-manager-864dd78c4c-7j94s\" (UID: \"2b2e829b-0cf7-4f05-9c10-ab3853766ca1\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7j94s" Jul 14 11:23:33.645846 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:33.645808 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7j94s" Jul 14 11:23:33.796257 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:33.796227 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7j94s"] Jul 14 11:23:33.801784 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:23:33.801756 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b2e829b_0cf7_4f05_9c10_ab3853766ca1.slice/crio-4429bd8db0d89b6ca6d2e6b7953df48ede44563d32f414dd22ef2846d681e9fe WatchSource:0}: Error finding container 4429bd8db0d89b6ca6d2e6b7953df48ede44563d32f414dd22ef2846d681e9fe: Status 404 returned error can't find the container with id 4429bd8db0d89b6ca6d2e6b7953df48ede44563d32f414dd22ef2846d681e9fe Jul 14 11:23:33.830981 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:33.830938 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7j94s" event={"ID":"2b2e829b-0cf7-4f05-9c10-ab3853766ca1","Type":"ContainerStarted","Data":"4429bd8db0d89b6ca6d2e6b7953df48ede44563d32f414dd22ef2846d681e9fe"} Jul 14 11:23:35.795687 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:35.795660 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 14 11:23:36.849219 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:36.849176 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7j94s" event={"ID":"2b2e829b-0cf7-4f05-9c10-ab3853766ca1","Type":"ContainerStarted","Data":"fdf5f2a19af81c60d89f8a5fed6f37f05b1b0866d356a38cc2cd6a41efff7568"} Jul 14 11:23:36.849744 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:36.849319 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7j94s" Jul 14 11:23:38.892823 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:38.892759 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7j94s" podStartSLOduration=3.905096164 podStartE2EDuration="5.892738308s" totalImagesPullingTime="1.987642144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:23:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:23:36.883144387 +0000 UTC m=+721.456524760" watchObservedRunningTime="2026-07-14 11:23:38.892738308 +0000 UTC m=+723.466118683" Jul 14 11:23:38.893721 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:38.893701 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkck"] Jul 14 11:23:38.899014 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:38.898989 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkck" Jul 14 11:23:38.904411 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:38.904379 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-m8qkz\"" Jul 14 11:23:38.922739 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:38.922709 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkck"] Jul 14 11:23:39.045242 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:39.045206 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqt92\" (UniqueName: \"kubernetes.io/projected/3de28a18-3cf4-4dca-be22-13ccafa88adb-kube-api-access-vqt92\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5tkck\" (UID: \"3de28a18-3cf4-4dca-be22-13ccafa88adb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkck" Jul 14 11:23:39.045521 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:39.045496 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3de28a18-3cf4-4dca-be22-13ccafa88adb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5tkck\" (UID: \"3de28a18-3cf4-4dca-be22-13ccafa88adb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkck" Jul 14 11:23:39.146398 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:39.146295 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3de28a18-3cf4-4dca-be22-13ccafa88adb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5tkck\" (UID: \"3de28a18-3cf4-4dca-be22-13ccafa88adb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkck" Jul 14 11:23:39.146398 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:39.146368 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqt92\" (UniqueName: \"kubernetes.io/projected/3de28a18-3cf4-4dca-be22-13ccafa88adb-kube-api-access-vqt92\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5tkck\" (UID: \"3de28a18-3cf4-4dca-be22-13ccafa88adb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkck" Jul 14 11:23:39.146818 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:39.146794 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3de28a18-3cf4-4dca-be22-13ccafa88adb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5tkck\" (UID: \"3de28a18-3cf4-4dca-be22-13ccafa88adb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkck" Jul 14 11:23:39.183890 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:39.183855 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqt92\" (UniqueName: \"kubernetes.io/projected/3de28a18-3cf4-4dca-be22-13ccafa88adb-kube-api-access-vqt92\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5tkck\" (UID: \"3de28a18-3cf4-4dca-be22-13ccafa88adb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkck" Jul 14 11:23:39.209655 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:39.209614 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkck" Jul 14 11:23:39.380416 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:39.380382 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkck"] Jul 14 11:23:39.383746 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:23:39.383716 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3de28a18_3cf4_4dca_be22_13ccafa88adb.slice/crio-022ca49b82b9c444ca28cebfdd607d70b58be28294065bcdc210bc0e5673e0cf WatchSource:0}: Error finding container 022ca49b82b9c444ca28cebfdd607d70b58be28294065bcdc210bc0e5673e0cf: Status 404 returned error can't find the container with id 022ca49b82b9c444ca28cebfdd607d70b58be28294065bcdc210bc0e5673e0cf Jul 14 11:23:39.868117 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:39.868075 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkck" event={"ID":"3de28a18-3cf4-4dca-be22-13ccafa88adb","Type":"ContainerStarted","Data":"022ca49b82b9c444ca28cebfdd607d70b58be28294065bcdc210bc0e5673e0cf"} Jul 14 11:23:42.324797 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:42.324757 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wxt5r"] Jul 14 11:23:42.333025 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:42.333002 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wxt5r" Jul 14 11:23:42.335998 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:42.335974 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-pdv8q\"" Jul 14 11:23:42.340631 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:42.340604 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wxt5r"] Jul 14 11:23:42.478381 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:42.478336 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n94rt\" (UniqueName: \"kubernetes.io/projected/67a32fb8-4023-4a0b-ab3f-81d4682f81b7-kube-api-access-n94rt\") pod \"authorino-operator-75cc8d5cb7-wxt5r\" (UID: \"67a32fb8-4023-4a0b-ab3f-81d4682f81b7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wxt5r" Jul 14 11:23:42.579009 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:42.578918 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n94rt\" (UniqueName: \"kubernetes.io/projected/67a32fb8-4023-4a0b-ab3f-81d4682f81b7-kube-api-access-n94rt\") pod \"authorino-operator-75cc8d5cb7-wxt5r\" (UID: \"67a32fb8-4023-4a0b-ab3f-81d4682f81b7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wxt5r" Jul 14 11:23:42.595454 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:42.595419 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n94rt\" (UniqueName: \"kubernetes.io/projected/67a32fb8-4023-4a0b-ab3f-81d4682f81b7-kube-api-access-n94rt\") pod \"authorino-operator-75cc8d5cb7-wxt5r\" (UID: \"67a32fb8-4023-4a0b-ab3f-81d4682f81b7\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wxt5r" Jul 14 11:23:42.646008 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:42.645963 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wxt5r" Jul 14 11:23:42.805726 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:42.805698 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wxt5r"] Jul 14 11:23:42.808182 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:23:42.808147 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67a32fb8_4023_4a0b_ab3f_81d4682f81b7.slice/crio-fe16b278c03d8e75acc5373c6970097fe57e933bc04ad0c9abebf4e38fa0de58 WatchSource:0}: Error finding container fe16b278c03d8e75acc5373c6970097fe57e933bc04ad0c9abebf4e38fa0de58: Status 404 returned error can't find the container with id fe16b278c03d8e75acc5373c6970097fe57e933bc04ad0c9abebf4e38fa0de58 Jul 14 11:23:42.887818 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:42.887709 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wxt5r" event={"ID":"67a32fb8-4023-4a0b-ab3f-81d4682f81b7","Type":"ContainerStarted","Data":"fe16b278c03d8e75acc5373c6970097fe57e933bc04ad0c9abebf4e38fa0de58"} Jul 14 11:23:45.290634 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:45.290598 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9724t"] Jul 14 11:23:45.300156 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:45.300124 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9724t" Jul 14 11:23:45.304073 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:45.303783 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-8qc8x\"" Jul 14 11:23:45.306250 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:45.306223 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9724t"] Jul 14 11:23:45.404637 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:45.404597 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccv8k\" (UniqueName: \"kubernetes.io/projected/7ed4c19f-edd8-4f65-91f0-fd4424428514-kube-api-access-ccv8k\") pod \"limitador-operator-controller-manager-859d7b78bd-9724t\" (UID: \"7ed4c19f-edd8-4f65-91f0-fd4424428514\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9724t" Jul 14 11:23:45.505968 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:45.505929 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccv8k\" (UniqueName: \"kubernetes.io/projected/7ed4c19f-edd8-4f65-91f0-fd4424428514-kube-api-access-ccv8k\") pod \"limitador-operator-controller-manager-859d7b78bd-9724t\" (UID: \"7ed4c19f-edd8-4f65-91f0-fd4424428514\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9724t" Jul 14 11:23:45.525503 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:45.525468 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccv8k\" (UniqueName: \"kubernetes.io/projected/7ed4c19f-edd8-4f65-91f0-fd4424428514-kube-api-access-ccv8k\") pod \"limitador-operator-controller-manager-859d7b78bd-9724t\" (UID: \"7ed4c19f-edd8-4f65-91f0-fd4424428514\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9724t" Jul 14 11:23:45.614439 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:45.614339 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9724t" Jul 14 11:23:46.261666 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:46.261633 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9724t"] Jul 14 11:23:46.265475 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:23:46.265448 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ed4c19f_edd8_4f65_91f0_fd4424428514.slice/crio-1caeac17cc1690ed291634ad76c58c7fd114d1f40902b017b03a58f1197bd6fb WatchSource:0}: Error finding container 1caeac17cc1690ed291634ad76c58c7fd114d1f40902b017b03a58f1197bd6fb: Status 404 returned error can't find the container with id 1caeac17cc1690ed291634ad76c58c7fd114d1f40902b017b03a58f1197bd6fb Jul 14 11:23:46.915333 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:46.915289 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkck" event={"ID":"3de28a18-3cf4-4dca-be22-13ccafa88adb","Type":"ContainerStarted","Data":"0e15e5943c87795e78e636c45f462c1e5ba8f07988bca7237cefe0e56417d1ec"} Jul 14 11:23:46.915905 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:46.915417 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkck" Jul 14 11:23:46.916922 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:46.916890 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9724t" event={"ID":"7ed4c19f-edd8-4f65-91f0-fd4424428514","Type":"ContainerStarted","Data":"1caeac17cc1690ed291634ad76c58c7fd114d1f40902b017b03a58f1197bd6fb"} Jul 14 11:23:46.918688 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:46.918660 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wxt5r" event={"ID":"67a32fb8-4023-4a0b-ab3f-81d4682f81b7","Type":"ContainerStarted","Data":"300b89173d937c2bedb1b7dc0417f46dd4c1e54ebb8371658ad478e745367725"} Jul 14 11:23:46.918801 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:46.918737 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wxt5r" Jul 14 11:23:46.947044 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:46.946991 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkck" podStartSLOduration=2.1896566809999998 podStartE2EDuration="8.946972294s" totalImagesPullingTime="6.757315613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:23:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:23:46.946791197 +0000 UTC m=+731.520171590" watchObservedRunningTime="2026-07-14 11:23:46.946972294 +0000 UTC m=+731.520352671" Jul 14 11:23:46.972581 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:46.972501 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wxt5r" podStartSLOduration=1.628522186 podStartE2EDuration="4.97248045s" totalImagesPullingTime="3.343958264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:23:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:23:46.971377567 +0000 UTC m=+731.544757961" watchObservedRunningTime="2026-07-14 11:23:46.97248045 +0000 UTC m=+731.545860901" Jul 14 11:23:47.857871 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:47.857835 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7j94s" Jul 14 11:23:48.932633 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:48.932590 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9724t" event={"ID":"7ed4c19f-edd8-4f65-91f0-fd4424428514","Type":"ContainerStarted","Data":"e16257121685bdda785c05977e90fcd8394db97e0f503d8a8ad6836932a10a0c"} Jul 14 11:23:48.933058 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:48.932733 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9724t" Jul 14 11:23:48.958514 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:48.958464 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9724t" podStartSLOduration=2.142757935 podStartE2EDuration="3.958446436s" totalImagesPullingTime="1.815688501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:23:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:23:48.95681962 +0000 UTC m=+733.530200015" watchObservedRunningTime="2026-07-14 11:23:48.958446436 +0000 UTC m=+733.531826810" Jul 14 11:23:49.239619 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:49.239581 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cqpz5"] Jul 14 11:23:49.243351 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:49.243324 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cqpz5" Jul 14 11:23:49.246196 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:49.246171 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 14 11:23:49.246326 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:49.246271 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2ztm4\"" Jul 14 11:23:49.246593 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:49.246571 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 14 11:23:49.255425 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:49.255399 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cqpz5"] Jul 14 11:23:49.342706 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:49.342663 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs4vk\" (UniqueName: \"kubernetes.io/projected/9b36ce92-f4a2-49d8-b6fe-2ae46c0f782f-kube-api-access-fs4vk\") pod \"kuadrant-console-plugin-66b5774985-cqpz5\" (UID: \"9b36ce92-f4a2-49d8-b6fe-2ae46c0f782f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cqpz5" Jul 14 11:23:49.342888 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:49.342803 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b36ce92-f4a2-49d8-b6fe-2ae46c0f782f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cqpz5\" (UID: \"9b36ce92-f4a2-49d8-b6fe-2ae46c0f782f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cqpz5" Jul 14 11:23:49.342888 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:49.342833 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9b36ce92-f4a2-49d8-b6fe-2ae46c0f782f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cqpz5\" (UID: \"9b36ce92-f4a2-49d8-b6fe-2ae46c0f782f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cqpz5" Jul 14 11:23:49.444061 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:49.444024 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b36ce92-f4a2-49d8-b6fe-2ae46c0f782f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cqpz5\" (UID: \"9b36ce92-f4a2-49d8-b6fe-2ae46c0f782f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cqpz5" Jul 14 11:23:49.444061 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:49.444062 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9b36ce92-f4a2-49d8-b6fe-2ae46c0f782f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cqpz5\" (UID: \"9b36ce92-f4a2-49d8-b6fe-2ae46c0f782f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cqpz5" Jul 14 11:23:49.444328 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:49.444109 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs4vk\" (UniqueName: \"kubernetes.io/projected/9b36ce92-f4a2-49d8-b6fe-2ae46c0f782f-kube-api-access-fs4vk\") pod \"kuadrant-console-plugin-66b5774985-cqpz5\" (UID: \"9b36ce92-f4a2-49d8-b6fe-2ae46c0f782f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cqpz5" Jul 14 11:23:49.444852 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:49.444822 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9b36ce92-f4a2-49d8-b6fe-2ae46c0f782f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cqpz5\" (UID: \"9b36ce92-f4a2-49d8-b6fe-2ae46c0f782f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cqpz5" Jul 14 11:23:49.446860 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:49.446840 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b36ce92-f4a2-49d8-b6fe-2ae46c0f782f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cqpz5\" (UID: \"9b36ce92-f4a2-49d8-b6fe-2ae46c0f782f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cqpz5" Jul 14 11:23:49.459642 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:49.459605 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs4vk\" (UniqueName: \"kubernetes.io/projected/9b36ce92-f4a2-49d8-b6fe-2ae46c0f782f-kube-api-access-fs4vk\") pod \"kuadrant-console-plugin-66b5774985-cqpz5\" (UID: \"9b36ce92-f4a2-49d8-b6fe-2ae46c0f782f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cqpz5" Jul 14 11:23:49.553462 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:49.553363 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cqpz5" Jul 14 11:23:49.713666 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:49.713640 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cqpz5"] Jul 14 11:23:49.716325 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:23:49.716296 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b36ce92_f4a2_49d8_b6fe_2ae46c0f782f.slice/crio-fe022c74112adfab44d2efefaac6dc83461bdfc056b7abebaa502440181ffcc5 WatchSource:0}: Error finding container fe022c74112adfab44d2efefaac6dc83461bdfc056b7abebaa502440181ffcc5: Status 404 returned error can't find the container with id fe022c74112adfab44d2efefaac6dc83461bdfc056b7abebaa502440181ffcc5 Jul 14 11:23:49.939018 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:49.938923 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cqpz5" event={"ID":"9b36ce92-f4a2-49d8-b6fe-2ae46c0f782f","Type":"ContainerStarted","Data":"fe022c74112adfab44d2efefaac6dc83461bdfc056b7abebaa502440181ffcc5"} Jul 14 11:23:57.929095 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:57.929055 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wxt5r" Jul 14 11:23:57.929666 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:57.929317 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkck" Jul 14 11:23:59.942281 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:59.942235 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9724t" Jul 14 11:23:59.965730 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:59.965694 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkck"] Jul 14 11:23:59.965927 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:59.965891 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkck" podUID="3de28a18-3cf4-4dca-be22-13ccafa88adb" containerName="manager" containerID="cri-o://0e15e5943c87795e78e636c45f462c1e5ba8f07988bca7237cefe0e56417d1ec" gracePeriod=2 Jul 14 11:23:59.976101 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:23:59.976068 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkck"] Jul 14 11:23:59.983375 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:23:59.983336 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5tkck\" is forbidden: User \"system:node:ip-10-0-139-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-35.ec2.internal' and this object" podUID="3de28a18-3cf4-4dca-be22-13ccafa88adb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkck" Jul 14 11:24:00.001769 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:00.001736 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9724t"] Jul 14 11:24:00.008527 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:00.008484 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9724t" podUID="7ed4c19f-edd8-4f65-91f0-fd4424428514" containerName="manager" containerID="cri-o://e16257121685bdda785c05977e90fcd8394db97e0f503d8a8ad6836932a10a0c" gracePeriod=2 Jul 14 11:24:00.025041 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:00.024487 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pptm2"] Jul 14 11:24:00.025227 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:00.025197 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3de28a18-3cf4-4dca-be22-13ccafa88adb" containerName="manager" Jul 14 11:24:00.025227 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:00.025219 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3de28a18-3cf4-4dca-be22-13ccafa88adb" containerName="manager" Jul 14 11:24:00.025511 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:00.025406 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3de28a18-3cf4-4dca-be22-13ccafa88adb" containerName="manager" Jul 14 11:24:00.025934 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:24:00.025602 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5tkck\" is forbidden: User \"system:node:ip-10-0-139-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-35.ec2.internal' and this object" podUID="3de28a18-3cf4-4dca-be22-13ccafa88adb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkck" Jul 14 11:24:00.031788 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:00.031759 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9724t"] Jul 14 11:24:00.031935 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:00.031866 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pptm2" Jul 14 11:24:00.034596 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:24:00.034556 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9724t\" is forbidden: User \"system:node:ip-10-0-139-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-35.ec2.internal' and this object" podUID="7ed4c19f-edd8-4f65-91f0-fd4424428514" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9724t" Jul 14 11:24:00.080908 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:00.080665 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pptm2"] Jul 14 11:24:00.086406 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:00.085716 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twr7j"] Jul 14 11:24:00.086406 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:00.086325 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ed4c19f-edd8-4f65-91f0-fd4424428514" containerName="manager" Jul 14 11:24:00.086406 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:00.086346 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ed4c19f-edd8-4f65-91f0-fd4424428514" containerName="manager" Jul 14 11:24:00.086762 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:00.086475 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ed4c19f-edd8-4f65-91f0-fd4424428514" containerName="manager" Jul 14 11:24:00.090695 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:00.090668 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twr7j" Jul 14 11:24:00.106720 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:00.106494 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twr7j"] Jul 14 11:24:00.106720 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:24:00.106666 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5tkck\" is forbidden: User \"system:node:ip-10-0-139-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-35.ec2.internal' and this object" podUID="3de28a18-3cf4-4dca-be22-13ccafa88adb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkck" Jul 14 11:24:00.150302 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:24:00.150258 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5tkck\" is forbidden: User \"system:node:ip-10-0-139-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-35.ec2.internal' and this object" podUID="3de28a18-3cf4-4dca-be22-13ccafa88adb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkck" Jul 14 11:24:00.153532 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:24:00.153489 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9724t\" is forbidden: User \"system:node:ip-10-0-139-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-35.ec2.internal' and this object" podUID="7ed4c19f-edd8-4f65-91f0-fd4424428514" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9724t" Jul 14 11:24:00.160100 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:00.160052 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q5xr\" (UniqueName: \"kubernetes.io/projected/92fa77cd-188a-4fd5-8665-228c5de45be8-kube-api-access-6q5xr\") pod \"limitador-operator-controller-manager-859d7b78bd-twr7j\" (UID: \"92fa77cd-188a-4fd5-8665-228c5de45be8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twr7j" Jul 14 11:24:00.160281 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:00.160167 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jq92\" (UniqueName: \"kubernetes.io/projected/c4a4539d-ba21-4ff1-b348-1b1c8d23911f-kube-api-access-8jq92\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pptm2\" (UID: \"c4a4539d-ba21-4ff1-b348-1b1c8d23911f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pptm2" Jul 14 11:24:00.160281 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:00.160230 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4a4539d-ba21-4ff1-b348-1b1c8d23911f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pptm2\" (UID: \"c4a4539d-ba21-4ff1-b348-1b1c8d23911f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pptm2" Jul 14 11:24:00.260945 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:00.260890 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jq92\" (UniqueName: \"kubernetes.io/projected/c4a4539d-ba21-4ff1-b348-1b1c8d23911f-kube-api-access-8jq92\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pptm2\" (UID: \"c4a4539d-ba21-4ff1-b348-1b1c8d23911f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pptm2" Jul 14 11:24:00.261130 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:00.260975 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4a4539d-ba21-4ff1-b348-1b1c8d23911f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pptm2\" (UID: \"c4a4539d-ba21-4ff1-b348-1b1c8d23911f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pptm2" Jul 14 11:24:00.261130 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:00.261065 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q5xr\" (UniqueName: \"kubernetes.io/projected/92fa77cd-188a-4fd5-8665-228c5de45be8-kube-api-access-6q5xr\") pod \"limitador-operator-controller-manager-859d7b78bd-twr7j\" (UID: \"92fa77cd-188a-4fd5-8665-228c5de45be8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twr7j" Jul 14 11:24:00.261416 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:00.261386 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4a4539d-ba21-4ff1-b348-1b1c8d23911f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pptm2\" (UID: \"c4a4539d-ba21-4ff1-b348-1b1c8d23911f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pptm2" Jul 14 11:24:00.295009 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:00.294977 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q5xr\" (UniqueName: \"kubernetes.io/projected/92fa77cd-188a-4fd5-8665-228c5de45be8-kube-api-access-6q5xr\") pod \"limitador-operator-controller-manager-859d7b78bd-twr7j\" (UID: \"92fa77cd-188a-4fd5-8665-228c5de45be8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twr7j" Jul 14 11:24:00.305273 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:00.305237 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jq92\" (UniqueName: \"kubernetes.io/projected/c4a4539d-ba21-4ff1-b348-1b1c8d23911f-kube-api-access-8jq92\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pptm2\" (UID: \"c4a4539d-ba21-4ff1-b348-1b1c8d23911f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pptm2" Jul 14 11:24:00.394267 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:00.394227 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pptm2" Jul 14 11:24:00.410841 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:00.410804 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twr7j" Jul 14 11:24:12.395828 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:12.395796 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9724t" Jul 14 11:24:12.398882 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:12.398858 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkck" Jul 14 11:24:12.399030 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:24:12.398843 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9724t\" is forbidden: User \"system:node:ip-10-0-139-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-35.ec2.internal' and this object" podUID="7ed4c19f-edd8-4f65-91f0-fd4424428514" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9724t" Jul 14 11:24:12.407662 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:24:12.407624 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5tkck\" is forbidden: User \"system:node:ip-10-0-139-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-35.ec2.internal' and this object" podUID="3de28a18-3cf4-4dca-be22-13ccafa88adb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkck" Jul 14 11:24:12.408806 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:24:12.408773 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4a4539d_ba21_4ff1_b348_1b1c8d23911f.slice/crio-828a9adbacb780c3ef794c1a3070dc3a3c3b41b1a0451eb2a8a6bb3a579f67e5 WatchSource:0}: Error finding container 828a9adbacb780c3ef794c1a3070dc3a3c3b41b1a0451eb2a8a6bb3a579f67e5: Status 404 returned error can't find the container with id 828a9adbacb780c3ef794c1a3070dc3a3c3b41b1a0451eb2a8a6bb3a579f67e5 Jul 14 11:24:12.410098 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:12.410066 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pptm2"] Jul 14 11:24:12.410837 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:24:12.410800 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9724t\" is forbidden: User \"system:node:ip-10-0-139-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-35.ec2.internal' and this object" podUID="7ed4c19f-edd8-4f65-91f0-fd4424428514" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9724t" Jul 14 11:24:12.436065 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:12.436042 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twr7j"] Jul 14 11:24:12.444014 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:24:12.443985 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92fa77cd_188a_4fd5_8665_228c5de45be8.slice/crio-14b9b7ed2c0baaae7c70138ba2fcec07542f2b7dbbcb62fed1e534811437eee1 WatchSource:0}: Error finding container 14b9b7ed2c0baaae7c70138ba2fcec07542f2b7dbbcb62fed1e534811437eee1: Status 404 returned error can't find the container with id 14b9b7ed2c0baaae7c70138ba2fcec07542f2b7dbbcb62fed1e534811437eee1 Jul 14 11:24:12.488762 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:12.488737 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqt92\" (UniqueName: \"kubernetes.io/projected/3de28a18-3cf4-4dca-be22-13ccafa88adb-kube-api-access-vqt92\") pod \"3de28a18-3cf4-4dca-be22-13ccafa88adb\" (UID: \"3de28a18-3cf4-4dca-be22-13ccafa88adb\") " Jul 14 11:24:12.488874 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:12.488845 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3de28a18-3cf4-4dca-be22-13ccafa88adb-extensions-socket-volume\") pod \"3de28a18-3cf4-4dca-be22-13ccafa88adb\" (UID: \"3de28a18-3cf4-4dca-be22-13ccafa88adb\") " Jul 14 11:24:12.488966 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:12.488895 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ccv8k\" (UniqueName: \"kubernetes.io/projected/7ed4c19f-edd8-4f65-91f0-fd4424428514-kube-api-access-ccv8k\") pod \"7ed4c19f-edd8-4f65-91f0-fd4424428514\" (UID: \"7ed4c19f-edd8-4f65-91f0-fd4424428514\") " Jul 14 11:24:12.489405 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:12.489375 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3de28a18-3cf4-4dca-be22-13ccafa88adb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3de28a18-3cf4-4dca-be22-13ccafa88adb" (UID: "3de28a18-3cf4-4dca-be22-13ccafa88adb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 11:24:12.491055 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:12.491031 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3de28a18-3cf4-4dca-be22-13ccafa88adb-kube-api-access-vqt92" (OuterVolumeSpecName: "kube-api-access-vqt92") pod "3de28a18-3cf4-4dca-be22-13ccafa88adb" (UID: "3de28a18-3cf4-4dca-be22-13ccafa88adb"). InnerVolumeSpecName "kube-api-access-vqt92". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:24:12.491226 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:12.491160 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ed4c19f-edd8-4f65-91f0-fd4424428514-kube-api-access-ccv8k" (OuterVolumeSpecName: "kube-api-access-ccv8k") pod "7ed4c19f-edd8-4f65-91f0-fd4424428514" (UID: "7ed4c19f-edd8-4f65-91f0-fd4424428514"). InnerVolumeSpecName "kube-api-access-ccv8k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:24:12.589806 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:12.589771 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3de28a18-3cf4-4dca-be22-13ccafa88adb-extensions-socket-volume\") on node \"ip-10-0-139-35.ec2.internal\" DevicePath \"\"" Jul 14 11:24:12.589806 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:12.589804 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccv8k\" (UniqueName: \"kubernetes.io/projected/7ed4c19f-edd8-4f65-91f0-fd4424428514-kube-api-access-ccv8k\") on node \"ip-10-0-139-35.ec2.internal\" DevicePath \"\"" Jul 14 11:24:12.589806 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:12.589815 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqt92\" (UniqueName: \"kubernetes.io/projected/3de28a18-3cf4-4dca-be22-13ccafa88adb-kube-api-access-vqt92\") on node \"ip-10-0-139-35.ec2.internal\" DevicePath \"\"" Jul 14 11:24:13.088581 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:13.088517 2576 generic.go:356] "Generic (PLEG): container finished" podID="3de28a18-3cf4-4dca-be22-13ccafa88adb" containerID="0e15e5943c87795e78e636c45f462c1e5ba8f07988bca7237cefe0e56417d1ec" exitCode=0 Jul 14 11:24:13.088794 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:13.088600 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkck" Jul 14 11:24:13.088794 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:13.088625 2576 scope.go:117] "RemoveContainer" containerID="0e15e5943c87795e78e636c45f462c1e5ba8f07988bca7237cefe0e56417d1ec" Jul 14 11:24:13.090046 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:13.090023 2576 generic.go:356] "Generic (PLEG): container finished" podID="7ed4c19f-edd8-4f65-91f0-fd4424428514" containerID="e16257121685bdda785c05977e90fcd8394db97e0f503d8a8ad6836932a10a0c" exitCode=0 Jul 14 11:24:13.090160 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:13.090088 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9724t" Jul 14 11:24:13.091126 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:24:13.091095 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5tkck\" is forbidden: User \"system:node:ip-10-0-139-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-35.ec2.internal' and this object" podUID="3de28a18-3cf4-4dca-be22-13ccafa88adb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkck" Jul 14 11:24:13.092150 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:13.092120 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twr7j" event={"ID":"92fa77cd-188a-4fd5-8665-228c5de45be8","Type":"ContainerStarted","Data":"a6c7b1f35b940e25c8b27c50e4e519e56c233f7a6e7d00b2ed52b95882cbc28c"} Jul 14 11:24:13.092267 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:13.092179 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twr7j" event={"ID":"92fa77cd-188a-4fd5-8665-228c5de45be8","Type":"ContainerStarted","Data":"14b9b7ed2c0baaae7c70138ba2fcec07542f2b7dbbcb62fed1e534811437eee1"} Jul 14 11:24:13.092324 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:13.092286 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twr7j" Jul 14 11:24:13.093269 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:24:13.093246 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9724t\" is forbidden: User \"system:node:ip-10-0-139-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-35.ec2.internal' and this object" podUID="7ed4c19f-edd8-4f65-91f0-fd4424428514" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9724t" Jul 14 11:24:13.093823 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:13.093799 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cqpz5" event={"ID":"9b36ce92-f4a2-49d8-b6fe-2ae46c0f782f","Type":"ContainerStarted","Data":"85e80d2d1d41c5d658acfd723a9087b3ef08e3629b7a2896dae9856545eeae19"} Jul 14 11:24:13.095720 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:13.095696 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pptm2" event={"ID":"c4a4539d-ba21-4ff1-b348-1b1c8d23911f","Type":"ContainerStarted","Data":"5092ac4e3fc21a74001a934f204234cf97877a44fb46252443866b4a21680a00"} Jul 14 11:24:13.095817 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:24:13.095732 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9724t\" is forbidden: User \"system:node:ip-10-0-139-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-35.ec2.internal' and this object" podUID="7ed4c19f-edd8-4f65-91f0-fd4424428514" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9724t" Jul 14 11:24:13.095817 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:13.095743 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pptm2" event={"ID":"c4a4539d-ba21-4ff1-b348-1b1c8d23911f","Type":"ContainerStarted","Data":"828a9adbacb780c3ef794c1a3070dc3a3c3b41b1a0451eb2a8a6bb3a579f67e5"} Jul 14 11:24:13.095921 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:13.095853 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pptm2" Jul 14 11:24:13.104772 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:13.104462 2576 scope.go:117] "RemoveContainer" containerID="0e15e5943c87795e78e636c45f462c1e5ba8f07988bca7237cefe0e56417d1ec" Jul 14 11:24:13.105685 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:24:13.105650 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e15e5943c87795e78e636c45f462c1e5ba8f07988bca7237cefe0e56417d1ec\": container with ID starting with 0e15e5943c87795e78e636c45f462c1e5ba8f07988bca7237cefe0e56417d1ec not found: ID does not exist" containerID="0e15e5943c87795e78e636c45f462c1e5ba8f07988bca7237cefe0e56417d1ec" Jul 14 11:24:13.105778 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:13.105746 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e15e5943c87795e78e636c45f462c1e5ba8f07988bca7237cefe0e56417d1ec"} err="failed to get container status \"0e15e5943c87795e78e636c45f462c1e5ba8f07988bca7237cefe0e56417d1ec\": rpc error: code = NotFound desc = could not find container \"0e15e5943c87795e78e636c45f462c1e5ba8f07988bca7237cefe0e56417d1ec\": container with ID starting with 0e15e5943c87795e78e636c45f462c1e5ba8f07988bca7237cefe0e56417d1ec not found: ID does not exist" Jul 14 11:24:13.105778 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:13.105774 2576 scope.go:117] "RemoveContainer" containerID="e16257121685bdda785c05977e90fcd8394db97e0f503d8a8ad6836932a10a0c" Jul 14 11:24:13.115144 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:13.114888 2576 scope.go:117] "RemoveContainer" containerID="e16257121685bdda785c05977e90fcd8394db97e0f503d8a8ad6836932a10a0c" Jul 14 11:24:13.115232 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:24:13.115202 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e16257121685bdda785c05977e90fcd8394db97e0f503d8a8ad6836932a10a0c\": container with ID starting with e16257121685bdda785c05977e90fcd8394db97e0f503d8a8ad6836932a10a0c not found: ID does not exist" containerID="e16257121685bdda785c05977e90fcd8394db97e0f503d8a8ad6836932a10a0c" Jul 14 11:24:13.115288 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:13.115229 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e16257121685bdda785c05977e90fcd8394db97e0f503d8a8ad6836932a10a0c"} err="failed to get container status \"e16257121685bdda785c05977e90fcd8394db97e0f503d8a8ad6836932a10a0c\": rpc error: code = NotFound desc = could not find container \"e16257121685bdda785c05977e90fcd8394db97e0f503d8a8ad6836932a10a0c\": container with ID starting with e16257121685bdda785c05977e90fcd8394db97e0f503d8a8ad6836932a10a0c not found: ID does not exist" Jul 14 11:24:13.115974 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:13.115931 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twr7j" podStartSLOduration=13.115918118 podStartE2EDuration="13.115918118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:24:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:24:13.114260516 +0000 UTC m=+757.687640890" watchObservedRunningTime="2026-07-14 11:24:13.115918118 +0000 UTC m=+757.689298492" Jul 14 11:24:13.116500 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:24:13.116474 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5tkck\" is forbidden: User \"system:node:ip-10-0-139-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-35.ec2.internal' and this object" podUID="3de28a18-3cf4-4dca-be22-13ccafa88adb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkck" Jul 14 11:24:13.118496 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:24:13.118475 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9724t\" is forbidden: User \"system:node:ip-10-0-139-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-35.ec2.internal' and this object" podUID="7ed4c19f-edd8-4f65-91f0-fd4424428514" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9724t" Jul 14 11:24:13.138527 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:13.138471 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pptm2" podStartSLOduration=14.138454645 podStartE2EDuration="14.138454645s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:23:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:24:13.137498627 +0000 UTC m=+757.710879022" watchObservedRunningTime="2026-07-14 11:24:13.138454645 +0000 UTC m=+757.711835019" Jul 14 11:24:13.141131 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:24:13.141104 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5tkck\" is forbidden: User \"system:node:ip-10-0-139-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-35.ec2.internal' and this object" podUID="3de28a18-3cf4-4dca-be22-13ccafa88adb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5tkck" Jul 14 11:24:13.158601 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:13.158516 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cqpz5" podStartSLOduration=1.5661600249999998 podStartE2EDuration="24.158499967s" totalImagesPullingTime="22.592339942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:23:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:24:13.157743148 +0000 UTC m=+757.731123524" watchObservedRunningTime="2026-07-14 11:24:13.158499967 +0000 UTC m=+757.731880341" Jul 14 11:24:13.961697 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:13.961660 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3de28a18-3cf4-4dca-be22-13ccafa88adb" path="/var/lib/kubelet/pods/3de28a18-3cf4-4dca-be22-13ccafa88adb/volumes" Jul 14 11:24:13.962072 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:13.962016 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ed4c19f-edd8-4f65-91f0-fd4424428514" path="/var/lib/kubelet/pods/7ed4c19f-edd8-4f65-91f0-fd4424428514/volumes" Jul 14 11:24:19.278526 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:19.278480 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pptm2"] Jul 14 11:24:19.279037 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:19.278787 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pptm2" podUID="c4a4539d-ba21-4ff1-b348-1b1c8d23911f" containerName="manager" containerID="cri-o://5092ac4e3fc21a74001a934f204234cf97877a44fb46252443866b4a21680a00" gracePeriod=10 Jul 14 11:24:19.281063 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:19.281035 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pptm2" Jul 14 11:24:19.590152 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:19.590115 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pptm2" Jul 14 11:24:19.755358 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:19.755319 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jq92\" (UniqueName: \"kubernetes.io/projected/c4a4539d-ba21-4ff1-b348-1b1c8d23911f-kube-api-access-8jq92\") pod \"c4a4539d-ba21-4ff1-b348-1b1c8d23911f\" (UID: \"c4a4539d-ba21-4ff1-b348-1b1c8d23911f\") " Jul 14 11:24:19.755573 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:19.755466 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4a4539d-ba21-4ff1-b348-1b1c8d23911f-extensions-socket-volume\") pod \"c4a4539d-ba21-4ff1-b348-1b1c8d23911f\" (UID: \"c4a4539d-ba21-4ff1-b348-1b1c8d23911f\") " Jul 14 11:24:19.755883 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:19.755855 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4a4539d-ba21-4ff1-b348-1b1c8d23911f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c4a4539d-ba21-4ff1-b348-1b1c8d23911f" (UID: "c4a4539d-ba21-4ff1-b348-1b1c8d23911f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 11:24:19.757697 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:19.757661 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4a4539d-ba21-4ff1-b348-1b1c8d23911f-kube-api-access-8jq92" (OuterVolumeSpecName: "kube-api-access-8jq92") pod "c4a4539d-ba21-4ff1-b348-1b1c8d23911f" (UID: "c4a4539d-ba21-4ff1-b348-1b1c8d23911f"). InnerVolumeSpecName "kube-api-access-8jq92". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:24:19.856985 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:19.856890 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4a4539d-ba21-4ff1-b348-1b1c8d23911f-extensions-socket-volume\") on node \"ip-10-0-139-35.ec2.internal\" DevicePath \"\"" Jul 14 11:24:19.856985 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:19.856924 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jq92\" (UniqueName: \"kubernetes.io/projected/c4a4539d-ba21-4ff1-b348-1b1c8d23911f-kube-api-access-8jq92\") on node \"ip-10-0-139-35.ec2.internal\" DevicePath \"\"" Jul 14 11:24:20.135578 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:20.135466 2576 generic.go:356] "Generic (PLEG): container finished" podID="c4a4539d-ba21-4ff1-b348-1b1c8d23911f" containerID="5092ac4e3fc21a74001a934f204234cf97877a44fb46252443866b4a21680a00" exitCode=0 Jul 14 11:24:20.135578 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:20.135523 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pptm2" Jul 14 11:24:20.135578 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:20.135556 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pptm2" event={"ID":"c4a4539d-ba21-4ff1-b348-1b1c8d23911f","Type":"ContainerDied","Data":"5092ac4e3fc21a74001a934f204234cf97877a44fb46252443866b4a21680a00"} Jul 14 11:24:20.135814 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:20.135611 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pptm2" event={"ID":"c4a4539d-ba21-4ff1-b348-1b1c8d23911f","Type":"ContainerDied","Data":"828a9adbacb780c3ef794c1a3070dc3a3c3b41b1a0451eb2a8a6bb3a579f67e5"} Jul 14 11:24:20.135814 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:20.135633 2576 scope.go:117] "RemoveContainer" containerID="5092ac4e3fc21a74001a934f204234cf97877a44fb46252443866b4a21680a00" Jul 14 11:24:20.144961 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:20.144940 2576 scope.go:117] "RemoveContainer" containerID="5092ac4e3fc21a74001a934f204234cf97877a44fb46252443866b4a21680a00" Jul 14 11:24:20.145337 ip-10-0-139-35 kubenswrapper[2576]: E0714 11:24:20.145291 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5092ac4e3fc21a74001a934f204234cf97877a44fb46252443866b4a21680a00\": container with ID starting with 5092ac4e3fc21a74001a934f204234cf97877a44fb46252443866b4a21680a00 not found: ID does not exist" containerID="5092ac4e3fc21a74001a934f204234cf97877a44fb46252443866b4a21680a00" Jul 14 11:24:20.145448 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:20.145343 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5092ac4e3fc21a74001a934f204234cf97877a44fb46252443866b4a21680a00"} err="failed to get container status \"5092ac4e3fc21a74001a934f204234cf97877a44fb46252443866b4a21680a00\": rpc error: code = NotFound desc = could not find container \"5092ac4e3fc21a74001a934f204234cf97877a44fb46252443866b4a21680a00\": container with ID starting with 5092ac4e3fc21a74001a934f204234cf97877a44fb46252443866b4a21680a00 not found: ID does not exist" Jul 14 11:24:20.175017 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:20.174981 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pptm2"] Jul 14 11:24:20.179237 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:20.179205 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pptm2"] Jul 14 11:24:21.960983 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:21.960947 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4a4539d-ba21-4ff1-b348-1b1c8d23911f" path="/var/lib/kubelet/pods/c4a4539d-ba21-4ff1-b348-1b1c8d23911f/volumes" Jul 14 11:24:24.105591 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:24.105560 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twr7j" Jul 14 11:24:35.672037 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:35.672002 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh"] Jul 14 11:24:35.672442 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:35.672410 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4a4539d-ba21-4ff1-b348-1b1c8d23911f" containerName="manager" Jul 14 11:24:35.672442 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:35.672421 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4a4539d-ba21-4ff1-b348-1b1c8d23911f" containerName="manager" Jul 14 11:24:35.672524 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:35.672501 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4a4539d-ba21-4ff1-b348-1b1c8d23911f" containerName="manager" Jul 14 11:24:35.772436 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:35.772400 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh"] Jul 14 11:24:35.772625 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:35.772515 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:24:35.775656 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:35.775630 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-zzwl9\"" Jul 14 11:24:35.803627 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:35.803594 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbs72\" (UniqueName: \"kubernetes.io/projected/82a68712-df38-4a90-bcce-669392d7d017-kube-api-access-dbs72\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7rdh\" (UID: \"82a68712-df38-4a90-bcce-669392d7d017\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:24:35.803800 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:35.803640 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82a68712-df38-4a90-bcce-669392d7d017-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7rdh\" (UID: \"82a68712-df38-4a90-bcce-669392d7d017\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:24:35.803800 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:35.803693 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82a68712-df38-4a90-bcce-669392d7d017-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7rdh\" (UID: \"82a68712-df38-4a90-bcce-669392d7d017\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:24:35.803800 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:35.803708 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82a68712-df38-4a90-bcce-669392d7d017-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7rdh\" (UID: \"82a68712-df38-4a90-bcce-669392d7d017\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:24:35.803800 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:35.803722 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82a68712-df38-4a90-bcce-669392d7d017-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7rdh\" (UID: \"82a68712-df38-4a90-bcce-669392d7d017\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:24:35.803800 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:35.803762 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82a68712-df38-4a90-bcce-669392d7d017-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7rdh\" (UID: \"82a68712-df38-4a90-bcce-669392d7d017\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:24:35.803966 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:35.803805 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82a68712-df38-4a90-bcce-669392d7d017-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7rdh\" (UID: \"82a68712-df38-4a90-bcce-669392d7d017\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:24:35.803966 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:35.803849 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82a68712-df38-4a90-bcce-669392d7d017-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7rdh\" (UID: \"82a68712-df38-4a90-bcce-669392d7d017\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:24:35.803966 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:35.803884 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82a68712-df38-4a90-bcce-669392d7d017-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7rdh\" (UID: \"82a68712-df38-4a90-bcce-669392d7d017\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:24:35.904876 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:35.904702 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82a68712-df38-4a90-bcce-669392d7d017-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7rdh\" (UID: \"82a68712-df38-4a90-bcce-669392d7d017\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:24:35.904876 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:35.904817 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbs72\" (UniqueName: \"kubernetes.io/projected/82a68712-df38-4a90-bcce-669392d7d017-kube-api-access-dbs72\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7rdh\" (UID: \"82a68712-df38-4a90-bcce-669392d7d017\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:24:35.905002 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:35.904875 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82a68712-df38-4a90-bcce-669392d7d017-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7rdh\" (UID: \"82a68712-df38-4a90-bcce-669392d7d017\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:24:35.905002 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:35.904927 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82a68712-df38-4a90-bcce-669392d7d017-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7rdh\" (UID: \"82a68712-df38-4a90-bcce-669392d7d017\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:24:35.905002 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:35.904949 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82a68712-df38-4a90-bcce-669392d7d017-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7rdh\" (UID: \"82a68712-df38-4a90-bcce-669392d7d017\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:24:35.905002 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:35.904975 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82a68712-df38-4a90-bcce-669392d7d017-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7rdh\" (UID: \"82a68712-df38-4a90-bcce-669392d7d017\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:24:35.905230 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:35.905001 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82a68712-df38-4a90-bcce-669392d7d017-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7rdh\" (UID: \"82a68712-df38-4a90-bcce-669392d7d017\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:24:35.905230 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:35.905027 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82a68712-df38-4a90-bcce-669392d7d017-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7rdh\" (UID: \"82a68712-df38-4a90-bcce-669392d7d017\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:24:35.905230 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:35.905064 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82a68712-df38-4a90-bcce-669392d7d017-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7rdh\" (UID: \"82a68712-df38-4a90-bcce-669392d7d017\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:24:35.905447 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:35.905361 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82a68712-df38-4a90-bcce-669392d7d017-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7rdh\" (UID: \"82a68712-df38-4a90-bcce-669392d7d017\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:24:35.905523 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:35.905503 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82a68712-df38-4a90-bcce-669392d7d017-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7rdh\" (UID: \"82a68712-df38-4a90-bcce-669392d7d017\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:24:35.905686 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:35.905663 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82a68712-df38-4a90-bcce-669392d7d017-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7rdh\" (UID: \"82a68712-df38-4a90-bcce-669392d7d017\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:24:35.905742 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:35.905715 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82a68712-df38-4a90-bcce-669392d7d017-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7rdh\" (UID: \"82a68712-df38-4a90-bcce-669392d7d017\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:24:35.905948 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:35.905923 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82a68712-df38-4a90-bcce-669392d7d017-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7rdh\" (UID: \"82a68712-df38-4a90-bcce-669392d7d017\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:24:35.907985 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:35.907941 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82a68712-df38-4a90-bcce-669392d7d017-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7rdh\" (UID: \"82a68712-df38-4a90-bcce-669392d7d017\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:24:35.908085 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:35.908015 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82a68712-df38-4a90-bcce-669392d7d017-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7rdh\" (UID: \"82a68712-df38-4a90-bcce-669392d7d017\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:24:35.921700 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:35.921673 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbs72\" (UniqueName: \"kubernetes.io/projected/82a68712-df38-4a90-bcce-669392d7d017-kube-api-access-dbs72\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7rdh\" (UID: \"82a68712-df38-4a90-bcce-669392d7d017\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:24:35.922100 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:35.922045 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82a68712-df38-4a90-bcce-669392d7d017-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-k7rdh\" (UID: \"82a68712-df38-4a90-bcce-669392d7d017\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:24:36.087735 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:36.087704 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-zzwl9\"" Jul 14 11:24:36.095327 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:36.095295 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:24:36.329900 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:36.329864 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh"] Jul 14 11:24:36.330190 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:24:36.330166 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82a68712_df38_4a90_bcce_669392d7d017.slice/crio-01c0ed4e37dc411fa306325e3b0f1247c9ca2d516f5b3ddeea6c3a2af61ed467 WatchSource:0}: Error finding container 01c0ed4e37dc411fa306325e3b0f1247c9ca2d516f5b3ddeea6c3a2af61ed467: Status 404 returned error can't find the container with id 01c0ed4e37dc411fa306325e3b0f1247c9ca2d516f5b3ddeea6c3a2af61ed467 Jul 14 11:24:36.332477 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:36.332448 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 14 11:24:36.332571 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:36.332532 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 14 11:24:36.332614 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:36.332580 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 14 11:24:37.229345 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:37.229299 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" event={"ID":"82a68712-df38-4a90-bcce-669392d7d017","Type":"ContainerStarted","Data":"2edd60f7c16e3b74f1fdf85609747efce6e025441b19641badd2e9d4920dbe48"} Jul 14 11:24:37.229766 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:37.229355 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" event={"ID":"82a68712-df38-4a90-bcce-669392d7d017","Type":"ContainerStarted","Data":"01c0ed4e37dc411fa306325e3b0f1247c9ca2d516f5b3ddeea6c3a2af61ed467"} Jul 14 11:24:38.095766 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:38.095720 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:24:38.100711 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:38.100674 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:24:38.221740 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:38.221689 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" podStartSLOduration=3.221671549 podStartE2EDuration="3.221671549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:24:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:24:37.269615504 +0000 UTC m=+781.842995898" watchObservedRunningTime="2026-07-14 11:24:38.221671549 +0000 UTC m=+782.795051923" Jul 14 11:24:38.234886 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:38.234853 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:24:38.235980 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:38.235955 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:24:39.115134 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:39.115098 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpk68"] Jul 14 11:24:39.338477 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:39.338434 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpk68"] Jul 14 11:24:39.338477 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:39.338483 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpk68"] Jul 14 11:24:39.338999 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:39.338588 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-gpk68" Jul 14 11:24:39.341666 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:39.341643 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 14 11:24:39.443000 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:39.442915 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/81eaabd4-8f6d-4343-9a5e-32cc25dbf605-config-file\") pod \"limitador-limitador-54d6d988d5-gpk68\" (UID: \"81eaabd4-8f6d-4343-9a5e-32cc25dbf605\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gpk68" Jul 14 11:24:39.443000 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:39.442966 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89f9q\" (UniqueName: \"kubernetes.io/projected/81eaabd4-8f6d-4343-9a5e-32cc25dbf605-kube-api-access-89f9q\") pod \"limitador-limitador-54d6d988d5-gpk68\" (UID: \"81eaabd4-8f6d-4343-9a5e-32cc25dbf605\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gpk68" Jul 14 11:24:39.544143 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:39.544101 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/81eaabd4-8f6d-4343-9a5e-32cc25dbf605-config-file\") pod \"limitador-limitador-54d6d988d5-gpk68\" (UID: \"81eaabd4-8f6d-4343-9a5e-32cc25dbf605\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gpk68" Jul 14 11:24:39.544398 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:39.544158 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89f9q\" (UniqueName: \"kubernetes.io/projected/81eaabd4-8f6d-4343-9a5e-32cc25dbf605-kube-api-access-89f9q\") pod \"limitador-limitador-54d6d988d5-gpk68\" (UID: \"81eaabd4-8f6d-4343-9a5e-32cc25dbf605\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gpk68" Jul 14 11:24:39.544771 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:39.544752 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/81eaabd4-8f6d-4343-9a5e-32cc25dbf605-config-file\") pod \"limitador-limitador-54d6d988d5-gpk68\" (UID: \"81eaabd4-8f6d-4343-9a5e-32cc25dbf605\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gpk68" Jul 14 11:24:39.556151 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:39.556123 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89f9q\" (UniqueName: \"kubernetes.io/projected/81eaabd4-8f6d-4343-9a5e-32cc25dbf605-kube-api-access-89f9q\") pod \"limitador-limitador-54d6d988d5-gpk68\" (UID: \"81eaabd4-8f6d-4343-9a5e-32cc25dbf605\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gpk68" Jul 14 11:24:39.649725 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:39.649690 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-gpk68" Jul 14 11:24:39.821241 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:39.821213 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpk68"] Jul 14 11:24:39.823912 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:24:39.823879 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81eaabd4_8f6d_4343_9a5e_32cc25dbf605.slice/crio-9fabbf097271b7abb0d7ee7cb2e0c98ac3c6215dd76ee186e21a9b1807031419 WatchSource:0}: Error finding container 9fabbf097271b7abb0d7ee7cb2e0c98ac3c6215dd76ee186e21a9b1807031419: Status 404 returned error can't find the container with id 9fabbf097271b7abb0d7ee7cb2e0c98ac3c6215dd76ee186e21a9b1807031419 Jul 14 11:24:40.247311 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:40.247270 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-gpk68" event={"ID":"81eaabd4-8f6d-4343-9a5e-32cc25dbf605","Type":"ContainerStarted","Data":"9fabbf097271b7abb0d7ee7cb2e0c98ac3c6215dd76ee186e21a9b1807031419"} Jul 14 11:24:44.276047 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:44.276007 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-gpk68" event={"ID":"81eaabd4-8f6d-4343-9a5e-32cc25dbf605","Type":"ContainerStarted","Data":"f2ae0b297908a90a95aa2433792b9c7a96fe02e654b4201ff1f207e6bd8a331b"} Jul 14 11:24:44.276437 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:44.276076 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-gpk68" Jul 14 11:24:44.296426 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:44.296364 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-gpk68" podStartSLOduration=1.496159171 podStartE2EDuration="5.296346811s" totalImagesPullingTime="3.80018764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:24:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:24:44.294647206 +0000 UTC m=+788.868027607" watchObservedRunningTime="2026-07-14 11:24:44.296346811 +0000 UTC m=+788.869727226" Jul 14 11:24:55.282872 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:24:55.282840 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-gpk68" Jul 14 11:25:56.291375 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:25:56.291336 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpk68"] Jul 14 11:26:04.711129 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:04.711090 2576 generic.go:356] "Generic (PLEG): container finished" podID="82a68712-df38-4a90-bcce-669392d7d017" containerID="2edd60f7c16e3b74f1fdf85609747efce6e025441b19641badd2e9d4920dbe48" exitCode=0 Jul 14 11:26:04.711594 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:04.711167 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" event={"ID":"82a68712-df38-4a90-bcce-669392d7d017","Type":"ContainerDied","Data":"2edd60f7c16e3b74f1fdf85609747efce6e025441b19641badd2e9d4920dbe48"} Jul 14 11:26:04.711594 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:04.711581 2576 scope.go:117] "RemoveContainer" containerID="2edd60f7c16e3b74f1fdf85609747efce6e025441b19641badd2e9d4920dbe48" Jul 14 11:26:04.712577 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:04.712521 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 14 11:26:04.712888 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:04.712613 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 14 11:26:04.712888 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:04.712646 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 14 11:26:05.717904 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:05.717871 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" event={"ID":"82a68712-df38-4a90-bcce-669392d7d017","Type":"ContainerStarted","Data":"440e251133a0ce163ace0524eb9771d87cf001573d768d4897e67df077230683"} Jul 14 11:26:06.096423 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:06.096350 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:26:06.097576 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:06.097525 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-k7rdh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 14 11:26:06.097704 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:06.097599 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" podUID="82a68712-df38-4a90-bcce-669392d7d017" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 14 11:26:07.096026 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:07.095985 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-k7rdh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 14 11:26:07.096434 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:07.096042 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" podUID="82a68712-df38-4a90-bcce-669392d7d017" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 14 11:26:08.096759 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:08.096722 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-k7rdh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 14 11:26:08.097157 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:08.096779 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" podUID="82a68712-df38-4a90-bcce-669392d7d017" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 14 11:26:08.234819 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:08.234770 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:26:09.096340 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:09.096293 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-k7rdh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 14 11:26:09.096576 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:09.096367 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" podUID="82a68712-df38-4a90-bcce-669392d7d017" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 14 11:26:10.099908 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:10.099875 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:26:10.100854 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:10.100835 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-k7rdh" Jul 14 11:26:24.363063 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:24.363025 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpk68"] Jul 14 11:26:35.902476 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:35.902390 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvhwc_720aefb6-81a1-44d1-a01f-4bc07ff30465/ovn-acl-logging/0.log" Jul 14 11:26:35.903721 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:35.903699 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvhwc_720aefb6-81a1-44d1-a01f-4bc07ff30465/ovn-acl-logging/0.log" Jul 14 11:26:38.090819 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:38.090784 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-dgn7f"] Jul 14 11:26:38.094665 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:38.094641 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgn7f" Jul 14 11:26:38.097964 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:38.097932 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 14 11:26:38.098232 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:38.098207 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 14 11:26:38.099160 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:38.099133 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 14 11:26:38.105871 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:38.105842 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-nlg7b\"" Jul 14 11:26:38.110509 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:38.110461 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-dgn7f"] Jul 14 11:26:38.263589 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:38.263514 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e3aede8-048b-418a-ba8a-3c0fd512d3c6-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dgn7f\" (UID: \"6e3aede8-048b-418a-ba8a-3c0fd512d3c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgn7f" Jul 14 11:26:38.263781 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:38.263615 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e3aede8-048b-418a-ba8a-3c0fd512d3c6-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dgn7f\" (UID: \"6e3aede8-048b-418a-ba8a-3c0fd512d3c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgn7f" Jul 14 11:26:38.263781 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:38.263654 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e3aede8-048b-418a-ba8a-3c0fd512d3c6-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dgn7f\" (UID: \"6e3aede8-048b-418a-ba8a-3c0fd512d3c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgn7f" Jul 14 11:26:38.263781 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:38.263677 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e3aede8-048b-418a-ba8a-3c0fd512d3c6-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dgn7f\" (UID: \"6e3aede8-048b-418a-ba8a-3c0fd512d3c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgn7f" Jul 14 11:26:38.263781 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:38.263768 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmh2c\" (UniqueName: \"kubernetes.io/projected/6e3aede8-048b-418a-ba8a-3c0fd512d3c6-kube-api-access-kmh2c\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dgn7f\" (UID: \"6e3aede8-048b-418a-ba8a-3c0fd512d3c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgn7f" Jul 14 11:26:38.263919 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:38.263804 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e3aede8-048b-418a-ba8a-3c0fd512d3c6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dgn7f\" (UID: \"6e3aede8-048b-418a-ba8a-3c0fd512d3c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgn7f" Jul 14 11:26:38.364785 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:38.364686 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e3aede8-048b-418a-ba8a-3c0fd512d3c6-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dgn7f\" (UID: \"6e3aede8-048b-418a-ba8a-3c0fd512d3c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgn7f" Jul 14 11:26:38.364785 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:38.364750 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e3aede8-048b-418a-ba8a-3c0fd512d3c6-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dgn7f\" (UID: \"6e3aede8-048b-418a-ba8a-3c0fd512d3c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgn7f" Jul 14 11:26:38.364785 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:38.364768 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e3aede8-048b-418a-ba8a-3c0fd512d3c6-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dgn7f\" (UID: \"6e3aede8-048b-418a-ba8a-3c0fd512d3c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgn7f" Jul 14 11:26:38.365078 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:38.364805 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmh2c\" (UniqueName: \"kubernetes.io/projected/6e3aede8-048b-418a-ba8a-3c0fd512d3c6-kube-api-access-kmh2c\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dgn7f\" (UID: \"6e3aede8-048b-418a-ba8a-3c0fd512d3c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgn7f" Jul 14 11:26:38.365078 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:38.364832 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e3aede8-048b-418a-ba8a-3c0fd512d3c6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dgn7f\" (UID: \"6e3aede8-048b-418a-ba8a-3c0fd512d3c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgn7f" Jul 14 11:26:38.365078 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:38.364907 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e3aede8-048b-418a-ba8a-3c0fd512d3c6-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dgn7f\" (UID: \"6e3aede8-048b-418a-ba8a-3c0fd512d3c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgn7f" Jul 14 11:26:38.365301 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:38.365164 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e3aede8-048b-418a-ba8a-3c0fd512d3c6-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dgn7f\" (UID: \"6e3aede8-048b-418a-ba8a-3c0fd512d3c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgn7f" Jul 14 11:26:38.365301 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:38.365184 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e3aede8-048b-418a-ba8a-3c0fd512d3c6-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dgn7f\" (UID: \"6e3aede8-048b-418a-ba8a-3c0fd512d3c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgn7f" Jul 14 11:26:38.365301 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:38.365251 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e3aede8-048b-418a-ba8a-3c0fd512d3c6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dgn7f\" (UID: \"6e3aede8-048b-418a-ba8a-3c0fd512d3c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgn7f" Jul 14 11:26:38.367390 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:38.367366 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e3aede8-048b-418a-ba8a-3c0fd512d3c6-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dgn7f\" (UID: \"6e3aede8-048b-418a-ba8a-3c0fd512d3c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgn7f" Jul 14 11:26:38.367494 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:38.367458 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e3aede8-048b-418a-ba8a-3c0fd512d3c6-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dgn7f\" (UID: \"6e3aede8-048b-418a-ba8a-3c0fd512d3c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgn7f" Jul 14 11:26:38.374722 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:38.374700 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmh2c\" (UniqueName: \"kubernetes.io/projected/6e3aede8-048b-418a-ba8a-3c0fd512d3c6-kube-api-access-kmh2c\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dgn7f\" (UID: \"6e3aede8-048b-418a-ba8a-3c0fd512d3c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgn7f" Jul 14 11:26:38.416767 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:38.416723 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgn7f" Jul 14 11:26:38.515927 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:38.515896 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpk68"] Jul 14 11:26:38.584196 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:38.584166 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-dgn7f"] Jul 14 11:26:38.586454 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:26:38.586425 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e3aede8_048b_418a_ba8a_3c0fd512d3c6.slice/crio-4b5cacf1e1bcb56e61fb14fcb7b28b1a251b223b8169e2bd4d4cbe5ec0b77dcd WatchSource:0}: Error finding container 4b5cacf1e1bcb56e61fb14fcb7b28b1a251b223b8169e2bd4d4cbe5ec0b77dcd: Status 404 returned error can't find the container with id 4b5cacf1e1bcb56e61fb14fcb7b28b1a251b223b8169e2bd4d4cbe5ec0b77dcd Jul 14 11:26:38.907052 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:38.907012 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgn7f" event={"ID":"6e3aede8-048b-418a-ba8a-3c0fd512d3c6","Type":"ContainerStarted","Data":"4b5cacf1e1bcb56e61fb14fcb7b28b1a251b223b8169e2bd4d4cbe5ec0b77dcd"} Jul 14 11:26:39.914804 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:39.914763 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgn7f" event={"ID":"6e3aede8-048b-418a-ba8a-3c0fd512d3c6","Type":"ContainerStarted","Data":"f0329b1063200a0f93e28325ea97f4b6a84c77bd880276aa4a085f7ac52fd7ff"} Jul 14 11:26:39.936250 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:39.936123 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgn7f" podStartSLOduration=0.845005783 podStartE2EDuration="1.936102314s" totalImagesPullingTime="1.091096531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:26:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:26:39.934088074 +0000 UTC m=+904.507468472" watchObservedRunningTime="2026-07-14 11:26:39.936102314 +0000 UTC m=+904.509482744" Jul 14 11:26:48.417559 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:48.417494 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgn7f" Jul 14 11:26:48.417989 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:48.417602 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgn7f" Jul 14 11:26:48.430995 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:48.430960 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgn7f" Jul 14 11:26:48.976989 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:48.976954 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgn7f" Jul 14 11:26:50.127196 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:26:50.127160 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpk68"] Jul 14 11:27:06.415996 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:27:06.415953 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpk68"] Jul 14 11:27:16.824610 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:27:16.824571 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpk68"] Jul 14 11:27:24.221369 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:27:24.221328 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpk68"] Jul 14 11:30:00.185410 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:30:00.185371 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733810-j8jxb"] Jul 14 11:30:00.190437 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:30:00.190402 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733810-j8jxb" Jul 14 11:30:00.194866 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:30:00.194831 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-26jk8\"" Jul 14 11:30:00.201810 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:30:00.201790 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733810-j8jxb" Jul 14 11:30:00.225580 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:30:00.225526 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733810-j8jxb"] Jul 14 11:30:00.355674 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:30:00.355645 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733810-j8jxb"] Jul 14 11:30:00.358414 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:30:00.358380 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ec2e908_241d_4fda_bb18_6ec175dbb351.slice/crio-e423213ca567b4ccd01dda619dd7ce12cb349c9a3d0235438080bc75bb7835fd WatchSource:0}: Error finding container e423213ca567b4ccd01dda619dd7ce12cb349c9a3d0235438080bc75bb7835fd: Status 404 returned error can't find the container with id e423213ca567b4ccd01dda619dd7ce12cb349c9a3d0235438080bc75bb7835fd Jul 14 11:30:00.360388 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:30:00.360369 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 11:30:00.988635 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:30:00.988600 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733810-j8jxb" event={"ID":"4ec2e908-241d-4fda-bb18-6ec175dbb351","Type":"ContainerStarted","Data":"e423213ca567b4ccd01dda619dd7ce12cb349c9a3d0235438080bc75bb7835fd"} Jul 14 11:30:03.003471 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:30:03.003371 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733810-j8jxb" event={"ID":"4ec2e908-241d-4fda-bb18-6ec175dbb351","Type":"ContainerStarted","Data":"ed9f5db137ca839cf5c10fa1242c2ee53c9cbae4958a6542d4ef94df374afc0e"} Jul 14 11:30:04.010317 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:30:04.010280 2576 generic.go:356] "Generic (PLEG): container finished" podID="4ec2e908-241d-4fda-bb18-6ec175dbb351" containerID="ed9f5db137ca839cf5c10fa1242c2ee53c9cbae4958a6542d4ef94df374afc0e" exitCode=0 Jul 14 11:30:04.010789 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:30:04.010355 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733810-j8jxb" event={"ID":"4ec2e908-241d-4fda-bb18-6ec175dbb351","Type":"ContainerDied","Data":"ed9f5db137ca839cf5c10fa1242c2ee53c9cbae4958a6542d4ef94df374afc0e"} Jul 14 11:30:05.168826 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:30:05.168798 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733810-j8jxb" Jul 14 11:30:06.023073 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:30:06.023032 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733810-j8jxb" event={"ID":"4ec2e908-241d-4fda-bb18-6ec175dbb351","Type":"ContainerDied","Data":"e423213ca567b4ccd01dda619dd7ce12cb349c9a3d0235438080bc75bb7835fd"} Jul 14 11:30:06.023073 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:30:06.023050 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733810-j8jxb" Jul 14 11:30:06.023073 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:30:06.023083 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e423213ca567b4ccd01dda619dd7ce12cb349c9a3d0235438080bc75bb7835fd" Jul 14 11:31:35.939586 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:31:35.939553 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvhwc_720aefb6-81a1-44d1-a01f-4bc07ff30465/ovn-acl-logging/0.log" Jul 14 11:31:35.942140 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:31:35.941674 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rvhwc_720aefb6-81a1-44d1-a01f-4bc07ff30465/ovn-acl-logging/0.log" Jul 14 11:31:42.223152 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:31:42.223113 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpk68"] Jul 14 11:31:51.720026 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:31:51.719986 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpk68"] Jul 14 11:32:04.244295 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:32:04.244253 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpk68"] Jul 14 11:32:12.123887 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:32:12.123844 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpk68"] Jul 14 11:32:23.135361 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:32:23.135320 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpk68"] Jul 14 11:32:48.588440 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:32:48.588397 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpk68"] Jul 14 11:32:59.143032 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:32:59.142982 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gpk68"] Jul 14 11:33:43.394992 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:43.394931 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-gzdvw_7b96a3bb-4f4a-450e-a15c-7840fc08eeaf/manager/0.log" Jul 14 11:33:43.523725 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:43.523684 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-7cpcf_adf43478-0d24-48d3-9487-ac3765a18975/manager/0.log" Jul 14 11:33:43.775956 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:43.775926 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-whlln_196ab9de-acb8-4bb7-858a-47ea9bd46804/server/0.log" Jul 14 11:33:43.907841 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:43.907801 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-jpkt7_de199871-dbb3-4814-bf72-dacd4247230b/manager/0.log" Jul 14 11:33:44.038994 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:44.038908 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bf58df976-brhns_e15a2d7c-1f99-4d13-bf06-d95892717484/copy-manifests/0.log" Jul 14 11:33:44.047421 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:44.047390 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bf58df976-brhns_e15a2d7c-1f99-4d13-bf06-d95892717484/manager/0.log" Jul 14 11:33:44.797995 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:44.797964 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29733810-j8jxb_4ec2e908-241d-4fda-bb18-6ec175dbb351/cleanup/0.log" Jul 14 11:33:46.332972 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:46.332920 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-wxt5r_67a32fb8-4023-4a0b-ab3f-81d4682f81b7/manager/0.log" Jul 14 11:33:46.446891 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:46.446856 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7j94s_2b2e829b-0cf7-4f05-9c10-ab3853766ca1/manager/0.log" Jul 14 11:33:46.564551 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:46.564511 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-cqpz5_9b36ce92-f4a2-49d8-b6fe-2ae46c0f782f/kuadrant-console-plugin/0.log" Jul 14 11:33:46.689056 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:46.688971 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-d56mc_75cd06e6-934c-4f1e-868f-cae367dea3a7/registry-server/0.log" Jul 14 11:33:46.979348 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:46.979282 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-gpk68_81eaabd4-8f6d-4343-9a5e-32cc25dbf605/limitador/0.log" Jul 14 11:33:47.114750 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:47.114717 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-twr7j_92fa77cd-188a-4fd5-8665-228c5de45be8/manager/0.log" Jul 14 11:33:47.465583 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:47.465530 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4jsvwf_976ae51f-69b8-432d-b4ff-551403684b5b/istio-proxy/0.log" Jul 14 11:33:47.805328 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:47.805238 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b948bb5ff-l5kvc_f77b4fd2-69eb-44c7-9dea-3dee79258cec/kube-auth-proxy/0.log" Jul 14 11:33:47.925513 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:47.925458 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-k7rdh_82a68712-df38-4a90-bcce-669392d7d017/istio-proxy/1.log" Jul 14 11:33:48.267434 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:48.267402 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f9bb8c67d-6vnpr_ca5d6937-4feb-431e-b78b-fe1f595d8b36/router/0.log" Jul 14 11:33:48.730241 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:48.730209 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-dgn7f_6e3aede8-048b-418a-ba8a-3c0fd512d3c6/main/0.log" Jul 14 11:33:53.419775 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:53.419735 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-82fbt/must-gather-kklc9"] Jul 14 11:33:53.420253 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:53.420158 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ec2e908-241d-4fda-bb18-6ec175dbb351" containerName="cleanup" Jul 14 11:33:53.420253 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:53.420170 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ec2e908-241d-4fda-bb18-6ec175dbb351" containerName="cleanup" Jul 14 11:33:53.420326 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:53.420262 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ec2e908-241d-4fda-bb18-6ec175dbb351" containerName="cleanup" Jul 14 11:33:53.423702 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:53.423681 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-82fbt/must-gather-kklc9" Jul 14 11:33:53.428481 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:53.428147 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-82fbt\"/\"default-dockercfg-qbkjj\"" Jul 14 11:33:53.428481 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:53.428405 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-82fbt\"/\"openshift-service-ca.crt\"" Jul 14 11:33:53.428481 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:53.428414 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-82fbt\"/\"kube-root-ca.crt\"" Jul 14 11:33:53.481012 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:53.480973 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnzm6\" (UniqueName: \"kubernetes.io/projected/6049fd34-ede0-49e2-ab31-27c00a7b3430-kube-api-access-fnzm6\") pod \"must-gather-kklc9\" (UID: \"6049fd34-ede0-49e2-ab31-27c00a7b3430\") " pod="openshift-must-gather-82fbt/must-gather-kklc9" Jul 14 11:33:53.481012 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:53.481012 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6049fd34-ede0-49e2-ab31-27c00a7b3430-must-gather-output\") pod \"must-gather-kklc9\" (UID: \"6049fd34-ede0-49e2-ab31-27c00a7b3430\") " pod="openshift-must-gather-82fbt/must-gather-kklc9" Jul 14 11:33:53.509899 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:53.509867 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-82fbt/must-gather-kklc9"] Jul 14 11:33:53.582027 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:53.581988 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnzm6\" (UniqueName: \"kubernetes.io/projected/6049fd34-ede0-49e2-ab31-27c00a7b3430-kube-api-access-fnzm6\") pod \"must-gather-kklc9\" (UID: \"6049fd34-ede0-49e2-ab31-27c00a7b3430\") " pod="openshift-must-gather-82fbt/must-gather-kklc9" Jul 14 11:33:53.582027 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:53.582034 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6049fd34-ede0-49e2-ab31-27c00a7b3430-must-gather-output\") pod \"must-gather-kklc9\" (UID: \"6049fd34-ede0-49e2-ab31-27c00a7b3430\") " pod="openshift-must-gather-82fbt/must-gather-kklc9" Jul 14 11:33:53.582425 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:53.582402 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6049fd34-ede0-49e2-ab31-27c00a7b3430-must-gather-output\") pod \"must-gather-kklc9\" (UID: \"6049fd34-ede0-49e2-ab31-27c00a7b3430\") " pod="openshift-must-gather-82fbt/must-gather-kklc9" Jul 14 11:33:53.591312 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:53.591282 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnzm6\" (UniqueName: \"kubernetes.io/projected/6049fd34-ede0-49e2-ab31-27c00a7b3430-kube-api-access-fnzm6\") pod \"must-gather-kklc9\" (UID: \"6049fd34-ede0-49e2-ab31-27c00a7b3430\") " pod="openshift-must-gather-82fbt/must-gather-kklc9" Jul 14 11:33:53.734403 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:53.734350 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-82fbt/must-gather-kklc9" Jul 14 11:33:53.882414 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:53.882310 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-82fbt/must-gather-kklc9"] Jul 14 11:33:53.885474 ip-10-0-139-35 kubenswrapper[2576]: W0714 11:33:53.885436 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6049fd34_ede0_49e2_ab31_27c00a7b3430.slice/crio-a504a53808d9a0ec86fba78aa3d96ec23e2952ef5d821894bcd1f0efa68bdbe5 WatchSource:0}: Error finding container a504a53808d9a0ec86fba78aa3d96ec23e2952ef5d821894bcd1f0efa68bdbe5: Status 404 returned error can't find the container with id a504a53808d9a0ec86fba78aa3d96ec23e2952ef5d821894bcd1f0efa68bdbe5 Jul 14 11:33:54.256560 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:54.256497 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-82fbt/must-gather-kklc9" event={"ID":"6049fd34-ede0-49e2-ab31-27c00a7b3430","Type":"ContainerStarted","Data":"a504a53808d9a0ec86fba78aa3d96ec23e2952ef5d821894bcd1f0efa68bdbe5"} Jul 14 11:33:55.265230 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:55.265186 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-82fbt/must-gather-kklc9" event={"ID":"6049fd34-ede0-49e2-ab31-27c00a7b3430","Type":"ContainerStarted","Data":"c8c1d15e6b5fde0a54203292be7b449dccc0254177f544835f12dc97d11bc9f1"} Jul 14 11:33:55.265749 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:55.265246 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-82fbt/must-gather-kklc9" event={"ID":"6049fd34-ede0-49e2-ab31-27c00a7b3430","Type":"ContainerStarted","Data":"adff1a3f5eac3f458f209a8a40d0cb0d2633ac60049303e7199a836416201a0d"} Jul 14 11:33:55.285019 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:55.284944 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-82fbt/must-gather-kklc9" podStartSLOduration=1.508587417 podStartE2EDuration="2.284920505s" totalImagesPullingTime="776.333088ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:33:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:33:55.282004885 +0000 UTC m=+1339.855385264" watchObservedRunningTime="2026-07-14 11:33:55.284920505 +0000 UTC m=+1339.858300880" Jul 14 11:33:56.522081 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:56.521975 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mcz4r_485ab2d2-0fbc-4d2d-95b0-d60732668829/global-pull-secret-syncer/0.log" Jul 14 11:33:56.631714 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:56.631675 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kd42k_5e0333e8-ff9a-4d6b-a66a-d3c651db407d/konnectivity-agent/0.log" Jul 14 11:33:56.707387 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:33:56.707354 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-35.ec2.internal_c51082c0153c21c37ec0e44752612da3/haproxy/0.log" Jul 14 11:34:02.317084 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:02.317054 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-wxt5r_67a32fb8-4023-4a0b-ab3f-81d4682f81b7/manager/0.log" Jul 14 11:34:02.349371 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:02.349336 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7j94s_2b2e829b-0cf7-4f05-9c10-ab3853766ca1/manager/0.log" Jul 14 11:34:02.382786 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:02.382749 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-cqpz5_9b36ce92-f4a2-49d8-b6fe-2ae46c0f782f/kuadrant-console-plugin/0.log" Jul 14 11:34:02.416995 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:02.416955 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-d56mc_75cd06e6-934c-4f1e-868f-cae367dea3a7/registry-server/0.log" Jul 14 11:34:02.512706 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:02.512673 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-gpk68_81eaabd4-8f6d-4343-9a5e-32cc25dbf605/limitador/0.log" Jul 14 11:34:02.550269 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:02.550224 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-twr7j_92fa77cd-188a-4fd5-8665-228c5de45be8/manager/0.log" Jul 14 11:34:04.845135 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:04.845107 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-s6dd5_0862349d-af9b-45f6-8227-6ab44f85edcc/monitoring-plugin/0.log" Jul 14 11:34:04.890466 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:04.890411 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cnlp8_9d82e707-afa5-4354-80b7-623b97b5208b/node-exporter/0.log" Jul 14 11:34:04.921219 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:04.921179 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cnlp8_9d82e707-afa5-4354-80b7-623b97b5208b/kube-rbac-proxy/0.log" Jul 14 11:34:04.949685 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:04.949651 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cnlp8_9d82e707-afa5-4354-80b7-623b97b5208b/init-textfile/0.log" Jul 14 11:34:05.182433 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:05.182339 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-8fksf_10775e6e-386a-4d84-b634-95dd74f20e7f/kube-rbac-proxy-main/0.log" Jul 14 11:34:05.209997 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:05.209966 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-8fksf_10775e6e-386a-4d84-b634-95dd74f20e7f/kube-rbac-proxy-self/0.log" Jul 14 11:34:05.240572 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:05.240524 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-8fksf_10775e6e-386a-4d84-b634-95dd74f20e7f/openshift-state-metrics/0.log" Jul 14 11:34:05.515721 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:05.515693 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-c579z_26c04831-fe7d-4d29-9bf3-e51b5ac0cba1/prometheus-operator/0.log" Jul 14 11:34:05.543663 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:05.543621 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-c579z_26c04831-fe7d-4d29-9bf3-e51b5ac0cba1/kube-rbac-proxy/0.log" Jul 14 11:34:05.574924 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:05.574842 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-4zk2f_f90bde1d-5f1f-4fff-a833-bb7e0dc48154/prometheus-operator-admission-webhook/0.log" Jul 14 11:34:05.612646 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:05.612605 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6db976f7f4-nctrc_0b4c5e1d-f72e-470c-b75e-922f128e5f9f/telemeter-client/0.log" Jul 14 11:34:05.643967 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:05.643923 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6db976f7f4-nctrc_0b4c5e1d-f72e-470c-b75e-922f128e5f9f/reload/0.log" Jul 14 11:34:05.672880 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:05.672848 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6db976f7f4-nctrc_0b4c5e1d-f72e-470c-b75e-922f128e5f9f/kube-rbac-proxy/0.log" Jul 14 11:34:05.716616 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:05.716576 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f745c758c-xtfkr_40c059fb-01e5-4bdb-845e-c4188e213a41/thanos-query/0.log" Jul 14 11:34:05.747845 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:05.747813 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f745c758c-xtfkr_40c059fb-01e5-4bdb-845e-c4188e213a41/kube-rbac-proxy-web/0.log" Jul 14 11:34:05.800584 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:05.800481 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f745c758c-xtfkr_40c059fb-01e5-4bdb-845e-c4188e213a41/kube-rbac-proxy/0.log" Jul 14 11:34:05.857835 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:05.857802 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f745c758c-xtfkr_40c059fb-01e5-4bdb-845e-c4188e213a41/prom-label-proxy/0.log" Jul 14 11:34:05.911388 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:05.911357 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f745c758c-xtfkr_40c059fb-01e5-4bdb-845e-c4188e213a41/kube-rbac-proxy-rules/0.log" Jul 14 11:34:05.950201 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:05.950169 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f745c758c-xtfkr_40c059fb-01e5-4bdb-845e-c4188e213a41/kube-rbac-proxy-metrics/0.log" Jul 14 11:34:06.458728 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:06.458689 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-82fbt/perf-node-gather-daemonset-jwnfd"] Jul 14 11:34:06.466610 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:06.466578 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-jwnfd" Jul 14 11:34:06.470970 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:06.470939 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-82fbt/perf-node-gather-daemonset-jwnfd"] Jul 14 11:34:06.532214 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:06.532163 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/37dbb478-b71b-4ea0-9636-074057ac0bc5-podres\") pod \"perf-node-gather-daemonset-jwnfd\" (UID: \"37dbb478-b71b-4ea0-9636-074057ac0bc5\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-jwnfd" Jul 14 11:34:06.532492 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:06.532227 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/37dbb478-b71b-4ea0-9636-074057ac0bc5-proc\") pod \"perf-node-gather-daemonset-jwnfd\" (UID: \"37dbb478-b71b-4ea0-9636-074057ac0bc5\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-jwnfd" Jul 14 11:34:06.532492 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:06.532320 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t472v\" (UniqueName: \"kubernetes.io/projected/37dbb478-b71b-4ea0-9636-074057ac0bc5-kube-api-access-t472v\") pod \"perf-node-gather-daemonset-jwnfd\" (UID: \"37dbb478-b71b-4ea0-9636-074057ac0bc5\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-jwnfd" Jul 14 11:34:06.532695 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:06.532527 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37dbb478-b71b-4ea0-9636-074057ac0bc5-sys\") pod \"perf-node-gather-daemonset-jwnfd\" (UID: \"37dbb478-b71b-4ea0-9636-074057ac0bc5\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-jwnfd" Jul 14 11:34:06.532695 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:06.532610 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/37dbb478-b71b-4ea0-9636-074057ac0bc5-lib-modules\") pod \"perf-node-gather-daemonset-jwnfd\" (UID: \"37dbb478-b71b-4ea0-9636-074057ac0bc5\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-jwnfd" Jul 14 11:34:06.634159 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:06.634113 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/37dbb478-b71b-4ea0-9636-074057ac0bc5-proc\") pod \"perf-node-gather-daemonset-jwnfd\" (UID: \"37dbb478-b71b-4ea0-9636-074057ac0bc5\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-jwnfd" Jul 14 11:34:06.634385 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:06.634174 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t472v\" (UniqueName: \"kubernetes.io/projected/37dbb478-b71b-4ea0-9636-074057ac0bc5-kube-api-access-t472v\") pod \"perf-node-gather-daemonset-jwnfd\" (UID: \"37dbb478-b71b-4ea0-9636-074057ac0bc5\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-jwnfd" Jul 14 11:34:06.634385 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:06.634244 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37dbb478-b71b-4ea0-9636-074057ac0bc5-sys\") pod \"perf-node-gather-daemonset-jwnfd\" (UID: \"37dbb478-b71b-4ea0-9636-074057ac0bc5\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-jwnfd" Jul 14 11:34:06.634385 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:06.634284 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/37dbb478-b71b-4ea0-9636-074057ac0bc5-proc\") pod \"perf-node-gather-daemonset-jwnfd\" (UID: \"37dbb478-b71b-4ea0-9636-074057ac0bc5\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-jwnfd" Jul 14 11:34:06.634385 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:06.634328 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37dbb478-b71b-4ea0-9636-074057ac0bc5-sys\") pod \"perf-node-gather-daemonset-jwnfd\" (UID: \"37dbb478-b71b-4ea0-9636-074057ac0bc5\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-jwnfd" Jul 14 11:34:06.634638 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:06.634414 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/37dbb478-b71b-4ea0-9636-074057ac0bc5-lib-modules\") pod \"perf-node-gather-daemonset-jwnfd\" (UID: \"37dbb478-b71b-4ea0-9636-074057ac0bc5\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-jwnfd" Jul 14 11:34:06.634638 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:06.634501 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/37dbb478-b71b-4ea0-9636-074057ac0bc5-podres\") pod \"perf-node-gather-daemonset-jwnfd\" (UID: \"37dbb478-b71b-4ea0-9636-074057ac0bc5\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-jwnfd" Jul 14 11:34:06.634753 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:06.634701 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/37dbb478-b71b-4ea0-9636-074057ac0bc5-podres\") pod \"perf-node-gather-daemonset-jwnfd\" (UID: \"37dbb478-b71b-4ea0-9636-074057ac0bc5\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-jwnfd" Jul 14 11:34:06.634807 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:06.634752 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/37dbb478-b71b-4ea0-9636-074057ac0bc5-lib-modules\") pod \"perf-node-gather-daemonset-jwnfd\" (UID: \"37dbb478-b71b-4ea0-9636-074057ac0bc5\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-jwnfd" Jul 14 11:34:06.643665 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:06.643635 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t472v\" (UniqueName: \"kubernetes.io/projected/37dbb478-b71b-4ea0-9636-074057ac0bc5-kube-api-access-t472v\") pod \"perf-node-gather-daemonset-jwnfd\" (UID: \"37dbb478-b71b-4ea0-9636-074057ac0bc5\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-jwnfd" Jul 14 11:34:06.781212 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:06.781178 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-jwnfd" Jul 14 11:34:06.974253 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:06.974156 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-82fbt/perf-node-gather-daemonset-jwnfd"] Jul 14 11:34:07.361037 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:07.360935 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-jwnfd" event={"ID":"37dbb478-b71b-4ea0-9636-074057ac0bc5","Type":"ContainerStarted","Data":"88ae1644c5570c069b3e8a218d2a80250dac77b76cb1d9353f1f4be4118a7e99"} Jul 14 11:34:07.361037 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:07.360992 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-jwnfd" event={"ID":"37dbb478-b71b-4ea0-9636-074057ac0bc5","Type":"ContainerStarted","Data":"1fc2bc458c7a580628b97529d12cfd195aee0095fee1cdbbf1220eb677f349b8"} Jul 14 11:34:07.361274 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:07.361087 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-jwnfd" Jul 14 11:34:07.380570 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:07.380487 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-jwnfd" podStartSLOduration=1.380467929 podStartE2EDuration="1.380467929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:34:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:34:07.378016365 +0000 UTC m=+1351.951396754" watchObservedRunningTime="2026-07-14 11:34:07.380467929 +0000 UTC m=+1351.953848302" Jul 14 11:34:08.390043 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:08.389992 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5b46b475c5-rwfgn_215074c7-0bab-4185-943c-48a7f7377a44/console/0.log" Jul 14 11:34:09.059251 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:09.059216 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-s5kt6_308849f7-66e5-4f4a-99c2-480719fa57f6/volume-data-source-validator/0.log" Jul 14 11:34:10.387981 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:10.387954 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tgz82_3c2af027-67fa-46e8-8502-7b584d80674e/dns/0.log" Jul 14 11:34:10.433855 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:10.433825 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tgz82_3c2af027-67fa-46e8-8502-7b584d80674e/kube-rbac-proxy/0.log" Jul 14 11:34:10.521151 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:10.521117 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rf5p6_8cb4cc75-45c5-4e00-8434-71d348adcb4d/dns-node-resolver/0.log" Jul 14 11:34:11.441141 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:11.441081 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qmwvf_c428ac6b-bf9d-4d77-8554-c2c09614b02c/node-ca/0.log" Jul 14 11:34:12.531481 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:12.531452 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4jsvwf_976ae51f-69b8-432d-b4ff-551403684b5b/istio-proxy/0.log" Jul 14 11:34:12.631949 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:12.631918 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b948bb5ff-l5kvc_f77b4fd2-69eb-44c7-9dea-3dee79258cec/kube-auth-proxy/0.log" Jul 14 11:34:12.669214 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:12.669176 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-k7rdh_82a68712-df38-4a90-bcce-669392d7d017/istio-proxy/0.log" Jul 14 11:34:12.687696 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:12.687657 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-k7rdh_82a68712-df38-4a90-bcce-669392d7d017/istio-proxy/1.log" Jul 14 11:34:12.769604 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:12.769571 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f9bb8c67d-6vnpr_ca5d6937-4feb-431e-b78b-fe1f595d8b36/router/0.log" Jul 14 11:34:13.384390 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:13.384357 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-jwnfd" Jul 14 11:34:13.452505 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:13.452474 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cf5nb_0f8a832e-cf67-47c0-817f-caf7db077628/serve-healthcheck-canary/0.log" Jul 14 11:34:14.006961 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:14.006930 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-xdbds_3128342d-d07b-428a-9e8c-9fd701bf417d/insights-operator/1.log" Jul 14 11:34:14.007598 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:14.007193 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-xdbds_3128342d-d07b-428a-9e8c-9fd701bf417d/insights-operator/0.log" Jul 14 11:34:14.177943 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:14.177905 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m7vpc_bcbcb21e-9bb2-474f-b0f3-b8bad02f3084/kube-rbac-proxy/0.log" Jul 14 11:34:14.200796 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:14.200750 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m7vpc_bcbcb21e-9bb2-474f-b0f3-b8bad02f3084/exporter/0.log" Jul 14 11:34:14.225141 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:14.225113 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m7vpc_bcbcb21e-9bb2-474f-b0f3-b8bad02f3084/extractor/0.log" Jul 14 11:34:17.190996 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:17.190968 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-gzdvw_7b96a3bb-4f4a-450e-a15c-7840fc08eeaf/manager/0.log" Jul 14 11:34:17.287445 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:17.287407 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-7cpcf_adf43478-0d24-48d3-9487-ac3765a18975/manager/0.log" Jul 14 11:34:17.377441 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:17.377406 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-whlln_196ab9de-acb8-4bb7-858a-47ea9bd46804/server/0.log" Jul 14 11:34:17.463284 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:17.463190 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-jpkt7_de199871-dbb3-4814-bf72-dacd4247230b/manager/0.log" Jul 14 11:34:17.525179 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:17.525140 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bf58df976-brhns_e15a2d7c-1f99-4d13-bf06-d95892717484/manager/0.log" Jul 14 11:34:17.571252 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:17.571217 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bf58df976-brhns_e15a2d7c-1f99-4d13-bf06-d95892717484/copy-manifests/0.log" Jul 14 11:34:17.750862 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:17.750834 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4jsvwf_976ae51f-69b8-432d-b4ff-551403684b5b/istio-proxy/0.log" Jul 14 11:34:17.828206 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:17.828170 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b948bb5ff-l5kvc_f77b4fd2-69eb-44c7-9dea-3dee79258cec/kube-auth-proxy/0.log" Jul 14 11:34:17.859652 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:17.859611 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-k7rdh_82a68712-df38-4a90-bcce-669392d7d017/istio-proxy/0.log" Jul 14 11:34:17.865088 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:17.865034 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-k7rdh_82a68712-df38-4a90-bcce-669392d7d017/istio-proxy/1.log" Jul 14 11:34:17.928054 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:17.928021 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f9bb8c67d-6vnpr_ca5d6937-4feb-431e-b78b-fe1f595d8b36/router/0.log" Jul 14 11:34:19.065184 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:19.065090 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4jsvwf_976ae51f-69b8-432d-b4ff-551403684b5b/istio-proxy/0.log" Jul 14 11:34:19.136472 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:19.136429 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b948bb5ff-l5kvc_f77b4fd2-69eb-44c7-9dea-3dee79258cec/kube-auth-proxy/0.log" Jul 14 11:34:19.161272 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:19.161229 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-k7rdh_82a68712-df38-4a90-bcce-669392d7d017/istio-proxy/0.log" Jul 14 11:34:19.178649 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:19.178619 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-k7rdh_82a68712-df38-4a90-bcce-669392d7d017/istio-proxy/1.log" Jul 14 11:34:19.235737 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:19.235704 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f9bb8c67d-6vnpr_ca5d6937-4feb-431e-b78b-fe1f595d8b36/router/0.log" Jul 14 11:34:24.502078 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:24.502041 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-zvcpj_3ce79a00-8cf5-4047-b927-cbdea4048663/kube-storage-version-migrator-operator/1.log" Jul 14 11:34:24.504119 ip-10-0-139-35 kubenswrapper[2576]: I0714 11:34:24.504093 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-zvcpj_3ce79a00-8cf5-4047-b927-cbdea4048663/kube-storage-version-migrator-operator/0.log"