Jun 11 19:55:51.254497 ip-10-0-137-142 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 11 19:55:51.254511 ip-10-0-137-142 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 11 19:55:51.254521 ip-10-0-137-142 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 11 19:55:51.254831 ip-10-0-137-142 systemd[1]: Failed to start Kubernetes Kubelet. Jun 11 19:56:02.415016 ip-10-0-137-142 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 11 19:56:02.415032 ip-10-0-137-142 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 9a4978f492044c89b91982ce1b4de098 -- Jun 11 19:58:28.147723 ip-10-0-137-142 systemd[1]: Starting Kubernetes Kubelet... Jun 11 19:58:28.577236 ip-10-0-137-142 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 19:58:28.577236 ip-10-0-137-142 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 19:58:28.577236 ip-10-0-137-142 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 19:58:28.577236 ip-10-0-137-142 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 19:58:28.577236 ip-10-0-137-142 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 19:58:28.578034 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.577943 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 19:58:28.581588 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581571 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:58:28.581588 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581587 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:58:28.581657 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581591 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:58:28.581657 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581596 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:58:28.581657 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581599 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:58:28.581657 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581602 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:58:28.581657 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581605 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:58:28.581657 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581608 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:58:28.581657 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581610 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:58:28.581657 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581613 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:58:28.581657 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581616 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:58:28.581657 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581618 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:58:28.581657 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581621 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:58:28.581657 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581633 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:58:28.581657 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581635 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:58:28.581657 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581638 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:58:28.581657 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581640 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:58:28.581657 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581643 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:58:28.581657 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581645 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:58:28.581657 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581648 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:58:28.581657 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581651 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:58:28.582113 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581653 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:58:28.582113 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581658 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:58:28.582113 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581662 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:58:28.582113 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581665 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:58:28.582113 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581668 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:58:28.582113 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581672 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:58:28.582113 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581674 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:58:28.582113 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581677 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:58:28.582113 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581680 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:58:28.582113 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581683 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:58:28.582113 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581685 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:58:28.582113 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581687 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:58:28.582113 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581690 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:58:28.582113 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581692 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:58:28.582113 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581695 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:58:28.582113 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581698 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:58:28.582113 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581700 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:58:28.582113 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581709 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:58:28.582113 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581711 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:58:28.582634 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581714 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:58:28.582634 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581716 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:58:28.582634 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581719 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:58:28.582634 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581721 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:58:28.582634 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581724 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:58:28.582634 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581726 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:58:28.582634 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581728 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:58:28.582634 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581731 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:58:28.582634 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581733 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:58:28.582634 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581735 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:58:28.582634 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581738 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:58:28.582634 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581740 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:58:28.582634 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581742 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:58:28.582634 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581745 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:58:28.582634 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581748 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:58:28.582634 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581751 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:58:28.582634 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581753 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:58:28.582634 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581756 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:58:28.582634 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581758 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:58:28.582634 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581761 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:58:28.583112 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581763 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:58:28.583112 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581766 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:58:28.583112 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581770 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:58:28.583112 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581773 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:58:28.583112 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581776 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:58:28.583112 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581779 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:58:28.583112 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581781 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:58:28.583112 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581784 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:58:28.583112 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581787 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:58:28.583112 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581789 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:58:28.583112 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581792 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:58:28.583112 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581795 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:58:28.583112 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581799 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:58:28.583112 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581802 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:58:28.583112 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581804 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:58:28.583112 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581806 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:58:28.583112 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581809 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:58:28.583112 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581812 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:58:28.583112 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581815 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:58:28.583112 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581819 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:58:28.583618 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581821 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:58:28.583618 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581824 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:58:28.583618 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581826 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:58:28.583618 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581828 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:58:28.583618 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581831 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:58:28.583618 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581833 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:58:28.583618 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581837 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:58:28.583618 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581839 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:58:28.583618 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581842 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:58:28.583618 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581845 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:58:28.583618 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581847 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:58:28.583618 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581850 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:58:28.583618 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581852 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:58:28.583618 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581854 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:58:28.583618 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581857 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:58:28.583618 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581860 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:58:28.583618 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581862 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:58:28.583618 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581865 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:58:28.583618 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.581867 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:58:28.583618 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582644 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:58:28.584103 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582653 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:58:28.584103 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582658 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:58:28.584103 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582661 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:58:28.584103 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582663 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:58:28.584103 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582667 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:58:28.584103 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582670 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:58:28.584103 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582672 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:58:28.584103 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582677 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:58:28.584103 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582680 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:58:28.584103 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582683 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:58:28.584103 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582686 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:58:28.584103 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582689 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:58:28.584103 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582692 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:58:28.584103 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582695 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:58:28.584103 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582697 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:58:28.584103 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582700 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:58:28.584103 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582702 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:58:28.584103 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582705 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:58:28.584103 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582708 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:58:28.584577 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582711 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:58:28.584577 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582714 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:58:28.584577 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582717 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:58:28.584577 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582719 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:58:28.584577 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582722 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:58:28.584577 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582724 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:58:28.584577 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582727 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:58:28.584577 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582730 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:58:28.584577 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582732 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:58:28.584577 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582734 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:58:28.584577 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582737 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:58:28.584577 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582739 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:58:28.584577 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582742 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:58:28.584577 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582744 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:58:28.584577 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582747 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:58:28.584577 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582749 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:58:28.584577 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582752 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:58:28.584577 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582754 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:58:28.584577 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582758 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:58:28.584577 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582760 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:58:28.585065 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582763 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:58:28.585065 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582765 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:58:28.585065 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582768 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:58:28.585065 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582770 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:58:28.585065 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582773 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:58:28.585065 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582776 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:58:28.585065 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582778 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:58:28.585065 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582781 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:58:28.585065 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582783 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:58:28.585065 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582786 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:58:28.585065 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582789 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:58:28.585065 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582791 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:58:28.585065 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582796 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:58:28.585065 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582800 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:58:28.585065 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582803 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:58:28.585065 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582805 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:58:28.585065 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582808 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:58:28.585065 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582810 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:58:28.585065 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582813 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:58:28.585545 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582816 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:58:28.585545 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582818 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:58:28.585545 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582821 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:58:28.585545 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582823 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:58:28.585545 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582825 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:58:28.585545 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582828 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:58:28.585545 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582831 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:58:28.585545 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582833 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:58:28.585545 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582836 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:58:28.585545 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582838 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:58:28.585545 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582842 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:58:28.585545 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582845 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:58:28.585545 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582848 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:58:28.585545 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582851 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:58:28.585545 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582853 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:58:28.585545 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582856 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:58:28.585545 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582858 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:58:28.585545 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582861 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:58:28.585545 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582864 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:58:28.585545 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582866 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:58:28.586126 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582869 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:58:28.586126 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582871 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:58:28.586126 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582874 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:58:28.586126 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582876 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:58:28.586126 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582879 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:58:28.586126 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582881 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:58:28.586126 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582884 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:58:28.586126 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582886 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:58:28.586126 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582889 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:58:28.586126 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582891 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:58:28.586126 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582894 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:58:28.586126 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582897 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:58:28.586126 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582900 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:58:28.586126 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582903 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:58:28.586126 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582905 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:58:28.586126 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582908 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:58:28.586126 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582910 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:58:28.586126 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582913 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:58:28.586126 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582915 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:58:28.586126 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.582917 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:58:28.586644 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583289 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:58:28.586644 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583294 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:58:28.586644 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583297 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:58:28.586644 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583299 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:58:28.586644 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583303 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:58:28.586644 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583306 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:58:28.586644 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583308 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:58:28.586644 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583311 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:58:28.586644 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583314 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:58:28.586644 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583316 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:58:28.586644 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583319 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:58:28.586644 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583322 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:58:28.586644 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583324 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:58:28.586644 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583327 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:58:28.586644 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583329 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:58:28.586644 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583332 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:58:28.586644 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583334 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:58:28.586644 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583337 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:58:28.586644 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583339 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:58:28.586644 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583342 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:58:28.587123 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583344 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:58:28.587123 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583346 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:58:28.587123 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583349 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:58:28.587123 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583352 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:58:28.587123 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583354 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:58:28.587123 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583357 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:58:28.587123 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583362 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:58:28.587123 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583366 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:58:28.587123 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583368 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:58:28.587123 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583388 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:58:28.587123 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583391 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:58:28.587123 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583394 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:58:28.587123 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583399 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:58:28.587123 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583401 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:58:28.587123 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583404 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:58:28.587123 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583407 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:58:28.587123 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583410 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:58:28.587123 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583413 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:58:28.587123 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583415 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:58:28.587637 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583418 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:58:28.587637 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583421 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:58:28.587637 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583423 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:58:28.587637 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583426 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:58:28.587637 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583428 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:58:28.587637 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583431 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:58:28.587637 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583433 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:58:28.587637 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583435 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:58:28.587637 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583438 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:58:28.587637 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583440 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:58:28.587637 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583444 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:58:28.587637 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583447 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:58:28.587637 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583449 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:58:28.587637 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583451 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:58:28.587637 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583454 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:58:28.587637 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583456 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:58:28.587637 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583459 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:58:28.587637 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583461 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:58:28.587637 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583464 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:58:28.588092 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583466 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:58:28.588092 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583468 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:58:28.588092 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583471 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:58:28.588092 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583473 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:58:28.588092 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583476 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:58:28.588092 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583478 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:58:28.588092 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583482 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:58:28.588092 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583485 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:58:28.588092 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583489 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:58:28.588092 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583491 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:58:28.588092 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583494 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:58:28.588092 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583496 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:58:28.588092 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583499 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:58:28.588092 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583502 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:58:28.588092 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583504 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:58:28.588092 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583507 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:58:28.588092 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583509 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:58:28.588092 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583512 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:58:28.588092 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583514 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:58:28.588092 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583516 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:58:28.588592 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583520 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:58:28.588592 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583524 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:58:28.588592 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583527 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:58:28.588592 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583529 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:58:28.588592 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583532 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:58:28.588592 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583535 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:58:28.588592 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583537 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:58:28.588592 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583540 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:58:28.588592 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583543 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:58:28.588592 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583545 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:58:28.588592 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583548 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:58:28.588592 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583550 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:58:28.588592 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583553 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:58:28.588592 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583556 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:58:28.588592 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583558 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:58:28.588592 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583561 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:58:28.588592 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583563 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:58:28.588592 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583566 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:58:28.588592 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583569 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:58:28.588592 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583572 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:58:28.589072 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.583577 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:58:28.589072 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583645 2562 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 19:58:28.589072 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583652 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 19:58:28.589072 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583658 2562 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 19:58:28.589072 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583662 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 19:58:28.589072 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583667 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 19:58:28.589072 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583671 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 19:58:28.589072 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583675 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 19:58:28.589072 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583679 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 19:58:28.589072 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583682 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 19:58:28.589072 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583685 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 19:58:28.589072 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583688 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 19:58:28.589072 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583692 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 19:58:28.589072 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583695 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 19:58:28.589072 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583698 2562 flags.go:64] FLAG: --cgroup-root="" Jun 11 19:58:28.589072 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583700 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 19:58:28.589072 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583703 2562 flags.go:64] FLAG: --client-ca-file="" Jun 11 19:58:28.589072 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583706 2562 flags.go:64] FLAG: --cloud-provider="external" Jun 11 19:58:28.589072 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583709 2562 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 19:58:28.589072 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583713 2562 flags.go:64] FLAG: --cluster-domain="" Jun 11 19:58:28.589072 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583716 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 19:58:28.589072 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583719 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 19:58:28.589072 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583721 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 19:58:28.589072 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583725 2562 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 19:58:28.589674 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583728 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 19:58:28.589674 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583731 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 19:58:28.589674 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583734 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 19:58:28.589674 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583737 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 19:58:28.589674 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583740 2562 flags.go:64] FLAG: --contention-profiling="false" Jun 11 19:58:28.589674 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583743 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 19:58:28.589674 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583747 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 19:58:28.589674 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583750 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 19:58:28.589674 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583754 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 19:58:28.589674 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583758 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 19:58:28.589674 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583761 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 19:58:28.589674 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583764 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 19:58:28.589674 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583767 2562 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 19:58:28.589674 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583770 2562 flags.go:64] FLAG: --enable-server="true" Jun 11 19:58:28.589674 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583774 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 19:58:28.589674 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583778 2562 flags.go:64] FLAG: --event-burst="100" Jun 11 19:58:28.589674 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583781 2562 flags.go:64] FLAG: --event-qps="50" Jun 11 19:58:28.589674 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583784 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 19:58:28.589674 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583787 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 19:58:28.589674 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583790 2562 flags.go:64] FLAG: --eviction-hard="" Jun 11 19:58:28.589674 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583793 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 19:58:28.589674 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583796 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 19:58:28.589674 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583799 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 19:58:28.589674 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583802 2562 flags.go:64] FLAG: --eviction-soft="" Jun 11 19:58:28.589674 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583804 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 19:58:28.590279 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583807 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 19:58:28.590279 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583810 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 19:58:28.590279 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583813 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 19:58:28.590279 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583816 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 19:58:28.590279 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583819 2562 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 19:58:28.590279 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583822 2562 flags.go:64] FLAG: --feature-gates="" Jun 11 19:58:28.590279 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583825 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 19:58:28.590279 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583829 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 19:58:28.590279 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583832 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 19:58:28.590279 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583835 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 19:58:28.590279 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583838 2562 flags.go:64] FLAG: --healthz-port="10248" Jun 11 19:58:28.590279 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583841 2562 flags.go:64] FLAG: --help="false" Jun 11 19:58:28.590279 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583844 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-137-142.ec2.internal" Jun 11 19:58:28.590279 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583848 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 19:58:28.590279 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583851 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 19:58:28.590279 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583855 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 19:58:28.590279 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583859 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 19:58:28.590279 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583862 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 19:58:28.590279 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583865 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 19:58:28.590279 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583868 2562 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 19:58:28.590279 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583870 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 19:58:28.590279 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583874 2562 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 19:58:28.590279 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583877 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 19:58:28.590955 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583880 2562 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 19:58:28.590955 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583883 2562 flags.go:64] FLAG: --kube-reserved="" Jun 11 19:58:28.590955 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583885 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 19:58:28.590955 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583888 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 19:58:28.590955 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583891 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 19:58:28.590955 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583894 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 19:58:28.590955 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583897 2562 flags.go:64] FLAG: --lock-file="" Jun 11 19:58:28.590955 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583900 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 19:58:28.590955 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583903 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 19:58:28.590955 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583905 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 19:58:28.590955 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583910 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 19:58:28.590955 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583913 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 19:58:28.590955 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583916 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 19:58:28.590955 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583918 2562 flags.go:64] FLAG: --logging-format="text" Jun 11 19:58:28.590955 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583921 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 19:58:28.590955 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583925 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 19:58:28.590955 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583928 2562 flags.go:64] FLAG: --manifest-url="" Jun 11 19:58:28.590955 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583930 2562 flags.go:64] FLAG: --manifest-url-header="" Jun 11 19:58:28.590955 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583934 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 19:58:28.590955 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583937 2562 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 19:58:28.590955 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583941 2562 flags.go:64] FLAG: --max-pods="110" Jun 11 19:58:28.590955 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583944 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 19:58:28.590955 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583948 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 19:58:28.590955 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583951 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 19:58:28.590955 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583955 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 19:58:28.591588 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583958 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 19:58:28.591588 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583961 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 19:58:28.591588 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583964 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 19:58:28.591588 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583971 2562 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 19:58:28.591588 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583974 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 19:58:28.591588 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583977 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 19:58:28.591588 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583980 2562 flags.go:64] FLAG: --pod-cidr="" Jun 11 19:58:28.591588 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583983 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 11 19:58:28.591588 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583988 2562 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 19:58:28.591588 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583991 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 19:58:28.591588 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583994 2562 flags.go:64] FLAG: --pods-per-core="0" Jun 11 19:58:28.591588 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.583997 2562 flags.go:64] FLAG: --port="10250" Jun 11 19:58:28.591588 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584000 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 19:58:28.591588 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584003 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0145940844093cee0" Jun 11 19:58:28.591588 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584006 2562 flags.go:64] FLAG: --qos-reserved="" Jun 11 19:58:28.591588 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584009 2562 flags.go:64] FLAG: --read-only-port="10255" Jun 11 19:58:28.591588 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584011 2562 flags.go:64] FLAG: --register-node="true" Jun 11 19:58:28.591588 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584014 2562 flags.go:64] FLAG: --register-with-taints="" Jun 11 19:58:28.591588 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584018 2562 flags.go:64] FLAG: --registry-burst="10" Jun 11 19:58:28.591588 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584021 2562 flags.go:64] FLAG: --registry-qps="5" Jun 11 19:58:28.591588 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584023 2562 flags.go:64] FLAG: --reserved-cpus="" Jun 11 19:58:28.591588 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584026 2562 flags.go:64] FLAG: --reserved-memory="" Jun 11 19:58:28.591588 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584034 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 19:58:28.591588 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584037 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 19:58:28.591588 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584040 2562 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 19:58:28.592186 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584043 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 19:58:28.592186 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584045 2562 flags.go:64] FLAG: --runonce="false" Jun 11 19:58:28.592186 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584048 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 19:58:28.592186 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584051 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 19:58:28.592186 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584055 2562 flags.go:64] FLAG: --seccomp-default="false" Jun 11 19:58:28.592186 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584058 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 19:58:28.592186 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584061 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 19:58:28.592186 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584065 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 19:58:28.592186 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584068 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 19:58:28.592186 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584071 2562 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 19:58:28.592186 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584074 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 19:58:28.592186 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584076 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 19:58:28.592186 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584079 2562 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 19:58:28.592186 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584082 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 19:58:28.592186 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584085 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 19:58:28.592186 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584088 2562 flags.go:64] FLAG: --system-cgroups="" Jun 11 19:58:28.592186 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584091 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 19:58:28.592186 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584096 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 19:58:28.592186 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584099 2562 flags.go:64] FLAG: --tls-cert-file="" Jun 11 19:58:28.592186 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584102 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 19:58:28.592186 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584105 2562 flags.go:64] FLAG: --tls-min-version="" Jun 11 19:58:28.592186 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584108 2562 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 19:58:28.592186 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584111 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 19:58:28.592186 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584114 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 19:58:28.592186 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584117 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 19:58:28.593034 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584120 2562 flags.go:64] FLAG: --v="2" Jun 11 19:58:28.593034 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584124 2562 flags.go:64] FLAG: --version="false" Jun 11 19:58:28.593034 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584127 2562 flags.go:64] FLAG: --vmodule="" Jun 11 19:58:28.593034 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584131 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 19:58:28.593034 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.584134 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 19:58:28.593034 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584269 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:58:28.593034 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584273 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:58:28.593034 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584276 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:58:28.593034 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584279 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:58:28.593034 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584282 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:58:28.593034 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584284 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:58:28.593034 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584287 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:58:28.593034 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584289 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:58:28.593034 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584292 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:58:28.593034 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584295 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:58:28.593034 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584297 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:58:28.593034 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584299 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:58:28.593034 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584302 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:58:28.593034 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584304 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:58:28.593034 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584307 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:58:28.593851 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584309 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:58:28.593851 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584311 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:58:28.593851 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584314 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:58:28.593851 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584317 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:58:28.593851 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584319 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:58:28.593851 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584321 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:58:28.593851 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584324 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:58:28.593851 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584326 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:58:28.593851 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584329 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:58:28.593851 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584331 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:58:28.593851 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584334 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:58:28.593851 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584336 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:58:28.593851 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584339 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:58:28.593851 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584341 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:58:28.593851 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584343 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:58:28.593851 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584346 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:58:28.593851 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584348 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:58:28.593851 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584350 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:58:28.593851 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584352 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:58:28.593851 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584355 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:58:28.594351 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584357 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:58:28.594351 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584360 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:58:28.594351 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584362 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:58:28.594351 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584365 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:58:28.594351 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584368 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:58:28.594351 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584386 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:58:28.594351 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584389 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:58:28.594351 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584392 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:58:28.594351 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584395 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:58:28.594351 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584398 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:58:28.594351 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584400 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:58:28.594351 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584403 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:58:28.594351 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584405 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:58:28.594351 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584408 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:58:28.594351 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584410 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:58:28.594351 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584414 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:58:28.594351 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584418 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:58:28.594351 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584421 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:58:28.594351 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584424 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:58:28.594846 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584427 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:58:28.594846 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584430 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:58:28.594846 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584433 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:58:28.594846 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584436 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:58:28.594846 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584438 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:58:28.594846 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584441 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:58:28.594846 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584445 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:58:28.594846 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584448 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:58:28.594846 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584452 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:58:28.594846 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584454 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:58:28.594846 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584457 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:58:28.594846 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584460 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:58:28.594846 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584463 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:58:28.594846 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584465 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:58:28.594846 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584468 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:58:28.594846 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584470 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:58:28.594846 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584473 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:58:28.594846 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584475 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:58:28.594846 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584478 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:58:28.594846 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584480 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:58:28.595338 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584483 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:58:28.595338 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584485 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:58:28.595338 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584488 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:58:28.595338 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584490 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:58:28.595338 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584493 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:58:28.595338 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584495 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:58:28.595338 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584498 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:58:28.595338 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584500 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:58:28.595338 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584503 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:58:28.595338 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584505 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:58:28.595338 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584508 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:58:28.595338 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584510 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:58:28.595338 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584513 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:58:28.595338 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584515 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:58:28.595338 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584518 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:58:28.595338 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584520 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:58:28.595338 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584522 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:58:28.595338 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584525 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:58:28.595338 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584527 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:58:28.595338 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584530 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:58:28.595847 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584532 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:58:28.595847 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584534 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:58:28.595847 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584537 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:58:28.595847 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584540 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:58:28.595847 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.584543 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:58:28.595847 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.585101 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 19:58:28.595847 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.591982 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 19:58:28.595847 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.591997 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 19:58:28.595847 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.592013 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 19:58:28.595847 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.592018 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 19:58:28.595847 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592068 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:58:28.595847 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592073 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:58:28.595847 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592077 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:58:28.595847 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592081 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:58:28.596191 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592085 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:58:28.596191 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592087 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:58:28.596191 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592090 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:58:28.596191 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592093 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:58:28.596191 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592096 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:58:28.596191 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592099 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:58:28.596191 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592102 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:58:28.596191 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592105 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:58:28.596191 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592107 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:58:28.596191 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592110 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:58:28.596191 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592112 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:58:28.596191 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592115 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:58:28.596191 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592117 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:58:28.596191 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592119 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:58:28.596191 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592122 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:58:28.596191 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592124 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:58:28.596191 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592127 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:58:28.596191 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592129 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:58:28.596191 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592132 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:58:28.596191 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592134 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:58:28.596191 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592137 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:58:28.596708 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592139 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:58:28.596708 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592142 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:58:28.596708 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592146 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:58:28.596708 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592149 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:58:28.596708 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592153 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:58:28.596708 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592156 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:58:28.596708 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592159 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:58:28.596708 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592162 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:58:28.596708 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592164 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:58:28.596708 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592167 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:58:28.596708 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592171 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:58:28.596708 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592174 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:58:28.596708 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592177 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:58:28.596708 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592179 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:58:28.596708 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592182 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:58:28.596708 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592184 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:58:28.596708 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592187 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:58:28.596708 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592189 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:58:28.596708 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592192 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:58:28.597198 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592195 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:58:28.597198 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592198 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:58:28.597198 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592200 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:58:28.597198 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592203 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:58:28.597198 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592205 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:58:28.597198 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592208 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:58:28.597198 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592210 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:58:28.597198 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592213 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:58:28.597198 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592215 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:58:28.597198 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592218 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:58:28.597198 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592220 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:58:28.597198 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592223 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:58:28.597198 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592225 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:58:28.597198 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592228 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:58:28.597198 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592230 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:58:28.597198 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592233 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:58:28.597198 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592235 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:58:28.597198 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592238 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:58:28.597198 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592241 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:58:28.597198 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592244 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:58:28.597805 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592246 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:58:28.597805 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592249 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:58:28.597805 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592251 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:58:28.597805 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592254 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:58:28.597805 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592256 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:58:28.597805 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592259 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:58:28.597805 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592261 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:58:28.597805 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592264 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:58:28.597805 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592266 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:58:28.597805 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592268 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:58:28.597805 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592271 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:58:28.597805 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592273 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:58:28.597805 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592275 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:58:28.597805 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592278 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:58:28.597805 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592280 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:58:28.597805 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592282 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:58:28.597805 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592285 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:58:28.597805 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592287 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:58:28.597805 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592290 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:58:28.598261 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592292 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:58:28.598261 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592295 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:58:28.598261 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592297 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:58:28.598261 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592300 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:58:28.598261 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592302 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:58:28.598261 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592304 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:58:28.598261 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592307 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:58:28.598261 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592309 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:58:28.598261 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592312 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:58:28.598261 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592314 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:58:28.598261 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592317 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:58:28.598261 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592329 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:58:28.598261 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592333 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:58:28.598261 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592336 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:58:28.598261 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592339 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:58:28.598261 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592342 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:58:28.598672 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.592347 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 19:58:28.598672 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592576 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:58:28.598672 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592585 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:58:28.598672 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592588 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:58:28.598672 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592591 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:58:28.598672 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592596 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:58:28.598672 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592611 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:58:28.598672 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592616 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:58:28.598672 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592621 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:58:28.598672 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592626 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:58:28.598672 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.592739 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:58:28.598672 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593174 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:58:28.598672 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593181 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:58:28.598672 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593186 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:58:28.599016 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593192 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:58:28.599016 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593200 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:58:28.599016 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593208 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:58:28.599016 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593213 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:58:28.599016 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593218 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:58:28.599016 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593223 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:58:28.599016 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593227 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:58:28.599016 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593232 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:58:28.599016 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593243 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:58:28.599016 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593248 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:58:28.599016 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593252 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:58:28.599016 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593257 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:58:28.599016 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593261 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:58:28.599016 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593265 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:58:28.599016 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593270 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:58:28.599016 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593274 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:58:28.599016 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593278 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:58:28.599016 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593282 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:58:28.599016 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593286 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:58:28.599479 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593291 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:58:28.599479 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593300 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:58:28.599479 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593304 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:58:28.599479 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593308 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:58:28.599479 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593313 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:58:28.599479 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593319 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:58:28.599479 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593324 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:58:28.599479 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593330 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:58:28.599479 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593335 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:58:28.599479 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593339 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:58:28.599479 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593344 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:58:28.599479 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593350 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:58:28.599479 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593354 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:58:28.599479 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593358 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:58:28.599479 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593367 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:58:28.599479 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593371 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:58:28.599479 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593394 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:58:28.599479 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593398 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:58:28.599479 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593402 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:58:28.599479 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593407 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:58:28.599965 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593411 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:58:28.599965 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593415 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:58:28.599965 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593419 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:58:28.599965 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593423 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:58:28.599965 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593428 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:58:28.599965 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593433 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:58:28.599965 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593442 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:58:28.599965 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593446 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:58:28.599965 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593450 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:58:28.599965 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593454 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:58:28.599965 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593458 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:58:28.599965 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593462 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:58:28.599965 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593466 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:58:28.599965 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593470 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:58:28.599965 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593474 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:58:28.599965 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593478 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:58:28.599965 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593482 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:58:28.599965 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593486 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:58:28.599965 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593494 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:58:28.599965 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593498 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:58:28.600489 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593503 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:58:28.600489 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593506 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:58:28.600489 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593511 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:58:28.600489 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593515 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:58:28.600489 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593520 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:58:28.600489 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593524 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:58:28.600489 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593528 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:58:28.600489 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593532 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:58:28.600489 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593536 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:58:28.600489 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593541 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:58:28.600489 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593545 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:58:28.600489 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593554 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:58:28.600489 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593558 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:58:28.600489 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593562 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:58:28.600489 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593566 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:58:28.600489 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593570 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:58:28.600489 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593574 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:58:28.600489 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593578 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:58:28.600489 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593582 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:58:28.600489 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593586 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:58:28.600968 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593591 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:58:28.600968 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593595 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:58:28.600968 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593599 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:58:28.600968 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593603 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:58:28.600968 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593612 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:58:28.600968 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593617 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:58:28.600968 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:28.593621 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:58:28.600968 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.593629 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 19:58:28.600968 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.594007 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 19:58:28.600968 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.596769 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 19:58:28.600968 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.598278 2562 server.go:1019] "Starting client certificate rotation" Jun 11 19:58:28.600968 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.598404 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 19:58:28.600968 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.598434 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 19:58:28.601298 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.600916 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 19:58:28.602090 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.602070 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 19:58:28.615167 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.615150 2562 log.go:25] "Validated CRI v1 runtime API" Jun 11 19:58:28.618619 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.618594 2562 log.go:25] "Validated CRI v1 image API" Jun 11 19:58:28.620017 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.620001 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 19:58:28.622625 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.622598 2562 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a1159270-38b5-437c-a462-acc56b895a21:/dev/nvme0n1p4 aa313c8b-acab-4469-852c-718e442d4d12:/dev/nvme0n1p3] Jun 11 19:58:28.622625 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.622620 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 19:58:28.629271 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.629144 2562 manager.go:216] Machine: {Timestamp:2026-06-11 19:58:28.627438839 +0000 UTC m=+0.358600809 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100111 MemoryCapacity:32812183552 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a6a26468de9f37ee76637fc4a5751 SystemUUID:ec2a6a26-468d-e9f3-7ee7-6637fc4a5751 BootID:9a4978f4-9204-4c89-b919-82ce1b4de098 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406093824 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2d:d2:30:89:d9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2d:d2:30:89:d9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:96:11:f4:e7:e0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812183552 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 19:58:28.629271 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.629252 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 19:58:28.629443 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.629350 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 19:58:28.632451 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.632418 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 19:58:28.632593 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.632455 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-142.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 19:58:28.632869 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.632853 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 19:58:28.633349 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.633337 2562 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 19:58:28.633400 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.633353 2562 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 19:58:28.633400 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.633361 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 19:58:28.634197 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.634187 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 19:58:28.635523 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.635513 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 19:58:28.639073 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.639062 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 11 19:58:28.639196 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.639187 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 19:58:28.639225 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.639217 2562 kubelet.go:486] "Attempting to sync node with API server" Jun 11 19:58:28.639261 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.639228 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 19:58:28.639261 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.639242 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 19:58:28.639261 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.639252 2562 kubelet.go:398] "Adding apiserver pod source" Jun 11 19:58:28.639261 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.639261 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 19:58:28.639652 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.639640 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 19:58:28.639695 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.639661 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 19:58:28.641888 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.641872 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 19:58:28.643858 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.643846 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 19:58:28.643904 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.643877 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 19:58:28.645030 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.645019 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 19:58:28.645062 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.645037 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 19:58:28.645062 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.645043 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 19:58:28.645062 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.645049 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 19:58:28.645062 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.645057 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 19:58:28.645062 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.645062 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 19:58:28.645202 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.645069 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 19:58:28.645202 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.645074 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 19:58:28.645202 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.645081 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 19:58:28.645202 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.645086 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 19:58:28.645202 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.645096 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 19:58:28.645202 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.645101 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 19:58:28.646087 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.646076 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 19:58:28.646128 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.646088 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 19:58:28.649247 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.649234 2562 server.go:1268] "Started kubelet" Jun 11 19:58:28.649569 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.649545 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 19:58:28.649704 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.649670 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 19:58:28.649821 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.649722 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 19:58:28.649953 ip-10-0-137-142 systemd[1]: Started Kubernetes Kubelet. Jun 11 19:58:28.651547 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.651527 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 19:58:28.651682 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:28.651575 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-142.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 19:58:28.651682 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:28.651615 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 19:58:28.651829 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.651644 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-142.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 19:58:28.653167 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.653152 2562 server.go:310] "Adding debug handlers to kubelet server" Jun 11 19:58:28.655489 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:28.654492 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-142.ec2.internal.18b81f27da26f7f6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-142.ec2.internal,UID:ip-10-0-137-142.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-142.ec2.internal,},FirstTimestamp:2026-06-11 19:58:28.649203702 +0000 UTC m=+0.380365669,LastTimestamp:2026-06-11 19:58:28.649203702 +0000 UTC m=+0.380365669,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-142.ec2.internal,}" Jun 11 19:58:28.655701 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:28.655681 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 19:58:28.657629 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.657612 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 19:58:28.657717 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.657634 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 19:58:28.657776 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:28.657736 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-142.ec2.internal\" not found" Jun 11 19:58:28.658358 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.658339 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 19:58:28.658518 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.658414 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 19:58:28.658518 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.658436 2562 factory.go:55] Registering systemd factory Jun 11 19:58:28.658518 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.658450 2562 factory.go:223] Registration of the systemd container factory successfully Jun 11 19:58:28.658518 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.658314 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 19:58:28.658819 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.658581 2562 reconstruct.go:97] "Volume reconstruction finished" Jun 11 19:58:28.658819 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.658590 2562 reconciler.go:29] "Reconciler: start to sync state" Jun 11 19:58:28.658819 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.658659 2562 factory.go:153] Registering CRI-O factory Jun 11 19:58:28.658819 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.658670 2562 factory.go:223] Registration of the crio container factory successfully Jun 11 19:58:28.658819 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.658740 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 19:58:28.658819 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.658757 2562 factory.go:103] Registering Raw factory Jun 11 19:58:28.658819 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.658767 2562 manager.go:1196] Started watching for new ooms in manager Jun 11 19:58:28.659427 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.659413 2562 manager.go:349] Starting recovery of all containers Jun 11 19:58:28.669555 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:28.669522 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 19:58:28.669659 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:28.669520 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-142.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 19:58:28.672985 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.672831 2562 manager.go:354] Recovery completed Jun 11 19:58:28.674420 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:28.674397 2562 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 11 19:58:28.677334 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.677322 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:58:28.679141 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.679125 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-142.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:58:28.679216 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.679162 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-142.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:58:28.679216 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.679174 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-142.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:58:28.679768 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.679753 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 19:58:28.679768 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.679765 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 19:58:28.679884 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.679772 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:58:28.679884 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.679790 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 11 19:58:28.680572 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.680551 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-142.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:58:28.680654 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.680582 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-142.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:58:28.680654 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.680592 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-142.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:58:28.681246 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.681235 2562 policy_none.go:49] "None policy: Start" Jun 11 19:58:28.681278 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.681251 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 19:58:28.681278 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.681261 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 19:58:28.682298 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.682288 2562 policy_none.go:47] "Start" Jun 11 19:58:28.683845 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.683827 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hgxzf" Jun 11 19:58:28.690411 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:28.690316 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-142.ec2.internal.18b81f27dbefc7c6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-142.ec2.internal,UID:ip-10-0-137-142.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-142.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-142.ec2.internal,},FirstTimestamp:2026-06-11 19:58:28.679141318 +0000 UTC m=+0.410303286,LastTimestamp:2026-06-11 19:58:28.679141318 +0000 UTC m=+0.410303286,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-142.ec2.internal,}" Jun 11 19:58:28.694321 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.694300 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hgxzf" Jun 11 19:58:28.719015 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.719000 2562 manager.go:337] "Starting Device Plugin manager" Jun 11 19:58:28.731526 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:28.719034 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 19:58:28.731526 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.719044 2562 server.go:87] "Starting device plugin registration server" Jun 11 19:58:28.731526 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.719273 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 19:58:28.731526 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.719284 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 19:58:28.731526 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.719392 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 19:58:28.731526 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.719471 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 19:58:28.731526 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.719482 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 19:58:28.731526 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:28.720104 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 19:58:28.731526 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:28.720147 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-142.ec2.internal\" not found" Jun 11 19:58:28.731526 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.727188 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 19:58:28.731526 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.728560 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 19:58:28.731526 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.728587 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 19:58:28.731526 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.728606 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 19:58:28.731526 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:28.728638 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 19:58:28.731526 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.730727 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:58:28.820322 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.820286 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:58:28.821366 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.821342 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-142.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:58:28.821502 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.821400 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-142.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:58:28.821502 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.821415 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-142.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:58:28.821502 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.821438 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-142.ec2.internal" Jun 11 19:58:28.828791 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.828735 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-142.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-142.ec2.internal"] Jun 11 19:58:28.828864 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.828804 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:58:28.830530 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.830500 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-142.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:58:28.830668 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.830543 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-142.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:58:28.830668 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.830557 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-142.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:58:28.830947 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.830924 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-142.ec2.internal" Jun 11 19:58:28.831073 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:28.830963 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-142.ec2.internal\": node \"ip-10-0-137-142.ec2.internal\" not found" Jun 11 19:58:28.831951 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.831934 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:58:28.832068 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.832051 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-142.ec2.internal" Jun 11 19:58:28.832118 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.832091 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:58:28.832733 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.832715 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-142.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:58:28.832822 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.832747 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-142.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:58:28.832822 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.832758 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-142.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:58:28.832822 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.832721 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-142.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:58:28.832822 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.832814 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-142.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:58:28.832944 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.832831 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-142.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:58:28.834111 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.834095 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-142.ec2.internal" Jun 11 19:58:28.834203 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.834125 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:58:28.834783 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.834766 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-142.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:58:28.834861 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.834802 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-142.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:58:28.834861 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.834816 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-142.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:58:28.851926 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:28.851905 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-142.ec2.internal\" not found" node="ip-10-0-137-142.ec2.internal" Jun 11 19:58:28.855802 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:28.855787 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-142.ec2.internal\" not found" node="ip-10-0-137-142.ec2.internal" Jun 11 19:58:28.859955 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.859938 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cc4cacf13e921090a70062cceab74d3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-142.ec2.internal\" (UID: \"4cc4cacf13e921090a70062cceab74d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-142.ec2.internal" Jun 11 19:58:28.860007 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.859962 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d4265531fa51f38220398935b4c5d991-config\") pod \"kube-apiserver-proxy-ip-10-0-137-142.ec2.internal\" (UID: \"d4265531fa51f38220398935b4c5d991\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-142.ec2.internal" Jun 11 19:58:28.860007 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.859980 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4cc4cacf13e921090a70062cceab74d3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-142.ec2.internal\" (UID: \"4cc4cacf13e921090a70062cceab74d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-142.ec2.internal" Jun 11 19:58:28.867716 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:28.867698 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-142.ec2.internal\" not found" Jun 11 19:58:28.961075 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.961013 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d4265531fa51f38220398935b4c5d991-config\") pod \"kube-apiserver-proxy-ip-10-0-137-142.ec2.internal\" (UID: \"d4265531fa51f38220398935b4c5d991\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-142.ec2.internal" Jun 11 19:58:28.961075 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.961076 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4cc4cacf13e921090a70062cceab74d3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-142.ec2.internal\" (UID: \"4cc4cacf13e921090a70062cceab74d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-142.ec2.internal" Jun 11 19:58:28.961242 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.961092 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cc4cacf13e921090a70062cceab74d3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-142.ec2.internal\" (UID: \"4cc4cacf13e921090a70062cceab74d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-142.ec2.internal" Jun 11 19:58:28.961242 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.961121 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d4265531fa51f38220398935b4c5d991-config\") pod \"kube-apiserver-proxy-ip-10-0-137-142.ec2.internal\" (UID: \"d4265531fa51f38220398935b4c5d991\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-142.ec2.internal" Jun 11 19:58:28.961242 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.961146 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4cc4cacf13e921090a70062cceab74d3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-142.ec2.internal\" (UID: \"4cc4cacf13e921090a70062cceab74d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-142.ec2.internal" Jun 11 19:58:28.961242 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:28.961128 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cc4cacf13e921090a70062cceab74d3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-142.ec2.internal\" (UID: \"4cc4cacf13e921090a70062cceab74d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-142.ec2.internal" Jun 11 19:58:28.968150 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:28.968125 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-142.ec2.internal\" not found" Jun 11 19:58:29.068707 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:29.068670 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-142.ec2.internal\" not found" Jun 11 19:58:29.155150 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.155075 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-142.ec2.internal" Jun 11 19:58:29.159454 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.159435 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-142.ec2.internal" Jun 11 19:58:29.169766 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:29.169741 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-142.ec2.internal\" not found" Jun 11 19:58:29.270276 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:29.270236 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-142.ec2.internal\" not found" Jun 11 19:58:29.370875 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:29.370841 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-142.ec2.internal\" not found" Jun 11 19:58:29.471473 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:29.471397 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-142.ec2.internal\" not found" Jun 11 19:58:29.571185 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.571154 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:58:29.597505 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.597476 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 19:58:29.598041 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.597586 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 19:58:29.640046 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.640015 2562 apiserver.go:52] "Watching apiserver" Jun 11 19:58:29.650937 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.650919 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 19:58:29.651257 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.651236 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-pdqc7","openshift-multus/network-metrics-daemon-k98nz","openshift-network-diagnostics/network-check-target-n6qj6","openshift-network-operator/iptables-alerter-588lm","kube-system/global-pull-secret-syncer-g9g8h","kube-system/konnectivity-agent-4k7kz","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2sgx","openshift-dns/node-resolver-lb5qs","openshift-image-registry/node-ca-648xp","openshift-multus/multus-additional-cni-plugins-zjv5h","openshift-ovn-kubernetes/ovnkube-node-qn6rn","openshift-cluster-node-tuning-operator/tuned-kmglm"] Jun 11 19:58:29.652603 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.652585 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.653828 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.653808 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k98nz" Jun 11 19:58:29.653911 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:29.653888 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k98nz" podUID="dcc3087e-d6a7-4ec1-b911-8bf96a4319d2" Jun 11 19:58:29.654911 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.654893 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4k7kz" Jun 11 19:58:29.655301 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.655279 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 19:58:29.655301 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.655292 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 19:58:29.655626 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.655609 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 19:58:29.655680 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.655656 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ch2nj\"" Jun 11 19:58:29.655726 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.655691 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 19:58:29.656131 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.656114 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2sgx" Jun 11 19:58:29.657490 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.657468 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 19:58:29.657578 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.657559 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zjv5h" Jun 11 19:58:29.657988 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.657741 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 19:58:29.657988 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.657841 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-142.ec2.internal" Jun 11 19:58:29.657988 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.657839 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 19:58:29.657988 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.657979 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fsfkb\"" Jun 11 19:58:29.658242 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.658220 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 19:58:29.658891 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.658659 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 19:58:29.658891 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.658726 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 19:58:29.658891 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.658766 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6qj6" Jun 11 19:58:29.658891 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:29.658832 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6qj6" podUID="ffbc3051-b38e-43f1-8092-dc1ac0109cd3" Jun 11 19:58:29.659157 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.659003 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ff86x\"" Jun 11 19:58:29.659766 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.659747 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 19:58:29.660529 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.660012 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-588lm" Jun 11 19:58:29.662487 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.662465 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 19:58:29.664822 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.664797 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lc6c2\"" Jun 11 19:58:29.664925 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.664842 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dcc3087e-d6a7-4ec1-b911-8bf96a4319d2-metrics-certs\") pod \"network-metrics-daemon-k98nz\" (UID: \"dcc3087e-d6a7-4ec1-b911-8bf96a4319d2\") " pod="openshift-multus/network-metrics-daemon-k98nz" Jun 11 19:58:29.664925 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.664873 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2eeabcc2-717f-4bb3-92c0-db55b02864cb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zjv5h\" (UID: \"2eeabcc2-717f-4bb3-92c0-db55b02864cb\") " pod="openshift-multus/multus-additional-cni-plugins-zjv5h" Jun 11 19:58:29.664925 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.664893 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6fbe6cf6-0970-4e06-919f-081f1240fd53-cni-binary-copy\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.664925 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.664921 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1df140d0-b0a6-469d-bdc3-95111fffcd7f-socket-dir\") pod \"aws-ebs-csi-driver-node-q2sgx\" (UID: \"1df140d0-b0a6-469d-bdc3-95111fffcd7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2sgx" Jun 11 19:58:29.665095 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.664951 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1df140d0-b0a6-469d-bdc3-95111fffcd7f-registration-dir\") pod \"aws-ebs-csi-driver-node-q2sgx\" (UID: \"1df140d0-b0a6-469d-bdc3-95111fffcd7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2sgx" Jun 11 19:58:29.665095 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.664981 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-host-run-multus-certs\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.665095 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.665006 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-os-release\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.665095 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.665021 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-multus-socket-dir-parent\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.665275 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.665097 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-host-run-k8s-cni-cncf-io\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.665275 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.665134 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-multus-conf-dir\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.665275 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.665165 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/276fbaef-fe1a-48d5-a683-6cba382611f8-host-slash\") pod \"iptables-alerter-588lm\" (UID: \"276fbaef-fe1a-48d5-a683-6cba382611f8\") " pod="openshift-network-operator/iptables-alerter-588lm" Jun 11 19:58:29.665275 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.665252 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1df140d0-b0a6-469d-bdc3-95111fffcd7f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q2sgx\" (UID: \"1df140d0-b0a6-469d-bdc3-95111fffcd7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2sgx" Jun 11 19:58:29.665491 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.665296 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1df140d0-b0a6-469d-bdc3-95111fffcd7f-device-dir\") pod \"aws-ebs-csi-driver-node-q2sgx\" (UID: \"1df140d0-b0a6-469d-bdc3-95111fffcd7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2sgx" Jun 11 19:58:29.665491 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.665329 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1df140d0-b0a6-469d-bdc3-95111fffcd7f-etc-selinux\") pod \"aws-ebs-csi-driver-node-q2sgx\" (UID: \"1df140d0-b0a6-469d-bdc3-95111fffcd7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2sgx" Jun 11 19:58:29.665491 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.665363 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/276fbaef-fe1a-48d5-a683-6cba382611f8-iptables-alerter-script\") pod \"iptables-alerter-588lm\" (UID: \"276fbaef-fe1a-48d5-a683-6cba382611f8\") " pod="openshift-network-operator/iptables-alerter-588lm" Jun 11 19:58:29.665491 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.665411 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxqlt\" (UniqueName: \"kubernetes.io/projected/dcc3087e-d6a7-4ec1-b911-8bf96a4319d2-kube-api-access-xxqlt\") pod \"network-metrics-daemon-k98nz\" (UID: \"dcc3087e-d6a7-4ec1-b911-8bf96a4319d2\") " pod="openshift-multus/network-metrics-daemon-k98nz" Jun 11 19:58:29.665491 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.665445 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g8h" Jun 11 19:58:29.665722 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:29.665527 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9g8h" podUID="ebe82df4-c733-4be3-924b-3f32111102b7" Jun 11 19:58:29.665722 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.665601 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lb5qs" Jun 11 19:58:29.665722 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.665448 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-cnibin\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.665722 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.665689 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-host-var-lib-cni-multus\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.665891 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.665727 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6fbe6cf6-0970-4e06-919f-081f1240fd53-multus-daemon-config\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.665891 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.665760 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wngcp\" (UniqueName: \"kubernetes.io/projected/276fbaef-fe1a-48d5-a683-6cba382611f8-kube-api-access-wngcp\") pod \"iptables-alerter-588lm\" (UID: \"276fbaef-fe1a-48d5-a683-6cba382611f8\") " pod="openshift-network-operator/iptables-alerter-588lm" Jun 11 19:58:29.665891 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.665787 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2eeabcc2-717f-4bb3-92c0-db55b02864cb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zjv5h\" (UID: \"2eeabcc2-717f-4bb3-92c0-db55b02864cb\") " pod="openshift-multus/multus-additional-cni-plugins-zjv5h" Jun 11 19:58:29.665891 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.665816 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhjd8\" (UniqueName: \"kubernetes.io/projected/ffbc3051-b38e-43f1-8092-dc1ac0109cd3-kube-api-access-qhjd8\") pod \"network-check-target-n6qj6\" (UID: \"ffbc3051-b38e-43f1-8092-dc1ac0109cd3\") " pod="openshift-network-diagnostics/network-check-target-n6qj6" Jun 11 19:58:29.665891 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.665847 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-multus-cni-dir\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.665891 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.665875 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-host-run-netns\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.666162 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.665902 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-host-var-lib-cni-bin\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.666162 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.665933 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-host-var-lib-kubelet\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.666162 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.665993 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-hostroot\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.666162 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.666054 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1df140d0-b0a6-469d-bdc3-95111fffcd7f-sys-fs\") pod \"aws-ebs-csi-driver-node-q2sgx\" (UID: \"1df140d0-b0a6-469d-bdc3-95111fffcd7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2sgx" Jun 11 19:58:29.666162 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.666102 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-etc-kubernetes\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.666162 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.666137 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2eeabcc2-717f-4bb3-92c0-db55b02864cb-os-release\") pod \"multus-additional-cni-plugins-zjv5h\" (UID: \"2eeabcc2-717f-4bb3-92c0-db55b02864cb\") " pod="openshift-multus/multus-additional-cni-plugins-zjv5h" Jun 11 19:58:29.666656 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.666169 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2eeabcc2-717f-4bb3-92c0-db55b02864cb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zjv5h\" (UID: \"2eeabcc2-717f-4bb3-92c0-db55b02864cb\") " pod="openshift-multus/multus-additional-cni-plugins-zjv5h" Jun 11 19:58:29.666656 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.666244 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-system-cni-dir\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.666656 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.666274 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c76c354d-881c-4879-b7f6-9d9ddc209100-agent-certs\") pod \"konnectivity-agent-4k7kz\" (UID: \"c76c354d-881c-4879-b7f6-9d9ddc209100\") " pod="kube-system/konnectivity-agent-4k7kz" Jun 11 19:58:29.666656 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.666299 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8lwz\" (UniqueName: \"kubernetes.io/projected/1df140d0-b0a6-469d-bdc3-95111fffcd7f-kube-api-access-p8lwz\") pod \"aws-ebs-csi-driver-node-q2sgx\" (UID: \"1df140d0-b0a6-469d-bdc3-95111fffcd7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2sgx" Jun 11 19:58:29.666656 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.666328 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2eeabcc2-717f-4bb3-92c0-db55b02864cb-cnibin\") pod \"multus-additional-cni-plugins-zjv5h\" (UID: \"2eeabcc2-717f-4bb3-92c0-db55b02864cb\") " pod="openshift-multus/multus-additional-cni-plugins-zjv5h" Jun 11 19:58:29.666656 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.666360 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2eeabcc2-717f-4bb3-92c0-db55b02864cb-cni-binary-copy\") pod \"multus-additional-cni-plugins-zjv5h\" (UID: \"2eeabcc2-717f-4bb3-92c0-db55b02864cb\") " pod="openshift-multus/multus-additional-cni-plugins-zjv5h" Jun 11 19:58:29.666978 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.666417 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg6vt\" (UniqueName: \"kubernetes.io/projected/6fbe6cf6-0970-4e06-919f-081f1240fd53-kube-api-access-hg6vt\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.667056 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.666992 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2eeabcc2-717f-4bb3-92c0-db55b02864cb-system-cni-dir\") pod \"multus-additional-cni-plugins-zjv5h\" (UID: \"2eeabcc2-717f-4bb3-92c0-db55b02864cb\") " pod="openshift-multus/multus-additional-cni-plugins-zjv5h" Jun 11 19:58:29.667056 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.667043 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d55dx\" (UniqueName: \"kubernetes.io/projected/2eeabcc2-717f-4bb3-92c0-db55b02864cb-kube-api-access-d55dx\") pod \"multus-additional-cni-plugins-zjv5h\" (UID: \"2eeabcc2-717f-4bb3-92c0-db55b02864cb\") " pod="openshift-multus/multus-additional-cni-plugins-zjv5h" Jun 11 19:58:29.667158 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.667075 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c76c354d-881c-4879-b7f6-9d9ddc209100-konnectivity-ca\") pod \"konnectivity-agent-4k7kz\" (UID: \"c76c354d-881c-4879-b7f6-9d9ddc209100\") " pod="kube-system/konnectivity-agent-4k7kz" Jun 11 19:58:29.667158 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.667080 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 19:58:29.667325 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.667303 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-648xp" Jun 11 19:58:29.667893 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.667651 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 19:58:29.667893 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.667729 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jwn74\"" Jun 11 19:58:29.668135 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.668117 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 19:58:29.668437 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.668421 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 19:58:29.668437 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.668433 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 19:58:29.668631 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.668487 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-t4wr7\"" Jun 11 19:58:29.669095 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.669080 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.670134 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.670112 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 19:58:29.670240 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.670168 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 19:58:29.670306 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.670254 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 19:58:29.670306 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.670279 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-l9mfl\"" Jun 11 19:58:29.671146 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.671128 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.671484 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.671467 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 19:58:29.671609 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.671593 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 19:58:29.671791 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.671663 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 19:58:29.671873 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.671854 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 19:58:29.672898 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.672878 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 19:58:29.673000 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.672947 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8xd64\"" Jun 11 19:58:29.673059 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.672951 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 19:58:29.673853 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.673829 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 19:58:29.674077 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.674059 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 19:58:29.674333 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.674316 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 19:58:29.674554 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.674541 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vxsjv\"" Jun 11 19:58:29.675445 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.675427 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 19:58:29.675548 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.675510 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-142.ec2.internal" Jun 11 19:58:29.675725 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.675708 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-142.ec2.internal"] Jun 11 19:58:29.685124 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.685102 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 19:58:29.685361 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.685342 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-142.ec2.internal"] Jun 11 19:58:29.698974 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.698926 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 19:53:28 +0000 UTC" deadline="2028-03-09 19:18:04.659933578 +0000 UTC" Jun 11 19:58:29.698974 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.698973 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15287h19m34.960962995s" Jun 11 19:58:29.699674 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.699659 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fkc2j" Jun 11 19:58:29.709560 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.709541 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fkc2j" Jun 11 19:58:29.756725 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.756705 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:58:29.760074 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.760056 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 19:58:29.766309 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:29.766282 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cc4cacf13e921090a70062cceab74d3.slice/crio-c0acb5a26c15c056737e3a9bb127bd512388de74bda21c10e3807856d7dc33aa WatchSource:0}: Error finding container c0acb5a26c15c056737e3a9bb127bd512388de74bda21c10e3807856d7dc33aa: Status 404 returned error can't find the container with id c0acb5a26c15c056737e3a9bb127bd512388de74bda21c10e3807856d7dc33aa Jun 11 19:58:29.766988 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:29.766964 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4265531fa51f38220398935b4c5d991.slice/crio-fc2559a7e3cc89735ba914967150d2204ff9089b48db936ac0d153397b5c73f4 WatchSource:0}: Error finding container fc2559a7e3cc89735ba914967150d2204ff9089b48db936ac0d153397b5c73f4: Status 404 returned error can't find the container with id fc2559a7e3cc89735ba914967150d2204ff9089b48db936ac0d153397b5c73f4 Jun 11 19:58:29.767235 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.767214 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2eeabcc2-717f-4bb3-92c0-db55b02864cb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zjv5h\" (UID: \"2eeabcc2-717f-4bb3-92c0-db55b02864cb\") " pod="openshift-multus/multus-additional-cni-plugins-zjv5h" Jun 11 19:58:29.767417 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.767252 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6fbe6cf6-0970-4e06-919f-081f1240fd53-cni-binary-copy\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.767417 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.767278 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1df140d0-b0a6-469d-bdc3-95111fffcd7f-socket-dir\") pod \"aws-ebs-csi-driver-node-q2sgx\" (UID: \"1df140d0-b0a6-469d-bdc3-95111fffcd7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2sgx" Jun 11 19:58:29.767417 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.767302 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1df140d0-b0a6-469d-bdc3-95111fffcd7f-registration-dir\") pod \"aws-ebs-csi-driver-node-q2sgx\" (UID: \"1df140d0-b0a6-469d-bdc3-95111fffcd7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2sgx" Jun 11 19:58:29.767417 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.767329 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-etc-sysconfig\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.767417 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.767355 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-etc-kubernetes\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.767417 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.767396 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-host-cni-bin\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.767417 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.767410 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2eeabcc2-717f-4bb3-92c0-db55b02864cb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zjv5h\" (UID: \"2eeabcc2-717f-4bb3-92c0-db55b02864cb\") " pod="openshift-multus/multus-additional-cni-plugins-zjv5h" Jun 11 19:58:29.767777 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.767421 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6znhf\" (UniqueName: \"kubernetes.io/projected/653f3438-4943-4656-9b11-e75cdcd5fa9f-kube-api-access-6znhf\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.767777 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.767475 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j44lx\" (UniqueName: \"kubernetes.io/projected/1b6c5b1c-65de-4fe3-9ccd-9c2996176ccb-kube-api-access-j44lx\") pod \"node-ca-648xp\" (UID: \"1b6c5b1c-65de-4fe3-9ccd-9c2996176ccb\") " pod="openshift-image-registry/node-ca-648xp" Jun 11 19:58:29.767777 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.767498 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1df140d0-b0a6-469d-bdc3-95111fffcd7f-registration-dir\") pod \"aws-ebs-csi-driver-node-q2sgx\" (UID: \"1df140d0-b0a6-469d-bdc3-95111fffcd7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2sgx" Jun 11 19:58:29.767777 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.767510 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1df140d0-b0a6-469d-bdc3-95111fffcd7f-socket-dir\") pod \"aws-ebs-csi-driver-node-q2sgx\" (UID: \"1df140d0-b0a6-469d-bdc3-95111fffcd7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2sgx" Jun 11 19:58:29.767777 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.767518 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-etc-modprobe-d\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.767777 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.767554 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-host-cni-netd\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.767777 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.767598 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1df140d0-b0a6-469d-bdc3-95111fffcd7f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q2sgx\" (UID: \"1df140d0-b0a6-469d-bdc3-95111fffcd7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2sgx" Jun 11 19:58:29.767777 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.767641 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1df140d0-b0a6-469d-bdc3-95111fffcd7f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q2sgx\" (UID: \"1df140d0-b0a6-469d-bdc3-95111fffcd7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2sgx" Jun 11 19:58:29.767777 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.767714 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wngcp\" (UniqueName: \"kubernetes.io/projected/276fbaef-fe1a-48d5-a683-6cba382611f8-kube-api-access-wngcp\") pod \"iptables-alerter-588lm\" (UID: \"276fbaef-fe1a-48d5-a683-6cba382611f8\") " pod="openshift-network-operator/iptables-alerter-588lm" Jun 11 19:58:29.767777 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.767754 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-var-lib-kubelet\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.768255 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.767786 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ebe82df4-c733-4be3-924b-3f32111102b7-kubelet-config\") pod \"global-pull-secret-syncer-g9g8h\" (UID: \"ebe82df4-c733-4be3-924b-3f32111102b7\") " pod="kube-system/global-pull-secret-syncer-g9g8h" Jun 11 19:58:29.768255 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.767814 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/653f3438-4943-4656-9b11-e75cdcd5fa9f-env-overrides\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.768255 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.768049 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6fbe6cf6-0970-4e06-919f-081f1240fd53-cni-binary-copy\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.768407 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.768292 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2eeabcc2-717f-4bb3-92c0-db55b02864cb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zjv5h\" (UID: \"2eeabcc2-717f-4bb3-92c0-db55b02864cb\") " pod="openshift-multus/multus-additional-cni-plugins-zjv5h" Jun 11 19:58:29.768407 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.768322 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-host-run-netns\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.768407 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.768348 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-host-var-lib-kubelet\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.768407 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.768389 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-hostroot\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.768591 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.768413 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-tmp\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.768591 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.768467 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-hostroot\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.768591 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.768504 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-host-run-netns\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.768591 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.768527 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-host-var-lib-kubelet\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.768591 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.768550 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ad153657-154e-4342-b701-95873f67a210-hosts-file\") pod \"node-resolver-lb5qs\" (UID: \"ad153657-154e-4342-b701-95873f67a210\") " pod="openshift-dns/node-resolver-lb5qs" Jun 11 19:58:29.768591 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.768570 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-node-log\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.768591 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.768585 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/653f3438-4943-4656-9b11-e75cdcd5fa9f-ovnkube-script-lib\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.768832 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.768602 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-etc-kubernetes\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.768832 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.768620 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2eeabcc2-717f-4bb3-92c0-db55b02864cb-os-release\") pod \"multus-additional-cni-plugins-zjv5h\" (UID: \"2eeabcc2-717f-4bb3-92c0-db55b02864cb\") " pod="openshift-multus/multus-additional-cni-plugins-zjv5h" Jun 11 19:58:29.768832 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.768702 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-etc-kubernetes\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.768832 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.768711 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2eeabcc2-717f-4bb3-92c0-db55b02864cb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zjv5h\" (UID: \"2eeabcc2-717f-4bb3-92c0-db55b02864cb\") " pod="openshift-multus/multus-additional-cni-plugins-zjv5h" Jun 11 19:58:29.768832 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.768743 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/653f3438-4943-4656-9b11-e75cdcd5fa9f-ovn-node-metrics-cert\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.768832 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.768788 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2eeabcc2-717f-4bb3-92c0-db55b02864cb-cni-binary-copy\") pod \"multus-additional-cni-plugins-zjv5h\" (UID: \"2eeabcc2-717f-4bb3-92c0-db55b02864cb\") " pod="openshift-multus/multus-additional-cni-plugins-zjv5h" Jun 11 19:58:29.771781 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.768797 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2eeabcc2-717f-4bb3-92c0-db55b02864cb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zjv5h\" (UID: \"2eeabcc2-717f-4bb3-92c0-db55b02864cb\") " pod="openshift-multus/multus-additional-cni-plugins-zjv5h" Jun 11 19:58:29.771781 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.770000 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg6vt\" (UniqueName: \"kubernetes.io/projected/6fbe6cf6-0970-4e06-919f-081f1240fd53-kube-api-access-hg6vt\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.771781 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.770051 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-systemd-units\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.771781 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.770095 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-run-ovn\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.771781 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.768827 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2eeabcc2-717f-4bb3-92c0-db55b02864cb-os-release\") pod \"multus-additional-cni-plugins-zjv5h\" (UID: \"2eeabcc2-717f-4bb3-92c0-db55b02864cb\") " pod="openshift-multus/multus-additional-cni-plugins-zjv5h" Jun 11 19:58:29.771781 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.770739 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c76c354d-881c-4879-b7f6-9d9ddc209100-konnectivity-ca\") pod \"konnectivity-agent-4k7kz\" (UID: \"c76c354d-881c-4879-b7f6-9d9ddc209100\") " pod="kube-system/konnectivity-agent-4k7kz" Jun 11 19:58:29.771781 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.770783 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dcc3087e-d6a7-4ec1-b911-8bf96a4319d2-metrics-certs\") pod \"network-metrics-daemon-k98nz\" (UID: \"dcc3087e-d6a7-4ec1-b911-8bf96a4319d2\") " pod="openshift-multus/network-metrics-daemon-k98nz" Jun 11 19:58:29.771781 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.770819 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-etc-systemd\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.771781 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.770989 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2eeabcc2-717f-4bb3-92c0-db55b02864cb-cni-binary-copy\") pod \"multus-additional-cni-plugins-zjv5h\" (UID: \"2eeabcc2-717f-4bb3-92c0-db55b02864cb\") " pod="openshift-multus/multus-additional-cni-plugins-zjv5h" Jun 11 19:58:29.771781 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.771052 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-run-openvswitch\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.771781 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.771085 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-etc-sysctl-conf\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.771781 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.771117 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-sys\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.771781 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:29.771196 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:58:29.771781 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.771263 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhjmz\" (UniqueName: \"kubernetes.io/projected/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-kube-api-access-lhjmz\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.771781 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.771298 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad153657-154e-4342-b701-95873f67a210-tmp-dir\") pod \"node-resolver-lb5qs\" (UID: \"ad153657-154e-4342-b701-95873f67a210\") " pod="openshift-dns/node-resolver-lb5qs" Jun 11 19:58:29.771781 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:29.771397 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcc3087e-d6a7-4ec1-b911-8bf96a4319d2-metrics-certs podName:dcc3087e-d6a7-4ec1-b911-8bf96a4319d2 nodeName:}" failed. No retries permitted until 2026-06-11 19:58:30.271357448 +0000 UTC m=+2.002519418 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dcc3087e-d6a7-4ec1-b911-8bf96a4319d2-metrics-certs") pod "network-metrics-daemon-k98nz" (UID: "dcc3087e-d6a7-4ec1-b911-8bf96a4319d2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:58:29.771781 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.771497 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-host-run-multus-certs\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.772478 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.771541 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-os-release\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.772478 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.771567 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-multus-socket-dir-parent\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.772478 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.771598 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-host-run-k8s-cni-cncf-io\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.772478 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.771758 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-multus-conf-dir\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.772478 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.771762 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-multus-socket-dir-parent\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.772478 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.771869 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c76c354d-881c-4879-b7f6-9d9ddc209100-konnectivity-ca\") pod \"konnectivity-agent-4k7kz\" (UID: \"c76c354d-881c-4879-b7f6-9d9ddc209100\") " pod="kube-system/konnectivity-agent-4k7kz" Jun 11 19:58:29.772478 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.771899 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-multus-conf-dir\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.772478 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.771975 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-os-release\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.772478 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.772021 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-host-run-k8s-cni-cncf-io\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.772478 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.772126 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2eeabcc2-717f-4bb3-92c0-db55b02864cb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zjv5h\" (UID: \"2eeabcc2-717f-4bb3-92c0-db55b02864cb\") " pod="openshift-multus/multus-additional-cni-plugins-zjv5h" Jun 11 19:58:29.772478 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.772164 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/276fbaef-fe1a-48d5-a683-6cba382611f8-host-slash\") pod \"iptables-alerter-588lm\" (UID: \"276fbaef-fe1a-48d5-a683-6cba382611f8\") " pod="openshift-network-operator/iptables-alerter-588lm" Jun 11 19:58:29.772478 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.772200 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-host-run-multus-certs\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.772478 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.772224 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-etc-tuned\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.772478 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.772281 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/276fbaef-fe1a-48d5-a683-6cba382611f8-host-slash\") pod \"iptables-alerter-588lm\" (UID: \"276fbaef-fe1a-48d5-a683-6cba382611f8\") " pod="openshift-network-operator/iptables-alerter-588lm" Jun 11 19:58:29.772478 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.772332 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-host-run-netns\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.772478 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.772392 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1df140d0-b0a6-469d-bdc3-95111fffcd7f-device-dir\") pod \"aws-ebs-csi-driver-node-q2sgx\" (UID: \"1df140d0-b0a6-469d-bdc3-95111fffcd7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2sgx" Jun 11 19:58:29.772478 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.772430 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1df140d0-b0a6-469d-bdc3-95111fffcd7f-etc-selinux\") pod \"aws-ebs-csi-driver-node-q2sgx\" (UID: \"1df140d0-b0a6-469d-bdc3-95111fffcd7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2sgx" Jun 11 19:58:29.773235 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.772504 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1df140d0-b0a6-469d-bdc3-95111fffcd7f-device-dir\") pod \"aws-ebs-csi-driver-node-q2sgx\" (UID: \"1df140d0-b0a6-469d-bdc3-95111fffcd7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2sgx" Jun 11 19:58:29.773235 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.772604 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1df140d0-b0a6-469d-bdc3-95111fffcd7f-etc-selinux\") pod \"aws-ebs-csi-driver-node-q2sgx\" (UID: \"1df140d0-b0a6-469d-bdc3-95111fffcd7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2sgx" Jun 11 19:58:29.773235 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.773037 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/276fbaef-fe1a-48d5-a683-6cba382611f8-iptables-alerter-script\") pod \"iptables-alerter-588lm\" (UID: \"276fbaef-fe1a-48d5-a683-6cba382611f8\") " pod="openshift-network-operator/iptables-alerter-588lm" Jun 11 19:58:29.773235 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.773082 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxqlt\" (UniqueName: \"kubernetes.io/projected/dcc3087e-d6a7-4ec1-b911-8bf96a4319d2-kube-api-access-xxqlt\") pod \"network-metrics-daemon-k98nz\" (UID: \"dcc3087e-d6a7-4ec1-b911-8bf96a4319d2\") " pod="openshift-multus/network-metrics-daemon-k98nz" Jun 11 19:58:29.773235 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.773114 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-host\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.773235 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.773143 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebe82df4-c733-4be3-924b-3f32111102b7-original-pull-secret\") pod \"global-pull-secret-syncer-g9g8h\" (UID: \"ebe82df4-c733-4be3-924b-3f32111102b7\") " pod="kube-system/global-pull-secret-syncer-g9g8h" Jun 11 19:58:29.773235 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.773170 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-etc-openvswitch\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.773235 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.773203 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-cnibin\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.773235 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.773231 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-host-var-lib-cni-multus\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.773679 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.773259 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6fbe6cf6-0970-4e06-919f-081f1240fd53-multus-daemon-config\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.773679 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.773305 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-etc-sysctl-d\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.773679 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.773327 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-host-run-ovn-kubernetes\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.773679 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.773359 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.773679 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.773407 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhjd8\" (UniqueName: \"kubernetes.io/projected/ffbc3051-b38e-43f1-8092-dc1ac0109cd3-kube-api-access-qhjd8\") pod \"network-check-target-n6qj6\" (UID: \"ffbc3051-b38e-43f1-8092-dc1ac0109cd3\") " pod="openshift-network-diagnostics/network-check-target-n6qj6" Jun 11 19:58:29.773679 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.773436 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-multus-cni-dir\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.773679 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.773465 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-host-var-lib-cni-bin\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.773679 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.773489 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1df140d0-b0a6-469d-bdc3-95111fffcd7f-sys-fs\") pod \"aws-ebs-csi-driver-node-q2sgx\" (UID: \"1df140d0-b0a6-469d-bdc3-95111fffcd7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2sgx" Jun 11 19:58:29.773679 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.773518 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8lwz\" (UniqueName: \"kubernetes.io/projected/1df140d0-b0a6-469d-bdc3-95111fffcd7f-kube-api-access-p8lwz\") pod \"aws-ebs-csi-driver-node-q2sgx\" (UID: \"1df140d0-b0a6-469d-bdc3-95111fffcd7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2sgx" Jun 11 19:58:29.773679 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.773547 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-run-systemd\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.773679 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.773575 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-var-lib-openvswitch\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.773679 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.773606 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-system-cni-dir\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.773679 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.773635 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c76c354d-881c-4879-b7f6-9d9ddc209100-agent-certs\") pod \"konnectivity-agent-4k7kz\" (UID: \"c76c354d-881c-4879-b7f6-9d9ddc209100\") " pod="kube-system/konnectivity-agent-4k7kz" Jun 11 19:58:29.773679 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.773662 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1b6c5b1c-65de-4fe3-9ccd-9c2996176ccb-serviceca\") pod \"node-ca-648xp\" (UID: \"1b6c5b1c-65de-4fe3-9ccd-9c2996176ccb\") " pod="openshift-image-registry/node-ca-648xp" Jun 11 19:58:29.775281 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.773691 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d24jf\" (UniqueName: \"kubernetes.io/projected/ad153657-154e-4342-b701-95873f67a210-kube-api-access-d24jf\") pod \"node-resolver-lb5qs\" (UID: \"ad153657-154e-4342-b701-95873f67a210\") " pod="openshift-dns/node-resolver-lb5qs" Jun 11 19:58:29.775281 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.773719 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-log-socket\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.775281 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.773743 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2eeabcc2-717f-4bb3-92c0-db55b02864cb-cnibin\") pod \"multus-additional-cni-plugins-zjv5h\" (UID: \"2eeabcc2-717f-4bb3-92c0-db55b02864cb\") " pod="openshift-multus/multus-additional-cni-plugins-zjv5h" Jun 11 19:58:29.775281 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.773770 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b6c5b1c-65de-4fe3-9ccd-9c2996176ccb-host\") pod \"node-ca-648xp\" (UID: \"1b6c5b1c-65de-4fe3-9ccd-9c2996176ccb\") " pod="openshift-image-registry/node-ca-648xp" Jun 11 19:58:29.775281 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.773796 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-host-kubelet\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.775281 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.773824 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/653f3438-4943-4656-9b11-e75cdcd5fa9f-ovnkube-config\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.775281 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.773852 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2eeabcc2-717f-4bb3-92c0-db55b02864cb-system-cni-dir\") pod \"multus-additional-cni-plugins-zjv5h\" (UID: \"2eeabcc2-717f-4bb3-92c0-db55b02864cb\") " pod="openshift-multus/multus-additional-cni-plugins-zjv5h" Jun 11 19:58:29.775281 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.773888 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d55dx\" (UniqueName: \"kubernetes.io/projected/2eeabcc2-717f-4bb3-92c0-db55b02864cb-kube-api-access-d55dx\") pod \"multus-additional-cni-plugins-zjv5h\" (UID: \"2eeabcc2-717f-4bb3-92c0-db55b02864cb\") " pod="openshift-multus/multus-additional-cni-plugins-zjv5h" Jun 11 19:58:29.775281 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.773916 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-run\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.775281 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.773942 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-lib-modules\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.775281 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.773971 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ebe82df4-c733-4be3-924b-3f32111102b7-dbus\") pod \"global-pull-secret-syncer-g9g8h\" (UID: \"ebe82df4-c733-4be3-924b-3f32111102b7\") " pod="kube-system/global-pull-secret-syncer-g9g8h" Jun 11 19:58:29.775281 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.773997 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-host-slash\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.775281 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.774356 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-host-var-lib-cni-bin\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.775281 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.774536 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-multus-cni-dir\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.775281 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.774691 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2eeabcc2-717f-4bb3-92c0-db55b02864cb-system-cni-dir\") pod \"multus-additional-cni-plugins-zjv5h\" (UID: \"2eeabcc2-717f-4bb3-92c0-db55b02864cb\") " pod="openshift-multus/multus-additional-cni-plugins-zjv5h" Jun 11 19:58:29.775281 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.774767 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-system-cni-dir\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.775281 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.774828 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2eeabcc2-717f-4bb3-92c0-db55b02864cb-cnibin\") pod \"multus-additional-cni-plugins-zjv5h\" (UID: \"2eeabcc2-717f-4bb3-92c0-db55b02864cb\") " pod="openshift-multus/multus-additional-cni-plugins-zjv5h" Jun 11 19:58:29.775959 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.774845 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-cnibin\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.775959 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.774873 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6fbe6cf6-0970-4e06-919f-081f1240fd53-host-var-lib-cni-multus\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.775959 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.774884 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 19:58:29.775959 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.774940 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/276fbaef-fe1a-48d5-a683-6cba382611f8-iptables-alerter-script\") pod \"iptables-alerter-588lm\" (UID: \"276fbaef-fe1a-48d5-a683-6cba382611f8\") " pod="openshift-network-operator/iptables-alerter-588lm" Jun 11 19:58:29.775959 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.775053 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6fbe6cf6-0970-4e06-919f-081f1240fd53-multus-daemon-config\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.775959 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.775124 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1df140d0-b0a6-469d-bdc3-95111fffcd7f-sys-fs\") pod \"aws-ebs-csi-driver-node-q2sgx\" (UID: \"1df140d0-b0a6-469d-bdc3-95111fffcd7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2sgx" Jun 11 19:58:29.776922 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.776907 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 19:58:29.778954 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.778935 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c76c354d-881c-4879-b7f6-9d9ddc209100-agent-certs\") pod \"konnectivity-agent-4k7kz\" (UID: \"c76c354d-881c-4879-b7f6-9d9ddc209100\") " pod="kube-system/konnectivity-agent-4k7kz" Jun 11 19:58:29.781253 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.781236 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wngcp\" (UniqueName: \"kubernetes.io/projected/276fbaef-fe1a-48d5-a683-6cba382611f8-kube-api-access-wngcp\") pod \"iptables-alerter-588lm\" (UID: \"276fbaef-fe1a-48d5-a683-6cba382611f8\") " pod="openshift-network-operator/iptables-alerter-588lm" Jun 11 19:58:29.781754 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.781733 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg6vt\" (UniqueName: \"kubernetes.io/projected/6fbe6cf6-0970-4e06-919f-081f1240fd53-kube-api-access-hg6vt\") pod \"multus-pdqc7\" (UID: \"6fbe6cf6-0970-4e06-919f-081f1240fd53\") " pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.784323 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:29.784304 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:58:29.784323 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:29.784321 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:58:29.784625 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:29.784330 2562 projected.go:196] Error preparing data for projected volume kube-api-access-qhjd8 for pod openshift-network-diagnostics/network-check-target-n6qj6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:58:29.784625 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:29.784399 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ffbc3051-b38e-43f1-8092-dc1ac0109cd3-kube-api-access-qhjd8 podName:ffbc3051-b38e-43f1-8092-dc1ac0109cd3 nodeName:}" failed. No retries permitted until 2026-06-11 19:58:30.284363905 +0000 UTC m=+2.015525859 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qhjd8" (UniqueName: "kubernetes.io/projected/ffbc3051-b38e-43f1-8092-dc1ac0109cd3-kube-api-access-qhjd8") pod "network-check-target-n6qj6" (UID: "ffbc3051-b38e-43f1-8092-dc1ac0109cd3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:58:29.786105 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.786083 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8lwz\" (UniqueName: \"kubernetes.io/projected/1df140d0-b0a6-469d-bdc3-95111fffcd7f-kube-api-access-p8lwz\") pod \"aws-ebs-csi-driver-node-q2sgx\" (UID: \"1df140d0-b0a6-469d-bdc3-95111fffcd7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2sgx" Jun 11 19:58:29.786614 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.786593 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxqlt\" (UniqueName: \"kubernetes.io/projected/dcc3087e-d6a7-4ec1-b911-8bf96a4319d2-kube-api-access-xxqlt\") pod \"network-metrics-daemon-k98nz\" (UID: \"dcc3087e-d6a7-4ec1-b911-8bf96a4319d2\") " pod="openshift-multus/network-metrics-daemon-k98nz" Jun 11 19:58:29.788206 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.788184 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d55dx\" (UniqueName: \"kubernetes.io/projected/2eeabcc2-717f-4bb3-92c0-db55b02864cb-kube-api-access-d55dx\") pod \"multus-additional-cni-plugins-zjv5h\" (UID: \"2eeabcc2-717f-4bb3-92c0-db55b02864cb\") " pod="openshift-multus/multus-additional-cni-plugins-zjv5h" Jun 11 19:58:29.874655 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.874623 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-etc-tuned\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.874655 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.874657 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-host-run-netns\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.874655 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.874673 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-host\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.874953 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.874687 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebe82df4-c733-4be3-924b-3f32111102b7-original-pull-secret\") pod \"global-pull-secret-syncer-g9g8h\" (UID: \"ebe82df4-c733-4be3-924b-3f32111102b7\") " pod="kube-system/global-pull-secret-syncer-g9g8h" Jun 11 19:58:29.874953 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.874753 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-host-run-netns\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.874953 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.874820 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-host\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.874953 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:29.874856 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:58:29.874953 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:29.874915 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebe82df4-c733-4be3-924b-3f32111102b7-original-pull-secret podName:ebe82df4-c733-4be3-924b-3f32111102b7 nodeName:}" failed. No retries permitted until 2026-06-11 19:58:30.374896017 +0000 UTC m=+2.106057984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebe82df4-c733-4be3-924b-3f32111102b7-original-pull-secret") pod "global-pull-secret-syncer-g9g8h" (UID: "ebe82df4-c733-4be3-924b-3f32111102b7") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:58:29.874953 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.874936 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-etc-openvswitch\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.875299 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.874967 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-etc-sysctl-d\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.875299 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.874992 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-host-run-ovn-kubernetes\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.875299 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875019 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.875299 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875030 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-etc-openvswitch\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.875299 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875060 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-run-systemd\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.875299 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875069 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-host-run-ovn-kubernetes\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.875299 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875084 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-var-lib-openvswitch\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.875299 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875110 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1b6c5b1c-65de-4fe3-9ccd-9c2996176ccb-serviceca\") pod \"node-ca-648xp\" (UID: \"1b6c5b1c-65de-4fe3-9ccd-9c2996176ccb\") " pod="openshift-image-registry/node-ca-648xp" Jun 11 19:58:29.875299 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875113 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-run-systemd\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.875299 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875114 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.875299 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875134 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d24jf\" (UniqueName: \"kubernetes.io/projected/ad153657-154e-4342-b701-95873f67a210-kube-api-access-d24jf\") pod \"node-resolver-lb5qs\" (UID: \"ad153657-154e-4342-b701-95873f67a210\") " pod="openshift-dns/node-resolver-lb5qs" Jun 11 19:58:29.875299 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875152 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-var-lib-openvswitch\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.875299 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875171 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-log-socket\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.875299 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875118 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-etc-sysctl-d\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.875299 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875218 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-log-socket\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.875299 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875218 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b6c5b1c-65de-4fe3-9ccd-9c2996176ccb-host\") pod \"node-ca-648xp\" (UID: \"1b6c5b1c-65de-4fe3-9ccd-9c2996176ccb\") " pod="openshift-image-registry/node-ca-648xp" Jun 11 19:58:29.875299 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875246 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b6c5b1c-65de-4fe3-9ccd-9c2996176ccb-host\") pod \"node-ca-648xp\" (UID: \"1b6c5b1c-65de-4fe3-9ccd-9c2996176ccb\") " pod="openshift-image-registry/node-ca-648xp" Jun 11 19:58:29.875966 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875265 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-host-kubelet\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.875966 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875293 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/653f3438-4943-4656-9b11-e75cdcd5fa9f-ovnkube-config\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.875966 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875310 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-host-kubelet\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.875966 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875323 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-run\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.875966 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875402 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-run\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.875966 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875407 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-lib-modules\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.875966 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875432 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ebe82df4-c733-4be3-924b-3f32111102b7-dbus\") pod \"global-pull-secret-syncer-g9g8h\" (UID: \"ebe82df4-c733-4be3-924b-3f32111102b7\") " pod="kube-system/global-pull-secret-syncer-g9g8h" Jun 11 19:58:29.875966 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875452 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-host-slash\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.875966 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875470 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-etc-sysconfig\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.875966 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875485 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-etc-kubernetes\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.875966 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875517 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-host-cni-bin\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.875966 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875538 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6znhf\" (UniqueName: \"kubernetes.io/projected/653f3438-4943-4656-9b11-e75cdcd5fa9f-kube-api-access-6znhf\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.875966 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875786 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/653f3438-4943-4656-9b11-e75cdcd5fa9f-ovnkube-config\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.875966 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875797 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j44lx\" (UniqueName: \"kubernetes.io/projected/1b6c5b1c-65de-4fe3-9ccd-9c2996176ccb-kube-api-access-j44lx\") pod \"node-ca-648xp\" (UID: \"1b6c5b1c-65de-4fe3-9ccd-9c2996176ccb\") " pod="openshift-image-registry/node-ca-648xp" Jun 11 19:58:29.875966 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875581 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-etc-sysconfig\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.875966 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875593 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-host-cni-bin\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.875966 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875607 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ebe82df4-c733-4be3-924b-3f32111102b7-dbus\") pod \"global-pull-secret-syncer-g9g8h\" (UID: \"ebe82df4-c733-4be3-924b-3f32111102b7\") " pod="kube-system/global-pull-secret-syncer-g9g8h" Jun 11 19:58:29.875966 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875580 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-host-slash\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.876815 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875687 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-lib-modules\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.876815 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875819 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-etc-modprobe-d\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.876815 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875558 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1b6c5b1c-65de-4fe3-9ccd-9c2996176ccb-serviceca\") pod \"node-ca-648xp\" (UID: \"1b6c5b1c-65de-4fe3-9ccd-9c2996176ccb\") " pod="openshift-image-registry/node-ca-648xp" Jun 11 19:58:29.876815 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875593 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-etc-kubernetes\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.876815 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875867 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-host-cni-netd\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.876815 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875910 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-host-cni-netd\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.876815 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875910 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-etc-modprobe-d\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.876815 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875931 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-var-lib-kubelet\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.876815 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875960 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ebe82df4-c733-4be3-924b-3f32111102b7-kubelet-config\") pod \"global-pull-secret-syncer-g9g8h\" (UID: \"ebe82df4-c733-4be3-924b-3f32111102b7\") " pod="kube-system/global-pull-secret-syncer-g9g8h" Jun 11 19:58:29.876815 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.875985 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/653f3438-4943-4656-9b11-e75cdcd5fa9f-env-overrides\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.876815 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.876012 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-tmp\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.876815 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.876036 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ad153657-154e-4342-b701-95873f67a210-hosts-file\") pod \"node-resolver-lb5qs\" (UID: \"ad153657-154e-4342-b701-95873f67a210\") " pod="openshift-dns/node-resolver-lb5qs" Jun 11 19:58:29.876815 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.876038 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-var-lib-kubelet\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.876815 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.876060 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-node-log\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.876815 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.876077 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ad153657-154e-4342-b701-95873f67a210-hosts-file\") pod \"node-resolver-lb5qs\" (UID: \"ad153657-154e-4342-b701-95873f67a210\") " pod="openshift-dns/node-resolver-lb5qs" Jun 11 19:58:29.876815 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.876085 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ebe82df4-c733-4be3-924b-3f32111102b7-kubelet-config\") pod \"global-pull-secret-syncer-g9g8h\" (UID: \"ebe82df4-c733-4be3-924b-3f32111102b7\") " pod="kube-system/global-pull-secret-syncer-g9g8h" Jun 11 19:58:29.876815 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.876101 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/653f3438-4943-4656-9b11-e75cdcd5fa9f-ovnkube-script-lib\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.876815 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.876126 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/653f3438-4943-4656-9b11-e75cdcd5fa9f-ovn-node-metrics-cert\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.877513 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.876091 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-node-log\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.877513 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.876146 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-systemd-units\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.877513 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.876170 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-run-ovn\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.877513 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.876204 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-etc-systemd\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.877513 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.876213 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-systemd-units\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.877513 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.876233 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-run-openvswitch\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.877513 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.876256 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-run-ovn\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.877513 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.876258 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-etc-sysctl-conf\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.877513 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.876303 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-sys\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.877513 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.876280 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-etc-systemd\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.877513 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.876331 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhjmz\" (UniqueName: \"kubernetes.io/projected/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-kube-api-access-lhjmz\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.877513 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.876361 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-sys\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.877513 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.876407 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-etc-sysctl-conf\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.877513 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.876370 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad153657-154e-4342-b701-95873f67a210-tmp-dir\") pod \"node-resolver-lb5qs\" (UID: \"ad153657-154e-4342-b701-95873f67a210\") " pod="openshift-dns/node-resolver-lb5qs" Jun 11 19:58:29.877513 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.876410 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/653f3438-4943-4656-9b11-e75cdcd5fa9f-env-overrides\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.877513 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.876485 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/653f3438-4943-4656-9b11-e75cdcd5fa9f-run-openvswitch\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.877513 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.876640 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad153657-154e-4342-b701-95873f67a210-tmp-dir\") pod \"node-resolver-lb5qs\" (UID: \"ad153657-154e-4342-b701-95873f67a210\") " pod="openshift-dns/node-resolver-lb5qs" Jun 11 19:58:29.877513 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.876986 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/653f3438-4943-4656-9b11-e75cdcd5fa9f-ovnkube-script-lib\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.878039 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.877330 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-etc-tuned\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.878567 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.878551 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/653f3438-4943-4656-9b11-e75cdcd5fa9f-ovn-node-metrics-cert\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.878607 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.878563 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-tmp\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.887079 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.887045 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhjmz\" (UniqueName: \"kubernetes.io/projected/d54eee6b-cdd3-4244-b5e0-75aae0dcea62-kube-api-access-lhjmz\") pod \"tuned-kmglm\" (UID: \"d54eee6b-cdd3-4244-b5e0-75aae0dcea62\") " pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:29.887079 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.887074 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d24jf\" (UniqueName: \"kubernetes.io/projected/ad153657-154e-4342-b701-95873f67a210-kube-api-access-d24jf\") pod \"node-resolver-lb5qs\" (UID: \"ad153657-154e-4342-b701-95873f67a210\") " pod="openshift-dns/node-resolver-lb5qs" Jun 11 19:58:29.887300 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.887282 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j44lx\" (UniqueName: \"kubernetes.io/projected/1b6c5b1c-65de-4fe3-9ccd-9c2996176ccb-kube-api-access-j44lx\") pod \"node-ca-648xp\" (UID: \"1b6c5b1c-65de-4fe3-9ccd-9c2996176ccb\") " pod="openshift-image-registry/node-ca-648xp" Jun 11 19:58:29.887447 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.887432 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6znhf\" (UniqueName: \"kubernetes.io/projected/653f3438-4943-4656-9b11-e75cdcd5fa9f-kube-api-access-6znhf\") pod \"ovnkube-node-qn6rn\" (UID: \"653f3438-4943-4656-9b11-e75cdcd5fa9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:29.920467 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.920439 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:58:29.976564 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.976476 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pdqc7" Jun 11 19:58:29.984695 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:29.984667 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fbe6cf6_0970_4e06_919f_081f1240fd53.slice/crio-bc62a5de6a6c052ce8e089f2501111ffbbaed8b3caa6bcd3cade98cf8dec343b WatchSource:0}: Error finding container bc62a5de6a6c052ce8e089f2501111ffbbaed8b3caa6bcd3cade98cf8dec343b: Status 404 returned error can't find the container with id bc62a5de6a6c052ce8e089f2501111ffbbaed8b3caa6bcd3cade98cf8dec343b Jun 11 19:58:29.990419 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:29.990396 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4k7kz" Jun 11 19:58:29.997696 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:29.997676 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc76c354d_881c_4879_b7f6_9d9ddc209100.slice/crio-bc5cd9eba371dac3dab821bd802a8beff596748023f51a86506ccc998704a20f WatchSource:0}: Error finding container bc5cd9eba371dac3dab821bd802a8beff596748023f51a86506ccc998704a20f: Status 404 returned error can't find the container with id bc5cd9eba371dac3dab821bd802a8beff596748023f51a86506ccc998704a20f Jun 11 19:58:30.009240 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:30.009217 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2sgx" Jun 11 19:58:30.016455 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:30.016434 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1df140d0_b0a6_469d_bdc3_95111fffcd7f.slice/crio-b3cd2884330716fc037b122e7db1ee0febf3f7d15030fbbff53e1b9e9a4d3eeb WatchSource:0}: Error finding container b3cd2884330716fc037b122e7db1ee0febf3f7d15030fbbff53e1b9e9a4d3eeb: Status 404 returned error can't find the container with id b3cd2884330716fc037b122e7db1ee0febf3f7d15030fbbff53e1b9e9a4d3eeb Jun 11 19:58:30.021452 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:30.021429 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zjv5h" Jun 11 19:58:30.028602 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:30.028572 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eeabcc2_717f_4bb3_92c0_db55b02864cb.slice/crio-0bc4570be6593fe08edff9551d4043b39343baf8c577a81a7dd1195c552407b3 WatchSource:0}: Error finding container 0bc4570be6593fe08edff9551d4043b39343baf8c577a81a7dd1195c552407b3: Status 404 returned error can't find the container with id 0bc4570be6593fe08edff9551d4043b39343baf8c577a81a7dd1195c552407b3 Jun 11 19:58:30.040335 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:30.040311 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-588lm" Jun 11 19:58:30.048148 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:30.048123 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod276fbaef_fe1a_48d5_a683_6cba382611f8.slice/crio-d5408f873f5b37b77041c40728d4dcb1077260e06a96b73a1fcd880b011560de WatchSource:0}: Error finding container d5408f873f5b37b77041c40728d4dcb1077260e06a96b73a1fcd880b011560de: Status 404 returned error can't find the container with id d5408f873f5b37b77041c40728d4dcb1077260e06a96b73a1fcd880b011560de Jun 11 19:58:30.071236 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:30.071203 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lb5qs" Jun 11 19:58:30.079351 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:30.079330 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-648xp" Jun 11 19:58:30.080515 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:30.080491 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad153657_154e_4342_b701_95873f67a210.slice/crio-5aa3ac0eb84036fc0e4baa2e0e8b4ccadacb5cbed6529f1264c361f6c7045f32 WatchSource:0}: Error finding container 5aa3ac0eb84036fc0e4baa2e0e8b4ccadacb5cbed6529f1264c361f6c7045f32: Status 404 returned error can't find the container with id 5aa3ac0eb84036fc0e4baa2e0e8b4ccadacb5cbed6529f1264c361f6c7045f32 Jun 11 19:58:30.086508 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:30.086486 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:30.086870 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:30.086845 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b6c5b1c_65de_4fe3_9ccd_9c2996176ccb.slice/crio-caa8566809ea5a3348671dc198906c5cff7995a6ed93570dcdfa90dc53edd19d WatchSource:0}: Error finding container caa8566809ea5a3348671dc198906c5cff7995a6ed93570dcdfa90dc53edd19d: Status 404 returned error can't find the container with id caa8566809ea5a3348671dc198906c5cff7995a6ed93570dcdfa90dc53edd19d Jun 11 19:58:30.090903 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:30.090882 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kmglm" Jun 11 19:58:30.094845 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:30.094819 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod653f3438_4943_4656_9b11_e75cdcd5fa9f.slice/crio-6756e41badc0c3a5fa7b98d6bbfbc09b89e11b2b2307efabbbdd88fb4cdf727f WatchSource:0}: Error finding container 6756e41badc0c3a5fa7b98d6bbfbc09b89e11b2b2307efabbbdd88fb4cdf727f: Status 404 returned error can't find the container with id 6756e41badc0c3a5fa7b98d6bbfbc09b89e11b2b2307efabbbdd88fb4cdf727f Jun 11 19:58:30.098624 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:58:30.098604 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd54eee6b_cdd3_4244_b5e0_75aae0dcea62.slice/crio-770eb0172a63b29e5cbf18ca4ac2a361d0e70b5d83932235f6cc8ccaa419195e WatchSource:0}: Error finding container 770eb0172a63b29e5cbf18ca4ac2a361d0e70b5d83932235f6cc8ccaa419195e: Status 404 returned error can't find the container with id 770eb0172a63b29e5cbf18ca4ac2a361d0e70b5d83932235f6cc8ccaa419195e Jun 11 19:58:30.279707 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:30.279610 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dcc3087e-d6a7-4ec1-b911-8bf96a4319d2-metrics-certs\") pod \"network-metrics-daemon-k98nz\" (UID: \"dcc3087e-d6a7-4ec1-b911-8bf96a4319d2\") " pod="openshift-multus/network-metrics-daemon-k98nz" Jun 11 19:58:30.279853 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:30.279750 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:58:30.279853 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:30.279813 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcc3087e-d6a7-4ec1-b911-8bf96a4319d2-metrics-certs podName:dcc3087e-d6a7-4ec1-b911-8bf96a4319d2 nodeName:}" failed. No retries permitted until 2026-06-11 19:58:31.279796393 +0000 UTC m=+3.010958350 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dcc3087e-d6a7-4ec1-b911-8bf96a4319d2-metrics-certs") pod "network-metrics-daemon-k98nz" (UID: "dcc3087e-d6a7-4ec1-b911-8bf96a4319d2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:58:30.380419 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:30.380358 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebe82df4-c733-4be3-924b-3f32111102b7-original-pull-secret\") pod \"global-pull-secret-syncer-g9g8h\" (UID: \"ebe82df4-c733-4be3-924b-3f32111102b7\") " pod="kube-system/global-pull-secret-syncer-g9g8h" Jun 11 19:58:30.380554 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:30.380438 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhjd8\" (UniqueName: \"kubernetes.io/projected/ffbc3051-b38e-43f1-8092-dc1ac0109cd3-kube-api-access-qhjd8\") pod \"network-check-target-n6qj6\" (UID: \"ffbc3051-b38e-43f1-8092-dc1ac0109cd3\") " pod="openshift-network-diagnostics/network-check-target-n6qj6" Jun 11 19:58:30.380667 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:30.380601 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:58:30.380667 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:30.380624 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:58:30.380667 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:30.380638 2562 projected.go:196] Error preparing data for projected volume kube-api-access-qhjd8 for pod openshift-network-diagnostics/network-check-target-n6qj6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:58:30.380837 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:30.380696 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ffbc3051-b38e-43f1-8092-dc1ac0109cd3-kube-api-access-qhjd8 podName:ffbc3051-b38e-43f1-8092-dc1ac0109cd3 nodeName:}" failed. No retries permitted until 2026-06-11 19:58:31.380677493 +0000 UTC m=+3.111839469 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qhjd8" (UniqueName: "kubernetes.io/projected/ffbc3051-b38e-43f1-8092-dc1ac0109cd3-kube-api-access-qhjd8") pod "network-check-target-n6qj6" (UID: "ffbc3051-b38e-43f1-8092-dc1ac0109cd3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:58:30.381111 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:30.381091 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:58:30.381177 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:30.381145 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebe82df4-c733-4be3-924b-3f32111102b7-original-pull-secret podName:ebe82df4-c733-4be3-924b-3f32111102b7 nodeName:}" failed. No retries permitted until 2026-06-11 19:58:31.381130048 +0000 UTC m=+3.112292020 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebe82df4-c733-4be3-924b-3f32111102b7-original-pull-secret") pod "global-pull-secret-syncer-g9g8h" (UID: "ebe82df4-c733-4be3-924b-3f32111102b7") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:58:30.531960 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:30.531752 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:58:30.711766 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:30.711721 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 19:53:29 +0000 UTC" deadline="2027-12-06 14:34:01.073797388 +0000 UTC" Jun 11 19:58:30.711766 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:30.711758 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13026h35m30.362043699s" Jun 11 19:58:30.730737 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:30.730177 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6qj6" Jun 11 19:58:30.730737 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:30.730307 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6qj6" podUID="ffbc3051-b38e-43f1-8092-dc1ac0109cd3" Jun 11 19:58:30.756501 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:30.756435 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-142.ec2.internal" event={"ID":"4cc4cacf13e921090a70062cceab74d3","Type":"ContainerStarted","Data":"c0acb5a26c15c056737e3a9bb127bd512388de74bda21c10e3807856d7dc33aa"} Jun 11 19:58:30.761838 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:30.761798 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kmglm" event={"ID":"d54eee6b-cdd3-4244-b5e0-75aae0dcea62","Type":"ContainerStarted","Data":"770eb0172a63b29e5cbf18ca4ac2a361d0e70b5d83932235f6cc8ccaa419195e"} Jun 11 19:58:30.779145 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:30.779110 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" event={"ID":"653f3438-4943-4656-9b11-e75cdcd5fa9f","Type":"ContainerStarted","Data":"6756e41badc0c3a5fa7b98d6bbfbc09b89e11b2b2307efabbbdd88fb4cdf727f"} Jun 11 19:58:30.791032 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:30.790850 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4k7kz" event={"ID":"c76c354d-881c-4879-b7f6-9d9ddc209100","Type":"ContainerStarted","Data":"bc5cd9eba371dac3dab821bd802a8beff596748023f51a86506ccc998704a20f"} Jun 11 19:58:30.800387 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:30.800337 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pdqc7" event={"ID":"6fbe6cf6-0970-4e06-919f-081f1240fd53","Type":"ContainerStarted","Data":"bc62a5de6a6c052ce8e089f2501111ffbbaed8b3caa6bcd3cade98cf8dec343b"} Jun 11 19:58:30.813232 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:30.813186 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-648xp" event={"ID":"1b6c5b1c-65de-4fe3-9ccd-9c2996176ccb","Type":"ContainerStarted","Data":"caa8566809ea5a3348671dc198906c5cff7995a6ed93570dcdfa90dc53edd19d"} Jun 11 19:58:30.819188 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:30.819152 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lb5qs" event={"ID":"ad153657-154e-4342-b701-95873f67a210","Type":"ContainerStarted","Data":"5aa3ac0eb84036fc0e4baa2e0e8b4ccadacb5cbed6529f1264c361f6c7045f32"} Jun 11 19:58:30.829429 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:30.829323 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-588lm" event={"ID":"276fbaef-fe1a-48d5-a683-6cba382611f8","Type":"ContainerStarted","Data":"d5408f873f5b37b77041c40728d4dcb1077260e06a96b73a1fcd880b011560de"} Jun 11 19:58:30.843317 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:30.843289 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zjv5h" event={"ID":"2eeabcc2-717f-4bb3-92c0-db55b02864cb","Type":"ContainerStarted","Data":"0bc4570be6593fe08edff9551d4043b39343baf8c577a81a7dd1195c552407b3"} Jun 11 19:58:30.870057 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:30.870021 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2sgx" event={"ID":"1df140d0-b0a6-469d-bdc3-95111fffcd7f","Type":"ContainerStarted","Data":"b3cd2884330716fc037b122e7db1ee0febf3f7d15030fbbff53e1b9e9a4d3eeb"} Jun 11 19:58:30.879965 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:30.879874 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-142.ec2.internal" event={"ID":"d4265531fa51f38220398935b4c5d991","Type":"ContainerStarted","Data":"fc2559a7e3cc89735ba914967150d2204ff9089b48db936ac0d153397b5c73f4"} Jun 11 19:58:31.287064 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:31.286978 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dcc3087e-d6a7-4ec1-b911-8bf96a4319d2-metrics-certs\") pod \"network-metrics-daemon-k98nz\" (UID: \"dcc3087e-d6a7-4ec1-b911-8bf96a4319d2\") " pod="openshift-multus/network-metrics-daemon-k98nz" Jun 11 19:58:31.287226 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:31.287159 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:58:31.287226 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:31.287223 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcc3087e-d6a7-4ec1-b911-8bf96a4319d2-metrics-certs podName:dcc3087e-d6a7-4ec1-b911-8bf96a4319d2 nodeName:}" failed. No retries permitted until 2026-06-11 19:58:33.287206105 +0000 UTC m=+5.018368061 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dcc3087e-d6a7-4ec1-b911-8bf96a4319d2-metrics-certs") pod "network-metrics-daemon-k98nz" (UID: "dcc3087e-d6a7-4ec1-b911-8bf96a4319d2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:58:31.387966 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:31.387913 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebe82df4-c733-4be3-924b-3f32111102b7-original-pull-secret\") pod \"global-pull-secret-syncer-g9g8h\" (UID: \"ebe82df4-c733-4be3-924b-3f32111102b7\") " pod="kube-system/global-pull-secret-syncer-g9g8h" Jun 11 19:58:31.387966 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:31.387966 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhjd8\" (UniqueName: \"kubernetes.io/projected/ffbc3051-b38e-43f1-8092-dc1ac0109cd3-kube-api-access-qhjd8\") pod \"network-check-target-n6qj6\" (UID: \"ffbc3051-b38e-43f1-8092-dc1ac0109cd3\") " pod="openshift-network-diagnostics/network-check-target-n6qj6" Jun 11 19:58:31.388205 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:31.388115 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:58:31.388205 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:31.388134 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:58:31.388205 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:31.388148 2562 projected.go:196] Error preparing data for projected volume kube-api-access-qhjd8 for pod openshift-network-diagnostics/network-check-target-n6qj6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:58:31.388346 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:31.388206 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ffbc3051-b38e-43f1-8092-dc1ac0109cd3-kube-api-access-qhjd8 podName:ffbc3051-b38e-43f1-8092-dc1ac0109cd3 nodeName:}" failed. No retries permitted until 2026-06-11 19:58:33.388188604 +0000 UTC m=+5.119350561 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qhjd8" (UniqueName: "kubernetes.io/projected/ffbc3051-b38e-43f1-8092-dc1ac0109cd3-kube-api-access-qhjd8") pod "network-check-target-n6qj6" (UID: "ffbc3051-b38e-43f1-8092-dc1ac0109cd3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:58:31.388625 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:31.388605 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:58:31.388705 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:31.388664 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebe82df4-c733-4be3-924b-3f32111102b7-original-pull-secret podName:ebe82df4-c733-4be3-924b-3f32111102b7 nodeName:}" failed. No retries permitted until 2026-06-11 19:58:33.388648557 +0000 UTC m=+5.119810515 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebe82df4-c733-4be3-924b-3f32111102b7-original-pull-secret") pod "global-pull-secret-syncer-g9g8h" (UID: "ebe82df4-c733-4be3-924b-3f32111102b7") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:58:31.712510 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:31.712397 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 19:53:29 +0000 UTC" deadline="2028-02-13 06:49:33.905495594 +0000 UTC" Jun 11 19:58:31.712510 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:31.712463 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14674h51m2.193037654s" Jun 11 19:58:31.729762 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:31.729731 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g8h" Jun 11 19:58:31.729928 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:31.729868 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9g8h" podUID="ebe82df4-c733-4be3-924b-3f32111102b7" Jun 11 19:58:31.730282 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:31.730261 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k98nz" Jun 11 19:58:31.730421 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:31.730389 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k98nz" podUID="dcc3087e-d6a7-4ec1-b911-8bf96a4319d2" Jun 11 19:58:32.732338 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:32.731687 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6qj6" Jun 11 19:58:32.732338 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:32.731815 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6qj6" podUID="ffbc3051-b38e-43f1-8092-dc1ac0109cd3" Jun 11 19:58:33.306524 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:33.306480 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dcc3087e-d6a7-4ec1-b911-8bf96a4319d2-metrics-certs\") pod \"network-metrics-daemon-k98nz\" (UID: \"dcc3087e-d6a7-4ec1-b911-8bf96a4319d2\") " pod="openshift-multus/network-metrics-daemon-k98nz" Jun 11 19:58:33.306732 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:33.306713 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:58:33.306799 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:33.306785 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcc3087e-d6a7-4ec1-b911-8bf96a4319d2-metrics-certs podName:dcc3087e-d6a7-4ec1-b911-8bf96a4319d2 nodeName:}" failed. No retries permitted until 2026-06-11 19:58:37.306766849 +0000 UTC m=+9.037928805 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dcc3087e-d6a7-4ec1-b911-8bf96a4319d2-metrics-certs") pod "network-metrics-daemon-k98nz" (UID: "dcc3087e-d6a7-4ec1-b911-8bf96a4319d2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:58:33.408034 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:33.407582 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebe82df4-c733-4be3-924b-3f32111102b7-original-pull-secret\") pod \"global-pull-secret-syncer-g9g8h\" (UID: \"ebe82df4-c733-4be3-924b-3f32111102b7\") " pod="kube-system/global-pull-secret-syncer-g9g8h" Jun 11 19:58:33.408034 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:33.407637 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhjd8\" (UniqueName: \"kubernetes.io/projected/ffbc3051-b38e-43f1-8092-dc1ac0109cd3-kube-api-access-qhjd8\") pod \"network-check-target-n6qj6\" (UID: \"ffbc3051-b38e-43f1-8092-dc1ac0109cd3\") " pod="openshift-network-diagnostics/network-check-target-n6qj6" Jun 11 19:58:33.408034 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:33.407795 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:58:33.408034 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:33.407814 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:58:33.408034 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:33.407828 2562 projected.go:196] Error preparing data for projected volume kube-api-access-qhjd8 for pod openshift-network-diagnostics/network-check-target-n6qj6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:58:33.408034 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:33.407886 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ffbc3051-b38e-43f1-8092-dc1ac0109cd3-kube-api-access-qhjd8 podName:ffbc3051-b38e-43f1-8092-dc1ac0109cd3 nodeName:}" failed. No retries permitted until 2026-06-11 19:58:37.407866721 +0000 UTC m=+9.139028678 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qhjd8" (UniqueName: "kubernetes.io/projected/ffbc3051-b38e-43f1-8092-dc1ac0109cd3-kube-api-access-qhjd8") pod "network-check-target-n6qj6" (UID: "ffbc3051-b38e-43f1-8092-dc1ac0109cd3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:58:33.408034 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:33.407959 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:58:33.408034 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:33.407991 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebe82df4-c733-4be3-924b-3f32111102b7-original-pull-secret podName:ebe82df4-c733-4be3-924b-3f32111102b7 nodeName:}" failed. No retries permitted until 2026-06-11 19:58:37.407979927 +0000 UTC m=+9.139141879 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebe82df4-c733-4be3-924b-3f32111102b7-original-pull-secret") pod "global-pull-secret-syncer-g9g8h" (UID: "ebe82df4-c733-4be3-924b-3f32111102b7") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:58:33.729058 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:33.729024 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g8h" Jun 11 19:58:33.729244 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:33.729163 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9g8h" podUID="ebe82df4-c733-4be3-924b-3f32111102b7" Jun 11 19:58:33.729623 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:33.729569 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k98nz" Jun 11 19:58:33.729705 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:33.729683 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k98nz" podUID="dcc3087e-d6a7-4ec1-b911-8bf96a4319d2" Jun 11 19:58:34.730991 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:34.730952 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6qj6" Jun 11 19:58:34.731480 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:34.731061 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6qj6" podUID="ffbc3051-b38e-43f1-8092-dc1ac0109cd3" Jun 11 19:58:35.729339 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:35.729307 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g8h" Jun 11 19:58:35.729532 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:35.729481 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9g8h" podUID="ebe82df4-c733-4be3-924b-3f32111102b7" Jun 11 19:58:35.729598 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:35.729541 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k98nz" Jun 11 19:58:35.729684 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:35.729658 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k98nz" podUID="dcc3087e-d6a7-4ec1-b911-8bf96a4319d2" Jun 11 19:58:36.729553 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:36.729080 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6qj6" Jun 11 19:58:36.729553 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:36.729185 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6qj6" podUID="ffbc3051-b38e-43f1-8092-dc1ac0109cd3" Jun 11 19:58:37.342454 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:37.342412 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dcc3087e-d6a7-4ec1-b911-8bf96a4319d2-metrics-certs\") pod \"network-metrics-daemon-k98nz\" (UID: \"dcc3087e-d6a7-4ec1-b911-8bf96a4319d2\") " pod="openshift-multus/network-metrics-daemon-k98nz" Jun 11 19:58:37.342645 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:37.342550 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:58:37.342645 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:37.342621 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcc3087e-d6a7-4ec1-b911-8bf96a4319d2-metrics-certs podName:dcc3087e-d6a7-4ec1-b911-8bf96a4319d2 nodeName:}" failed. No retries permitted until 2026-06-11 19:58:45.34260193 +0000 UTC m=+17.073763900 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dcc3087e-d6a7-4ec1-b911-8bf96a4319d2-metrics-certs") pod "network-metrics-daemon-k98nz" (UID: "dcc3087e-d6a7-4ec1-b911-8bf96a4319d2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:58:37.443033 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:37.442992 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebe82df4-c733-4be3-924b-3f32111102b7-original-pull-secret\") pod \"global-pull-secret-syncer-g9g8h\" (UID: \"ebe82df4-c733-4be3-924b-3f32111102b7\") " pod="kube-system/global-pull-secret-syncer-g9g8h" Jun 11 19:58:37.443218 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:37.443045 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhjd8\" (UniqueName: \"kubernetes.io/projected/ffbc3051-b38e-43f1-8092-dc1ac0109cd3-kube-api-access-qhjd8\") pod \"network-check-target-n6qj6\" (UID: \"ffbc3051-b38e-43f1-8092-dc1ac0109cd3\") " pod="openshift-network-diagnostics/network-check-target-n6qj6" Jun 11 19:58:37.443218 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:37.443203 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:58:37.443318 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:37.443224 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:58:37.443318 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:37.443236 2562 projected.go:196] Error preparing data for projected volume kube-api-access-qhjd8 for pod openshift-network-diagnostics/network-check-target-n6qj6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:58:37.443318 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:37.443300 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ffbc3051-b38e-43f1-8092-dc1ac0109cd3-kube-api-access-qhjd8 podName:ffbc3051-b38e-43f1-8092-dc1ac0109cd3 nodeName:}" failed. No retries permitted until 2026-06-11 19:58:45.443287534 +0000 UTC m=+17.174449486 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qhjd8" (UniqueName: "kubernetes.io/projected/ffbc3051-b38e-43f1-8092-dc1ac0109cd3-kube-api-access-qhjd8") pod "network-check-target-n6qj6" (UID: "ffbc3051-b38e-43f1-8092-dc1ac0109cd3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:58:37.443653 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:37.443637 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:58:37.443706 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:37.443679 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebe82df4-c733-4be3-924b-3f32111102b7-original-pull-secret podName:ebe82df4-c733-4be3-924b-3f32111102b7 nodeName:}" failed. No retries permitted until 2026-06-11 19:58:45.443668803 +0000 UTC m=+17.174830756 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebe82df4-c733-4be3-924b-3f32111102b7-original-pull-secret") pod "global-pull-secret-syncer-g9g8h" (UID: "ebe82df4-c733-4be3-924b-3f32111102b7") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:58:37.729881 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:37.729800 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g8h" Jun 11 19:58:37.730314 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:37.729944 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9g8h" podUID="ebe82df4-c733-4be3-924b-3f32111102b7" Jun 11 19:58:37.730314 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:37.730301 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k98nz" Jun 11 19:58:37.730449 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:37.730407 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k98nz" podUID="dcc3087e-d6a7-4ec1-b911-8bf96a4319d2" Jun 11 19:58:38.730081 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:38.729698 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6qj6" Jun 11 19:58:38.730081 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:38.729804 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6qj6" podUID="ffbc3051-b38e-43f1-8092-dc1ac0109cd3" Jun 11 19:58:39.733569 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:39.729732 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g8h" Jun 11 19:58:39.733569 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:39.729742 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k98nz" Jun 11 19:58:39.733569 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:39.729868 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9g8h" podUID="ebe82df4-c733-4be3-924b-3f32111102b7" Jun 11 19:58:39.733569 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:39.729941 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k98nz" podUID="dcc3087e-d6a7-4ec1-b911-8bf96a4319d2" Jun 11 19:58:40.729754 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:40.729712 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6qj6" Jun 11 19:58:40.729917 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:40.729846 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6qj6" podUID="ffbc3051-b38e-43f1-8092-dc1ac0109cd3" Jun 11 19:58:41.729560 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:41.729528 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k98nz" Jun 11 19:58:41.729933 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:41.729528 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g8h" Jun 11 19:58:41.729933 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:41.729645 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k98nz" podUID="dcc3087e-d6a7-4ec1-b911-8bf96a4319d2" Jun 11 19:58:41.729933 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:41.729698 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9g8h" podUID="ebe82df4-c733-4be3-924b-3f32111102b7" Jun 11 19:58:42.729270 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:42.729224 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6qj6" Jun 11 19:58:42.729510 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:42.729370 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6qj6" podUID="ffbc3051-b38e-43f1-8092-dc1ac0109cd3" Jun 11 19:58:43.729474 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:43.729438 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g8h" Jun 11 19:58:43.730027 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:43.729446 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k98nz" Jun 11 19:58:43.730027 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:43.729576 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9g8h" podUID="ebe82df4-c733-4be3-924b-3f32111102b7" Jun 11 19:58:43.730027 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:43.729662 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k98nz" podUID="dcc3087e-d6a7-4ec1-b911-8bf96a4319d2" Jun 11 19:58:44.732243 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:44.732214 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6qj6" Jun 11 19:58:44.732642 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:44.732317 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6qj6" podUID="ffbc3051-b38e-43f1-8092-dc1ac0109cd3" Jun 11 19:58:45.400272 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:45.400232 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dcc3087e-d6a7-4ec1-b911-8bf96a4319d2-metrics-certs\") pod \"network-metrics-daemon-k98nz\" (UID: \"dcc3087e-d6a7-4ec1-b911-8bf96a4319d2\") " pod="openshift-multus/network-metrics-daemon-k98nz" Jun 11 19:58:45.400553 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:45.400415 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:58:45.400553 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:45.400502 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcc3087e-d6a7-4ec1-b911-8bf96a4319d2-metrics-certs podName:dcc3087e-d6a7-4ec1-b911-8bf96a4319d2 nodeName:}" failed. No retries permitted until 2026-06-11 19:59:01.400479435 +0000 UTC m=+33.131641405 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dcc3087e-d6a7-4ec1-b911-8bf96a4319d2-metrics-certs") pod "network-metrics-daemon-k98nz" (UID: "dcc3087e-d6a7-4ec1-b911-8bf96a4319d2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:58:45.500823 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:45.500781 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebe82df4-c733-4be3-924b-3f32111102b7-original-pull-secret\") pod \"global-pull-secret-syncer-g9g8h\" (UID: \"ebe82df4-c733-4be3-924b-3f32111102b7\") " pod="kube-system/global-pull-secret-syncer-g9g8h" Jun 11 19:58:45.501013 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:45.500833 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhjd8\" (UniqueName: \"kubernetes.io/projected/ffbc3051-b38e-43f1-8092-dc1ac0109cd3-kube-api-access-qhjd8\") pod \"network-check-target-n6qj6\" (UID: \"ffbc3051-b38e-43f1-8092-dc1ac0109cd3\") " pod="openshift-network-diagnostics/network-check-target-n6qj6" Jun 11 19:58:45.501013 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:45.500938 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:58:45.501013 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:45.500961 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:58:45.501013 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:45.500978 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:58:45.501013 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:45.500990 2562 projected.go:196] Error preparing data for projected volume kube-api-access-qhjd8 for pod openshift-network-diagnostics/network-check-target-n6qj6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:58:45.501013 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:45.501009 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebe82df4-c733-4be3-924b-3f32111102b7-original-pull-secret podName:ebe82df4-c733-4be3-924b-3f32111102b7 nodeName:}" failed. No retries permitted until 2026-06-11 19:59:01.500994884 +0000 UTC m=+33.232156836 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebe82df4-c733-4be3-924b-3f32111102b7-original-pull-secret") pod "global-pull-secret-syncer-g9g8h" (UID: "ebe82df4-c733-4be3-924b-3f32111102b7") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:58:45.501246 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:45.501035 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ffbc3051-b38e-43f1-8092-dc1ac0109cd3-kube-api-access-qhjd8 podName:ffbc3051-b38e-43f1-8092-dc1ac0109cd3 nodeName:}" failed. No retries permitted until 2026-06-11 19:59:01.501021217 +0000 UTC m=+33.232183186 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qhjd8" (UniqueName: "kubernetes.io/projected/ffbc3051-b38e-43f1-8092-dc1ac0109cd3-kube-api-access-qhjd8") pod "network-check-target-n6qj6" (UID: "ffbc3051-b38e-43f1-8092-dc1ac0109cd3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:58:45.729426 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:45.729395 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g8h" Jun 11 19:58:45.729590 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:45.729403 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k98nz" Jun 11 19:58:45.729590 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:45.729505 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9g8h" podUID="ebe82df4-c733-4be3-924b-3f32111102b7" Jun 11 19:58:45.729686 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:45.729601 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k98nz" podUID="dcc3087e-d6a7-4ec1-b911-8bf96a4319d2" Jun 11 19:58:46.732270 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:46.732241 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6qj6" Jun 11 19:58:46.732721 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:46.732361 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6qj6" podUID="ffbc3051-b38e-43f1-8092-dc1ac0109cd3" Jun 11 19:58:47.729813 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:47.729775 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g8h" Jun 11 19:58:47.729966 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:47.729784 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k98nz" Jun 11 19:58:47.729966 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:47.729896 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9g8h" podUID="ebe82df4-c733-4be3-924b-3f32111102b7" Jun 11 19:58:47.730050 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:47.729988 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k98nz" podUID="dcc3087e-d6a7-4ec1-b911-8bf96a4319d2" Jun 11 19:58:48.730598 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:48.730275 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6qj6" Jun 11 19:58:48.731071 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:48.730695 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6qj6" podUID="ffbc3051-b38e-43f1-8092-dc1ac0109cd3" Jun 11 19:58:49.729814 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:49.729728 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k98nz" Jun 11 19:58:49.729989 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:49.729742 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g8h" Jun 11 19:58:49.729989 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:49.729873 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k98nz" podUID="dcc3087e-d6a7-4ec1-b911-8bf96a4319d2" Jun 11 19:58:49.730094 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:49.729988 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9g8h" podUID="ebe82df4-c733-4be3-924b-3f32111102b7" Jun 11 19:58:50.731895 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:50.730747 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6qj6" Jun 11 19:58:50.731895 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:50.730962 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6qj6" podUID="ffbc3051-b38e-43f1-8092-dc1ac0109cd3" Jun 11 19:58:50.930637 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:50.930602 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kmglm" event={"ID":"d54eee6b-cdd3-4244-b5e0-75aae0dcea62","Type":"ContainerStarted","Data":"86c7c2d84424922d64dbe176bc55515cce4c728584bdce55697a49a58e1ed961"} Jun 11 19:58:50.935229 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:50.935203 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" event={"ID":"653f3438-4943-4656-9b11-e75cdcd5fa9f","Type":"ContainerStarted","Data":"33b09414493a86e97fc3975e8f5e8382e654d4cb385a6a733260cb671d8ef4a3"} Jun 11 19:58:50.935316 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:50.935295 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" event={"ID":"653f3438-4943-4656-9b11-e75cdcd5fa9f","Type":"ContainerStarted","Data":"7520d3627f1f91cac3cddd0ab4b07cc6121cf7906e233e74d7fb05fe58822896"} Jun 11 19:58:50.935360 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:50.935350 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" event={"ID":"653f3438-4943-4656-9b11-e75cdcd5fa9f","Type":"ContainerStarted","Data":"ac748cb2b4f46eb8f15e3fb72be645d6f5586dab14891530fce9b2519881d38d"} Jun 11 19:58:50.935446 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:50.935432 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" event={"ID":"653f3438-4943-4656-9b11-e75cdcd5fa9f","Type":"ContainerStarted","Data":"e79d3ada36ad49bb9899af1e9594b54ca52554f2a51ea27348299b4949abd55c"} Jun 11 19:58:50.938182 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:50.938128 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pdqc7" event={"ID":"6fbe6cf6-0970-4e06-919f-081f1240fd53","Type":"ContainerStarted","Data":"cb9636dab7392f9fce0f101ce8dc5d1499aa1ecbf97eca5fc3d3fe42dd42609b"} Jun 11 19:58:50.939431 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:50.939410 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-142.ec2.internal" event={"ID":"d4265531fa51f38220398935b4c5d991","Type":"ContainerStarted","Data":"3cd80bf2d2bc5c025b240619ecf57af4d239c4d8b70c4b2fe565c366bdf83a59"} Jun 11 19:58:50.947848 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:50.947798 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kmglm" podStartSLOduration=1.771555381 podStartE2EDuration="21.947785831s" totalImagesPullingTime="20.17623045s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:58:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:58:50.94727662 +0000 UTC m=+22.678438595" watchObservedRunningTime="2026-06-11 19:58:50.947785831 +0000 UTC m=+22.678947805" Jun 11 19:58:50.970729 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:50.970684 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pdqc7" podStartSLOduration=2.627767253 podStartE2EDuration="22.970671614s" totalImagesPullingTime="20.342904361s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:58:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:58:50.970195355 +0000 UTC m=+22.701357331" watchObservedRunningTime="2026-06-11 19:58:50.970671614 +0000 UTC m=+22.701833589" Jun 11 19:58:50.992121 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:50.992076 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-142.ec2.internal" podStartSLOduration=21.992059449 podStartE2EDuration="21.992059449s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:58:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:58:50.991798754 +0000 UTC m=+22.722960731" watchObservedRunningTime="2026-06-11 19:58:50.992059449 +0000 UTC m=+22.723221424" Jun 11 19:58:51.729814 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:51.729599 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g8h" Jun 11 19:58:51.730036 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:51.729681 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k98nz" Jun 11 19:58:51.730036 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:51.729952 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9g8h" podUID="ebe82df4-c733-4be3-924b-3f32111102b7" Jun 11 19:58:51.730125 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:51.730084 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k98nz" podUID="dcc3087e-d6a7-4ec1-b911-8bf96a4319d2" Jun 11 19:58:51.945906 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:51.945749 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" event={"ID":"653f3438-4943-4656-9b11-e75cdcd5fa9f","Type":"ContainerStarted","Data":"8ee55cd633cf047beed5ef0eaaf5d824b3c3384c80f45066fb443c87e08ea008"} Jun 11 19:58:51.945906 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:51.945853 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" event={"ID":"653f3438-4943-4656-9b11-e75cdcd5fa9f","Type":"ContainerStarted","Data":"5f7650d7c14ea3b763076ca218fc1c5fda2b6f9b2f6a96c52014f79f116100b0"} Jun 11 19:58:51.947504 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:51.947471 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4k7kz" event={"ID":"c76c354d-881c-4879-b7f6-9d9ddc209100","Type":"ContainerStarted","Data":"5f6ceb9c4acaa8e359e833d1f1fe74c15ac36bc559d075ba1bcbbac3e3383229"} Jun 11 19:58:51.949258 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:51.949226 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-648xp" event={"ID":"1b6c5b1c-65de-4fe3-9ccd-9c2996176ccb","Type":"ContainerStarted","Data":"50a907b48f296b83f693b90052bb46be0295cb56ed35af4df69487899c72a0ba"} Jun 11 19:58:51.951166 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:51.951110 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lb5qs" event={"ID":"ad153657-154e-4342-b701-95873f67a210","Type":"ContainerStarted","Data":"cd446b9cf4508c912fa324b28d0ef345e2f7e4b51371274b54ff29ddb35b4389"} Jun 11 19:58:51.952871 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:51.952837 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-588lm" event={"ID":"276fbaef-fe1a-48d5-a683-6cba382611f8","Type":"ContainerStarted","Data":"885e2d16e291ddab6abbcb155e7881ac9b9ad1eb23dcd41a04d91cde03b5c665"} Jun 11 19:58:51.954879 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:51.954849 2562 generic.go:356] "Generic (PLEG): container finished" podID="2eeabcc2-717f-4bb3-92c0-db55b02864cb" containerID="8ee6c7af5c998915569487d8d712a98e06ad34a2ffbc33787b02f5be23fbacdc" exitCode=0 Jun 11 19:58:51.954982 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:51.954936 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zjv5h" event={"ID":"2eeabcc2-717f-4bb3-92c0-db55b02864cb","Type":"ContainerDied","Data":"8ee6c7af5c998915569487d8d712a98e06ad34a2ffbc33787b02f5be23fbacdc"} Jun 11 19:58:51.957043 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:51.957016 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2sgx" event={"ID":"1df140d0-b0a6-469d-bdc3-95111fffcd7f","Type":"ContainerStarted","Data":"c4151f9797e53e5615cf58ead5fcd174168c35d1729f5a4c13dc91276b40f609"} Jun 11 19:58:51.959498 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:51.959478 2562 generic.go:356] "Generic (PLEG): container finished" podID="4cc4cacf13e921090a70062cceab74d3" containerID="37c1b05fa8006f64a5bd1ac5a27d9240ec450cb845ff4de15c9ca3b8ddf605c1" exitCode=0 Jun 11 19:58:51.959588 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:51.959568 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-142.ec2.internal" event={"ID":"4cc4cacf13e921090a70062cceab74d3","Type":"ContainerDied","Data":"37c1b05fa8006f64a5bd1ac5a27d9240ec450cb845ff4de15c9ca3b8ddf605c1"} Jun 11 19:58:51.962390 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:51.962313 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4k7kz" podStartSLOduration=3.684977221 podStartE2EDuration="23.962294456s" totalImagesPullingTime="20.277317235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:58:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:58:51.961188711 +0000 UTC m=+23.692350714" watchObservedRunningTime="2026-06-11 19:58:51.962294456 +0000 UTC m=+23.693456432" Jun 11 19:58:52.006117 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:52.006059 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-588lm" podStartSLOduration=2.760666817 podStartE2EDuration="23.006043243s" totalImagesPullingTime="20.245376426s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:58:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:58:52.00553223 +0000 UTC m=+23.736694205" watchObservedRunningTime="2026-06-11 19:58:52.006043243 +0000 UTC m=+23.737205217" Jun 11 19:58:52.020612 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:52.020560 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lb5qs" podStartSLOduration=2.7857103370000003 podStartE2EDuration="23.020540133s" totalImagesPullingTime="20.234829796s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:58:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:58:52.020083248 +0000 UTC m=+23.751245222" watchObservedRunningTime="2026-06-11 19:58:52.020540133 +0000 UTC m=+23.751702108" Jun 11 19:58:52.032867 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:52.032818 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-648xp" podStartSLOduration=2.806671543 podStartE2EDuration="23.032801545s" totalImagesPullingTime="20.226130002s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:58:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:58:52.032720989 +0000 UTC m=+23.763882964" watchObservedRunningTime="2026-06-11 19:58:52.032801545 +0000 UTC m=+23.763963525" Jun 11 19:58:52.469313 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:52.469286 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 19:58:52.732399 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:52.731410 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T19:58:52.469306529Z","UUID":"533a942b-bdbc-4fe7-b643-6137943f4b0c","Handler":null,"Name":"","Endpoint":""} Jun 11 19:58:52.733146 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:52.733115 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 19:58:52.733289 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:52.733180 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 19:58:52.734393 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:52.734345 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6qj6" Jun 11 19:58:52.734516 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:52.734475 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6qj6" podUID="ffbc3051-b38e-43f1-8092-dc1ac0109cd3" Jun 11 19:58:52.964009 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:52.963965 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2sgx" event={"ID":"1df140d0-b0a6-469d-bdc3-95111fffcd7f","Type":"ContainerStarted","Data":"27147821c4d5af79762cc85cec5f9f1e6cc37303ad501da0145b27b18fc849d2"} Jun 11 19:58:52.966044 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:52.966005 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-142.ec2.internal" event={"ID":"4cc4cacf13e921090a70062cceab74d3","Type":"ContainerStarted","Data":"3a7f3e0a747ccc4d22d7853d733991cb9c533ac6199b6daec9be6b82c1491f21"} Jun 11 19:58:52.985226 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:52.985131 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-142.ec2.internal" podStartSLOduration=23.985116756 podStartE2EDuration="23.985116756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:58:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:58:52.984794816 +0000 UTC m=+24.715956792" watchObservedRunningTime="2026-06-11 19:58:52.985116756 +0000 UTC m=+24.716278730" Jun 11 19:58:53.696676 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:53.696643 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4k7kz" Jun 11 19:58:53.697425 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:53.697398 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4k7kz" Jun 11 19:58:53.729095 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:53.729018 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g8h" Jun 11 19:58:53.729235 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:53.729136 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9g8h" podUID="ebe82df4-c733-4be3-924b-3f32111102b7" Jun 11 19:58:53.729235 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:53.729183 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k98nz" Jun 11 19:58:53.729344 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:53.729314 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k98nz" podUID="dcc3087e-d6a7-4ec1-b911-8bf96a4319d2" Jun 11 19:58:53.970458 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:53.970417 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2sgx" event={"ID":"1df140d0-b0a6-469d-bdc3-95111fffcd7f","Type":"ContainerStarted","Data":"981cf936e09007129245cfac941ba7dd2de24c4b6826c8106a8e3395ade6dca2"} Jun 11 19:58:53.974571 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:53.974101 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" event={"ID":"653f3438-4943-4656-9b11-e75cdcd5fa9f","Type":"ContainerStarted","Data":"9ae59df6f926709966917a64b70dfbf5377b9face221cc2b9bf7848d6b607916"} Jun 11 19:58:53.974571 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:53.974512 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4k7kz" Jun 11 19:58:53.975008 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:53.974991 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4k7kz" Jun 11 19:58:53.987565 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:53.987478 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2sgx" podStartSLOduration=3.169107021 podStartE2EDuration="25.987451392s" totalImagesPullingTime="22.818344371s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:58:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:58:53.987345722 +0000 UTC m=+25.718507697" watchObservedRunningTime="2026-06-11 19:58:53.987451392 +0000 UTC m=+25.718613367" Jun 11 19:58:54.732328 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:54.732301 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6qj6" Jun 11 19:58:54.732536 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:54.732421 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6qj6" podUID="ffbc3051-b38e-43f1-8092-dc1ac0109cd3" Jun 11 19:58:55.729431 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:55.729367 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g8h" Jun 11 19:58:55.729805 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:55.729409 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k98nz" Jun 11 19:58:55.729805 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:55.729534 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9g8h" podUID="ebe82df4-c733-4be3-924b-3f32111102b7" Jun 11 19:58:55.729805 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:55.729619 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k98nz" podUID="dcc3087e-d6a7-4ec1-b911-8bf96a4319d2" Jun 11 19:58:56.732321 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:56.732296 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6qj6" Jun 11 19:58:56.732712 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:56.732405 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6qj6" podUID="ffbc3051-b38e-43f1-8092-dc1ac0109cd3" Jun 11 19:58:56.986795 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:56.986536 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" event={"ID":"653f3438-4943-4656-9b11-e75cdcd5fa9f","Type":"ContainerStarted","Data":"f68598acbcfb96f7acd86858fb973412c4a5c9138db05b8e6f5ccb5392533ace"} Jun 11 19:58:56.986950 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:56.986929 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:56.987062 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:56.987008 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:56.987062 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:56.987058 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:57.006777 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:57.006744 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:57.007812 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:57.007794 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:58:57.089828 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:57.089779 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" podStartSLOduration=7.700194988 podStartE2EDuration="28.089759456s" totalImagesPullingTime="20.389564468s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:58:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:58:57.042414855 +0000 UTC m=+28.773576830" watchObservedRunningTime="2026-06-11 19:58:57.089759456 +0000 UTC m=+28.820921432" Jun 11 19:58:57.729722 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:57.729683 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g8h" Jun 11 19:58:57.729908 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:57.729797 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9g8h" podUID="ebe82df4-c733-4be3-924b-3f32111102b7" Jun 11 19:58:57.729908 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:57.729847 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k98nz" Jun 11 19:58:57.730028 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:57.729951 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k98nz" podUID="dcc3087e-d6a7-4ec1-b911-8bf96a4319d2" Jun 11 19:58:57.992451 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:57.992343 2562 generic.go:356] "Generic (PLEG): container finished" podID="2eeabcc2-717f-4bb3-92c0-db55b02864cb" containerID="13f14e9f0ab64e6d6341f45ea502cd1a2e48f120eb0530da0dd3c021c846b2ee" exitCode=0 Jun 11 19:58:57.993321 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:57.992454 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zjv5h" event={"ID":"2eeabcc2-717f-4bb3-92c0-db55b02864cb","Type":"ContainerDied","Data":"13f14e9f0ab64e6d6341f45ea502cd1a2e48f120eb0530da0dd3c021c846b2ee"} Jun 11 19:58:58.732735 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:58.732706 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6qj6" Jun 11 19:58:58.732973 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:58.732814 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6qj6" podUID="ffbc3051-b38e-43f1-8092-dc1ac0109cd3" Jun 11 19:58:59.197050 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:59.196850 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g9g8h"] Jun 11 19:58:59.197482 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:59.197142 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g8h" Jun 11 19:58:59.197482 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:59.197244 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9g8h" podUID="ebe82df4-c733-4be3-924b-3f32111102b7" Jun 11 19:58:59.201114 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:59.201088 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k98nz"] Jun 11 19:58:59.201264 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:59.201189 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k98nz" Jun 11 19:58:59.201329 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:59.201267 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k98nz" podUID="dcc3087e-d6a7-4ec1-b911-8bf96a4319d2" Jun 11 19:58:59.213478 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:59.213449 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n6qj6"] Jun 11 19:58:59.213638 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:59.213531 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6qj6" Jun 11 19:58:59.213638 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:58:59.213602 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6qj6" podUID="ffbc3051-b38e-43f1-8092-dc1ac0109cd3" Jun 11 19:58:59.998776 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:59.998680 2562 generic.go:356] "Generic (PLEG): container finished" podID="2eeabcc2-717f-4bb3-92c0-db55b02864cb" containerID="645d3e0bc09f2f0cb93133443c4856c8d6cb6c03323098cf70bbe10393e08f7a" exitCode=0 Jun 11 19:58:59.998776 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:58:59.998723 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zjv5h" event={"ID":"2eeabcc2-717f-4bb3-92c0-db55b02864cb","Type":"ContainerDied","Data":"645d3e0bc09f2f0cb93133443c4856c8d6cb6c03323098cf70bbe10393e08f7a"} Jun 11 19:59:00.729844 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:00.729749 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k98nz" Jun 11 19:59:00.729844 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:00.729808 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g8h" Jun 11 19:59:00.730475 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:00.729759 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6qj6" Jun 11 19:59:00.730475 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:00.729893 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k98nz" podUID="dcc3087e-d6a7-4ec1-b911-8bf96a4319d2" Jun 11 19:59:00.730475 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:00.729947 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6qj6" podUID="ffbc3051-b38e-43f1-8092-dc1ac0109cd3" Jun 11 19:59:00.730475 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:00.730016 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9g8h" podUID="ebe82df4-c733-4be3-924b-3f32111102b7" Jun 11 19:59:01.421807 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:01.421774 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dcc3087e-d6a7-4ec1-b911-8bf96a4319d2-metrics-certs\") pod \"network-metrics-daemon-k98nz\" (UID: \"dcc3087e-d6a7-4ec1-b911-8bf96a4319d2\") " pod="openshift-multus/network-metrics-daemon-k98nz" Jun 11 19:59:01.421974 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:01.421939 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:59:01.422039 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:01.422024 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcc3087e-d6a7-4ec1-b911-8bf96a4319d2-metrics-certs podName:dcc3087e-d6a7-4ec1-b911-8bf96a4319d2 nodeName:}" failed. No retries permitted until 2026-06-11 19:59:33.422002068 +0000 UTC m=+65.153164023 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dcc3087e-d6a7-4ec1-b911-8bf96a4319d2-metrics-certs") pod "network-metrics-daemon-k98nz" (UID: "dcc3087e-d6a7-4ec1-b911-8bf96a4319d2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:59:01.522812 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:01.522777 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebe82df4-c733-4be3-924b-3f32111102b7-original-pull-secret\") pod \"global-pull-secret-syncer-g9g8h\" (UID: \"ebe82df4-c733-4be3-924b-3f32111102b7\") " pod="kube-system/global-pull-secret-syncer-g9g8h" Jun 11 19:59:01.522812 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:01.522816 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhjd8\" (UniqueName: \"kubernetes.io/projected/ffbc3051-b38e-43f1-8092-dc1ac0109cd3-kube-api-access-qhjd8\") pod \"network-check-target-n6qj6\" (UID: \"ffbc3051-b38e-43f1-8092-dc1ac0109cd3\") " pod="openshift-network-diagnostics/network-check-target-n6qj6" Jun 11 19:59:01.523012 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:01.522929 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:59:01.523012 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:01.522946 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:59:01.523012 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:01.522962 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:59:01.523012 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:01.522972 2562 projected.go:196] Error preparing data for projected volume kube-api-access-qhjd8 for pod openshift-network-diagnostics/network-check-target-n6qj6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:59:01.523012 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:01.522992 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebe82df4-c733-4be3-924b-3f32111102b7-original-pull-secret podName:ebe82df4-c733-4be3-924b-3f32111102b7 nodeName:}" failed. No retries permitted until 2026-06-11 19:59:33.522978522 +0000 UTC m=+65.254140476 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebe82df4-c733-4be3-924b-3f32111102b7-original-pull-secret") pod "global-pull-secret-syncer-g9g8h" (UID: "ebe82df4-c733-4be3-924b-3f32111102b7") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:59:01.523012 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:01.523014 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ffbc3051-b38e-43f1-8092-dc1ac0109cd3-kube-api-access-qhjd8 podName:ffbc3051-b38e-43f1-8092-dc1ac0109cd3 nodeName:}" failed. No retries permitted until 2026-06-11 19:59:33.523002585 +0000 UTC m=+65.254164569 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qhjd8" (UniqueName: "kubernetes.io/projected/ffbc3051-b38e-43f1-8092-dc1ac0109cd3-kube-api-access-qhjd8") pod "network-check-target-n6qj6" (UID: "ffbc3051-b38e-43f1-8092-dc1ac0109cd3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:59:02.006024 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:02.005992 2562 generic.go:356] "Generic (PLEG): container finished" podID="2eeabcc2-717f-4bb3-92c0-db55b02864cb" containerID="d015ee27603cb15822ba039a366a1eb02b20d73bd043606472ebcaa3cc6d4400" exitCode=0 Jun 11 19:59:02.006509 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:02.006036 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zjv5h" event={"ID":"2eeabcc2-717f-4bb3-92c0-db55b02864cb","Type":"ContainerDied","Data":"d015ee27603cb15822ba039a366a1eb02b20d73bd043606472ebcaa3cc6d4400"} Jun 11 19:59:02.729127 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:02.729081 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k98nz" Jun 11 19:59:02.729127 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:02.729103 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g8h" Jun 11 19:59:02.729414 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:02.729131 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6qj6" Jun 11 19:59:02.729480 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:02.729331 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k98nz" podUID="dcc3087e-d6a7-4ec1-b911-8bf96a4319d2" Jun 11 19:59:02.729534 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:02.729438 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g9g8h" podUID="ebe82df4-c733-4be3-924b-3f32111102b7" Jun 11 19:59:02.729534 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:02.729494 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6qj6" podUID="ffbc3051-b38e-43f1-8092-dc1ac0109cd3" Jun 11 19:59:04.092474 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.092442 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-142.ec2.internal" event="NodeReady" Jun 11 19:59:04.092916 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.092581 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 19:59:04.133060 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.132964 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7db79967bc-vgntv"] Jun 11 19:59:04.136865 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.136839 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 19:59:04.139804 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.139776 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 19:59:04.139929 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.139821 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 19:59:04.139929 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.139839 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 19:59:04.139929 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.139857 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7dg7r\"" Jun 11 19:59:04.145489 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.145451 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 19:59:04.146470 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.146441 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dwkpn"] Jun 11 19:59:04.150005 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.149983 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7db79967bc-vgntv"] Jun 11 19:59:04.150112 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.150093 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dwkpn" Jun 11 19:59:04.151750 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.151727 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nclx5"] Jun 11 19:59:04.154098 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.154027 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 19:59:04.154275 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.154037 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qrnmm\"" Jun 11 19:59:04.154388 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.154089 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 19:59:04.155061 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.155042 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nclx5" Jun 11 19:59:04.157711 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.157691 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5dllc\"" Jun 11 19:59:04.157923 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.157738 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 19:59:04.158017 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.157754 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 19:59:04.158017 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.157745 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 19:59:04.160687 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.160663 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dwkpn"] Jun 11 19:59:04.166907 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.166883 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nclx5"] Jun 11 19:59:04.243457 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.243426 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-tmp-dir\") pod \"dns-default-dwkpn\" (UID: \"40c0e2f2-95f6-4cb1-8cc3-86669ea992b0\") " pod="openshift-dns/dns-default-dwkpn" Jun 11 19:59:04.243457 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.243456 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d5823bf3-bd2b-498e-b24c-5787b60f595c-cert\") pod \"ingress-canary-nclx5\" (UID: \"d5823bf3-bd2b-498e-b24c-5787b60f595c\") " pod="openshift-ingress-canary/ingress-canary-nclx5" Jun 11 19:59:04.243677 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.243490 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ff2c3b7-0b29-4122-a9cc-5948769be69b-image-registry-private-configuration\") pod \"image-registry-7db79967bc-vgntv\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 19:59:04.243677 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.243580 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-bound-sa-token\") pod \"image-registry-7db79967bc-vgntv\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 19:59:04.243677 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.243642 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-metrics-tls\") pod \"dns-default-dwkpn\" (UID: \"40c0e2f2-95f6-4cb1-8cc3-86669ea992b0\") " pod="openshift-dns/dns-default-dwkpn" Jun 11 19:59:04.243677 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.243676 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-config-volume\") pod \"dns-default-dwkpn\" (UID: \"40c0e2f2-95f6-4cb1-8cc3-86669ea992b0\") " pod="openshift-dns/dns-default-dwkpn" Jun 11 19:59:04.243857 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.243695 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56hpb\" (UniqueName: \"kubernetes.io/projected/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-kube-api-access-56hpb\") pod \"dns-default-dwkpn\" (UID: \"40c0e2f2-95f6-4cb1-8cc3-86669ea992b0\") " pod="openshift-dns/dns-default-dwkpn" Jun 11 19:59:04.243857 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.243720 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-certificates\") pod \"image-registry-7db79967bc-vgntv\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 19:59:04.243857 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.243743 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhshr\" (UniqueName: \"kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-kube-api-access-qhshr\") pod \"image-registry-7db79967bc-vgntv\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 19:59:04.243857 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.243761 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-tls\") pod \"image-registry-7db79967bc-vgntv\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 19:59:04.243857 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.243774 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ff2c3b7-0b29-4122-a9cc-5948769be69b-ca-trust-extracted\") pod \"image-registry-7db79967bc-vgntv\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 19:59:04.243857 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.243797 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ff2c3b7-0b29-4122-a9cc-5948769be69b-trusted-ca\") pod \"image-registry-7db79967bc-vgntv\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 19:59:04.243857 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.243819 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ff2c3b7-0b29-4122-a9cc-5948769be69b-installation-pull-secrets\") pod \"image-registry-7db79967bc-vgntv\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 19:59:04.243857 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.243855 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wbwm\" (UniqueName: \"kubernetes.io/projected/d5823bf3-bd2b-498e-b24c-5787b60f595c-kube-api-access-6wbwm\") pod \"ingress-canary-nclx5\" (UID: \"d5823bf3-bd2b-498e-b24c-5787b60f595c\") " pod="openshift-ingress-canary/ingress-canary-nclx5" Jun 11 19:59:04.344303 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.344262 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ff2c3b7-0b29-4122-a9cc-5948769be69b-image-registry-private-configuration\") pod \"image-registry-7db79967bc-vgntv\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 19:59:04.344565 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.344320 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-bound-sa-token\") pod \"image-registry-7db79967bc-vgntv\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 19:59:04.344565 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.344483 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-metrics-tls\") pod \"dns-default-dwkpn\" (UID: \"40c0e2f2-95f6-4cb1-8cc3-86669ea992b0\") " pod="openshift-dns/dns-default-dwkpn" Jun 11 19:59:04.344565 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.344539 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-config-volume\") pod \"dns-default-dwkpn\" (UID: \"40c0e2f2-95f6-4cb1-8cc3-86669ea992b0\") " pod="openshift-dns/dns-default-dwkpn" Jun 11 19:59:04.344739 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.344577 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56hpb\" (UniqueName: \"kubernetes.io/projected/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-kube-api-access-56hpb\") pod \"dns-default-dwkpn\" (UID: \"40c0e2f2-95f6-4cb1-8cc3-86669ea992b0\") " pod="openshift-dns/dns-default-dwkpn" Jun 11 19:59:04.344739 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.344604 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-certificates\") pod \"image-registry-7db79967bc-vgntv\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 19:59:04.344739 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.344634 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhshr\" (UniqueName: \"kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-kube-api-access-qhshr\") pod \"image-registry-7db79967bc-vgntv\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 19:59:04.344739 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.344662 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-tls\") pod \"image-registry-7db79967bc-vgntv\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 19:59:04.344739 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.344686 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ff2c3b7-0b29-4122-a9cc-5948769be69b-ca-trust-extracted\") pod \"image-registry-7db79967bc-vgntv\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 19:59:04.344739 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.344714 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ff2c3b7-0b29-4122-a9cc-5948769be69b-trusted-ca\") pod \"image-registry-7db79967bc-vgntv\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 19:59:04.344739 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.344739 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ff2c3b7-0b29-4122-a9cc-5948769be69b-installation-pull-secrets\") pod \"image-registry-7db79967bc-vgntv\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 19:59:04.345065 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.344775 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wbwm\" (UniqueName: \"kubernetes.io/projected/d5823bf3-bd2b-498e-b24c-5787b60f595c-kube-api-access-6wbwm\") pod \"ingress-canary-nclx5\" (UID: \"d5823bf3-bd2b-498e-b24c-5787b60f595c\") " pod="openshift-ingress-canary/ingress-canary-nclx5" Jun 11 19:59:04.345065 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.344804 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-tmp-dir\") pod \"dns-default-dwkpn\" (UID: \"40c0e2f2-95f6-4cb1-8cc3-86669ea992b0\") " pod="openshift-dns/dns-default-dwkpn" Jun 11 19:59:04.345065 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.344828 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d5823bf3-bd2b-498e-b24c-5787b60f595c-cert\") pod \"ingress-canary-nclx5\" (UID: \"d5823bf3-bd2b-498e-b24c-5787b60f595c\") " pod="openshift-ingress-canary/ingress-canary-nclx5" Jun 11 19:59:04.345065 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:04.344940 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:59:04.345065 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:04.345011 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-metrics-tls podName:40c0e2f2-95f6-4cb1-8cc3-86669ea992b0 nodeName:}" failed. No retries permitted until 2026-06-11 19:59:04.844990405 +0000 UTC m=+36.576152371 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-metrics-tls") pod "dns-default-dwkpn" (UID: "40c0e2f2-95f6-4cb1-8cc3-86669ea992b0") : secret "dns-default-metrics-tls" not found Jun 11 19:59:04.345369 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.345347 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ff2c3b7-0b29-4122-a9cc-5948769be69b-ca-trust-extracted\") pod \"image-registry-7db79967bc-vgntv\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 19:59:04.345490 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:04.345469 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 19:59:04.345490 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:04.345488 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7db79967bc-vgntv: secret "image-registry-tls" not found Jun 11 19:59:04.345649 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:04.345532 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-tls podName:7ff2c3b7-0b29-4122-a9cc-5948769be69b nodeName:}" failed. No retries permitted until 2026-06-11 19:59:04.845517282 +0000 UTC m=+36.576679234 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-tls") pod "image-registry-7db79967bc-vgntv" (UID: "7ff2c3b7-0b29-4122-a9cc-5948769be69b") : secret "image-registry-tls" not found Jun 11 19:59:04.345767 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.345741 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-config-volume\") pod \"dns-default-dwkpn\" (UID: \"40c0e2f2-95f6-4cb1-8cc3-86669ea992b0\") " pod="openshift-dns/dns-default-dwkpn" Jun 11 19:59:04.346021 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.345980 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-certificates\") pod \"image-registry-7db79967bc-vgntv\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 19:59:04.346836 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.346811 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ff2c3b7-0b29-4122-a9cc-5948769be69b-trusted-ca\") pod \"image-registry-7db79967bc-vgntv\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 19:59:04.347260 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.347234 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-tmp-dir\") pod \"dns-default-dwkpn\" (UID: \"40c0e2f2-95f6-4cb1-8cc3-86669ea992b0\") " pod="openshift-dns/dns-default-dwkpn" Jun 11 19:59:04.349505 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.349487 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ff2c3b7-0b29-4122-a9cc-5948769be69b-image-registry-private-configuration\") pod \"image-registry-7db79967bc-vgntv\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 19:59:04.349613 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.349516 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ff2c3b7-0b29-4122-a9cc-5948769be69b-installation-pull-secrets\") pod \"image-registry-7db79967bc-vgntv\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 19:59:04.351243 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.351224 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d5823bf3-bd2b-498e-b24c-5787b60f595c-cert\") pod \"ingress-canary-nclx5\" (UID: \"d5823bf3-bd2b-498e-b24c-5787b60f595c\") " pod="openshift-ingress-canary/ingress-canary-nclx5" Jun 11 19:59:04.354537 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.354248 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-bound-sa-token\") pod \"image-registry-7db79967bc-vgntv\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 19:59:04.354537 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.354497 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wbwm\" (UniqueName: \"kubernetes.io/projected/d5823bf3-bd2b-498e-b24c-5787b60f595c-kube-api-access-6wbwm\") pod \"ingress-canary-nclx5\" (UID: \"d5823bf3-bd2b-498e-b24c-5787b60f595c\") " pod="openshift-ingress-canary/ingress-canary-nclx5" Jun 11 19:59:04.354537 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.354508 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56hpb\" (UniqueName: \"kubernetes.io/projected/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-kube-api-access-56hpb\") pod \"dns-default-dwkpn\" (UID: \"40c0e2f2-95f6-4cb1-8cc3-86669ea992b0\") " pod="openshift-dns/dns-default-dwkpn" Jun 11 19:59:04.355882 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.355865 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhshr\" (UniqueName: \"kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-kube-api-access-qhshr\") pod \"image-registry-7db79967bc-vgntv\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 19:59:04.470391 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.470294 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nclx5" Jun 11 19:59:04.626864 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.626833 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nclx5"] Jun 11 19:59:04.633900 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:59:04.633866 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5823bf3_bd2b_498e_b24c_5787b60f595c.slice/crio-2d1bf13f52a17fd75953d3688c3c0c400d601ad893af60bbd72b0395242bc547 WatchSource:0}: Error finding container 2d1bf13f52a17fd75953d3688c3c0c400d601ad893af60bbd72b0395242bc547: Status 404 returned error can't find the container with id 2d1bf13f52a17fd75953d3688c3c0c400d601ad893af60bbd72b0395242bc547 Jun 11 19:59:04.729469 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.729365 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k98nz" Jun 11 19:59:04.729469 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.729359 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g8h" Jun 11 19:59:04.729691 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.729594 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6qj6" Jun 11 19:59:04.732890 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.732642 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gpsgr\"" Jun 11 19:59:04.732890 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.732659 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 19:59:04.734360 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.733220 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 19:59:04.734360 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.734252 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 19:59:04.735392 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.734590 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gxxqs\"" Jun 11 19:59:04.735392 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.734880 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 19:59:04.849370 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.849332 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-metrics-tls\") pod \"dns-default-dwkpn\" (UID: \"40c0e2f2-95f6-4cb1-8cc3-86669ea992b0\") " pod="openshift-dns/dns-default-dwkpn" Jun 11 19:59:04.849569 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:04.849463 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:59:04.849569 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:04.849512 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-metrics-tls podName:40c0e2f2-95f6-4cb1-8cc3-86669ea992b0 nodeName:}" failed. No retries permitted until 2026-06-11 19:59:05.84949786 +0000 UTC m=+37.580659816 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-metrics-tls") pod "dns-default-dwkpn" (UID: "40c0e2f2-95f6-4cb1-8cc3-86669ea992b0") : secret "dns-default-metrics-tls" not found Jun 11 19:59:04.849569 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:04.849545 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-tls\") pod \"image-registry-7db79967bc-vgntv\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 19:59:04.849692 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:04.849654 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 19:59:04.849692 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:04.849665 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7db79967bc-vgntv: secret "image-registry-tls" not found Jun 11 19:59:04.849744 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:04.849716 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-tls podName:7ff2c3b7-0b29-4122-a9cc-5948769be69b nodeName:}" failed. No retries permitted until 2026-06-11 19:59:05.849704716 +0000 UTC m=+37.580866670 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-tls") pod "image-registry-7db79967bc-vgntv" (UID: "7ff2c3b7-0b29-4122-a9cc-5948769be69b") : secret "image-registry-tls" not found Jun 11 19:59:05.015672 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:05.015577 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nclx5" event={"ID":"d5823bf3-bd2b-498e-b24c-5787b60f595c","Type":"ContainerStarted","Data":"2d1bf13f52a17fd75953d3688c3c0c400d601ad893af60bbd72b0395242bc547"} Jun 11 19:59:05.859323 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:05.859283 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-metrics-tls\") pod \"dns-default-dwkpn\" (UID: \"40c0e2f2-95f6-4cb1-8cc3-86669ea992b0\") " pod="openshift-dns/dns-default-dwkpn" Jun 11 19:59:05.860175 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:05.859345 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-tls\") pod \"image-registry-7db79967bc-vgntv\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 19:59:05.860175 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:05.859459 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:59:05.860175 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:05.859520 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 19:59:05.860175 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:05.859547 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7db79967bc-vgntv: secret "image-registry-tls" not found Jun 11 19:59:05.860175 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:05.859529 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-metrics-tls podName:40c0e2f2-95f6-4cb1-8cc3-86669ea992b0 nodeName:}" failed. No retries permitted until 2026-06-11 19:59:07.859511037 +0000 UTC m=+39.590673017 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-metrics-tls") pod "dns-default-dwkpn" (UID: "40c0e2f2-95f6-4cb1-8cc3-86669ea992b0") : secret "dns-default-metrics-tls" not found Jun 11 19:59:05.860175 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:05.859604 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-tls podName:7ff2c3b7-0b29-4122-a9cc-5948769be69b nodeName:}" failed. No retries permitted until 2026-06-11 19:59:07.859590393 +0000 UTC m=+39.590752359 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-tls") pod "image-registry-7db79967bc-vgntv" (UID: "7ff2c3b7-0b29-4122-a9cc-5948769be69b") : secret "image-registry-tls" not found Jun 11 19:59:07.874859 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:07.874681 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-metrics-tls\") pod \"dns-default-dwkpn\" (UID: \"40c0e2f2-95f6-4cb1-8cc3-86669ea992b0\") " pod="openshift-dns/dns-default-dwkpn" Jun 11 19:59:07.875222 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:07.874876 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-tls\") pod \"image-registry-7db79967bc-vgntv\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 19:59:07.875222 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:07.874833 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:59:07.875222 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:07.874959 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 19:59:07.875222 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:07.874969 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7db79967bc-vgntv: secret "image-registry-tls" not found Jun 11 19:59:07.875222 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:07.874976 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-metrics-tls podName:40c0e2f2-95f6-4cb1-8cc3-86669ea992b0 nodeName:}" failed. No retries permitted until 2026-06-11 19:59:11.874961175 +0000 UTC m=+43.606123132 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-metrics-tls") pod "dns-default-dwkpn" (UID: "40c0e2f2-95f6-4cb1-8cc3-86669ea992b0") : secret "dns-default-metrics-tls" not found Jun 11 19:59:07.875222 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:07.875006 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-tls podName:7ff2c3b7-0b29-4122-a9cc-5948769be69b nodeName:}" failed. No retries permitted until 2026-06-11 19:59:11.874995868 +0000 UTC m=+43.606157826 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-tls") pod "image-registry-7db79967bc-vgntv" (UID: "7ff2c3b7-0b29-4122-a9cc-5948769be69b") : secret "image-registry-tls" not found Jun 11 19:59:07.949611 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:07.949574 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 19:59:08.024163 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:08.024129 2562 generic.go:356] "Generic (PLEG): container finished" podID="2eeabcc2-717f-4bb3-92c0-db55b02864cb" containerID="6957e4cd095d464cff764b5580d5c883dafa5b9b3e68e70d3ab4ba2e730eca83" exitCode=0 Jun 11 19:59:08.024298 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:08.024160 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zjv5h" event={"ID":"2eeabcc2-717f-4bb3-92c0-db55b02864cb","Type":"ContainerDied","Data":"6957e4cd095d464cff764b5580d5c883dafa5b9b3e68e70d3ab4ba2e730eca83"} Jun 11 19:59:08.025691 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:08.025669 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nclx5" event={"ID":"d5823bf3-bd2b-498e-b24c-5787b60f595c","Type":"ContainerStarted","Data":"a806d7e5207ceaf6bc85bb07d27dc9aa09d818b14107ab19008f856772e254ad"} Jun 11 19:59:08.033088 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:08.033068 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 19:59:08.061199 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:08.061154 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nclx5" podStartSLOduration=1.270870991 podStartE2EDuration="4.061134751s" totalImagesPullingTime="2.79026376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:59:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:59:08.061042325 +0000 UTC m=+39.792204299" watchObservedRunningTime="2026-06-11 19:59:08.061134751 +0000 UTC m=+39.792296727" Jun 11 19:59:09.031104 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:09.031019 2562 generic.go:356] "Generic (PLEG): container finished" podID="2eeabcc2-717f-4bb3-92c0-db55b02864cb" containerID="5d277f43bb14028d695fe220b4df2ff8c98430f06e64168dabf40983643db89d" exitCode=0 Jun 11 19:59:09.031483 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:09.031110 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zjv5h" event={"ID":"2eeabcc2-717f-4bb3-92c0-db55b02864cb","Type":"ContainerDied","Data":"5d277f43bb14028d695fe220b4df2ff8c98430f06e64168dabf40983643db89d"} Jun 11 19:59:09.820629 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:09.820595 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 19:59:09.921257 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:09.921226 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 19:59:10.036206 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:10.036172 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zjv5h" event={"ID":"2eeabcc2-717f-4bb3-92c0-db55b02864cb","Type":"ContainerStarted","Data":"f2c75146b4ce608e21325218f5bd67c772d8193182e72590e7d846f30f030015"} Jun 11 19:59:10.063967 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:10.063918 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zjv5h" podStartSLOduration=9.406521899 podStartE2EDuration="42.063902115s" totalImagesPullingTime="32.657380216s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:58:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:59:10.063130144 +0000 UTC m=+41.794292118" watchObservedRunningTime="2026-06-11 19:59:10.063902115 +0000 UTC m=+41.795064087" Jun 11 19:59:10.190881 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:10.190831 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 19:59:10.288442 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:10.288403 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 19:59:11.906245 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:11.906205 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-tls\") pod \"image-registry-7db79967bc-vgntv\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 19:59:11.906678 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:11.906306 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-metrics-tls\") pod \"dns-default-dwkpn\" (UID: \"40c0e2f2-95f6-4cb1-8cc3-86669ea992b0\") " pod="openshift-dns/dns-default-dwkpn" Jun 11 19:59:11.906678 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:11.906391 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 19:59:11.906678 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:11.906409 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7db79967bc-vgntv: secret "image-registry-tls" not found Jun 11 19:59:11.906678 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:11.906425 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:59:11.906885 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:11.906789 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-metrics-tls podName:40c0e2f2-95f6-4cb1-8cc3-86669ea992b0 nodeName:}" failed. No retries permitted until 2026-06-11 19:59:19.906756893 +0000 UTC m=+51.637918861 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-metrics-tls") pod "dns-default-dwkpn" (UID: "40c0e2f2-95f6-4cb1-8cc3-86669ea992b0") : secret "dns-default-metrics-tls" not found Jun 11 19:59:11.909575 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:11.909550 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-tls podName:7ff2c3b7-0b29-4122-a9cc-5948769be69b nodeName:}" failed. No retries permitted until 2026-06-11 19:59:19.909525754 +0000 UTC m=+51.640687710 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-tls") pod "image-registry-7db79967bc-vgntv" (UID: "7ff2c3b7-0b29-4122-a9cc-5948769be69b") : secret "image-registry-tls" not found Jun 11 19:59:12.244985 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:12.244911 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 19:59:12.346145 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:12.346115 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 19:59:13.287294 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:13.287255 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 19:59:13.361589 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:13.361561 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 19:59:15.633867 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:15.633835 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 19:59:15.727093 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:15.727048 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 19:59:17.537864 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:17.537831 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 19:59:17.630472 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:17.630426 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 19:59:19.966105 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:19.966063 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-tls\") pod \"image-registry-7db79967bc-vgntv\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 19:59:19.966530 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:19.966159 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-metrics-tls\") pod \"dns-default-dwkpn\" (UID: \"40c0e2f2-95f6-4cb1-8cc3-86669ea992b0\") " pod="openshift-dns/dns-default-dwkpn" Jun 11 19:59:19.966530 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:19.966236 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 19:59:19.966530 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:19.966257 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7db79967bc-vgntv: secret "image-registry-tls" not found Jun 11 19:59:19.966530 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:19.966270 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:59:19.966530 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:19.966326 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-tls podName:7ff2c3b7-0b29-4122-a9cc-5948769be69b nodeName:}" failed. No retries permitted until 2026-06-11 19:59:35.966307769 +0000 UTC m=+67.697469722 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-tls") pod "image-registry-7db79967bc-vgntv" (UID: "7ff2c3b7-0b29-4122-a9cc-5948769be69b") : secret "image-registry-tls" not found Jun 11 19:59:19.966530 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:19.966340 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-metrics-tls podName:40c0e2f2-95f6-4cb1-8cc3-86669ea992b0 nodeName:}" failed. No retries permitted until 2026-06-11 19:59:35.966334325 +0000 UTC m=+67.697496278 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-metrics-tls") pod "dns-default-dwkpn" (UID: "40c0e2f2-95f6-4cb1-8cc3-86669ea992b0") : secret "dns-default-metrics-tls" not found Jun 11 19:59:29.008831 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:29.008802 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qn6rn" Jun 11 19:59:29.166115 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:29.166046 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 19:59:29.239763 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:29.239738 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 19:59:32.852414 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:32.852370 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 19:59:32.970704 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:32.970680 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 19:59:33.462403 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:33.462349 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dcc3087e-d6a7-4ec1-b911-8bf96a4319d2-metrics-certs\") pod \"network-metrics-daemon-k98nz\" (UID: \"dcc3087e-d6a7-4ec1-b911-8bf96a4319d2\") " pod="openshift-multus/network-metrics-daemon-k98nz" Jun 11 19:59:33.465474 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:33.465457 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 19:59:33.472988 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:33.472972 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 19:59:33.473044 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:33.473037 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcc3087e-d6a7-4ec1-b911-8bf96a4319d2-metrics-certs podName:dcc3087e-d6a7-4ec1-b911-8bf96a4319d2 nodeName:}" failed. No retries permitted until 2026-06-11 20:00:37.473014853 +0000 UTC m=+129.204176812 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dcc3087e-d6a7-4ec1-b911-8bf96a4319d2-metrics-certs") pod "network-metrics-daemon-k98nz" (UID: "dcc3087e-d6a7-4ec1-b911-8bf96a4319d2") : secret "metrics-daemon-secret" not found Jun 11 19:59:33.563585 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:33.563543 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhjd8\" (UniqueName: \"kubernetes.io/projected/ffbc3051-b38e-43f1-8092-dc1ac0109cd3-kube-api-access-qhjd8\") pod \"network-check-target-n6qj6\" (UID: \"ffbc3051-b38e-43f1-8092-dc1ac0109cd3\") " pod="openshift-network-diagnostics/network-check-target-n6qj6" Jun 11 19:59:33.563670 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:33.563637 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebe82df4-c733-4be3-924b-3f32111102b7-original-pull-secret\") pod \"global-pull-secret-syncer-g9g8h\" (UID: \"ebe82df4-c733-4be3-924b-3f32111102b7\") " pod="kube-system/global-pull-secret-syncer-g9g8h" Jun 11 19:59:33.567138 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:33.567123 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 19:59:33.567192 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:33.567125 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 19:59:33.576996 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:33.576969 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 19:59:33.577740 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:33.577724 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebe82df4-c733-4be3-924b-3f32111102b7-original-pull-secret\") pod \"global-pull-secret-syncer-g9g8h\" (UID: \"ebe82df4-c733-4be3-924b-3f32111102b7\") " pod="kube-system/global-pull-secret-syncer-g9g8h" Jun 11 19:59:33.586851 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:33.586826 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhjd8\" (UniqueName: \"kubernetes.io/projected/ffbc3051-b38e-43f1-8092-dc1ac0109cd3-kube-api-access-qhjd8\") pod \"network-check-target-n6qj6\" (UID: \"ffbc3051-b38e-43f1-8092-dc1ac0109cd3\") " pod="openshift-network-diagnostics/network-check-target-n6qj6" Jun 11 19:59:33.852953 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:33.852916 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g9g8h" Jun 11 19:59:33.863744 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:33.863722 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gxxqs\"" Jun 11 19:59:33.868527 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:33.868506 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6qj6" Jun 11 19:59:34.020616 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:34.020594 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g9g8h"] Jun 11 19:59:34.023174 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:59:34.023147 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebe82df4_c733_4be3_924b_3f32111102b7.slice/crio-33ec684d1a665bd19a12bf2d1566021b19c6416fd82545c00783559ffe82fba5 WatchSource:0}: Error finding container 33ec684d1a665bd19a12bf2d1566021b19c6416fd82545c00783559ffe82fba5: Status 404 returned error can't find the container with id 33ec684d1a665bd19a12bf2d1566021b19c6416fd82545c00783559ffe82fba5 Jun 11 19:59:34.041185 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:34.041159 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n6qj6"] Jun 11 19:59:34.043892 ip-10-0-137-142 kubenswrapper[2562]: W0611 19:59:34.043867 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffbc3051_b38e_43f1_8092_dc1ac0109cd3.slice/crio-3b2871a443aa7246844b0acfea0c9187cba08a07ed38081ee544abcbcc3d1d44 WatchSource:0}: Error finding container 3b2871a443aa7246844b0acfea0c9187cba08a07ed38081ee544abcbcc3d1d44: Status 404 returned error can't find the container with id 3b2871a443aa7246844b0acfea0c9187cba08a07ed38081ee544abcbcc3d1d44 Jun 11 19:59:34.090885 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:34.090850 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g9g8h" event={"ID":"ebe82df4-c733-4be3-924b-3f32111102b7","Type":"ContainerStarted","Data":"33ec684d1a665bd19a12bf2d1566021b19c6416fd82545c00783559ffe82fba5"} Jun 11 19:59:34.091821 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:34.091799 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n6qj6" event={"ID":"ffbc3051-b38e-43f1-8092-dc1ac0109cd3","Type":"ContainerStarted","Data":"3b2871a443aa7246844b0acfea0c9187cba08a07ed38081ee544abcbcc3d1d44"} Jun 11 19:59:35.983396 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:35.983339 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-metrics-tls\") pod \"dns-default-dwkpn\" (UID: \"40c0e2f2-95f6-4cb1-8cc3-86669ea992b0\") " pod="openshift-dns/dns-default-dwkpn" Jun 11 19:59:35.983844 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:35.983434 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-tls\") pod \"image-registry-7db79967bc-vgntv\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 19:59:35.983844 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:35.983512 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:59:35.983844 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:35.983606 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-metrics-tls podName:40c0e2f2-95f6-4cb1-8cc3-86669ea992b0 nodeName:}" failed. No retries permitted until 2026-06-11 20:00:07.983583118 +0000 UTC m=+99.714745074 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-metrics-tls") pod "dns-default-dwkpn" (UID: "40c0e2f2-95f6-4cb1-8cc3-86669ea992b0") : secret "dns-default-metrics-tls" not found Jun 11 19:59:35.983844 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:35.983630 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 19:59:35.983844 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:35.983643 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7db79967bc-vgntv: secret "image-registry-tls" not found Jun 11 19:59:35.983844 ip-10-0-137-142 kubenswrapper[2562]: E0611 19:59:35.983701 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-tls podName:7ff2c3b7-0b29-4122-a9cc-5948769be69b nodeName:}" failed. No retries permitted until 2026-06-11 20:00:07.983684826 +0000 UTC m=+99.714846778 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-tls") pod "image-registry-7db79967bc-vgntv" (UID: "7ff2c3b7-0b29-4122-a9cc-5948769be69b") : secret "image-registry-tls" not found Jun 11 19:59:36.366654 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:36.366586 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 19:59:36.511206 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:36.511041 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 19:59:39.107742 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:39.107691 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n6qj6" event={"ID":"ffbc3051-b38e-43f1-8092-dc1ac0109cd3","Type":"ContainerStarted","Data":"4b6a2147bf0acf37dd983016e524170625e496e23d2f09083dd0b1003ed0b6ee"} Jun 11 19:59:39.112149 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:39.112118 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g9g8h" event={"ID":"ebe82df4-c733-4be3-924b-3f32111102b7","Type":"ContainerStarted","Data":"b061d57812a01a1f9a4d6abcd9fa73375b3e21e3309e75ff33e290b7f85fe9db"} Jun 11 19:59:39.142487 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:39.142449 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-n6qj6" podStartSLOduration=65.699497685 podStartE2EDuration="1m10.142436s" totalImagesPullingTime="4.442938315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:58:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:59:39.142040041 +0000 UTC m=+70.873202016" watchObservedRunningTime="2026-06-11 19:59:39.142436 +0000 UTC m=+70.873597953" Jun 11 19:59:40.114687 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:40.114657 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-n6qj6" Jun 11 19:59:44.539717 ip-10-0-137-142 kubenswrapper[2562]: I0611 19:59:44.539604 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:00:08.000017 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:00:07.999975 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-metrics-tls\") pod \"dns-default-dwkpn\" (UID: \"40c0e2f2-95f6-4cb1-8cc3-86669ea992b0\") " pod="openshift-dns/dns-default-dwkpn" Jun 11 20:00:08.000585 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:00:08.000029 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-tls\") pod \"image-registry-7db79967bc-vgntv\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 20:00:08.000585 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:00:08.000131 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 20:00:08.000585 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:00:08.000158 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 20:00:08.000585 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:00:08.000176 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7db79967bc-vgntv: secret "image-registry-tls" not found Jun 11 20:00:08.000585 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:00:08.000207 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-metrics-tls podName:40c0e2f2-95f6-4cb1-8cc3-86669ea992b0 nodeName:}" failed. No retries permitted until 2026-06-11 20:01:12.00018878 +0000 UTC m=+163.731350753 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-metrics-tls") pod "dns-default-dwkpn" (UID: "40c0e2f2-95f6-4cb1-8cc3-86669ea992b0") : secret "dns-default-metrics-tls" not found Jun 11 20:00:08.000585 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:00:08.000235 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-tls podName:7ff2c3b7-0b29-4122-a9cc-5948769be69b nodeName:}" failed. No retries permitted until 2026-06-11 20:01:12.00022017 +0000 UTC m=+163.731382160 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-tls") pod "image-registry-7db79967bc-vgntv" (UID: "7ff2c3b7-0b29-4122-a9cc-5948769be69b") : secret "image-registry-tls" not found Jun 11 20:00:11.119163 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:00:11.119133 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-n6qj6" Jun 11 20:00:11.143389 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:00:11.143326 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-g9g8h" podStartSLOduration=97.674325606 podStartE2EDuration="1m42.143310823s" totalImagesPullingTime="4.468985217s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:58:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:59:39.173958874 +0000 UTC m=+70.905120849" watchObservedRunningTime="2026-06-11 20:00:11.143310823 +0000 UTC m=+102.874472797" Jun 11 20:00:37.508568 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:00:37.508530 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dcc3087e-d6a7-4ec1-b911-8bf96a4319d2-metrics-certs\") pod \"network-metrics-daemon-k98nz\" (UID: \"dcc3087e-d6a7-4ec1-b911-8bf96a4319d2\") " pod="openshift-multus/network-metrics-daemon-k98nz" Jun 11 20:00:37.509105 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:00:37.508698 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 20:00:37.509105 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:00:37.508789 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcc3087e-d6a7-4ec1-b911-8bf96a4319d2-metrics-certs podName:dcc3087e-d6a7-4ec1-b911-8bf96a4319d2 nodeName:}" failed. No retries permitted until 2026-06-11 20:02:39.508766754 +0000 UTC m=+251.239928711 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dcc3087e-d6a7-4ec1-b911-8bf96a4319d2-metrics-certs") pod "network-metrics-daemon-k98nz" (UID: "dcc3087e-d6a7-4ec1-b911-8bf96a4319d2") : secret "metrics-daemon-secret" not found Jun 11 20:01:01.404687 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:01.404654 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:01:07.149928 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:07.149871 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7db79967bc-vgntv" podUID="7ff2c3b7-0b29-4122-a9cc-5948769be69b" Jun 11 20:01:07.163028 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:07.162988 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dwkpn" podUID="40c0e2f2-95f6-4cb1-8cc3-86669ea992b0" Jun 11 20:01:07.318335 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:07.318309 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 20:01:07.318563 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:07.318313 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dwkpn" Jun 11 20:01:07.744815 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:07.744770 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-k98nz" podUID="dcc3087e-d6a7-4ec1-b911-8bf96a4319d2" Jun 11 20:01:12.043545 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:12.043488 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-metrics-tls\") pod \"dns-default-dwkpn\" (UID: \"40c0e2f2-95f6-4cb1-8cc3-86669ea992b0\") " pod="openshift-dns/dns-default-dwkpn" Jun 11 20:01:12.043545 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:12.043555 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-tls\") pod \"image-registry-7db79967bc-vgntv\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 20:01:12.043977 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:12.043603 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 20:01:12.043977 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:12.043647 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 20:01:12.043977 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:12.043658 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7db79967bc-vgntv: secret "image-registry-tls" not found Jun 11 20:01:12.043977 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:12.043689 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-metrics-tls podName:40c0e2f2-95f6-4cb1-8cc3-86669ea992b0 nodeName:}" failed. No retries permitted until 2026-06-11 20:03:14.043671664 +0000 UTC m=+285.774833629 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-metrics-tls") pod "dns-default-dwkpn" (UID: "40c0e2f2-95f6-4cb1-8cc3-86669ea992b0") : secret "dns-default-metrics-tls" not found Jun 11 20:01:12.043977 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:12.043706 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-tls podName:7ff2c3b7-0b29-4122-a9cc-5948769be69b nodeName:}" failed. No retries permitted until 2026-06-11 20:03:14.04369965 +0000 UTC m=+285.774861603 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-tls") pod "image-registry-7db79967bc-vgntv" (UID: "7ff2c3b7-0b29-4122-a9cc-5948769be69b") : secret "image-registry-tls" not found Jun 11 20:01:22.729448 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:22.729404 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k98nz" Jun 11 20:01:48.046249 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.046220 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-h5kxx"] Jun 11 20:01:48.048294 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.048275 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-44fbb"] Jun 11 20:01:48.048443 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.048426 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-h5kxx" Jun 11 20:01:48.050076 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.050056 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-64f5b86456-67889"] Jun 11 20:01:48.050174 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.050154 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-44fbb" Jun 11 20:01:48.051964 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.051948 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-ckh6n"] Jun 11 20:01:48.052067 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.052052 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-64f5b86456-67889" Jun 11 20:01:48.054039 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.054017 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-ckh6n" Jun 11 20:01:48.054708 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.054692 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 11 20:01:48.054814 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.054720 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 20:01:48.056307 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.056292 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-kjdxb\"" Jun 11 20:01:48.056666 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.056650 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 11 20:01:48.056755 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.056649 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 11 20:01:48.057082 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.057067 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 20:01:48.057161 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.057071 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 20:01:48.057364 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.057345 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 11 20:01:48.057561 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.057549 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 11 20:01:48.059763 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.059746 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 11 20:01:48.059945 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.059928 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 11 20:01:48.059991 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.059953 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 11 20:01:48.060468 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.060454 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 11 20:01:48.061790 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.061774 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 20:01:48.063060 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.063043 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 11 20:01:48.063152 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.063079 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-7t7sp\"" Jun 11 20:01:48.067033 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.067014 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rxkql\"" Jun 11 20:01:48.072753 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.072728 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xpxcf\"" Jun 11 20:01:48.073515 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.073492 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-h5kxx"] Jun 11 20:01:48.074583 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.074559 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-64f5b86456-67889"] Jun 11 20:01:48.075175 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.075110 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 11 20:01:48.094642 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.094617 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkp96\" (UniqueName: \"kubernetes.io/projected/3f87ba75-1431-4113-a7df-cf35939bb63d-kube-api-access-vkp96\") pod \"cluster-monitoring-operator-f9d7df769-44fbb\" (UID: \"3f87ba75-1431-4113-a7df-cf35939bb63d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-44fbb" Jun 11 20:01:48.094748 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.094656 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f87ba75-1431-4113-a7df-cf35939bb63d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-44fbb\" (UID: \"3f87ba75-1431-4113-a7df-cf35939bb63d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-44fbb" Jun 11 20:01:48.094820 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.094776 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wsrb\" (UniqueName: \"kubernetes.io/projected/edf75c79-1cf6-4031-9f77-2c6f3c77dc28-kube-api-access-5wsrb\") pod \"network-check-source-6947749cfc-h5kxx\" (UID: \"edf75c79-1cf6-4031-9f77-2c6f3c77dc28\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-h5kxx" Jun 11 20:01:48.094820 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.094814 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3f87ba75-1431-4113-a7df-cf35939bb63d-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-44fbb\" (UID: \"3f87ba75-1431-4113-a7df-cf35939bb63d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-44fbb" Jun 11 20:01:48.095498 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.095476 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-44fbb"] Jun 11 20:01:48.108901 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.108873 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-ckh6n"] Jun 11 20:01:48.121071 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.121050 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-skt66"] Jun 11 20:01:48.122885 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.122861 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-skt66" Jun 11 20:01:48.123700 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.123683 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-qtc8f"] Jun 11 20:01:48.125614 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.125600 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-qtc8f" Jun 11 20:01:48.127089 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.127073 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 11 20:01:48.128465 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.128448 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 11 20:01:48.129691 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.129674 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 11 20:01:48.129887 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.129874 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-skw4b\"" Jun 11 20:01:48.130454 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.130438 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 11 20:01:48.130533 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.130438 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 11 20:01:48.132116 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.132096 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 11 20:01:48.132891 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.132875 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-mfmc8\"" Jun 11 20:01:48.143490 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.143472 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5c2fq"] Jun 11 20:01:48.145255 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.145241 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5c2fq" Jun 11 20:01:48.151210 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.151195 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 11 20:01:48.151290 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.151207 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 11 20:01:48.151290 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.151236 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 11 20:01:48.151522 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.151500 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-k5jqs\"" Jun 11 20:01:48.159162 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.159139 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-skt66"] Jun 11 20:01:48.168762 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.168738 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5c2fq"] Jun 11 20:01:48.169424 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.169406 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-qtc8f"] Jun 11 20:01:48.195125 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.195100 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f87ba75-1431-4113-a7df-cf35939bb63d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-44fbb\" (UID: \"3f87ba75-1431-4113-a7df-cf35939bb63d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-44fbb" Jun 11 20:01:48.195228 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.195132 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ba09d733-3024-4a3c-b49c-ab7213905587-config\") pod \"console-operator-5dbbb5d744-ckh6n\" (UID: \"ba09d733-3024-4a3c-b49c-ab7213905587\") " pod="openshift-console-operator/console-operator-5dbbb5d744-ckh6n" Jun 11 20:01:48.195228 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.195167 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbrb6\" (UniqueName: \"kubernetes.io/projected/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-kube-api-access-jbrb6\") pod \"router-default-64f5b86456-67889\" (UID: \"d4de4ed2-f4f2-4c34-b919-8c553e9df39f\") " pod="openshift-ingress/router-default-64f5b86456-67889" Jun 11 20:01:48.195228 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.195187 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qx84\" (UniqueName: \"kubernetes.io/projected/41492016-27bc-4186-aa74-739aae388ab0-kube-api-access-7qx84\") pod \"volume-data-source-validator-bd4ccd799-skt66\" (UID: \"41492016-27bc-4186-aa74-739aae388ab0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-skt66" Jun 11 20:01:48.195422 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.195262 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3e2eabc4-6dcb-442c-bfc3-d5d6d44f14c1-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-qtc8f\" (UID: \"3e2eabc4-6dcb-442c-bfc3-d5d6d44f14c1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-qtc8f" Jun 11 20:01:48.195422 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:48.195264 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 20:01:48.195422 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.195308 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-default-certificate\") pod \"router-default-64f5b86456-67889\" (UID: \"d4de4ed2-f4f2-4c34-b919-8c553e9df39f\") " pod="openshift-ingress/router-default-64f5b86456-67889" Jun 11 20:01:48.195422 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:48.195330 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f87ba75-1431-4113-a7df-cf35939bb63d-cluster-monitoring-operator-tls podName:3f87ba75-1431-4113-a7df-cf35939bb63d nodeName:}" failed. No retries permitted until 2026-06-11 20:01:48.695314045 +0000 UTC m=+200.426475998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3f87ba75-1431-4113-a7df-cf35939bb63d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-44fbb" (UID: "3f87ba75-1431-4113-a7df-cf35939bb63d") : secret "cluster-monitoring-operator-tls" not found Jun 11 20:01:48.195422 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.195355 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkp96\" (UniqueName: \"kubernetes.io/projected/3f87ba75-1431-4113-a7df-cf35939bb63d-kube-api-access-vkp96\") pod \"cluster-monitoring-operator-f9d7df769-44fbb\" (UID: \"3f87ba75-1431-4113-a7df-cf35939bb63d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-44fbb" Jun 11 20:01:48.195422 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.195394 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75qnm\" (UniqueName: \"kubernetes.io/projected/2879d66f-9e25-414d-a09e-10decbb8fe7a-kube-api-access-75qnm\") pod \"cluster-samples-operator-9547488fd-5c2fq\" (UID: \"2879d66f-9e25-414d-a09e-10decbb8fe7a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5c2fq" Jun 11 20:01:48.195701 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.195426 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ba09d733-3024-4a3c-b49c-ab7213905587-serving-cert\") pod \"console-operator-5dbbb5d744-ckh6n\" (UID: \"ba09d733-3024-4a3c-b49c-ab7213905587\") " pod="openshift-console-operator/console-operator-5dbbb5d744-ckh6n" Jun 11 20:01:48.195701 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.195466 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld6mw\" (UniqueName: \"kubernetes.io/projected/ba09d733-3024-4a3c-b49c-ab7213905587-kube-api-access-ld6mw\") pod \"console-operator-5dbbb5d744-ckh6n\" (UID: \"ba09d733-3024-4a3c-b49c-ab7213905587\") " pod="openshift-console-operator/console-operator-5dbbb5d744-ckh6n" Jun 11 20:01:48.195701 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.195494 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2879d66f-9e25-414d-a09e-10decbb8fe7a-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-5c2fq\" (UID: \"2879d66f-9e25-414d-a09e-10decbb8fe7a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5c2fq" Jun 11 20:01:48.195701 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.195527 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ba09d733-3024-4a3c-b49c-ab7213905587-trusted-ca\") pod \"console-operator-5dbbb5d744-ckh6n\" (UID: \"ba09d733-3024-4a3c-b49c-ab7213905587\") " pod="openshift-console-operator/console-operator-5dbbb5d744-ckh6n" Jun 11 20:01:48.195701 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.195547 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-metrics-certs\") pod \"router-default-64f5b86456-67889\" (UID: \"d4de4ed2-f4f2-4c34-b919-8c553e9df39f\") " pod="openshift-ingress/router-default-64f5b86456-67889" Jun 11 20:01:48.195701 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.195562 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3e2eabc4-6dcb-442c-bfc3-d5d6d44f14c1-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-qtc8f\" (UID: \"3e2eabc4-6dcb-442c-bfc3-d5d6d44f14c1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-qtc8f" Jun 11 20:01:48.195701 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.195635 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-stats-auth\") pod \"router-default-64f5b86456-67889\" (UID: \"d4de4ed2-f4f2-4c34-b919-8c553e9df39f\") " pod="openshift-ingress/router-default-64f5b86456-67889" Jun 11 20:01:48.195701 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.195663 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jgln\" (UniqueName: \"kubernetes.io/projected/3e2eabc4-6dcb-442c-bfc3-d5d6d44f14c1-kube-api-access-8jgln\") pod \"kube-storage-version-migrator-operator-7c578b78fc-qtc8f\" (UID: \"3e2eabc4-6dcb-442c-bfc3-d5d6d44f14c1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-qtc8f" Jun 11 20:01:48.195701 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.195699 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wsrb\" (UniqueName: \"kubernetes.io/projected/edf75c79-1cf6-4031-9f77-2c6f3c77dc28-kube-api-access-5wsrb\") pod \"network-check-source-6947749cfc-h5kxx\" (UID: \"edf75c79-1cf6-4031-9f77-2c6f3c77dc28\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-h5kxx" Jun 11 20:01:48.195975 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.195719 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3f87ba75-1431-4113-a7df-cf35939bb63d-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-44fbb\" (UID: \"3f87ba75-1431-4113-a7df-cf35939bb63d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-44fbb" Jun 11 20:01:48.195975 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.195747 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-service-ca-bundle\") pod \"router-default-64f5b86456-67889\" (UID: \"d4de4ed2-f4f2-4c34-b919-8c553e9df39f\") " pod="openshift-ingress/router-default-64f5b86456-67889" Jun 11 20:01:48.196345 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.196329 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3f87ba75-1431-4113-a7df-cf35939bb63d-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-44fbb\" (UID: \"3f87ba75-1431-4113-a7df-cf35939bb63d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-44fbb" Jun 11 20:01:48.221973 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.221942 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wsrb\" (UniqueName: \"kubernetes.io/projected/edf75c79-1cf6-4031-9f77-2c6f3c77dc28-kube-api-access-5wsrb\") pod \"network-check-source-6947749cfc-h5kxx\" (UID: \"edf75c79-1cf6-4031-9f77-2c6f3c77dc28\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-h5kxx" Jun 11 20:01:48.222083 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.222014 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkp96\" (UniqueName: \"kubernetes.io/projected/3f87ba75-1431-4113-a7df-cf35939bb63d-kube-api-access-vkp96\") pod \"cluster-monitoring-operator-f9d7df769-44fbb\" (UID: \"3f87ba75-1431-4113-a7df-cf35939bb63d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-44fbb" Jun 11 20:01:48.227510 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.227489 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-nbq4r"] Jun 11 20:01:48.230036 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.230018 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-nbq4r" Jun 11 20:01:48.236291 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.236270 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 11 20:01:48.236403 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.236271 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-5rq2k\"" Jun 11 20:01:48.238303 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.238288 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 11 20:01:48.248212 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.248182 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-nbq4r"] Jun 11 20:01:48.296075 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.296041 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbrb6\" (UniqueName: \"kubernetes.io/projected/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-kube-api-access-jbrb6\") pod \"router-default-64f5b86456-67889\" (UID: \"d4de4ed2-f4f2-4c34-b919-8c553e9df39f\") " pod="openshift-ingress/router-default-64f5b86456-67889" Jun 11 20:01:48.296075 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.296077 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9379570c-48c8-4906-80d9-8ec41b107a12-nginx-conf\") pod \"networking-console-plugin-867b76cb74-nbq4r\" (UID: \"9379570c-48c8-4906-80d9-8ec41b107a12\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-nbq4r" Jun 11 20:01:48.296339 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.296093 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qx84\" (UniqueName: \"kubernetes.io/projected/41492016-27bc-4186-aa74-739aae388ab0-kube-api-access-7qx84\") pod \"volume-data-source-validator-bd4ccd799-skt66\" (UID: \"41492016-27bc-4186-aa74-739aae388ab0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-skt66" Jun 11 20:01:48.296339 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.296111 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3e2eabc4-6dcb-442c-bfc3-d5d6d44f14c1-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-qtc8f\" (UID: \"3e2eabc4-6dcb-442c-bfc3-d5d6d44f14c1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-qtc8f" Jun 11 20:01:48.296339 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.296201 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-default-certificate\") pod \"router-default-64f5b86456-67889\" (UID: \"d4de4ed2-f4f2-4c34-b919-8c553e9df39f\") " pod="openshift-ingress/router-default-64f5b86456-67889" Jun 11 20:01:48.296339 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.296255 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75qnm\" (UniqueName: \"kubernetes.io/projected/2879d66f-9e25-414d-a09e-10decbb8fe7a-kube-api-access-75qnm\") pod \"cluster-samples-operator-9547488fd-5c2fq\" (UID: \"2879d66f-9e25-414d-a09e-10decbb8fe7a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5c2fq" Jun 11 20:01:48.296339 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.296295 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ba09d733-3024-4a3c-b49c-ab7213905587-serving-cert\") pod \"console-operator-5dbbb5d744-ckh6n\" (UID: \"ba09d733-3024-4a3c-b49c-ab7213905587\") " pod="openshift-console-operator/console-operator-5dbbb5d744-ckh6n" Jun 11 20:01:48.296339 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.296312 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld6mw\" (UniqueName: \"kubernetes.io/projected/ba09d733-3024-4a3c-b49c-ab7213905587-kube-api-access-ld6mw\") pod \"console-operator-5dbbb5d744-ckh6n\" (UID: \"ba09d733-3024-4a3c-b49c-ab7213905587\") " pod="openshift-console-operator/console-operator-5dbbb5d744-ckh6n" Jun 11 20:01:48.296339 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.296329 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2879d66f-9e25-414d-a09e-10decbb8fe7a-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-5c2fq\" (UID: \"2879d66f-9e25-414d-a09e-10decbb8fe7a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5c2fq" Jun 11 20:01:48.297032 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.296357 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ba09d733-3024-4a3c-b49c-ab7213905587-trusted-ca\") pod \"console-operator-5dbbb5d744-ckh6n\" (UID: \"ba09d733-3024-4a3c-b49c-ab7213905587\") " pod="openshift-console-operator/console-operator-5dbbb5d744-ckh6n" Jun 11 20:01:48.297032 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.296408 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-metrics-certs\") pod \"router-default-64f5b86456-67889\" (UID: \"d4de4ed2-f4f2-4c34-b919-8c553e9df39f\") " pod="openshift-ingress/router-default-64f5b86456-67889" Jun 11 20:01:48.297032 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.296432 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3e2eabc4-6dcb-442c-bfc3-d5d6d44f14c1-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-qtc8f\" (UID: \"3e2eabc4-6dcb-442c-bfc3-d5d6d44f14c1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-qtc8f" Jun 11 20:01:48.297032 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:48.296517 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 20:01:48.297032 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:48.296571 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 20:01:48.297032 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:48.296612 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2879d66f-9e25-414d-a09e-10decbb8fe7a-samples-operator-tls podName:2879d66f-9e25-414d-a09e-10decbb8fe7a nodeName:}" failed. No retries permitted until 2026-06-11 20:01:48.796593464 +0000 UTC m=+200.527755431 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2879d66f-9e25-414d-a09e-10decbb8fe7a-samples-operator-tls") pod "cluster-samples-operator-9547488fd-5c2fq" (UID: "2879d66f-9e25-414d-a09e-10decbb8fe7a") : secret "samples-operator-tls" not found Jun 11 20:01:48.297032 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:48.296637 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-metrics-certs podName:d4de4ed2-f4f2-4c34-b919-8c553e9df39f nodeName:}" failed. No retries permitted until 2026-06-11 20:01:48.796628841 +0000 UTC m=+200.527790795 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-metrics-certs") pod "router-default-64f5b86456-67889" (UID: "d4de4ed2-f4f2-4c34-b919-8c553e9df39f") : secret "router-metrics-certs-default" not found Jun 11 20:01:48.297032 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.296725 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9379570c-48c8-4906-80d9-8ec41b107a12-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-nbq4r\" (UID: \"9379570c-48c8-4906-80d9-8ec41b107a12\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-nbq4r" Jun 11 20:01:48.297032 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.296788 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-stats-auth\") pod \"router-default-64f5b86456-67889\" (UID: \"d4de4ed2-f4f2-4c34-b919-8c553e9df39f\") " pod="openshift-ingress/router-default-64f5b86456-67889" Jun 11 20:01:48.297032 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.296793 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3e2eabc4-6dcb-442c-bfc3-d5d6d44f14c1-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-qtc8f\" (UID: \"3e2eabc4-6dcb-442c-bfc3-d5d6d44f14c1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-qtc8f" Jun 11 20:01:48.297032 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.296817 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jgln\" (UniqueName: \"kubernetes.io/projected/3e2eabc4-6dcb-442c-bfc3-d5d6d44f14c1-kube-api-access-8jgln\") pod \"kube-storage-version-migrator-operator-7c578b78fc-qtc8f\" (UID: \"3e2eabc4-6dcb-442c-bfc3-d5d6d44f14c1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-qtc8f" Jun 11 20:01:48.297032 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.296890 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-service-ca-bundle\") pod \"router-default-64f5b86456-67889\" (UID: \"d4de4ed2-f4f2-4c34-b919-8c553e9df39f\") " pod="openshift-ingress/router-default-64f5b86456-67889" Jun 11 20:01:48.297032 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.296960 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ba09d733-3024-4a3c-b49c-ab7213905587-config\") pod \"console-operator-5dbbb5d744-ckh6n\" (UID: \"ba09d733-3024-4a3c-b49c-ab7213905587\") " pod="openshift-console-operator/console-operator-5dbbb5d744-ckh6n" Jun 11 20:01:48.297635 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:48.297193 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-service-ca-bundle podName:d4de4ed2-f4f2-4c34-b919-8c553e9df39f nodeName:}" failed. No retries permitted until 2026-06-11 20:01:48.797177042 +0000 UTC m=+200.528338997 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-service-ca-bundle") pod "router-default-64f5b86456-67889" (UID: "d4de4ed2-f4f2-4c34-b919-8c553e9df39f") : configmap references non-existent config key: service-ca.crt Jun 11 20:01:48.297635 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.297447 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ba09d733-3024-4a3c-b49c-ab7213905587-trusted-ca\") pod \"console-operator-5dbbb5d744-ckh6n\" (UID: \"ba09d733-3024-4a3c-b49c-ab7213905587\") " pod="openshift-console-operator/console-operator-5dbbb5d744-ckh6n" Jun 11 20:01:48.298032 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.298009 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ba09d733-3024-4a3c-b49c-ab7213905587-config\") pod \"console-operator-5dbbb5d744-ckh6n\" (UID: \"ba09d733-3024-4a3c-b49c-ab7213905587\") " pod="openshift-console-operator/console-operator-5dbbb5d744-ckh6n" Jun 11 20:01:48.298963 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.298935 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-default-certificate\") pod \"router-default-64f5b86456-67889\" (UID: \"d4de4ed2-f4f2-4c34-b919-8c553e9df39f\") " pod="openshift-ingress/router-default-64f5b86456-67889" Jun 11 20:01:48.299233 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.299217 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3e2eabc4-6dcb-442c-bfc3-d5d6d44f14c1-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-qtc8f\" (UID: \"3e2eabc4-6dcb-442c-bfc3-d5d6d44f14c1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-qtc8f" Jun 11 20:01:48.299369 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.299349 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ba09d733-3024-4a3c-b49c-ab7213905587-serving-cert\") pod \"console-operator-5dbbb5d744-ckh6n\" (UID: \"ba09d733-3024-4a3c-b49c-ab7213905587\") " pod="openshift-console-operator/console-operator-5dbbb5d744-ckh6n" Jun 11 20:01:48.299447 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.299429 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-stats-auth\") pod \"router-default-64f5b86456-67889\" (UID: \"d4de4ed2-f4f2-4c34-b919-8c553e9df39f\") " pod="openshift-ingress/router-default-64f5b86456-67889" Jun 11 20:01:48.312272 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.312239 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qx84\" (UniqueName: \"kubernetes.io/projected/41492016-27bc-4186-aa74-739aae388ab0-kube-api-access-7qx84\") pod \"volume-data-source-validator-bd4ccd799-skt66\" (UID: \"41492016-27bc-4186-aa74-739aae388ab0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-skt66" Jun 11 20:01:48.312610 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.312587 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbrb6\" (UniqueName: \"kubernetes.io/projected/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-kube-api-access-jbrb6\") pod \"router-default-64f5b86456-67889\" (UID: \"d4de4ed2-f4f2-4c34-b919-8c553e9df39f\") " pod="openshift-ingress/router-default-64f5b86456-67889" Jun 11 20:01:48.312803 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.312781 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jgln\" (UniqueName: \"kubernetes.io/projected/3e2eabc4-6dcb-442c-bfc3-d5d6d44f14c1-kube-api-access-8jgln\") pod \"kube-storage-version-migrator-operator-7c578b78fc-qtc8f\" (UID: \"3e2eabc4-6dcb-442c-bfc3-d5d6d44f14c1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-qtc8f" Jun 11 20:01:48.312920 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.312897 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75qnm\" (UniqueName: \"kubernetes.io/projected/2879d66f-9e25-414d-a09e-10decbb8fe7a-kube-api-access-75qnm\") pod \"cluster-samples-operator-9547488fd-5c2fq\" (UID: \"2879d66f-9e25-414d-a09e-10decbb8fe7a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5c2fq" Jun 11 20:01:48.313090 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.313076 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld6mw\" (UniqueName: \"kubernetes.io/projected/ba09d733-3024-4a3c-b49c-ab7213905587-kube-api-access-ld6mw\") pod \"console-operator-5dbbb5d744-ckh6n\" (UID: \"ba09d733-3024-4a3c-b49c-ab7213905587\") " pod="openshift-console-operator/console-operator-5dbbb5d744-ckh6n" Jun 11 20:01:48.359042 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.359016 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-h5kxx" Jun 11 20:01:48.369269 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.369235 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:01:48.377130 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.377104 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-ckh6n" Jun 11 20:01:48.398810 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.398681 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9379570c-48c8-4906-80d9-8ec41b107a12-nginx-conf\") pod \"networking-console-plugin-867b76cb74-nbq4r\" (UID: \"9379570c-48c8-4906-80d9-8ec41b107a12\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-nbq4r" Jun 11 20:01:48.398810 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.398804 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9379570c-48c8-4906-80d9-8ec41b107a12-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-nbq4r\" (UID: \"9379570c-48c8-4906-80d9-8ec41b107a12\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-nbq4r" Jun 11 20:01:48.399029 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:48.398932 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 20:01:48.399029 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:48.399018 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9379570c-48c8-4906-80d9-8ec41b107a12-networking-console-plugin-cert podName:9379570c-48c8-4906-80d9-8ec41b107a12 nodeName:}" failed. No retries permitted until 2026-06-11 20:01:48.89899783 +0000 UTC m=+200.630159788 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9379570c-48c8-4906-80d9-8ec41b107a12-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-nbq4r" (UID: "9379570c-48c8-4906-80d9-8ec41b107a12") : secret "networking-console-plugin-cert" not found Jun 11 20:01:48.399536 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.399515 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9379570c-48c8-4906-80d9-8ec41b107a12-nginx-conf\") pod \"networking-console-plugin-867b76cb74-nbq4r\" (UID: \"9379570c-48c8-4906-80d9-8ec41b107a12\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-nbq4r" Jun 11 20:01:48.432635 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.432603 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-skt66" Jun 11 20:01:48.436931 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.436819 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-qtc8f" Jun 11 20:01:48.472010 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.471934 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:01:48.497846 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.497466 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-h5kxx"] Jun 11 20:01:48.506465 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:01:48.506421 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedf75c79_1cf6_4031_9f77_2c6f3c77dc28.slice/crio-a8baf057b9d202a8023a87482eb50fa5c5a7181ea64e0074dad18f524f6f7a08 WatchSource:0}: Error finding container a8baf057b9d202a8023a87482eb50fa5c5a7181ea64e0074dad18f524f6f7a08: Status 404 returned error can't find the container with id a8baf057b9d202a8023a87482eb50fa5c5a7181ea64e0074dad18f524f6f7a08 Jun 11 20:01:48.530511 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.530487 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-ckh6n"] Jun 11 20:01:48.536456 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:01:48.536433 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba09d733_3024_4a3c_b49c_ab7213905587.slice/crio-2e5ae23a8ccbde9e0cecac3124216a1bb7d795d7cfff36cdf79fa5d73a7a3f79 WatchSource:0}: Error finding container 2e5ae23a8ccbde9e0cecac3124216a1bb7d795d7cfff36cdf79fa5d73a7a3f79: Status 404 returned error can't find the container with id 2e5ae23a8ccbde9e0cecac3124216a1bb7d795d7cfff36cdf79fa5d73a7a3f79 Jun 11 20:01:48.586268 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.585999 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-skt66"] Jun 11 20:01:48.588254 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:01:48.588218 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41492016_27bc_4186_aa74_739aae388ab0.slice/crio-1f3b54ab4a0638c6baf5978da1626de3231c981093eb9b387caa97d512ee6f4d WatchSource:0}: Error finding container 1f3b54ab4a0638c6baf5978da1626de3231c981093eb9b387caa97d512ee6f4d: Status 404 returned error can't find the container with id 1f3b54ab4a0638c6baf5978da1626de3231c981093eb9b387caa97d512ee6f4d Jun 11 20:01:48.601410 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.601369 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-qtc8f"] Jun 11 20:01:48.604498 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:01:48.604477 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e2eabc4_6dcb_442c_bfc3_d5d6d44f14c1.slice/crio-ca23f64e372954684ffc6ce528d8b76213c31282abbab264b23ef36bdf07f9a6 WatchSource:0}: Error finding container ca23f64e372954684ffc6ce528d8b76213c31282abbab264b23ef36bdf07f9a6: Status 404 returned error can't find the container with id ca23f64e372954684ffc6ce528d8b76213c31282abbab264b23ef36bdf07f9a6 Jun 11 20:01:48.701801 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.701763 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f87ba75-1431-4113-a7df-cf35939bb63d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-44fbb\" (UID: \"3f87ba75-1431-4113-a7df-cf35939bb63d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-44fbb" Jun 11 20:01:48.701967 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:48.701897 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 20:01:48.701967 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:48.701959 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f87ba75-1431-4113-a7df-cf35939bb63d-cluster-monitoring-operator-tls podName:3f87ba75-1431-4113-a7df-cf35939bb63d nodeName:}" failed. No retries permitted until 2026-06-11 20:01:49.701944275 +0000 UTC m=+201.433106231 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3f87ba75-1431-4113-a7df-cf35939bb63d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-44fbb" (UID: "3f87ba75-1431-4113-a7df-cf35939bb63d") : secret "cluster-monitoring-operator-tls" not found Jun 11 20:01:48.802305 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.802225 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2879d66f-9e25-414d-a09e-10decbb8fe7a-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-5c2fq\" (UID: \"2879d66f-9e25-414d-a09e-10decbb8fe7a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5c2fq" Jun 11 20:01:48.802305 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.802274 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-metrics-certs\") pod \"router-default-64f5b86456-67889\" (UID: \"d4de4ed2-f4f2-4c34-b919-8c553e9df39f\") " pod="openshift-ingress/router-default-64f5b86456-67889" Jun 11 20:01:48.802523 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.802333 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-service-ca-bundle\") pod \"router-default-64f5b86456-67889\" (UID: \"d4de4ed2-f4f2-4c34-b919-8c553e9df39f\") " pod="openshift-ingress/router-default-64f5b86456-67889" Jun 11 20:01:48.802523 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:48.802427 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 20:01:48.802523 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:48.802456 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 20:01:48.802523 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:48.802506 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2879d66f-9e25-414d-a09e-10decbb8fe7a-samples-operator-tls podName:2879d66f-9e25-414d-a09e-10decbb8fe7a nodeName:}" failed. No retries permitted until 2026-06-11 20:01:49.802485065 +0000 UTC m=+201.533647031 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2879d66f-9e25-414d-a09e-10decbb8fe7a-samples-operator-tls") pod "cluster-samples-operator-9547488fd-5c2fq" (UID: "2879d66f-9e25-414d-a09e-10decbb8fe7a") : secret "samples-operator-tls" not found Jun 11 20:01:48.802523 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:48.802524 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-metrics-certs podName:d4de4ed2-f4f2-4c34-b919-8c553e9df39f nodeName:}" failed. No retries permitted until 2026-06-11 20:01:49.80251473 +0000 UTC m=+201.533676697 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-metrics-certs") pod "router-default-64f5b86456-67889" (UID: "d4de4ed2-f4f2-4c34-b919-8c553e9df39f") : secret "router-metrics-certs-default" not found Jun 11 20:01:48.802688 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:48.802538 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-service-ca-bundle podName:d4de4ed2-f4f2-4c34-b919-8c553e9df39f nodeName:}" failed. No retries permitted until 2026-06-11 20:01:49.802530158 +0000 UTC m=+201.533692117 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-service-ca-bundle") pod "router-default-64f5b86456-67889" (UID: "d4de4ed2-f4f2-4c34-b919-8c553e9df39f") : configmap references non-existent config key: service-ca.crt Jun 11 20:01:48.902987 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:48.902955 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9379570c-48c8-4906-80d9-8ec41b107a12-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-nbq4r\" (UID: \"9379570c-48c8-4906-80d9-8ec41b107a12\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-nbq4r" Jun 11 20:01:48.903162 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:48.903126 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 20:01:48.903246 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:48.903208 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9379570c-48c8-4906-80d9-8ec41b107a12-networking-console-plugin-cert podName:9379570c-48c8-4906-80d9-8ec41b107a12 nodeName:}" failed. No retries permitted until 2026-06-11 20:01:49.903186901 +0000 UTC m=+201.634348874 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9379570c-48c8-4906-80d9-8ec41b107a12-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-nbq4r" (UID: "9379570c-48c8-4906-80d9-8ec41b107a12") : secret "networking-console-plugin-cert" not found Jun 11 20:01:49.421192 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:49.421150 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-qtc8f" event={"ID":"3e2eabc4-6dcb-442c-bfc3-d5d6d44f14c1","Type":"ContainerStarted","Data":"ca23f64e372954684ffc6ce528d8b76213c31282abbab264b23ef36bdf07f9a6"} Jun 11 20:01:49.422583 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:49.422532 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-skt66" event={"ID":"41492016-27bc-4186-aa74-739aae388ab0","Type":"ContainerStarted","Data":"1f3b54ab4a0638c6baf5978da1626de3231c981093eb9b387caa97d512ee6f4d"} Jun 11 20:01:49.424873 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:49.424457 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-h5kxx" event={"ID":"edf75c79-1cf6-4031-9f77-2c6f3c77dc28","Type":"ContainerStarted","Data":"f97414d727bcdc16bc17654371e8fdd61432e0ee7ce5cb73bab045d0e00dd7ef"} Jun 11 20:01:49.424873 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:49.424502 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-h5kxx" event={"ID":"edf75c79-1cf6-4031-9f77-2c6f3c77dc28","Type":"ContainerStarted","Data":"a8baf057b9d202a8023a87482eb50fa5c5a7181ea64e0074dad18f524f6f7a08"} Jun 11 20:01:49.426462 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:49.426436 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-ckh6n" event={"ID":"ba09d733-3024-4a3c-b49c-ab7213905587","Type":"ContainerStarted","Data":"2e5ae23a8ccbde9e0cecac3124216a1bb7d795d7cfff36cdf79fa5d73a7a3f79"} Jun 11 20:01:49.443846 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:49.443640 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6947749cfc-h5kxx" podStartSLOduration=1.443624108 podStartE2EDuration="1.443624108s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:01:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:01:49.442361102 +0000 UTC m=+201.173523078" watchObservedRunningTime="2026-06-11 20:01:49.443624108 +0000 UTC m=+201.174786082" Jun 11 20:01:49.709694 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:49.709604 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f87ba75-1431-4113-a7df-cf35939bb63d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-44fbb\" (UID: \"3f87ba75-1431-4113-a7df-cf35939bb63d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-44fbb" Jun 11 20:01:49.709865 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:49.709730 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 20:01:49.709865 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:49.709803 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f87ba75-1431-4113-a7df-cf35939bb63d-cluster-monitoring-operator-tls podName:3f87ba75-1431-4113-a7df-cf35939bb63d nodeName:}" failed. No retries permitted until 2026-06-11 20:01:51.709786189 +0000 UTC m=+203.440948145 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3f87ba75-1431-4113-a7df-cf35939bb63d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-44fbb" (UID: "3f87ba75-1431-4113-a7df-cf35939bb63d") : secret "cluster-monitoring-operator-tls" not found Jun 11 20:01:49.810311 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:49.810271 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-metrics-certs\") pod \"router-default-64f5b86456-67889\" (UID: \"d4de4ed2-f4f2-4c34-b919-8c553e9df39f\") " pod="openshift-ingress/router-default-64f5b86456-67889" Jun 11 20:01:49.810504 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:49.810403 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-service-ca-bundle\") pod \"router-default-64f5b86456-67889\" (UID: \"d4de4ed2-f4f2-4c34-b919-8c553e9df39f\") " pod="openshift-ingress/router-default-64f5b86456-67889" Jun 11 20:01:49.810585 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:49.810509 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2879d66f-9e25-414d-a09e-10decbb8fe7a-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-5c2fq\" (UID: \"2879d66f-9e25-414d-a09e-10decbb8fe7a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5c2fq" Jun 11 20:01:49.810658 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:49.810640 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 20:01:49.810722 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:49.810712 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2879d66f-9e25-414d-a09e-10decbb8fe7a-samples-operator-tls podName:2879d66f-9e25-414d-a09e-10decbb8fe7a nodeName:}" failed. No retries permitted until 2026-06-11 20:01:51.810691085 +0000 UTC m=+203.541853042 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2879d66f-9e25-414d-a09e-10decbb8fe7a-samples-operator-tls") pod "cluster-samples-operator-9547488fd-5c2fq" (UID: "2879d66f-9e25-414d-a09e-10decbb8fe7a") : secret "samples-operator-tls" not found Jun 11 20:01:49.811002 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:49.810875 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-service-ca-bundle podName:d4de4ed2-f4f2-4c34-b919-8c553e9df39f nodeName:}" failed. No retries permitted until 2026-06-11 20:01:51.810859731 +0000 UTC m=+203.542021688 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-service-ca-bundle") pod "router-default-64f5b86456-67889" (UID: "d4de4ed2-f4f2-4c34-b919-8c553e9df39f") : configmap references non-existent config key: service-ca.crt Jun 11 20:01:49.811002 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:49.810909 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 20:01:49.811002 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:49.810976 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-metrics-certs podName:d4de4ed2-f4f2-4c34-b919-8c553e9df39f nodeName:}" failed. No retries permitted until 2026-06-11 20:01:51.810956251 +0000 UTC m=+203.542118204 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-metrics-certs") pod "router-default-64f5b86456-67889" (UID: "d4de4ed2-f4f2-4c34-b919-8c553e9df39f") : secret "router-metrics-certs-default" not found Jun 11 20:01:49.911459 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:49.911431 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9379570c-48c8-4906-80d9-8ec41b107a12-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-nbq4r\" (UID: \"9379570c-48c8-4906-80d9-8ec41b107a12\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-nbq4r" Jun 11 20:01:49.911630 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:49.911599 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 20:01:49.911688 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:49.911676 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9379570c-48c8-4906-80d9-8ec41b107a12-networking-console-plugin-cert podName:9379570c-48c8-4906-80d9-8ec41b107a12 nodeName:}" failed. No retries permitted until 2026-06-11 20:01:51.911656122 +0000 UTC m=+203.642818087 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9379570c-48c8-4906-80d9-8ec41b107a12-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-nbq4r" (UID: "9379570c-48c8-4906-80d9-8ec41b107a12") : secret "networking-console-plugin-cert" not found Jun 11 20:01:50.431543 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:50.431504 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-skt66" event={"ID":"41492016-27bc-4186-aa74-739aae388ab0","Type":"ContainerStarted","Data":"8ad44e41bf93a477f5b60859a131f546e6d431695ad0e3b033d974096b1c672c"} Jun 11 20:01:50.448220 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:50.448167 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-skt66" podStartSLOduration=1.186224518 podStartE2EDuration="2.448145311s" totalImagesPullingTime="1.261920793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:01:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:01:50.446685823 +0000 UTC m=+202.177847798" watchObservedRunningTime="2026-06-11 20:01:50.448145311 +0000 UTC m=+202.179307288" Jun 11 20:01:50.530937 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:50.530898 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:01:50.594639 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:50.594609 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:01:51.348116 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:51.348085 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-g7qbq"] Jun 11 20:01:51.350005 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:51.349990 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g7qbq" Jun 11 20:01:51.353339 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:51.353320 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 20:01:51.353590 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:51.353575 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 20:01:51.354438 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:51.354420 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 20:01:51.354510 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:51.354435 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-l4879\"" Jun 11 20:01:51.354563 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:51.354437 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 20:01:51.371712 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:51.371684 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g7qbq"] Jun 11 20:01:51.408643 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:51.408615 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:01:51.425956 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:51.425925 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg2rn\" (UniqueName: \"kubernetes.io/projected/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-kube-api-access-bg2rn\") pod \"insights-runtime-extractor-g7qbq\" (UID: \"9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792\") " pod="openshift-insights/insights-runtime-extractor-g7qbq" Jun 11 20:01:51.426083 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:51.425994 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-crio-socket\") pod \"insights-runtime-extractor-g7qbq\" (UID: \"9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792\") " pod="openshift-insights/insights-runtime-extractor-g7qbq" Jun 11 20:01:51.426083 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:51.426035 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-data-volume\") pod \"insights-runtime-extractor-g7qbq\" (UID: \"9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792\") " pod="openshift-insights/insights-runtime-extractor-g7qbq" Jun 11 20:01:51.426083 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:51.426062 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g7qbq\" (UID: \"9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792\") " pod="openshift-insights/insights-runtime-extractor-g7qbq" Jun 11 20:01:51.426244 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:51.426122 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g7qbq\" (UID: \"9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792\") " pod="openshift-insights/insights-runtime-extractor-g7qbq" Jun 11 20:01:51.436030 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:51.436004 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ckh6n_ba09d733-3024-4a3c-b49c-ab7213905587/console-operator/0.log" Jun 11 20:01:51.436474 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:51.436052 2562 generic.go:356] "Generic (PLEG): container finished" podID="ba09d733-3024-4a3c-b49c-ab7213905587" containerID="723e8e80bbea390dd3df4d077a45d7ef494ef889326fae9f67d6df07529b22ff" exitCode=255 Jun 11 20:01:51.436474 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:51.436146 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-ckh6n" event={"ID":"ba09d733-3024-4a3c-b49c-ab7213905587","Type":"ContainerDied","Data":"723e8e80bbea390dd3df4d077a45d7ef494ef889326fae9f67d6df07529b22ff"} Jun 11 20:01:51.436474 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:51.436406 2562 scope.go:117] "RemoveContainer" containerID="723e8e80bbea390dd3df4d077a45d7ef494ef889326fae9f67d6df07529b22ff" Jun 11 20:01:51.437783 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:51.437756 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-qtc8f" event={"ID":"3e2eabc4-6dcb-442c-bfc3-d5d6d44f14c1","Type":"ContainerStarted","Data":"34054c22e17dd9026bf0856d65b6f693892b532e709d6a3c3d206f84b16f130b"} Jun 11 20:01:51.490202 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:51.490170 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:01:51.527662 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:51.527628 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g7qbq\" (UID: \"9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792\") " pod="openshift-insights/insights-runtime-extractor-g7qbq" Jun 11 20:01:51.527821 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:51.527760 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 20:01:51.527875 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:51.527836 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-kube-rbac-proxy-cm podName:9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792 nodeName:}" failed. No retries permitted until 2026-06-11 20:01:52.027813919 +0000 UTC m=+203.758975883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g7qbq" (UID: "9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792") : configmap "kube-rbac-proxy" not found Jun 11 20:01:51.528235 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:51.528201 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg2rn\" (UniqueName: \"kubernetes.io/projected/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-kube-api-access-bg2rn\") pod \"insights-runtime-extractor-g7qbq\" (UID: \"9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792\") " pod="openshift-insights/insights-runtime-extractor-g7qbq" Jun 11 20:01:51.528690 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:51.528291 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-crio-socket\") pod \"insights-runtime-extractor-g7qbq\" (UID: \"9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792\") " pod="openshift-insights/insights-runtime-extractor-g7qbq" Jun 11 20:01:51.529056 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:51.528869 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-crio-socket\") pod \"insights-runtime-extractor-g7qbq\" (UID: \"9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792\") " pod="openshift-insights/insights-runtime-extractor-g7qbq" Jun 11 20:01:51.533960 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:51.529313 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-data-volume\") pod \"insights-runtime-extractor-g7qbq\" (UID: \"9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792\") " pod="openshift-insights/insights-runtime-extractor-g7qbq" Jun 11 20:01:51.533960 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:51.529352 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g7qbq\" (UID: \"9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792\") " pod="openshift-insights/insights-runtime-extractor-g7qbq" Jun 11 20:01:51.533960 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:51.529725 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-data-volume\") pod \"insights-runtime-extractor-g7qbq\" (UID: \"9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792\") " pod="openshift-insights/insights-runtime-extractor-g7qbq" Jun 11 20:01:51.533960 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:51.530773 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 20:01:51.533960 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:51.530887 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-insights-runtime-extractor-tls podName:9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792 nodeName:}" failed. No retries permitted until 2026-06-11 20:01:52.03086887 +0000 UTC m=+203.762030829 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g7qbq" (UID: "9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792") : secret "insights-runtime-extractor-tls" not found Jun 11 20:01:51.545478 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:51.545445 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg2rn\" (UniqueName: \"kubernetes.io/projected/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-kube-api-access-bg2rn\") pod \"insights-runtime-extractor-g7qbq\" (UID: \"9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792\") " pod="openshift-insights/insights-runtime-extractor-g7qbq" Jun 11 20:01:51.732858 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:51.732763 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f87ba75-1431-4113-a7df-cf35939bb63d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-44fbb\" (UID: \"3f87ba75-1431-4113-a7df-cf35939bb63d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-44fbb" Jun 11 20:01:51.733019 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:51.732933 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 20:01:51.733019 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:51.733007 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f87ba75-1431-4113-a7df-cf35939bb63d-cluster-monitoring-operator-tls podName:3f87ba75-1431-4113-a7df-cf35939bb63d nodeName:}" failed. No retries permitted until 2026-06-11 20:01:55.732988861 +0000 UTC m=+207.464150832 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3f87ba75-1431-4113-a7df-cf35939bb63d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-44fbb" (UID: "3f87ba75-1431-4113-a7df-cf35939bb63d") : secret "cluster-monitoring-operator-tls" not found Jun 11 20:01:51.833469 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:51.833423 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2879d66f-9e25-414d-a09e-10decbb8fe7a-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-5c2fq\" (UID: \"2879d66f-9e25-414d-a09e-10decbb8fe7a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5c2fq" Jun 11 20:01:51.833469 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:51.833472 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-metrics-certs\") pod \"router-default-64f5b86456-67889\" (UID: \"d4de4ed2-f4f2-4c34-b919-8c553e9df39f\") " pod="openshift-ingress/router-default-64f5b86456-67889" Jun 11 20:01:51.833657 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:51.833580 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 20:01:51.833657 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:51.833648 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2879d66f-9e25-414d-a09e-10decbb8fe7a-samples-operator-tls podName:2879d66f-9e25-414d-a09e-10decbb8fe7a nodeName:}" failed. No retries permitted until 2026-06-11 20:01:55.833625759 +0000 UTC m=+207.564787713 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2879d66f-9e25-414d-a09e-10decbb8fe7a-samples-operator-tls") pod "cluster-samples-operator-9547488fd-5c2fq" (UID: "2879d66f-9e25-414d-a09e-10decbb8fe7a") : secret "samples-operator-tls" not found Jun 11 20:01:51.833733 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:51.833691 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 20:01:51.833762 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:51.833747 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-metrics-certs podName:d4de4ed2-f4f2-4c34-b919-8c553e9df39f nodeName:}" failed. No retries permitted until 2026-06-11 20:01:55.833733542 +0000 UTC m=+207.564895521 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-metrics-certs") pod "router-default-64f5b86456-67889" (UID: "d4de4ed2-f4f2-4c34-b919-8c553e9df39f") : secret "router-metrics-certs-default" not found Jun 11 20:01:51.833801 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:51.833783 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-service-ca-bundle\") pod \"router-default-64f5b86456-67889\" (UID: \"d4de4ed2-f4f2-4c34-b919-8c553e9df39f\") " pod="openshift-ingress/router-default-64f5b86456-67889" Jun 11 20:01:51.833996 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:51.833981 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-service-ca-bundle podName:d4de4ed2-f4f2-4c34-b919-8c553e9df39f nodeName:}" failed. No retries permitted until 2026-06-11 20:01:55.833966088 +0000 UTC m=+207.565128041 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-service-ca-bundle") pod "router-default-64f5b86456-67889" (UID: "d4de4ed2-f4f2-4c34-b919-8c553e9df39f") : configmap references non-existent config key: service-ca.crt Jun 11 20:01:51.934620 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:51.934583 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9379570c-48c8-4906-80d9-8ec41b107a12-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-nbq4r\" (UID: \"9379570c-48c8-4906-80d9-8ec41b107a12\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-nbq4r" Jun 11 20:01:51.934780 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:51.934700 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 20:01:51.934780 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:51.934758 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9379570c-48c8-4906-80d9-8ec41b107a12-networking-console-plugin-cert podName:9379570c-48c8-4906-80d9-8ec41b107a12 nodeName:}" failed. No retries permitted until 2026-06-11 20:01:55.93474124 +0000 UTC m=+207.665903197 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9379570c-48c8-4906-80d9-8ec41b107a12-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-nbq4r" (UID: "9379570c-48c8-4906-80d9-8ec41b107a12") : secret "networking-console-plugin-cert" not found Jun 11 20:01:51.952667 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:51.952632 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:01:52.035985 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:52.035885 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g7qbq\" (UID: \"9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792\") " pod="openshift-insights/insights-runtime-extractor-g7qbq" Jun 11 20:01:52.035985 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:52.035950 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g7qbq\" (UID: \"9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792\") " pod="openshift-insights/insights-runtime-extractor-g7qbq" Jun 11 20:01:52.036184 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:52.036029 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 20:01:52.036184 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:52.036076 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 20:01:52.036184 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:52.036097 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-insights-runtime-extractor-tls podName:9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792 nodeName:}" failed. No retries permitted until 2026-06-11 20:01:53.036081661 +0000 UTC m=+204.767243615 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g7qbq" (UID: "9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792") : secret "insights-runtime-extractor-tls" not found Jun 11 20:01:52.036184 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:52.036129 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-kube-rbac-proxy-cm podName:9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792 nodeName:}" failed. No retries permitted until 2026-06-11 20:01:53.036115648 +0000 UTC m=+204.767277601 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g7qbq" (UID: "9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792") : configmap "kube-rbac-proxy" not found Jun 11 20:01:52.052534 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:52.052503 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:01:52.442909 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:52.442879 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ckh6n_ba09d733-3024-4a3c-b49c-ab7213905587/console-operator/1.log" Jun 11 20:01:52.443277 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:52.443259 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ckh6n_ba09d733-3024-4a3c-b49c-ab7213905587/console-operator/0.log" Jun 11 20:01:52.443334 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:52.443295 2562 generic.go:356] "Generic (PLEG): container finished" podID="ba09d733-3024-4a3c-b49c-ab7213905587" containerID="2e5948d73689751de0571a9b670c5509af7dce8b83477f3300d3ad9b149870fd" exitCode=255 Jun 11 20:01:52.443419 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:52.443398 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-ckh6n" event={"ID":"ba09d733-3024-4a3c-b49c-ab7213905587","Type":"ContainerDied","Data":"2e5948d73689751de0571a9b670c5509af7dce8b83477f3300d3ad9b149870fd"} Jun 11 20:01:52.443495 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:52.443483 2562 scope.go:117] "RemoveContainer" containerID="723e8e80bbea390dd3df4d077a45d7ef494ef889326fae9f67d6df07529b22ff" Jun 11 20:01:52.443687 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:52.443669 2562 scope.go:117] "RemoveContainer" containerID="2e5948d73689751de0571a9b670c5509af7dce8b83477f3300d3ad9b149870fd" Jun 11 20:01:52.443864 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:52.443846 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-ckh6n_openshift-console-operator(ba09d733-3024-4a3c-b49c-ab7213905587)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-ckh6n" podUID="ba09d733-3024-4a3c-b49c-ab7213905587" Jun 11 20:01:52.465284 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:52.465237 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-qtc8f" podStartSLOduration=1.998118989 podStartE2EDuration="4.465222662s" totalImagesPullingTime="2.467103673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:01:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:01:51.477122636 +0000 UTC m=+203.208284621" watchObservedRunningTime="2026-06-11 20:01:52.465222662 +0000 UTC m=+204.196384691" Jun 11 20:01:53.044463 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:53.044415 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g7qbq\" (UID: \"9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792\") " pod="openshift-insights/insights-runtime-extractor-g7qbq" Jun 11 20:01:53.044463 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:53.044474 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g7qbq\" (UID: \"9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792\") " pod="openshift-insights/insights-runtime-extractor-g7qbq" Jun 11 20:01:53.044682 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:53.044569 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 20:01:53.044682 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:53.044573 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 20:01:53.044682 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:53.044644 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-kube-rbac-proxy-cm podName:9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792 nodeName:}" failed. No retries permitted until 2026-06-11 20:01:55.044630035 +0000 UTC m=+206.775791988 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g7qbq" (UID: "9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792") : configmap "kube-rbac-proxy" not found Jun 11 20:01:53.044682 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:53.044656 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-insights-runtime-extractor-tls podName:9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792 nodeName:}" failed. No retries permitted until 2026-06-11 20:01:55.044650291 +0000 UTC m=+206.775812244 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g7qbq" (UID: "9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792") : secret "insights-runtime-extractor-tls" not found Jun 11 20:01:53.431132 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:53.431096 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:01:53.448636 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:53.448612 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ckh6n_ba09d733-3024-4a3c-b49c-ab7213905587/console-operator/1.log" Jun 11 20:01:53.448999 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:53.448946 2562 scope.go:117] "RemoveContainer" containerID="2e5948d73689751de0571a9b670c5509af7dce8b83477f3300d3ad9b149870fd" Jun 11 20:01:53.449108 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:53.449089 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-ckh6n_openshift-console-operator(ba09d733-3024-4a3c-b49c-ab7213905587)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-ckh6n" podUID="ba09d733-3024-4a3c-b49c-ab7213905587" Jun 11 20:01:53.531918 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:53.531889 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:01:53.558321 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:53.558297 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lb5qs_ad153657-154e-4342-b701-95873f67a210/dns-node-resolver/0.log" Jun 11 20:01:53.650570 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:53.650536 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:01:53.749559 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:53.749477 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:01:54.145334 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:54.145307 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:01:54.158093 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:54.158068 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-648xp_1b6c5b1c-65de-4fe3-9ccd-9c2996176ccb/node-ca/0.log" Jun 11 20:01:54.244062 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:54.244039 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:01:54.652559 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:54.652530 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:01:54.754157 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:54.754121 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:01:55.061180 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:55.061081 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g7qbq\" (UID: \"9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792\") " pod="openshift-insights/insights-runtime-extractor-g7qbq" Jun 11 20:01:55.061180 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:55.061141 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g7qbq\" (UID: \"9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792\") " pod="openshift-insights/insights-runtime-extractor-g7qbq" Jun 11 20:01:55.061413 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:55.061210 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 20:01:55.061413 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:55.061239 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 20:01:55.061413 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:55.061289 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-insights-runtime-extractor-tls podName:9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792 nodeName:}" failed. No retries permitted until 2026-06-11 20:01:59.06127103 +0000 UTC m=+210.792433000 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g7qbq" (UID: "9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792") : secret "insights-runtime-extractor-tls" not found Jun 11 20:01:55.061413 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:55.061316 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-kube-rbac-proxy-cm podName:9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792 nodeName:}" failed. No retries permitted until 2026-06-11 20:01:59.061306798 +0000 UTC m=+210.792468754 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g7qbq" (UID: "9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792") : configmap "kube-rbac-proxy" not found Jun 11 20:01:55.358489 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:55.358464 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nclx5_d5823bf3-bd2b-498e-b24c-5787b60f595c/serve-healthcheck-canary/0.log" Jun 11 20:01:55.768168 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:55.768082 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f87ba75-1431-4113-a7df-cf35939bb63d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-44fbb\" (UID: \"3f87ba75-1431-4113-a7df-cf35939bb63d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-44fbb" Jun 11 20:01:55.768645 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:55.768259 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 20:01:55.768645 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:55.768339 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f87ba75-1431-4113-a7df-cf35939bb63d-cluster-monitoring-operator-tls podName:3f87ba75-1431-4113-a7df-cf35939bb63d nodeName:}" failed. No retries permitted until 2026-06-11 20:02:03.768318893 +0000 UTC m=+215.499480865 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3f87ba75-1431-4113-a7df-cf35939bb63d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-44fbb" (UID: "3f87ba75-1431-4113-a7df-cf35939bb63d") : secret "cluster-monitoring-operator-tls" not found Jun 11 20:01:55.828456 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:55.828423 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:01:55.868986 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:55.868937 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2879d66f-9e25-414d-a09e-10decbb8fe7a-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-5c2fq\" (UID: \"2879d66f-9e25-414d-a09e-10decbb8fe7a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5c2fq" Jun 11 20:01:55.868986 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:55.868997 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-metrics-certs\") pod \"router-default-64f5b86456-67889\" (UID: \"d4de4ed2-f4f2-4c34-b919-8c553e9df39f\") " pod="openshift-ingress/router-default-64f5b86456-67889" Jun 11 20:01:55.869159 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:55.869052 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-service-ca-bundle\") pod \"router-default-64f5b86456-67889\" (UID: \"d4de4ed2-f4f2-4c34-b919-8c553e9df39f\") " pod="openshift-ingress/router-default-64f5b86456-67889" Jun 11 20:01:55.869159 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:55.869115 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 20:01:55.869159 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:55.869138 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 20:01:55.869263 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:55.869186 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-service-ca-bundle podName:d4de4ed2-f4f2-4c34-b919-8c553e9df39f nodeName:}" failed. No retries permitted until 2026-06-11 20:02:03.869173521 +0000 UTC m=+215.600335475 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-service-ca-bundle") pod "router-default-64f5b86456-67889" (UID: "d4de4ed2-f4f2-4c34-b919-8c553e9df39f") : configmap references non-existent config key: service-ca.crt Jun 11 20:01:55.869263 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:55.869200 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-metrics-certs podName:d4de4ed2-f4f2-4c34-b919-8c553e9df39f nodeName:}" failed. No retries permitted until 2026-06-11 20:02:03.869194186 +0000 UTC m=+215.600356140 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-metrics-certs") pod "router-default-64f5b86456-67889" (UID: "d4de4ed2-f4f2-4c34-b919-8c553e9df39f") : secret "router-metrics-certs-default" not found Jun 11 20:01:55.869263 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:55.869209 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2879d66f-9e25-414d-a09e-10decbb8fe7a-samples-operator-tls podName:2879d66f-9e25-414d-a09e-10decbb8fe7a nodeName:}" failed. No retries permitted until 2026-06-11 20:02:03.869203886 +0000 UTC m=+215.600365838 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2879d66f-9e25-414d-a09e-10decbb8fe7a-samples-operator-tls") pod "cluster-samples-operator-9547488fd-5c2fq" (UID: "2879d66f-9e25-414d-a09e-10decbb8fe7a") : secret "samples-operator-tls" not found Jun 11 20:01:55.928479 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:55.928450 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:01:55.969564 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:55.969536 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9379570c-48c8-4906-80d9-8ec41b107a12-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-nbq4r\" (UID: \"9379570c-48c8-4906-80d9-8ec41b107a12\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-nbq4r" Jun 11 20:01:55.969697 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:55.969678 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 20:01:55.969746 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:55.969737 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9379570c-48c8-4906-80d9-8ec41b107a12-networking-console-plugin-cert podName:9379570c-48c8-4906-80d9-8ec41b107a12 nodeName:}" failed. No retries permitted until 2026-06-11 20:02:03.969723317 +0000 UTC m=+215.700885274 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9379570c-48c8-4906-80d9-8ec41b107a12-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-nbq4r" (UID: "9379570c-48c8-4906-80d9-8ec41b107a12") : secret "networking-console-plugin-cert" not found Jun 11 20:01:56.717708 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:56.717675 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:01:57.062650 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:57.062569 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:01:57.472396 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:57.472334 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:01:57.632238 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:57.632203 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:01:57.728656 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:57.728571 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:01:57.833017 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:57.832989 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:01:58.080876 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:58.080845 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:01:58.238177 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:58.238142 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:01:58.377942 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:58.377869 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-ckh6n" Jun 11 20:01:58.377942 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:58.377923 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-ckh6n" Jun 11 20:01:58.378260 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:58.378248 2562 scope.go:117] "RemoveContainer" containerID="2e5948d73689751de0571a9b670c5509af7dce8b83477f3300d3ad9b149870fd" Jun 11 20:01:58.378429 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:58.378412 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-ckh6n_openshift-console-operator(ba09d733-3024-4a3c-b49c-ab7213905587)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-ckh6n" podUID="ba09d733-3024-4a3c-b49c-ab7213905587" Jun 11 20:01:59.099413 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:59.099354 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g7qbq\" (UID: \"9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792\") " pod="openshift-insights/insights-runtime-extractor-g7qbq" Jun 11 20:01:59.099819 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:59.099431 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g7qbq\" (UID: \"9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792\") " pod="openshift-insights/insights-runtime-extractor-g7qbq" Jun 11 20:01:59.099819 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:59.099496 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 20:01:59.099819 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:59.099502 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 20:01:59.099819 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:59.099572 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-insights-runtime-extractor-tls podName:9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792 nodeName:}" failed. No retries permitted until 2026-06-11 20:02:07.099556218 +0000 UTC m=+218.830718176 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g7qbq" (UID: "9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792") : secret "insights-runtime-extractor-tls" not found Jun 11 20:01:59.099819 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:01:59.099588 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-kube-rbac-proxy-cm podName:9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792 nodeName:}" failed. No retries permitted until 2026-06-11 20:02:07.099580028 +0000 UTC m=+218.830741981 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g7qbq" (UID: "9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792") : configmap "kube-rbac-proxy" not found Jun 11 20:01:59.215841 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:59.215810 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:01:59.622768 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:59.622726 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:01:59.854772 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:59.854733 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:01:59.961076 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:01:59.960993 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:00.062652 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:00.062617 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:00.223779 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:00.223694 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:00.421601 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:00.421570 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:00.920508 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:00.920477 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:01.021119 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:01.021085 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:01.121091 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:01.121063 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:01.246824 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:01.246744 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:01.645331 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:01.645270 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:01.810046 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:01.810017 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:01.868571 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:01.868541 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:02.013334 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:02.013254 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:02.218713 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:02.218675 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:02.479797 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:02.479764 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:02.580093 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:02.580069 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:03.215827 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:03.215792 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:03.550226 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:03.550141 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:03.655091 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:03.655055 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:03.810747 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:03.810652 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:03.841921 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:03.841882 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f87ba75-1431-4113-a7df-cf35939bb63d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-44fbb\" (UID: \"3f87ba75-1431-4113-a7df-cf35939bb63d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-44fbb" Jun 11 20:02:03.842080 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:02:03.841984 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 20:02:03.842080 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:02:03.842037 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f87ba75-1431-4113-a7df-cf35939bb63d-cluster-monitoring-operator-tls podName:3f87ba75-1431-4113-a7df-cf35939bb63d nodeName:}" failed. No retries permitted until 2026-06-11 20:02:19.842024005 +0000 UTC m=+231.573185957 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3f87ba75-1431-4113-a7df-cf35939bb63d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-44fbb" (UID: "3f87ba75-1431-4113-a7df-cf35939bb63d") : secret "cluster-monitoring-operator-tls" not found Jun 11 20:02:03.943171 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:03.943137 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-service-ca-bundle\") pod \"router-default-64f5b86456-67889\" (UID: \"d4de4ed2-f4f2-4c34-b919-8c553e9df39f\") " pod="openshift-ingress/router-default-64f5b86456-67889" Jun 11 20:02:03.943363 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:03.943227 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2879d66f-9e25-414d-a09e-10decbb8fe7a-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-5c2fq\" (UID: \"2879d66f-9e25-414d-a09e-10decbb8fe7a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5c2fq" Jun 11 20:02:03.943363 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:03.943249 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-metrics-certs\") pod \"router-default-64f5b86456-67889\" (UID: \"d4de4ed2-f4f2-4c34-b919-8c553e9df39f\") " pod="openshift-ingress/router-default-64f5b86456-67889" Jun 11 20:02:03.943873 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:03.943841 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-service-ca-bundle\") pod \"router-default-64f5b86456-67889\" (UID: \"d4de4ed2-f4f2-4c34-b919-8c553e9df39f\") " pod="openshift-ingress/router-default-64f5b86456-67889" Jun 11 20:02:03.945784 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:03.945759 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2879d66f-9e25-414d-a09e-10decbb8fe7a-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-5c2fq\" (UID: \"2879d66f-9e25-414d-a09e-10decbb8fe7a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5c2fq" Jun 11 20:02:03.945875 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:03.945834 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4de4ed2-f4f2-4c34-b919-8c553e9df39f-metrics-certs\") pod \"router-default-64f5b86456-67889\" (UID: \"d4de4ed2-f4f2-4c34-b919-8c553e9df39f\") " pod="openshift-ingress/router-default-64f5b86456-67889" Jun 11 20:02:03.971149 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:03.971122 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-64f5b86456-67889" Jun 11 20:02:04.015165 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:04.015134 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:04.044746 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:04.044708 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9379570c-48c8-4906-80d9-8ec41b107a12-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-nbq4r\" (UID: \"9379570c-48c8-4906-80d9-8ec41b107a12\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-nbq4r" Jun 11 20:02:04.044897 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:02:04.044854 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 20:02:04.044936 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:02:04.044921 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9379570c-48c8-4906-80d9-8ec41b107a12-networking-console-plugin-cert podName:9379570c-48c8-4906-80d9-8ec41b107a12 nodeName:}" failed. No retries permitted until 2026-06-11 20:02:20.044903161 +0000 UTC m=+231.776065113 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9379570c-48c8-4906-80d9-8ec41b107a12-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-nbq4r" (UID: "9379570c-48c8-4906-80d9-8ec41b107a12") : secret "networking-console-plugin-cert" not found Jun 11 20:02:04.053565 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:04.053539 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5c2fq" Jun 11 20:02:04.101667 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:04.101473 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-64f5b86456-67889"] Jun 11 20:02:04.105236 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:02:04.105209 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4de4ed2_f4f2_4c34_b919_8c553e9df39f.slice/crio-98f15c30f283104794397c0e1f63ea96172203f4dd4b92694480b25dab0d3f2b WatchSource:0}: Error finding container 98f15c30f283104794397c0e1f63ea96172203f4dd4b92694480b25dab0d3f2b: Status 404 returned error can't find the container with id 98f15c30f283104794397c0e1f63ea96172203f4dd4b92694480b25dab0d3f2b Jun 11 20:02:04.184853 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:04.184824 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5c2fq"] Jun 11 20:02:04.216447 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:04.216419 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:04.480718 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:04.480684 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5c2fq" event={"ID":"2879d66f-9e25-414d-a09e-10decbb8fe7a","Type":"ContainerStarted","Data":"b98f17f64baaf2c8e42c4ebfb420dc327aac54cf64f27b78beb59277ae1d9b8b"} Jun 11 20:02:04.482015 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:04.481989 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-64f5b86456-67889" event={"ID":"d4de4ed2-f4f2-4c34-b919-8c553e9df39f","Type":"ContainerStarted","Data":"f55399c3c069134b52c1faa9a8507e055d914a84124e5846a1ebd65a1d075238"} Jun 11 20:02:04.482137 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:04.482031 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-64f5b86456-67889" event={"ID":"d4de4ed2-f4f2-4c34-b919-8c553e9df39f","Type":"ContainerStarted","Data":"98f15c30f283104794397c0e1f63ea96172203f4dd4b92694480b25dab0d3f2b"} Jun 11 20:02:04.506597 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:04.506544 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-64f5b86456-67889" podStartSLOduration=16.506524119 podStartE2EDuration="16.506524119s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:01:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:02:04.505462446 +0000 UTC m=+216.236624420" watchObservedRunningTime="2026-06-11 20:02:04.506524119 +0000 UTC m=+216.237686095" Jun 11 20:02:04.972276 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:04.972243 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-64f5b86456-67889" Jun 11 20:02:04.975133 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:04.975110 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-64f5b86456-67889" Jun 11 20:02:05.215679 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:05.215640 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:05.485898 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:05.485867 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-64f5b86456-67889" Jun 11 20:02:05.487322 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:05.487301 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-64f5b86456-67889" Jun 11 20:02:05.609958 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:05.609923 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:05.811993 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:05.811909 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:06.014778 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:06.014749 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:06.410564 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:06.410536 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:06.489971 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:06.489939 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5c2fq" event={"ID":"2879d66f-9e25-414d-a09e-10decbb8fe7a","Type":"ContainerStarted","Data":"84831db203b15b42ee1c07c7c96c94c8d534f3bf0b21c7e7b2cb22d50c7d9c7c"} Jun 11 20:02:06.490147 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:06.489994 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5c2fq" event={"ID":"2879d66f-9e25-414d-a09e-10decbb8fe7a","Type":"ContainerStarted","Data":"abac4b6b8e4338cf962f25045fb41a7f6de882aea377ea088f8ae562d386b347"} Jun 11 20:02:06.506292 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:06.506246 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-5c2fq" podStartSLOduration=16.416798035 podStartE2EDuration="18.506231481s" totalImagesPullingTime="2.089433446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:01:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:02:06.505141363 +0000 UTC m=+218.236303340" watchObservedRunningTime="2026-06-11 20:02:06.506231481 +0000 UTC m=+218.237393455" Jun 11 20:02:07.175872 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:07.175836 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g7qbq\" (UID: \"9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792\") " pod="openshift-insights/insights-runtime-extractor-g7qbq" Jun 11 20:02:07.176276 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:07.175883 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g7qbq\" (UID: \"9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792\") " pod="openshift-insights/insights-runtime-extractor-g7qbq" Jun 11 20:02:07.176334 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:07.176317 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g7qbq\" (UID: \"9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792\") " pod="openshift-insights/insights-runtime-extractor-g7qbq" Jun 11 20:02:07.178234 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:07.178208 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g7qbq\" (UID: \"9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792\") " pod="openshift-insights/insights-runtime-extractor-g7qbq" Jun 11 20:02:07.218929 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:07.218897 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:07.258981 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:07.258952 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g7qbq" Jun 11 20:02:07.386842 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:07.386763 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g7qbq"] Jun 11 20:02:07.389229 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:02:07.389203 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e9d7a1b_cbe8_4e53_84b0_e5b5f69e6792.slice/crio-2a75c3dbdac3cfdff085514d62c71527a1b99a156f390184dff5705714445035 WatchSource:0}: Error finding container 2a75c3dbdac3cfdff085514d62c71527a1b99a156f390184dff5705714445035: Status 404 returned error can't find the container with id 2a75c3dbdac3cfdff085514d62c71527a1b99a156f390184dff5705714445035 Jun 11 20:02:07.416135 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:07.416095 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:07.494233 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:07.494140 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g7qbq" event={"ID":"9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792","Type":"ContainerStarted","Data":"2a75c3dbdac3cfdff085514d62c71527a1b99a156f390184dff5705714445035"} Jun 11 20:02:07.609753 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:07.609717 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:07.795287 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:07.795212 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:07.849760 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:07.849714 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:09.729632 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:09.729602 2562 scope.go:117] "RemoveContainer" containerID="2e5948d73689751de0571a9b670c5509af7dce8b83477f3300d3ad9b149870fd" Jun 11 20:02:12.449527 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:12.449453 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:12.512806 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:12.512783 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ckh6n_ba09d733-3024-4a3c-b49c-ab7213905587/console-operator/1.log" Jun 11 20:02:12.512981 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:12.512889 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-ckh6n" event={"ID":"ba09d733-3024-4a3c-b49c-ab7213905587","Type":"ContainerStarted","Data":"5c9c3682b34cb7960aca2838aa5d28b7244860d8281a474a85fccc391157b5ec"} Jun 11 20:02:12.513290 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:12.513239 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-ckh6n" Jun 11 20:02:12.514602 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:12.514570 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g7qbq" event={"ID":"9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792","Type":"ContainerStarted","Data":"8b69f5bccb84711bb6acd4b8639e671aa52b979a32d53e239215e367ca0fe080"} Jun 11 20:02:12.514760 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:12.514630 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g7qbq" event={"ID":"9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792","Type":"ContainerStarted","Data":"6b8bcd2fd0f913943f36ee56e3bbb1a162db84886be22048f870c4aeebdc2752"} Jun 11 20:02:12.518093 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:12.518073 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5dbbb5d744-ckh6n" Jun 11 20:02:12.531465 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:12.531425 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5dbbb5d744-ckh6n" podStartSLOduration=21.998882528 podStartE2EDuration="24.531410842s" totalImagesPullingTime="2.532528314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:01:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:02:12.530351875 +0000 UTC m=+224.261513851" watchObservedRunningTime="2026-06-11 20:02:12.531410842 +0000 UTC m=+224.262572813" Jun 11 20:02:12.534661 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:12.534642 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:12.593068 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:12.593037 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:12.744409 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:12.744316 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:12.924220 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:12.924188 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:12.979293 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:12.979266 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:13.131009 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:13.130976 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:13.229279 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:13.229243 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:13.329818 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:13.329771 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:13.385031 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:13.384914 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:14.337111 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:14.337081 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:14.523915 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:14.523823 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g7qbq" event={"ID":"9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792","Type":"ContainerStarted","Data":"9cc21cfa225841ad5e3b30f4bdc1a92fc8d1766a0562d0da4bf3faa29e2cb84c"} Jun 11 20:02:14.531851 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:14.531824 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:14.542270 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:14.542222 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-g7qbq" podStartSLOduration=16.808503564 podStartE2EDuration="23.542205564s" totalImagesPullingTime="6.733702s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 20:01:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:02:14.541369976 +0000 UTC m=+226.272531962" watchObservedRunningTime="2026-06-11 20:02:14.542205564 +0000 UTC m=+226.273367587" Jun 11 20:02:14.810845 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:14.810759 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:14.952929 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:14.952902 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:15.025442 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:15.025416 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:16.608336 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:16.608305 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:16.677808 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:16.677769 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:17.062711 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:17.062657 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:17.195209 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:17.195167 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:17.480983 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:17.480945 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:17.594598 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:17.594569 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:19.881053 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:19.881000 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f87ba75-1431-4113-a7df-cf35939bb63d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-44fbb\" (UID: \"3f87ba75-1431-4113-a7df-cf35939bb63d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-44fbb" Jun 11 20:02:19.883532 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:19.883510 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3f87ba75-1431-4113-a7df-cf35939bb63d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-44fbb\" (UID: \"3f87ba75-1431-4113-a7df-cf35939bb63d\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-44fbb" Jun 11 20:02:20.082640 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:20.082602 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9379570c-48c8-4906-80d9-8ec41b107a12-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-nbq4r\" (UID: \"9379570c-48c8-4906-80d9-8ec41b107a12\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-nbq4r" Jun 11 20:02:20.085258 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:20.085229 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9379570c-48c8-4906-80d9-8ec41b107a12-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-nbq4r\" (UID: \"9379570c-48c8-4906-80d9-8ec41b107a12\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-nbq4r" Jun 11 20:02:20.165556 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:20.165467 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-44fbb" Jun 11 20:02:20.289468 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:20.289433 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-44fbb"] Jun 11 20:02:20.292194 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:02:20.292166 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f87ba75_1431_4113_a7df_cf35939bb63d.slice/crio-7e6c1c99282464d603f400e21da1391fdae74382b70b899e592908b01ce6bc4b WatchSource:0}: Error finding container 7e6c1c99282464d603f400e21da1391fdae74382b70b899e592908b01ce6bc4b: Status 404 returned error can't find the container with id 7e6c1c99282464d603f400e21da1391fdae74382b70b899e592908b01ce6bc4b Jun 11 20:02:20.338912 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:20.338882 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-nbq4r" Jun 11 20:02:20.459368 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:20.459289 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-nbq4r"] Jun 11 20:02:20.462012 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:02:20.461988 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9379570c_48c8_4906_80d9_8ec41b107a12.slice/crio-a85c7ca69af0254e4da51fc38e4c0fbbf95281b4b2dd332ab859ffc598029ff1 WatchSource:0}: Error finding container a85c7ca69af0254e4da51fc38e4c0fbbf95281b4b2dd332ab859ffc598029ff1: Status 404 returned error can't find the container with id a85c7ca69af0254e4da51fc38e4c0fbbf95281b4b2dd332ab859ffc598029ff1 Jun 11 20:02:20.543479 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:20.543442 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-nbq4r" event={"ID":"9379570c-48c8-4906-80d9-8ec41b107a12","Type":"ContainerStarted","Data":"a85c7ca69af0254e4da51fc38e4c0fbbf95281b4b2dd332ab859ffc598029ff1"} Jun 11 20:02:20.544489 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:20.544469 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-44fbb" event={"ID":"3f87ba75-1431-4113-a7df-cf35939bb63d","Type":"ContainerStarted","Data":"7e6c1c99282464d603f400e21da1391fdae74382b70b899e592908b01ce6bc4b"} Jun 11 20:02:21.156606 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:21.156570 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fddddd577-qjfs8"] Jun 11 20:02:21.158881 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:21.158861 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fddddd577-qjfs8" Jun 11 20:02:21.161892 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:21.161870 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 20:02:21.162136 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:21.162119 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 20:02:21.162347 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:21.162315 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 20:02:21.163491 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:21.163316 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 20:02:21.163491 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:21.163462 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-5d9r7\"" Jun 11 20:02:21.163491 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:21.163469 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 20:02:21.163695 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:21.163493 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 20:02:21.163749 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:21.163723 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 20:02:21.171689 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:21.171666 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fddddd577-qjfs8"] Jun 11 20:02:21.192268 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:21.192236 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtmcr\" (UniqueName: \"kubernetes.io/projected/4ffb068c-6d07-4f18-aa8c-e69057259a86-kube-api-access-wtmcr\") pod \"console-fddddd577-qjfs8\" (UID: \"4ffb068c-6d07-4f18-aa8c-e69057259a86\") " pod="openshift-console/console-fddddd577-qjfs8" Jun 11 20:02:21.192441 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:21.192316 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ffb068c-6d07-4f18-aa8c-e69057259a86-console-config\") pod \"console-fddddd577-qjfs8\" (UID: \"4ffb068c-6d07-4f18-aa8c-e69057259a86\") " pod="openshift-console/console-fddddd577-qjfs8" Jun 11 20:02:21.192528 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:21.192435 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ffb068c-6d07-4f18-aa8c-e69057259a86-service-ca\") pod \"console-fddddd577-qjfs8\" (UID: \"4ffb068c-6d07-4f18-aa8c-e69057259a86\") " pod="openshift-console/console-fddddd577-qjfs8" Jun 11 20:02:21.192528 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:21.192479 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ffb068c-6d07-4f18-aa8c-e69057259a86-console-serving-cert\") pod \"console-fddddd577-qjfs8\" (UID: \"4ffb068c-6d07-4f18-aa8c-e69057259a86\") " pod="openshift-console/console-fddddd577-qjfs8" Jun 11 20:02:21.192528 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:21.192522 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ffb068c-6d07-4f18-aa8c-e69057259a86-oauth-serving-cert\") pod \"console-fddddd577-qjfs8\" (UID: \"4ffb068c-6d07-4f18-aa8c-e69057259a86\") " pod="openshift-console/console-fddddd577-qjfs8" Jun 11 20:02:21.192674 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:21.192578 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ffb068c-6d07-4f18-aa8c-e69057259a86-console-oauth-config\") pod \"console-fddddd577-qjfs8\" (UID: \"4ffb068c-6d07-4f18-aa8c-e69057259a86\") " pod="openshift-console/console-fddddd577-qjfs8" Jun 11 20:02:21.293297 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:21.293263 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ffb068c-6d07-4f18-aa8c-e69057259a86-console-config\") pod \"console-fddddd577-qjfs8\" (UID: \"4ffb068c-6d07-4f18-aa8c-e69057259a86\") " pod="openshift-console/console-fddddd577-qjfs8" Jun 11 20:02:21.293566 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:21.293332 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ffb068c-6d07-4f18-aa8c-e69057259a86-service-ca\") pod \"console-fddddd577-qjfs8\" (UID: \"4ffb068c-6d07-4f18-aa8c-e69057259a86\") " pod="openshift-console/console-fddddd577-qjfs8" Jun 11 20:02:21.293566 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:21.293391 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ffb068c-6d07-4f18-aa8c-e69057259a86-console-serving-cert\") pod \"console-fddddd577-qjfs8\" (UID: \"4ffb068c-6d07-4f18-aa8c-e69057259a86\") " pod="openshift-console/console-fddddd577-qjfs8" Jun 11 20:02:21.293566 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:21.293423 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ffb068c-6d07-4f18-aa8c-e69057259a86-oauth-serving-cert\") pod \"console-fddddd577-qjfs8\" (UID: \"4ffb068c-6d07-4f18-aa8c-e69057259a86\") " pod="openshift-console/console-fddddd577-qjfs8" Jun 11 20:02:21.293566 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:21.293463 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ffb068c-6d07-4f18-aa8c-e69057259a86-console-oauth-config\") pod \"console-fddddd577-qjfs8\" (UID: \"4ffb068c-6d07-4f18-aa8c-e69057259a86\") " pod="openshift-console/console-fddddd577-qjfs8" Jun 11 20:02:21.293566 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:21.293499 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtmcr\" (UniqueName: \"kubernetes.io/projected/4ffb068c-6d07-4f18-aa8c-e69057259a86-kube-api-access-wtmcr\") pod \"console-fddddd577-qjfs8\" (UID: \"4ffb068c-6d07-4f18-aa8c-e69057259a86\") " pod="openshift-console/console-fddddd577-qjfs8" Jun 11 20:02:21.294115 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:21.294089 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ffb068c-6d07-4f18-aa8c-e69057259a86-console-config\") pod \"console-fddddd577-qjfs8\" (UID: \"4ffb068c-6d07-4f18-aa8c-e69057259a86\") " pod="openshift-console/console-fddddd577-qjfs8" Jun 11 20:02:21.294223 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:21.294180 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ffb068c-6d07-4f18-aa8c-e69057259a86-oauth-serving-cert\") pod \"console-fddddd577-qjfs8\" (UID: \"4ffb068c-6d07-4f18-aa8c-e69057259a86\") " pod="openshift-console/console-fddddd577-qjfs8" Jun 11 20:02:21.294223 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:21.294197 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ffb068c-6d07-4f18-aa8c-e69057259a86-service-ca\") pod \"console-fddddd577-qjfs8\" (UID: \"4ffb068c-6d07-4f18-aa8c-e69057259a86\") " pod="openshift-console/console-fddddd577-qjfs8" Jun 11 20:02:21.296742 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:21.296719 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ffb068c-6d07-4f18-aa8c-e69057259a86-console-oauth-config\") pod \"console-fddddd577-qjfs8\" (UID: \"4ffb068c-6d07-4f18-aa8c-e69057259a86\") " pod="openshift-console/console-fddddd577-qjfs8" Jun 11 20:02:21.297230 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:21.297206 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ffb068c-6d07-4f18-aa8c-e69057259a86-console-serving-cert\") pod \"console-fddddd577-qjfs8\" (UID: \"4ffb068c-6d07-4f18-aa8c-e69057259a86\") " pod="openshift-console/console-fddddd577-qjfs8" Jun 11 20:02:21.302072 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:21.302048 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtmcr\" (UniqueName: \"kubernetes.io/projected/4ffb068c-6d07-4f18-aa8c-e69057259a86-kube-api-access-wtmcr\") pod \"console-fddddd577-qjfs8\" (UID: \"4ffb068c-6d07-4f18-aa8c-e69057259a86\") " pod="openshift-console/console-fddddd577-qjfs8" Jun 11 20:02:21.470429 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:21.470216 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fddddd577-qjfs8" Jun 11 20:02:21.869473 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:21.869442 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fddddd577-qjfs8"] Jun 11 20:02:22.241570 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:02:22.241527 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ffb068c_6d07_4f18_aa8c_e69057259a86.slice/crio-4c02e0b7dc72903f87ad1187499b6f993246ec89d48ea8507ec5522d57469110 WatchSource:0}: Error finding container 4c02e0b7dc72903f87ad1187499b6f993246ec89d48ea8507ec5522d57469110: Status 404 returned error can't find the container with id 4c02e0b7dc72903f87ad1187499b6f993246ec89d48ea8507ec5522d57469110 Jun 11 20:02:22.556499 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:22.555812 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-nbq4r" event={"ID":"9379570c-48c8-4906-80d9-8ec41b107a12","Type":"ContainerStarted","Data":"8420157fe3393072dcc7f08ae2872d485b2ff6e633ede46d4852d145c1cef855"} Jun 11 20:02:22.560132 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:22.560093 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-44fbb" event={"ID":"3f87ba75-1431-4113-a7df-cf35939bb63d","Type":"ContainerStarted","Data":"3f1b073f04e9a9b589bbc6904837951ba2666b1486a2d8b2f70adc7059a0f637"} Jun 11 20:02:22.561584 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:22.561552 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fddddd577-qjfs8" event={"ID":"4ffb068c-6d07-4f18-aa8c-e69057259a86","Type":"ContainerStarted","Data":"4c02e0b7dc72903f87ad1187499b6f993246ec89d48ea8507ec5522d57469110"} Jun 11 20:02:22.576492 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:22.576433 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-867b76cb74-nbq4r" podStartSLOduration=32.795323899 podStartE2EDuration="34.576413735s" totalImagesPullingTime="1.781089836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:01:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:02:22.575838008 +0000 UTC m=+234.306999984" watchObservedRunningTime="2026-06-11 20:02:22.576413735 +0000 UTC m=+234.307575710" Jun 11 20:02:22.593316 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:22.593261 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-44fbb" podStartSLOduration=32.618158587 podStartE2EDuration="34.593241034s" totalImagesPullingTime="1.975082447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:01:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:02:22.591837361 +0000 UTC m=+234.322999336" watchObservedRunningTime="2026-06-11 20:02:22.593241034 +0000 UTC m=+234.324403010" Jun 11 20:02:22.603101 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:22.603074 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:22.669876 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:22.669838 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:22.755323 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:22.755285 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:22.820622 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:22.820534 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:23.055682 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:23.055651 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:25.572987 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:25.572952 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fddddd577-qjfs8" event={"ID":"4ffb068c-6d07-4f18-aa8c-e69057259a86","Type":"ContainerStarted","Data":"61f16403467ee8763972a1c5f187d450b76d0096ab5d3ddec39cea46559e5f57"} Jun 11 20:02:25.591295 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:25.591249 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fddddd577-qjfs8" podStartSLOduration=1.878928915 podStartE2EDuration="4.591234735s" totalImagesPullingTime="2.71230582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:02:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:02:25.590659351 +0000 UTC m=+237.321821326" watchObservedRunningTime="2026-06-11 20:02:25.591234735 +0000 UTC m=+237.322396710" Jun 11 20:02:25.785626 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:25.785590 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:25.855866 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:25.855831 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:26.363064 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:26.363030 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:26.427547 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:26.427518 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:26.572807 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:26.572774 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:28.422046 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:28.422009 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:28.766362 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:28.766283 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b767d89f-2dhmp"] Jun 11 20:02:28.769025 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:28.769006 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b767d89f-2dhmp" Jun 11 20:02:28.789018 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:28.788997 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 20:02:28.796587 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:28.796563 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b767d89f-2dhmp"] Jun 11 20:02:28.855394 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:28.855343 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17f3f6d7-5b4a-4917-baa9-b168d6b51233-trusted-ca-bundle\") pod \"console-b767d89f-2dhmp\" (UID: \"17f3f6d7-5b4a-4917-baa9-b168d6b51233\") " pod="openshift-console/console-b767d89f-2dhmp" Jun 11 20:02:28.855575 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:28.855401 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17f3f6d7-5b4a-4917-baa9-b168d6b51233-console-serving-cert\") pod \"console-b767d89f-2dhmp\" (UID: \"17f3f6d7-5b4a-4917-baa9-b168d6b51233\") " pod="openshift-console/console-b767d89f-2dhmp" Jun 11 20:02:28.855575 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:28.855440 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17f3f6d7-5b4a-4917-baa9-b168d6b51233-service-ca\") pod \"console-b767d89f-2dhmp\" (UID: \"17f3f6d7-5b4a-4917-baa9-b168d6b51233\") " pod="openshift-console/console-b767d89f-2dhmp" Jun 11 20:02:28.855575 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:28.855491 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv6mb\" (UniqueName: \"kubernetes.io/projected/17f3f6d7-5b4a-4917-baa9-b168d6b51233-kube-api-access-wv6mb\") pod \"console-b767d89f-2dhmp\" (UID: \"17f3f6d7-5b4a-4917-baa9-b168d6b51233\") " pod="openshift-console/console-b767d89f-2dhmp" Jun 11 20:02:28.855575 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:28.855538 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17f3f6d7-5b4a-4917-baa9-b168d6b51233-console-oauth-config\") pod \"console-b767d89f-2dhmp\" (UID: \"17f3f6d7-5b4a-4917-baa9-b168d6b51233\") " pod="openshift-console/console-b767d89f-2dhmp" Jun 11 20:02:28.855575 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:28.855573 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17f3f6d7-5b4a-4917-baa9-b168d6b51233-console-config\") pod \"console-b767d89f-2dhmp\" (UID: \"17f3f6d7-5b4a-4917-baa9-b168d6b51233\") " pod="openshift-console/console-b767d89f-2dhmp" Jun 11 20:02:28.855747 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:28.855619 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17f3f6d7-5b4a-4917-baa9-b168d6b51233-oauth-serving-cert\") pod \"console-b767d89f-2dhmp\" (UID: \"17f3f6d7-5b4a-4917-baa9-b168d6b51233\") " pod="openshift-console/console-b767d89f-2dhmp" Jun 11 20:02:28.956167 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:28.956131 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17f3f6d7-5b4a-4917-baa9-b168d6b51233-oauth-serving-cert\") pod \"console-b767d89f-2dhmp\" (UID: \"17f3f6d7-5b4a-4917-baa9-b168d6b51233\") " pod="openshift-console/console-b767d89f-2dhmp" Jun 11 20:02:28.956365 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:28.956232 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17f3f6d7-5b4a-4917-baa9-b168d6b51233-trusted-ca-bundle\") pod \"console-b767d89f-2dhmp\" (UID: \"17f3f6d7-5b4a-4917-baa9-b168d6b51233\") " pod="openshift-console/console-b767d89f-2dhmp" Jun 11 20:02:28.956365 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:28.956259 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17f3f6d7-5b4a-4917-baa9-b168d6b51233-console-serving-cert\") pod \"console-b767d89f-2dhmp\" (UID: \"17f3f6d7-5b4a-4917-baa9-b168d6b51233\") " pod="openshift-console/console-b767d89f-2dhmp" Jun 11 20:02:28.956365 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:28.956283 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17f3f6d7-5b4a-4917-baa9-b168d6b51233-service-ca\") pod \"console-b767d89f-2dhmp\" (UID: \"17f3f6d7-5b4a-4917-baa9-b168d6b51233\") " pod="openshift-console/console-b767d89f-2dhmp" Jun 11 20:02:28.956365 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:28.956314 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv6mb\" (UniqueName: \"kubernetes.io/projected/17f3f6d7-5b4a-4917-baa9-b168d6b51233-kube-api-access-wv6mb\") pod \"console-b767d89f-2dhmp\" (UID: \"17f3f6d7-5b4a-4917-baa9-b168d6b51233\") " pod="openshift-console/console-b767d89f-2dhmp" Jun 11 20:02:28.956365 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:28.956358 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17f3f6d7-5b4a-4917-baa9-b168d6b51233-console-oauth-config\") pod \"console-b767d89f-2dhmp\" (UID: \"17f3f6d7-5b4a-4917-baa9-b168d6b51233\") " pod="openshift-console/console-b767d89f-2dhmp" Jun 11 20:02:28.956647 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:28.956414 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17f3f6d7-5b4a-4917-baa9-b168d6b51233-console-config\") pod \"console-b767d89f-2dhmp\" (UID: \"17f3f6d7-5b4a-4917-baa9-b168d6b51233\") " pod="openshift-console/console-b767d89f-2dhmp" Jun 11 20:02:28.956998 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:28.956963 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17f3f6d7-5b4a-4917-baa9-b168d6b51233-oauth-serving-cert\") pod \"console-b767d89f-2dhmp\" (UID: \"17f3f6d7-5b4a-4917-baa9-b168d6b51233\") " pod="openshift-console/console-b767d89f-2dhmp" Jun 11 20:02:28.957190 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:28.957053 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17f3f6d7-5b4a-4917-baa9-b168d6b51233-service-ca\") pod \"console-b767d89f-2dhmp\" (UID: \"17f3f6d7-5b4a-4917-baa9-b168d6b51233\") " pod="openshift-console/console-b767d89f-2dhmp" Jun 11 20:02:28.957190 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:28.957115 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17f3f6d7-5b4a-4917-baa9-b168d6b51233-trusted-ca-bundle\") pod \"console-b767d89f-2dhmp\" (UID: \"17f3f6d7-5b4a-4917-baa9-b168d6b51233\") " pod="openshift-console/console-b767d89f-2dhmp" Jun 11 20:02:28.957190 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:28.957175 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17f3f6d7-5b4a-4917-baa9-b168d6b51233-console-config\") pod \"console-b767d89f-2dhmp\" (UID: \"17f3f6d7-5b4a-4917-baa9-b168d6b51233\") " pod="openshift-console/console-b767d89f-2dhmp" Jun 11 20:02:28.958960 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:28.958938 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17f3f6d7-5b4a-4917-baa9-b168d6b51233-console-oauth-config\") pod \"console-b767d89f-2dhmp\" (UID: \"17f3f6d7-5b4a-4917-baa9-b168d6b51233\") " pod="openshift-console/console-b767d89f-2dhmp" Jun 11 20:02:28.959054 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:28.958939 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17f3f6d7-5b4a-4917-baa9-b168d6b51233-console-serving-cert\") pod \"console-b767d89f-2dhmp\" (UID: \"17f3f6d7-5b4a-4917-baa9-b168d6b51233\") " pod="openshift-console/console-b767d89f-2dhmp" Jun 11 20:02:28.964979 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:28.964958 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv6mb\" (UniqueName: \"kubernetes.io/projected/17f3f6d7-5b4a-4917-baa9-b168d6b51233-kube-api-access-wv6mb\") pod \"console-b767d89f-2dhmp\" (UID: \"17f3f6d7-5b4a-4917-baa9-b168d6b51233\") " pod="openshift-console/console-b767d89f-2dhmp" Jun 11 20:02:29.077726 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:29.077637 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b767d89f-2dhmp" Jun 11 20:02:29.205117 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:29.205082 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b767d89f-2dhmp"] Jun 11 20:02:29.207881 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:02:29.207848 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17f3f6d7_5b4a_4917_baa9_b168d6b51233.slice/crio-dd0da5dfffdbaa5f738fa42f1bd049a82b98fae6178e320c90c5a22bd9f51619 WatchSource:0}: Error finding container dd0da5dfffdbaa5f738fa42f1bd049a82b98fae6178e320c90c5a22bd9f51619: Status 404 returned error can't find the container with id dd0da5dfffdbaa5f738fa42f1bd049a82b98fae6178e320c90c5a22bd9f51619 Jun 11 20:02:29.552498 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:29.552462 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:29.586727 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:29.586692 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b767d89f-2dhmp" event={"ID":"17f3f6d7-5b4a-4917-baa9-b168d6b51233","Type":"ContainerStarted","Data":"dc7574877e481fd260f0a5f2c2e37906492570c5e306388eeaec499188837cca"} Jun 11 20:02:29.586903 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:29.586747 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b767d89f-2dhmp" event={"ID":"17f3f6d7-5b4a-4917-baa9-b168d6b51233","Type":"ContainerStarted","Data":"dd0da5dfffdbaa5f738fa42f1bd049a82b98fae6178e320c90c5a22bd9f51619"} Jun 11 20:02:29.604579 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:29.604527 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b767d89f-2dhmp" podStartSLOduration=1.604510903 podStartE2EDuration="1.604510903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:02:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:02:29.603720221 +0000 UTC m=+241.334882200" watchObservedRunningTime="2026-06-11 20:02:29.604510903 +0000 UTC m=+241.335672878" Jun 11 20:02:29.930292 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:29.930262 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:30.154584 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.154553 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:30.194898 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.194821 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-gngss"] Jun 11 20:02:30.197339 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.197316 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-gngss" Jun 11 20:02:30.201142 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.201074 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 11 20:02:30.201265 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.201242 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-f4kct\"" Jun 11 20:02:30.202332 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.202313 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 11 20:02:30.202441 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.202413 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 20:02:30.211030 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.211011 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nsftk"] Jun 11 20:02:30.213404 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.213366 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nsftk" Jun 11 20:02:30.214952 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.214928 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-gngss"] Jun 11 20:02:30.216689 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.216670 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 20:02:30.217178 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.217164 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 20:02:30.217439 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.217426 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-clddp\"" Jun 11 20:02:30.218456 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.218436 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 20:02:30.254362 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.254329 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:30.270448 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.270417 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b854950-2217-420d-94c2-bbbe91c0e127-sys\") pod \"node-exporter-nsftk\" (UID: \"6b854950-2217-420d-94c2-bbbe91c0e127\") " pod="openshift-monitoring/node-exporter-nsftk" Jun 11 20:02:30.270589 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.270471 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27c9d0e7-c6aa-4c34-af39-5bc0b661769c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-gngss\" (UID: \"27c9d0e7-c6aa-4c34-af39-5bc0b661769c\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-gngss" Jun 11 20:02:30.270589 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.270491 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6b854950-2217-420d-94c2-bbbe91c0e127-node-exporter-tls\") pod \"node-exporter-nsftk\" (UID: \"6b854950-2217-420d-94c2-bbbe91c0e127\") " pod="openshift-monitoring/node-exporter-nsftk" Jun 11 20:02:30.270589 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.270559 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6b854950-2217-420d-94c2-bbbe91c0e127-node-exporter-textfile\") pod \"node-exporter-nsftk\" (UID: \"6b854950-2217-420d-94c2-bbbe91c0e127\") " pod="openshift-monitoring/node-exporter-nsftk" Jun 11 20:02:30.270770 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.270616 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6b854950-2217-420d-94c2-bbbe91c0e127-node-exporter-wtmp\") pod \"node-exporter-nsftk\" (UID: \"6b854950-2217-420d-94c2-bbbe91c0e127\") " pod="openshift-monitoring/node-exporter-nsftk" Jun 11 20:02:30.270770 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.270646 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b854950-2217-420d-94c2-bbbe91c0e127-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nsftk\" (UID: \"6b854950-2217-420d-94c2-bbbe91c0e127\") " pod="openshift-monitoring/node-exporter-nsftk" Jun 11 20:02:30.270770 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.270694 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6b854950-2217-420d-94c2-bbbe91c0e127-root\") pod \"node-exporter-nsftk\" (UID: \"6b854950-2217-420d-94c2-bbbe91c0e127\") " pod="openshift-monitoring/node-exporter-nsftk" Jun 11 20:02:30.270770 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.270743 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rvnj\" (UniqueName: \"kubernetes.io/projected/27c9d0e7-c6aa-4c34-af39-5bc0b661769c-kube-api-access-8rvnj\") pod \"openshift-state-metrics-6b8d965dd5-gngss\" (UID: \"27c9d0e7-c6aa-4c34-af39-5bc0b661769c\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-gngss" Jun 11 20:02:30.270930 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.270791 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6b854950-2217-420d-94c2-bbbe91c0e127-node-exporter-accelerators-collector-config\") pod \"node-exporter-nsftk\" (UID: \"6b854950-2217-420d-94c2-bbbe91c0e127\") " pod="openshift-monitoring/node-exporter-nsftk" Jun 11 20:02:30.270930 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.270811 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6dnf\" (UniqueName: \"kubernetes.io/projected/6b854950-2217-420d-94c2-bbbe91c0e127-kube-api-access-z6dnf\") pod \"node-exporter-nsftk\" (UID: \"6b854950-2217-420d-94c2-bbbe91c0e127\") " pod="openshift-monitoring/node-exporter-nsftk" Jun 11 20:02:30.270930 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.270832 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/27c9d0e7-c6aa-4c34-af39-5bc0b661769c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-gngss\" (UID: \"27c9d0e7-c6aa-4c34-af39-5bc0b661769c\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-gngss" Jun 11 20:02:30.270930 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.270876 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b854950-2217-420d-94c2-bbbe91c0e127-metrics-client-ca\") pod \"node-exporter-nsftk\" (UID: \"6b854950-2217-420d-94c2-bbbe91c0e127\") " pod="openshift-monitoring/node-exporter-nsftk" Jun 11 20:02:30.270930 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.270898 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27c9d0e7-c6aa-4c34-af39-5bc0b661769c-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-gngss\" (UID: \"27c9d0e7-c6aa-4c34-af39-5bc0b661769c\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-gngss" Jun 11 20:02:30.355959 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.355924 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:30.372073 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.372033 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27c9d0e7-c6aa-4c34-af39-5bc0b661769c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-gngss\" (UID: \"27c9d0e7-c6aa-4c34-af39-5bc0b661769c\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-gngss" Jun 11 20:02:30.372151 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.372079 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6b854950-2217-420d-94c2-bbbe91c0e127-node-exporter-tls\") pod \"node-exporter-nsftk\" (UID: \"6b854950-2217-420d-94c2-bbbe91c0e127\") " pod="openshift-monitoring/node-exporter-nsftk" Jun 11 20:02:30.372151 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.372099 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6b854950-2217-420d-94c2-bbbe91c0e127-node-exporter-textfile\") pod \"node-exporter-nsftk\" (UID: \"6b854950-2217-420d-94c2-bbbe91c0e127\") " pod="openshift-monitoring/node-exporter-nsftk" Jun 11 20:02:30.372151 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.372119 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6b854950-2217-420d-94c2-bbbe91c0e127-node-exporter-wtmp\") pod \"node-exporter-nsftk\" (UID: \"6b854950-2217-420d-94c2-bbbe91c0e127\") " pod="openshift-monitoring/node-exporter-nsftk" Jun 11 20:02:30.372151 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.372145 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b854950-2217-420d-94c2-bbbe91c0e127-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nsftk\" (UID: \"6b854950-2217-420d-94c2-bbbe91c0e127\") " pod="openshift-monitoring/node-exporter-nsftk" Jun 11 20:02:30.372317 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.372172 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6b854950-2217-420d-94c2-bbbe91c0e127-root\") pod \"node-exporter-nsftk\" (UID: \"6b854950-2217-420d-94c2-bbbe91c0e127\") " pod="openshift-monitoring/node-exporter-nsftk" Jun 11 20:02:30.372317 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.372203 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rvnj\" (UniqueName: \"kubernetes.io/projected/27c9d0e7-c6aa-4c34-af39-5bc0b661769c-kube-api-access-8rvnj\") pod \"openshift-state-metrics-6b8d965dd5-gngss\" (UID: \"27c9d0e7-c6aa-4c34-af39-5bc0b661769c\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-gngss" Jun 11 20:02:30.372317 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:02:30.372209 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 20:02:30.372317 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.372259 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6b854950-2217-420d-94c2-bbbe91c0e127-node-exporter-accelerators-collector-config\") pod \"node-exporter-nsftk\" (UID: \"6b854950-2217-420d-94c2-bbbe91c0e127\") " pod="openshift-monitoring/node-exporter-nsftk" Jun 11 20:02:30.372317 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:02:30.372275 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b854950-2217-420d-94c2-bbbe91c0e127-node-exporter-tls podName:6b854950-2217-420d-94c2-bbbe91c0e127 nodeName:}" failed. No retries permitted until 2026-06-11 20:02:30.872253905 +0000 UTC m=+242.603415876 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6b854950-2217-420d-94c2-bbbe91c0e127-node-exporter-tls") pod "node-exporter-nsftk" (UID: "6b854950-2217-420d-94c2-bbbe91c0e127") : secret "node-exporter-tls" not found Jun 11 20:02:30.372317 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.372308 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6b854950-2217-420d-94c2-bbbe91c0e127-root\") pod \"node-exporter-nsftk\" (UID: \"6b854950-2217-420d-94c2-bbbe91c0e127\") " pod="openshift-monitoring/node-exporter-nsftk" Jun 11 20:02:30.372650 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.372313 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6dnf\" (UniqueName: \"kubernetes.io/projected/6b854950-2217-420d-94c2-bbbe91c0e127-kube-api-access-z6dnf\") pod \"node-exporter-nsftk\" (UID: \"6b854950-2217-420d-94c2-bbbe91c0e127\") " pod="openshift-monitoring/node-exporter-nsftk" Jun 11 20:02:30.372650 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.372365 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/27c9d0e7-c6aa-4c34-af39-5bc0b661769c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-gngss\" (UID: \"27c9d0e7-c6aa-4c34-af39-5bc0b661769c\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-gngss" Jun 11 20:02:30.372650 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.372435 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b854950-2217-420d-94c2-bbbe91c0e127-metrics-client-ca\") pod \"node-exporter-nsftk\" (UID: \"6b854950-2217-420d-94c2-bbbe91c0e127\") " pod="openshift-monitoring/node-exporter-nsftk" Jun 11 20:02:30.372650 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.372272 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6b854950-2217-420d-94c2-bbbe91c0e127-node-exporter-wtmp\") pod \"node-exporter-nsftk\" (UID: \"6b854950-2217-420d-94c2-bbbe91c0e127\") " pod="openshift-monitoring/node-exporter-nsftk" Jun 11 20:02:30.372650 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.372475 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27c9d0e7-c6aa-4c34-af39-5bc0b661769c-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-gngss\" (UID: \"27c9d0e7-c6aa-4c34-af39-5bc0b661769c\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-gngss" Jun 11 20:02:30.372650 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.372540 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6b854950-2217-420d-94c2-bbbe91c0e127-node-exporter-textfile\") pod \"node-exporter-nsftk\" (UID: \"6b854950-2217-420d-94c2-bbbe91c0e127\") " pod="openshift-monitoring/node-exporter-nsftk" Jun 11 20:02:30.372650 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:02:30.372560 2562 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 11 20:02:30.372650 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.372605 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b854950-2217-420d-94c2-bbbe91c0e127-sys\") pod \"node-exporter-nsftk\" (UID: \"6b854950-2217-420d-94c2-bbbe91c0e127\") " pod="openshift-monitoring/node-exporter-nsftk" Jun 11 20:02:30.372969 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.372691 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b854950-2217-420d-94c2-bbbe91c0e127-sys\") pod \"node-exporter-nsftk\" (UID: \"6b854950-2217-420d-94c2-bbbe91c0e127\") " pod="openshift-monitoring/node-exporter-nsftk" Jun 11 20:02:30.372969 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:02:30.372710 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27c9d0e7-c6aa-4c34-af39-5bc0b661769c-openshift-state-metrics-tls podName:27c9d0e7-c6aa-4c34-af39-5bc0b661769c nodeName:}" failed. No retries permitted until 2026-06-11 20:02:30.87269069 +0000 UTC m=+242.603852644 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/27c9d0e7-c6aa-4c34-af39-5bc0b661769c-openshift-state-metrics-tls") pod "openshift-state-metrics-6b8d965dd5-gngss" (UID: "27c9d0e7-c6aa-4c34-af39-5bc0b661769c") : secret "openshift-state-metrics-tls" not found Jun 11 20:02:30.372969 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.372887 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6b854950-2217-420d-94c2-bbbe91c0e127-node-exporter-accelerators-collector-config\") pod \"node-exporter-nsftk\" (UID: \"6b854950-2217-420d-94c2-bbbe91c0e127\") " pod="openshift-monitoring/node-exporter-nsftk" Jun 11 20:02:30.373084 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.373037 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b854950-2217-420d-94c2-bbbe91c0e127-metrics-client-ca\") pod \"node-exporter-nsftk\" (UID: \"6b854950-2217-420d-94c2-bbbe91c0e127\") " pod="openshift-monitoring/node-exporter-nsftk" Jun 11 20:02:30.373198 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.373179 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27c9d0e7-c6aa-4c34-af39-5bc0b661769c-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-gngss\" (UID: \"27c9d0e7-c6aa-4c34-af39-5bc0b661769c\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-gngss" Jun 11 20:02:30.375118 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.375091 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b854950-2217-420d-94c2-bbbe91c0e127-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nsftk\" (UID: \"6b854950-2217-420d-94c2-bbbe91c0e127\") " pod="openshift-monitoring/node-exporter-nsftk" Jun 11 20:02:30.375226 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.375176 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27c9d0e7-c6aa-4c34-af39-5bc0b661769c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-gngss\" (UID: \"27c9d0e7-c6aa-4c34-af39-5bc0b661769c\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-gngss" Jun 11 20:02:30.382154 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.382133 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6dnf\" (UniqueName: \"kubernetes.io/projected/6b854950-2217-420d-94c2-bbbe91c0e127-kube-api-access-z6dnf\") pod \"node-exporter-nsftk\" (UID: \"6b854950-2217-420d-94c2-bbbe91c0e127\") " pod="openshift-monitoring/node-exporter-nsftk" Jun 11 20:02:30.382639 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.382620 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rvnj\" (UniqueName: \"kubernetes.io/projected/27c9d0e7-c6aa-4c34-af39-5bc0b661769c-kube-api-access-8rvnj\") pod \"openshift-state-metrics-6b8d965dd5-gngss\" (UID: \"27c9d0e7-c6aa-4c34-af39-5bc0b661769c\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-gngss" Jun 11 20:02:30.550851 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.550730 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:30.652203 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.652168 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:30.878179 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.878145 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/27c9d0e7-c6aa-4c34-af39-5bc0b661769c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-gngss\" (UID: \"27c9d0e7-c6aa-4c34-af39-5bc0b661769c\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-gngss" Jun 11 20:02:30.878330 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.878210 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6b854950-2217-420d-94c2-bbbe91c0e127-node-exporter-tls\") pod \"node-exporter-nsftk\" (UID: \"6b854950-2217-420d-94c2-bbbe91c0e127\") " pod="openshift-monitoring/node-exporter-nsftk" Jun 11 20:02:30.878330 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:02:30.878295 2562 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 11 20:02:30.878444 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:02:30.878350 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 20:02:30.878444 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:02:30.878363 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27c9d0e7-c6aa-4c34-af39-5bc0b661769c-openshift-state-metrics-tls podName:27c9d0e7-c6aa-4c34-af39-5bc0b661769c nodeName:}" failed. No retries permitted until 2026-06-11 20:02:31.878345875 +0000 UTC m=+243.609507828 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/27c9d0e7-c6aa-4c34-af39-5bc0b661769c-openshift-state-metrics-tls") pod "openshift-state-metrics-6b8d965dd5-gngss" (UID: "27c9d0e7-c6aa-4c34-af39-5bc0b661769c") : secret "openshift-state-metrics-tls" not found Jun 11 20:02:30.878444 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:02:30.878422 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b854950-2217-420d-94c2-bbbe91c0e127-node-exporter-tls podName:6b854950-2217-420d-94c2-bbbe91c0e127 nodeName:}" failed. No retries permitted until 2026-06-11 20:02:31.878408311 +0000 UTC m=+243.609570264 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6b854950-2217-420d-94c2-bbbe91c0e127-node-exporter-tls") pod "node-exporter-nsftk" (UID: "6b854950-2217-420d-94c2-bbbe91c0e127") : secret "node-exporter-tls" not found Jun 11 20:02:30.945431 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:30.945368 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:31.054587 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.054531 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:31.162324 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.162237 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:31.239261 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.239227 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:31.245073 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.245049 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 20:02:31.248324 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.248300 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.251066 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.251042 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 20:02:31.251200 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.251081 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 20:02:31.251200 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.251187 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 20:02:31.251200 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.251194 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 20:02:31.251360 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.251258 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-d5tgc\"" Jun 11 20:02:31.251360 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.251333 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 20:02:31.251360 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.251354 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 20:02:31.251535 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.251425 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 20:02:31.251535 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.251427 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 20:02:31.251535 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.251353 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 20:02:31.265283 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.265259 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 20:02:31.382711 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.382679 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6d928dda-ae89-4559-8e89-7779fe6f2e97-config-volume\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.382711 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.382713 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d928dda-ae89-4559-8e89-7779fe6f2e97-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.382929 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.382750 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt6dg\" (UniqueName: \"kubernetes.io/projected/6d928dda-ae89-4559-8e89-7779fe6f2e97-kube-api-access-gt6dg\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.382929 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.382890 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6d928dda-ae89-4559-8e89-7779fe6f2e97-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.383003 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.382952 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d928dda-ae89-4559-8e89-7779fe6f2e97-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.383003 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.382983 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d928dda-ae89-4559-8e89-7779fe6f2e97-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.383084 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.383010 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6d928dda-ae89-4559-8e89-7779fe6f2e97-web-config\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.383115 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.383091 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6d928dda-ae89-4559-8e89-7779fe6f2e97-config-out\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.383148 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.383112 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6d928dda-ae89-4559-8e89-7779fe6f2e97-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.383148 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.383140 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6d928dda-ae89-4559-8e89-7779fe6f2e97-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.383214 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.383182 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d928dda-ae89-4559-8e89-7779fe6f2e97-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.383255 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.383227 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6d928dda-ae89-4559-8e89-7779fe6f2e97-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.383255 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.383245 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6d928dda-ae89-4559-8e89-7779fe6f2e97-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.471122 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.471030 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fddddd577-qjfs8" Jun 11 20:02:31.471122 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.471088 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-fddddd577-qjfs8" Jun 11 20:02:31.472403 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.472352 2562 patch_prober.go:28] interesting pod/console-fddddd577-qjfs8 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.18:8443/health\": dial tcp 10.132.0.18:8443: connect: connection refused" start-of-body= Jun 11 20:02:31.472461 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.472441 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-fddddd577-qjfs8" podUID="4ffb068c-6d07-4f18-aa8c-e69057259a86" containerName="console" probeResult="failure" output="Get \"https://10.132.0.18:8443/health\": dial tcp 10.132.0.18:8443: connect: connection refused" Jun 11 20:02:31.483770 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.483746 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6d928dda-ae89-4559-8e89-7779fe6f2e97-config-out\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.483839 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.483773 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6d928dda-ae89-4559-8e89-7779fe6f2e97-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.483839 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.483795 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6d928dda-ae89-4559-8e89-7779fe6f2e97-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.483839 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.483822 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d928dda-ae89-4559-8e89-7779fe6f2e97-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.483951 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.483859 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6d928dda-ae89-4559-8e89-7779fe6f2e97-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.483951 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.483881 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6d928dda-ae89-4559-8e89-7779fe6f2e97-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.483951 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.483912 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6d928dda-ae89-4559-8e89-7779fe6f2e97-config-volume\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.483951 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.483931 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d928dda-ae89-4559-8e89-7779fe6f2e97-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.486014 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.484211 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt6dg\" (UniqueName: \"kubernetes.io/projected/6d928dda-ae89-4559-8e89-7779fe6f2e97-kube-api-access-gt6dg\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.486014 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.484249 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6d928dda-ae89-4559-8e89-7779fe6f2e97-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.486014 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.484343 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6d928dda-ae89-4559-8e89-7779fe6f2e97-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.486014 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.484436 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d928dda-ae89-4559-8e89-7779fe6f2e97-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.486014 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.484466 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d928dda-ae89-4559-8e89-7779fe6f2e97-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.486014 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.484494 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6d928dda-ae89-4559-8e89-7779fe6f2e97-web-config\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.486014 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.485403 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d928dda-ae89-4559-8e89-7779fe6f2e97-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.486014 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:02:31.485541 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d928dda-ae89-4559-8e89-7779fe6f2e97-alertmanager-trusted-ca-bundle podName:6d928dda-ae89-4559-8e89-7779fe6f2e97 nodeName:}" failed. No retries permitted until 2026-06-11 20:02:31.985522852 +0000 UTC m=+243.716684819 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/6d928dda-ae89-4559-8e89-7779fe6f2e97-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "6d928dda-ae89-4559-8e89-7779fe6f2e97") : configmap references non-existent config key: ca-bundle.crt Jun 11 20:02:31.487118 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.487094 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6d928dda-ae89-4559-8e89-7779fe6f2e97-config-out\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.487211 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.487158 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6d928dda-ae89-4559-8e89-7779fe6f2e97-config-volume\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.487363 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.487341 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6d928dda-ae89-4559-8e89-7779fe6f2e97-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.487521 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.487501 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6d928dda-ae89-4559-8e89-7779fe6f2e97-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.487732 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.487662 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d928dda-ae89-4559-8e89-7779fe6f2e97-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.487974 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.487955 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6d928dda-ae89-4559-8e89-7779fe6f2e97-web-config\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.488975 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.488951 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6d928dda-ae89-4559-8e89-7779fe6f2e97-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.489285 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.489266 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6d928dda-ae89-4559-8e89-7779fe6f2e97-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.489523 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.489504 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d928dda-ae89-4559-8e89-7779fe6f2e97-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.491582 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.491559 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt6dg\" (UniqueName: \"kubernetes.io/projected/6d928dda-ae89-4559-8e89-7779fe6f2e97-kube-api-access-gt6dg\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.513125 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.513075 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:31.888696 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.888659 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6b854950-2217-420d-94c2-bbbe91c0e127-node-exporter-tls\") pod \"node-exporter-nsftk\" (UID: \"6b854950-2217-420d-94c2-bbbe91c0e127\") " pod="openshift-monitoring/node-exporter-nsftk" Jun 11 20:02:31.889061 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.888750 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/27c9d0e7-c6aa-4c34-af39-5bc0b661769c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-gngss\" (UID: \"27c9d0e7-c6aa-4c34-af39-5bc0b661769c\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-gngss" Jun 11 20:02:31.891153 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.891129 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/27c9d0e7-c6aa-4c34-af39-5bc0b661769c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-gngss\" (UID: \"27c9d0e7-c6aa-4c34-af39-5bc0b661769c\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-gngss" Jun 11 20:02:31.891261 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.891188 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6b854950-2217-420d-94c2-bbbe91c0e127-node-exporter-tls\") pod \"node-exporter-nsftk\" (UID: \"6b854950-2217-420d-94c2-bbbe91c0e127\") " pod="openshift-monitoring/node-exporter-nsftk" Jun 11 20:02:31.989460 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.989420 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d928dda-ae89-4559-8e89-7779fe6f2e97-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:31.990308 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:31.990287 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d928dda-ae89-4559-8e89-7779fe6f2e97-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6d928dda-ae89-4559-8e89-7779fe6f2e97\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:32.007223 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.007194 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-gngss" Jun 11 20:02:32.023010 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.022987 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nsftk" Jun 11 20:02:32.033000 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:02:32.032972 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b854950_2217_420d_94c2_bbbe91c0e127.slice/crio-56d3bcbed47562f84e24bb5a67d9f73209b8de16503b56f09f263a6d010fdc2d WatchSource:0}: Error finding container 56d3bcbed47562f84e24bb5a67d9f73209b8de16503b56f09f263a6d010fdc2d: Status 404 returned error can't find the container with id 56d3bcbed47562f84e24bb5a67d9f73209b8de16503b56f09f263a6d010fdc2d Jun 11 20:02:32.138058 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.138007 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-gngss"] Jun 11 20:02:32.140219 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:02:32.140126 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27c9d0e7_c6aa_4c34_af39_5bc0b661769c.slice/crio-c8d68ccaa07d097d0a9cdd0cef4eafcac53d73ee91097dedcffe498979cadecd WatchSource:0}: Error finding container c8d68ccaa07d097d0a9cdd0cef4eafcac53d73ee91097dedcffe498979cadecd: Status 404 returned error can't find the container with id c8d68ccaa07d097d0a9cdd0cef4eafcac53d73ee91097dedcffe498979cadecd Jun 11 20:02:32.157729 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.157705 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 20:02:32.168939 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.168913 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-78d6f59854-q6vq6"] Jun 11 20:02:32.172809 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.172250 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-78d6f59854-q6vq6" Jun 11 20:02:32.174954 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.174931 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 11 20:02:32.175072 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.175006 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 11 20:02:32.175072 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.175006 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 11 20:02:32.175388 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.175294 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-al54fptjjktf8\"" Jun 11 20:02:32.175515 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.175477 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 11 20:02:32.175614 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.175595 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-cznmg\"" Jun 11 20:02:32.175708 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.175614 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 11 20:02:32.185361 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.185257 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-78d6f59854-q6vq6"] Jun 11 20:02:32.293397 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.293346 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ch2p\" (UniqueName: \"kubernetes.io/projected/7e0e0e02-15e4-4664-acaf-bc01a0e33e20-kube-api-access-6ch2p\") pod \"thanos-querier-78d6f59854-q6vq6\" (UID: \"7e0e0e02-15e4-4664-acaf-bc01a0e33e20\") " pod="openshift-monitoring/thanos-querier-78d6f59854-q6vq6" Jun 11 20:02:32.293397 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.293402 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7e0e0e02-15e4-4664-acaf-bc01a0e33e20-secret-thanos-querier-tls\") pod \"thanos-querier-78d6f59854-q6vq6\" (UID: \"7e0e0e02-15e4-4664-acaf-bc01a0e33e20\") " pod="openshift-monitoring/thanos-querier-78d6f59854-q6vq6" Jun 11 20:02:32.293578 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.293474 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7e0e0e02-15e4-4664-acaf-bc01a0e33e20-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-78d6f59854-q6vq6\" (UID: \"7e0e0e02-15e4-4664-acaf-bc01a0e33e20\") " pod="openshift-monitoring/thanos-querier-78d6f59854-q6vq6" Jun 11 20:02:32.293578 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.293513 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e0e0e02-15e4-4664-acaf-bc01a0e33e20-metrics-client-ca\") pod \"thanos-querier-78d6f59854-q6vq6\" (UID: \"7e0e0e02-15e4-4664-acaf-bc01a0e33e20\") " pod="openshift-monitoring/thanos-querier-78d6f59854-q6vq6" Jun 11 20:02:32.293578 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.293549 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7e0e0e02-15e4-4664-acaf-bc01a0e33e20-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-78d6f59854-q6vq6\" (UID: \"7e0e0e02-15e4-4664-acaf-bc01a0e33e20\") " pod="openshift-monitoring/thanos-querier-78d6f59854-q6vq6" Jun 11 20:02:32.293671 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.293648 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e0e0e02-15e4-4664-acaf-bc01a0e33e20-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-78d6f59854-q6vq6\" (UID: \"7e0e0e02-15e4-4664-acaf-bc01a0e33e20\") " pod="openshift-monitoring/thanos-querier-78d6f59854-q6vq6" Jun 11 20:02:32.293761 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.293745 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7e0e0e02-15e4-4664-acaf-bc01a0e33e20-secret-grpc-tls\") pod \"thanos-querier-78d6f59854-q6vq6\" (UID: \"7e0e0e02-15e4-4664-acaf-bc01a0e33e20\") " pod="openshift-monitoring/thanos-querier-78d6f59854-q6vq6" Jun 11 20:02:32.293794 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.293783 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e0e0e02-15e4-4664-acaf-bc01a0e33e20-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-78d6f59854-q6vq6\" (UID: \"7e0e0e02-15e4-4664-acaf-bc01a0e33e20\") " pod="openshift-monitoring/thanos-querier-78d6f59854-q6vq6" Jun 11 20:02:32.316106 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.316074 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 20:02:32.319022 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:02:32.318993 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d928dda_ae89_4559_8e89_7779fe6f2e97.slice/crio-594eb40a751174fb71fb216cfec7277fcbe3768a2793c4c6225cd36c1ebc8b80 WatchSource:0}: Error finding container 594eb40a751174fb71fb216cfec7277fcbe3768a2793c4c6225cd36c1ebc8b80: Status 404 returned error can't find the container with id 594eb40a751174fb71fb216cfec7277fcbe3768a2793c4c6225cd36c1ebc8b80 Jun 11 20:02:32.395070 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.394980 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7e0e0e02-15e4-4664-acaf-bc01a0e33e20-secret-grpc-tls\") pod \"thanos-querier-78d6f59854-q6vq6\" (UID: \"7e0e0e02-15e4-4664-acaf-bc01a0e33e20\") " pod="openshift-monitoring/thanos-querier-78d6f59854-q6vq6" Jun 11 20:02:32.395070 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.395055 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e0e0e02-15e4-4664-acaf-bc01a0e33e20-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-78d6f59854-q6vq6\" (UID: \"7e0e0e02-15e4-4664-acaf-bc01a0e33e20\") " pod="openshift-monitoring/thanos-querier-78d6f59854-q6vq6" Jun 11 20:02:32.395282 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.395150 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ch2p\" (UniqueName: \"kubernetes.io/projected/7e0e0e02-15e4-4664-acaf-bc01a0e33e20-kube-api-access-6ch2p\") pod \"thanos-querier-78d6f59854-q6vq6\" (UID: \"7e0e0e02-15e4-4664-acaf-bc01a0e33e20\") " pod="openshift-monitoring/thanos-querier-78d6f59854-q6vq6" Jun 11 20:02:32.395282 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.395181 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7e0e0e02-15e4-4664-acaf-bc01a0e33e20-secret-thanos-querier-tls\") pod \"thanos-querier-78d6f59854-q6vq6\" (UID: \"7e0e0e02-15e4-4664-acaf-bc01a0e33e20\") " pod="openshift-monitoring/thanos-querier-78d6f59854-q6vq6" Jun 11 20:02:32.395282 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.395221 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7e0e0e02-15e4-4664-acaf-bc01a0e33e20-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-78d6f59854-q6vq6\" (UID: \"7e0e0e02-15e4-4664-acaf-bc01a0e33e20\") " pod="openshift-monitoring/thanos-querier-78d6f59854-q6vq6" Jun 11 20:02:32.395282 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.395253 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e0e0e02-15e4-4664-acaf-bc01a0e33e20-metrics-client-ca\") pod \"thanos-querier-78d6f59854-q6vq6\" (UID: \"7e0e0e02-15e4-4664-acaf-bc01a0e33e20\") " pod="openshift-monitoring/thanos-querier-78d6f59854-q6vq6" Jun 11 20:02:32.395476 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.395289 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7e0e0e02-15e4-4664-acaf-bc01a0e33e20-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-78d6f59854-q6vq6\" (UID: \"7e0e0e02-15e4-4664-acaf-bc01a0e33e20\") " pod="openshift-monitoring/thanos-querier-78d6f59854-q6vq6" Jun 11 20:02:32.395476 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.395307 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e0e0e02-15e4-4664-acaf-bc01a0e33e20-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-78d6f59854-q6vq6\" (UID: \"7e0e0e02-15e4-4664-acaf-bc01a0e33e20\") " pod="openshift-monitoring/thanos-querier-78d6f59854-q6vq6" Jun 11 20:02:32.396366 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.396311 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e0e0e02-15e4-4664-acaf-bc01a0e33e20-metrics-client-ca\") pod \"thanos-querier-78d6f59854-q6vq6\" (UID: \"7e0e0e02-15e4-4664-acaf-bc01a0e33e20\") " pod="openshift-monitoring/thanos-querier-78d6f59854-q6vq6" Jun 11 20:02:32.398477 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.398448 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7e0e0e02-15e4-4664-acaf-bc01a0e33e20-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-78d6f59854-q6vq6\" (UID: \"7e0e0e02-15e4-4664-acaf-bc01a0e33e20\") " pod="openshift-monitoring/thanos-querier-78d6f59854-q6vq6" Jun 11 20:02:32.398674 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.398643 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e0e0e02-15e4-4664-acaf-bc01a0e33e20-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-78d6f59854-q6vq6\" (UID: \"7e0e0e02-15e4-4664-acaf-bc01a0e33e20\") " pod="openshift-monitoring/thanos-querier-78d6f59854-q6vq6" Jun 11 20:02:32.398762 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.398678 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7e0e0e02-15e4-4664-acaf-bc01a0e33e20-secret-thanos-querier-tls\") pod \"thanos-querier-78d6f59854-q6vq6\" (UID: \"7e0e0e02-15e4-4664-acaf-bc01a0e33e20\") " pod="openshift-monitoring/thanos-querier-78d6f59854-q6vq6" Jun 11 20:02:32.398854 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.398824 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7e0e0e02-15e4-4664-acaf-bc01a0e33e20-secret-grpc-tls\") pod \"thanos-querier-78d6f59854-q6vq6\" (UID: \"7e0e0e02-15e4-4664-acaf-bc01a0e33e20\") " pod="openshift-monitoring/thanos-querier-78d6f59854-q6vq6" Jun 11 20:02:32.398956 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.398936 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e0e0e02-15e4-4664-acaf-bc01a0e33e20-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-78d6f59854-q6vq6\" (UID: \"7e0e0e02-15e4-4664-acaf-bc01a0e33e20\") " pod="openshift-monitoring/thanos-querier-78d6f59854-q6vq6" Jun 11 20:02:32.399100 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.399083 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7e0e0e02-15e4-4664-acaf-bc01a0e33e20-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-78d6f59854-q6vq6\" (UID: \"7e0e0e02-15e4-4664-acaf-bc01a0e33e20\") " pod="openshift-monitoring/thanos-querier-78d6f59854-q6vq6" Jun 11 20:02:32.403439 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.403417 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ch2p\" (UniqueName: \"kubernetes.io/projected/7e0e0e02-15e4-4664-acaf-bc01a0e33e20-kube-api-access-6ch2p\") pod \"thanos-querier-78d6f59854-q6vq6\" (UID: \"7e0e0e02-15e4-4664-acaf-bc01a0e33e20\") " pod="openshift-monitoring/thanos-querier-78d6f59854-q6vq6" Jun 11 20:02:32.483497 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.483461 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-78d6f59854-q6vq6" Jun 11 20:02:32.598986 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.598953 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d928dda-ae89-4559-8e89-7779fe6f2e97","Type":"ContainerStarted","Data":"594eb40a751174fb71fb216cfec7277fcbe3768a2793c4c6225cd36c1ebc8b80"} Jun 11 20:02:32.600179 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.600150 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nsftk" event={"ID":"6b854950-2217-420d-94c2-bbbe91c0e127","Type":"ContainerStarted","Data":"56d3bcbed47562f84e24bb5a67d9f73209b8de16503b56f09f263a6d010fdc2d"} Jun 11 20:02:32.602041 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.602018 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-gngss" event={"ID":"27c9d0e7-c6aa-4c34-af39-5bc0b661769c","Type":"ContainerStarted","Data":"fa314fd7e2d8dab260a2f49d2f157bd9ba6ed9e70ccf27ba0d969f81eeafa91b"} Jun 11 20:02:32.602137 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.602075 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-gngss" event={"ID":"27c9d0e7-c6aa-4c34-af39-5bc0b661769c","Type":"ContainerStarted","Data":"cbfbb3d32ec1df27aecc97fb6a223da41434a9d4e3a4707a0e9f778dc4473983"} Jun 11 20:02:32.602137 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.602104 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-gngss" event={"ID":"27c9d0e7-c6aa-4c34-af39-5bc0b661769c","Type":"ContainerStarted","Data":"c8d68ccaa07d097d0a9cdd0cef4eafcac53d73ee91097dedcffe498979cadecd"} Jun 11 20:02:32.655564 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:32.655532 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-78d6f59854-q6vq6"] Jun 11 20:02:32.866106 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:02:32.866064 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e0e0e02_15e4_4664_acaf_bc01a0e33e20.slice/crio-e5f3bdfaddc5f0d4b2c32d53cc9cd1a7115bbc681936904072057e9d083abb02 WatchSource:0}: Error finding container e5f3bdfaddc5f0d4b2c32d53cc9cd1a7115bbc681936904072057e9d083abb02: Status 404 returned error can't find the container with id e5f3bdfaddc5f0d4b2c32d53cc9cd1a7115bbc681936904072057e9d083abb02 Jun 11 20:02:33.142728 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:33.142679 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:33.243918 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:33.243790 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:33.440494 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:33.440453 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:33.611798 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:33.611763 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78d6f59854-q6vq6" event={"ID":"7e0e0e02-15e4-4664-acaf-bc01a0e33e20","Type":"ContainerStarted","Data":"e5f3bdfaddc5f0d4b2c32d53cc9cd1a7115bbc681936904072057e9d083abb02"} Jun 11 20:02:33.614258 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:33.614229 2562 generic.go:356] "Generic (PLEG): container finished" podID="6b854950-2217-420d-94c2-bbbe91c0e127" containerID="237c64dddec91b9961cbf5b12ceea25947d5e579db916c6e802aee7e197ca3a2" exitCode=0 Jun 11 20:02:33.614393 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:33.614315 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nsftk" event={"ID":"6b854950-2217-420d-94c2-bbbe91c0e127","Type":"ContainerDied","Data":"237c64dddec91b9961cbf5b12ceea25947d5e579db916c6e802aee7e197ca3a2"} Jun 11 20:02:33.739400 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:33.739356 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:34.621235 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:34.620948 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nsftk" event={"ID":"6b854950-2217-420d-94c2-bbbe91c0e127","Type":"ContainerStarted","Data":"65062ac599f63adb5a3301c0cb0e83df29f56182d71d27569a7fa987fb760f26"} Jun 11 20:02:34.621235 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:34.621011 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nsftk" event={"ID":"6b854950-2217-420d-94c2-bbbe91c0e127","Type":"ContainerStarted","Data":"c75138b7346248fb66bbf11a23ab98398ead67ba0e68c2e760420a2239b542ee"} Jun 11 20:02:34.623007 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:34.622974 2562 generic.go:356] "Generic (PLEG): container finished" podID="6d928dda-ae89-4559-8e89-7779fe6f2e97" containerID="91fda56bec6790b7a9cd4522f82a5b0bc66be23c31cdb6d9763eaa498eb17d59" exitCode=0 Jun 11 20:02:34.623126 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:34.623069 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d928dda-ae89-4559-8e89-7779fe6f2e97","Type":"ContainerDied","Data":"91fda56bec6790b7a9cd4522f82a5b0bc66be23c31cdb6d9763eaa498eb17d59"} Jun 11 20:02:34.625687 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:34.625658 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-gngss" event={"ID":"27c9d0e7-c6aa-4c34-af39-5bc0b661769c","Type":"ContainerStarted","Data":"22989f779a33b7867dc88a29b8cb8eb301a9c1ef382bec0073dcdf0b7ecc3a42"} Jun 11 20:02:34.639842 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:34.639785 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nsftk" podStartSLOduration=3.677063436 podStartE2EDuration="4.639766249s" totalImagesPullingTime="879.308334ms" totalInitContainerRuntime="83.394479ms" isStatefulPod=true podCreationTimestamp="2026-06-11 20:02:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:02:34.638504695 +0000 UTC m=+246.369666671" watchObservedRunningTime="2026-06-11 20:02:34.639766249 +0000 UTC m=+246.370928223" Jun 11 20:02:34.656177 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:34.656123 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-gngss" podStartSLOduration=3.355222839 podStartE2EDuration="4.656100914s" totalImagesPullingTime="1.300878075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:02:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:02:34.654726511 +0000 UTC m=+246.385888487" watchObservedRunningTime="2026-06-11 20:02:34.656100914 +0000 UTC m=+246.387262890" Jun 11 20:02:34.953787 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:34.953758 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:35.030962 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:35.030930 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:35.152052 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:35.152020 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:35.253253 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:35.253159 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:35.632628 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:35.632586 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78d6f59854-q6vq6" event={"ID":"7e0e0e02-15e4-4664-acaf-bc01a0e33e20","Type":"ContainerStarted","Data":"507fb0f3fa208f1cb57a51793c83cfcaf6b6dd790377233440f4c7fa0faab446"} Jun 11 20:02:35.633110 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:35.632674 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78d6f59854-q6vq6" event={"ID":"7e0e0e02-15e4-4664-acaf-bc01a0e33e20","Type":"ContainerStarted","Data":"a8ada645413f0eddac913b0b48f82798d36242ca5b21a1674fea2e4e89ff4578"} Jun 11 20:02:35.633110 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:35.632705 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78d6f59854-q6vq6" event={"ID":"7e0e0e02-15e4-4664-acaf-bc01a0e33e20","Type":"ContainerStarted","Data":"05f5ca359cff6c61aa303d73729bb7760eee06b92c5b9571789b854207ecbdf6"} Jun 11 20:02:35.777434 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:35.777366 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:35.791726 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:35.789822 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fddddd577-qjfs8"] Jun 11 20:02:35.828056 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:35.828023 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65fc9b89bd-j46lk"] Jun 11 20:02:35.831171 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:35.831146 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65fc9b89bd-j46lk" Jun 11 20:02:35.846673 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:35.846641 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65fc9b89bd-j46lk"] Jun 11 20:02:35.896595 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:35.896555 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:35.930055 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:35.929897 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57500943-f9b4-4003-91e0-8d127cda69d2-console-config\") pod \"console-65fc9b89bd-j46lk\" (UID: \"57500943-f9b4-4003-91e0-8d127cda69d2\") " pod="openshift-console/console-65fc9b89bd-j46lk" Jun 11 20:02:35.930055 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:35.929971 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57500943-f9b4-4003-91e0-8d127cda69d2-trusted-ca-bundle\") pod \"console-65fc9b89bd-j46lk\" (UID: \"57500943-f9b4-4003-91e0-8d127cda69d2\") " pod="openshift-console/console-65fc9b89bd-j46lk" Jun 11 20:02:35.930055 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:35.930000 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85nsq\" (UniqueName: \"kubernetes.io/projected/57500943-f9b4-4003-91e0-8d127cda69d2-kube-api-access-85nsq\") pod \"console-65fc9b89bd-j46lk\" (UID: \"57500943-f9b4-4003-91e0-8d127cda69d2\") " pod="openshift-console/console-65fc9b89bd-j46lk" Jun 11 20:02:35.930055 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:35.930020 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57500943-f9b4-4003-91e0-8d127cda69d2-console-serving-cert\") pod \"console-65fc9b89bd-j46lk\" (UID: \"57500943-f9b4-4003-91e0-8d127cda69d2\") " pod="openshift-console/console-65fc9b89bd-j46lk" Jun 11 20:02:35.930055 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:35.930037 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57500943-f9b4-4003-91e0-8d127cda69d2-console-oauth-config\") pod \"console-65fc9b89bd-j46lk\" (UID: \"57500943-f9b4-4003-91e0-8d127cda69d2\") " pod="openshift-console/console-65fc9b89bd-j46lk" Jun 11 20:02:35.930055 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:35.930055 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57500943-f9b4-4003-91e0-8d127cda69d2-service-ca\") pod \"console-65fc9b89bd-j46lk\" (UID: \"57500943-f9b4-4003-91e0-8d127cda69d2\") " pod="openshift-console/console-65fc9b89bd-j46lk" Jun 11 20:02:35.930299 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:35.930177 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57500943-f9b4-4003-91e0-8d127cda69d2-oauth-serving-cert\") pod \"console-65fc9b89bd-j46lk\" (UID: \"57500943-f9b4-4003-91e0-8d127cda69d2\") " pod="openshift-console/console-65fc9b89bd-j46lk" Jun 11 20:02:36.031430 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:36.031402 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57500943-f9b4-4003-91e0-8d127cda69d2-console-config\") pod \"console-65fc9b89bd-j46lk\" (UID: \"57500943-f9b4-4003-91e0-8d127cda69d2\") " pod="openshift-console/console-65fc9b89bd-j46lk" Jun 11 20:02:36.031556 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:36.031495 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57500943-f9b4-4003-91e0-8d127cda69d2-trusted-ca-bundle\") pod \"console-65fc9b89bd-j46lk\" (UID: \"57500943-f9b4-4003-91e0-8d127cda69d2\") " pod="openshift-console/console-65fc9b89bd-j46lk" Jun 11 20:02:36.031556 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:36.031535 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85nsq\" (UniqueName: \"kubernetes.io/projected/57500943-f9b4-4003-91e0-8d127cda69d2-kube-api-access-85nsq\") pod \"console-65fc9b89bd-j46lk\" (UID: \"57500943-f9b4-4003-91e0-8d127cda69d2\") " pod="openshift-console/console-65fc9b89bd-j46lk" Jun 11 20:02:36.031638 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:36.031568 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57500943-f9b4-4003-91e0-8d127cda69d2-console-serving-cert\") pod \"console-65fc9b89bd-j46lk\" (UID: \"57500943-f9b4-4003-91e0-8d127cda69d2\") " pod="openshift-console/console-65fc9b89bd-j46lk" Jun 11 20:02:36.031714 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:36.031694 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57500943-f9b4-4003-91e0-8d127cda69d2-console-oauth-config\") pod \"console-65fc9b89bd-j46lk\" (UID: \"57500943-f9b4-4003-91e0-8d127cda69d2\") " pod="openshift-console/console-65fc9b89bd-j46lk" Jun 11 20:02:36.031766 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:36.031738 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57500943-f9b4-4003-91e0-8d127cda69d2-service-ca\") pod \"console-65fc9b89bd-j46lk\" (UID: \"57500943-f9b4-4003-91e0-8d127cda69d2\") " pod="openshift-console/console-65fc9b89bd-j46lk" Jun 11 20:02:36.032524 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:36.031826 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57500943-f9b4-4003-91e0-8d127cda69d2-oauth-serving-cert\") pod \"console-65fc9b89bd-j46lk\" (UID: \"57500943-f9b4-4003-91e0-8d127cda69d2\") " pod="openshift-console/console-65fc9b89bd-j46lk" Jun 11 20:02:36.032524 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:36.032146 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57500943-f9b4-4003-91e0-8d127cda69d2-console-config\") pod \"console-65fc9b89bd-j46lk\" (UID: \"57500943-f9b4-4003-91e0-8d127cda69d2\") " pod="openshift-console/console-65fc9b89bd-j46lk" Jun 11 20:02:36.032524 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:36.032365 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57500943-f9b4-4003-91e0-8d127cda69d2-trusted-ca-bundle\") pod \"console-65fc9b89bd-j46lk\" (UID: \"57500943-f9b4-4003-91e0-8d127cda69d2\") " pod="openshift-console/console-65fc9b89bd-j46lk" Jun 11 20:02:36.032524 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:36.032491 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57500943-f9b4-4003-91e0-8d127cda69d2-oauth-serving-cert\") pod \"console-65fc9b89bd-j46lk\" (UID: \"57500943-f9b4-4003-91e0-8d127cda69d2\") " pod="openshift-console/console-65fc9b89bd-j46lk" Jun 11 20:02:36.032524 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:36.032491 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57500943-f9b4-4003-91e0-8d127cda69d2-service-ca\") pod \"console-65fc9b89bd-j46lk\" (UID: \"57500943-f9b4-4003-91e0-8d127cda69d2\") " pod="openshift-console/console-65fc9b89bd-j46lk" Jun 11 20:02:36.034354 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:36.034329 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57500943-f9b4-4003-91e0-8d127cda69d2-console-oauth-config\") pod \"console-65fc9b89bd-j46lk\" (UID: \"57500943-f9b4-4003-91e0-8d127cda69d2\") " pod="openshift-console/console-65fc9b89bd-j46lk" Jun 11 20:02:36.034593 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:36.034566 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57500943-f9b4-4003-91e0-8d127cda69d2-console-serving-cert\") pod \"console-65fc9b89bd-j46lk\" (UID: \"57500943-f9b4-4003-91e0-8d127cda69d2\") " pod="openshift-console/console-65fc9b89bd-j46lk" Jun 11 20:02:36.041797 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:36.041769 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85nsq\" (UniqueName: \"kubernetes.io/projected/57500943-f9b4-4003-91e0-8d127cda69d2-kube-api-access-85nsq\") pod \"console-65fc9b89bd-j46lk\" (UID: \"57500943-f9b4-4003-91e0-8d127cda69d2\") " pod="openshift-console/console-65fc9b89bd-j46lk" Jun 11 20:02:36.140303 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:36.139959 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65fc9b89bd-j46lk" Jun 11 20:02:36.299008 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:36.298970 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65fc9b89bd-j46lk"] Jun 11 20:02:36.329052 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:02:36.329016 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57500943_f9b4_4003_91e0_8d127cda69d2.slice/crio-5864c9693f31c682b1e6c9eeeb977584c82b4e8f25b463ff850a479bb60537b4 WatchSource:0}: Error finding container 5864c9693f31c682b1e6c9eeeb977584c82b4e8f25b463ff850a479bb60537b4: Status 404 returned error can't find the container with id 5864c9693f31c682b1e6c9eeeb977584c82b4e8f25b463ff850a479bb60537b4 Jun 11 20:02:36.468045 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:36.468020 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:36.639427 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:36.639390 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d928dda-ae89-4559-8e89-7779fe6f2e97","Type":"ContainerStarted","Data":"3aefaa9f5f625b2aec107c671bbac5efaebb13a58520ffd2721d4e21efb2ff79"} Jun 11 20:02:36.639844 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:36.639465 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d928dda-ae89-4559-8e89-7779fe6f2e97","Type":"ContainerStarted","Data":"9b47d9963f278a595059162914c2888776a2617f8f9bfdd5501124b27974ed31"} Jun 11 20:02:36.639844 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:36.639507 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d928dda-ae89-4559-8e89-7779fe6f2e97","Type":"ContainerStarted","Data":"862444ed8bd89b52bfbe13aa100eeec47c6b62068ec70bb37791774f8ee68505"} Jun 11 20:02:36.639844 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:36.639545 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d928dda-ae89-4559-8e89-7779fe6f2e97","Type":"ContainerStarted","Data":"1c5053b9cc8ff516b9516ac0a498d9cec8ac69f9d7da6c92d8242bb9e0e899c3"} Jun 11 20:02:36.639844 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:36.639571 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d928dda-ae89-4559-8e89-7779fe6f2e97","Type":"ContainerStarted","Data":"cb67743b596871c86f256e150f98488876eba624059ea5240a97fb2c25b24884"} Jun 11 20:02:36.639844 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:36.639597 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d928dda-ae89-4559-8e89-7779fe6f2e97","Type":"ContainerStarted","Data":"fc6433141374daad7ac24a2994e6b88ba1b200510845a5a9026e392cde6724a6"} Jun 11 20:02:36.641305 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:36.641232 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65fc9b89bd-j46lk" event={"ID":"57500943-f9b4-4003-91e0-8d127cda69d2","Type":"ContainerStarted","Data":"cdbff50a7199c2557c13c2342b05e414a6d7ae157e0b3277789bbebaa6647366"} Jun 11 20:02:36.641305 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:36.641276 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65fc9b89bd-j46lk" event={"ID":"57500943-f9b4-4003-91e0-8d127cda69d2","Type":"ContainerStarted","Data":"5864c9693f31c682b1e6c9eeeb977584c82b4e8f25b463ff850a479bb60537b4"} Jun 11 20:02:36.644231 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:36.644209 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78d6f59854-q6vq6" event={"ID":"7e0e0e02-15e4-4664-acaf-bc01a0e33e20","Type":"ContainerStarted","Data":"e705f3d591767444f6d128c08956e91ebe3689a73b209c717d990113b8b92ecd"} Jun 11 20:02:36.644362 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:36.644258 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78d6f59854-q6vq6" event={"ID":"7e0e0e02-15e4-4664-acaf-bc01a0e33e20","Type":"ContainerStarted","Data":"969b8eb122919d7bd1f652fdb94d4e20ca31c58b96f204d78e3611c1c603876e"} Jun 11 20:02:36.644362 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:36.644283 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78d6f59854-q6vq6" event={"ID":"7e0e0e02-15e4-4664-acaf-bc01a0e33e20","Type":"ContainerStarted","Data":"c345d0d34bab85039e2bcbc69bb441f00a23f33a1a72aa78b1ce172caac32b20"} Jun 11 20:02:36.644493 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:36.644420 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-78d6f59854-q6vq6" Jun 11 20:02:36.674051 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:36.674003 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.847651091 podStartE2EDuration="5.673986503s" totalImagesPullingTime="2.8025042s" totalInitContainerRuntime="23.831212ms" isStatefulPod=false podCreationTimestamp="2026-06-11 20:02:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:02:36.671520163 +0000 UTC m=+248.402682139" watchObservedRunningTime="2026-06-11 20:02:36.673986503 +0000 UTC m=+248.405148544" Jun 11 20:02:36.696528 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:36.696455 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-78d6f59854-q6vq6" podStartSLOduration=1.405717991 podStartE2EDuration="4.696437237s" totalImagesPullingTime="3.290719246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:02:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:02:36.695794345 +0000 UTC m=+248.426956319" watchObservedRunningTime="2026-06-11 20:02:36.696437237 +0000 UTC m=+248.427599223" Jun 11 20:02:36.718932 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:36.718880 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65fc9b89bd-j46lk" podStartSLOduration=1.718864275 podStartE2EDuration="1.718864275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:02:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:02:36.717600945 +0000 UTC m=+248.448762920" watchObservedRunningTime="2026-06-11 20:02:36.718864275 +0000 UTC m=+248.450026249" Jun 11 20:02:39.078864 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:39.078818 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b767d89f-2dhmp" Jun 11 20:02:39.079340 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:39.078889 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b767d89f-2dhmp" Jun 11 20:02:39.080362 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:39.080333 2562 patch_prober.go:28] interesting pod/console-b767d89f-2dhmp container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" start-of-body= Jun 11 20:02:39.080479 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:39.080406 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-b767d89f-2dhmp" podUID="17f3f6d7-5b4a-4917-baa9-b168d6b51233" containerName="console" probeResult="failure" output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" Jun 11 20:02:39.138691 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:39.138648 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:39.190068 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:39.190029 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:39.567799 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:39.567758 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dcc3087e-d6a7-4ec1-b911-8bf96a4319d2-metrics-certs\") pod \"network-metrics-daemon-k98nz\" (UID: \"dcc3087e-d6a7-4ec1-b911-8bf96a4319d2\") " pod="openshift-multus/network-metrics-daemon-k98nz" Jun 11 20:02:39.570290 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:39.570263 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dcc3087e-d6a7-4ec1-b911-8bf96a4319d2-metrics-certs\") pod \"network-metrics-daemon-k98nz\" (UID: \"dcc3087e-d6a7-4ec1-b911-8bf96a4319d2\") " pod="openshift-multus/network-metrics-daemon-k98nz" Jun 11 20:02:39.832735 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:39.832706 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gpsgr\"" Jun 11 20:02:39.840501 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:39.840479 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k98nz" Jun 11 20:02:39.974820 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:39.974789 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k98nz"] Jun 11 20:02:39.977666 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:02:39.977642 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcc3087e_d6a7_4ec1_b911_8bf96a4319d2.slice/crio-040f6a2a39fecce44dd7ebec2330a554378a5f24fda9fda08612ac3b550ab0a3 WatchSource:0}: Error finding container 040f6a2a39fecce44dd7ebec2330a554378a5f24fda9fda08612ac3b550ab0a3: Status 404 returned error can't find the container with id 040f6a2a39fecce44dd7ebec2330a554378a5f24fda9fda08612ac3b550ab0a3 Jun 11 20:02:40.661439 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:40.661405 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k98nz" event={"ID":"dcc3087e-d6a7-4ec1-b911-8bf96a4319d2","Type":"ContainerStarted","Data":"040f6a2a39fecce44dd7ebec2330a554378a5f24fda9fda08612ac3b550ab0a3"} Jun 11 20:02:41.667683 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:41.667651 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k98nz" event={"ID":"dcc3087e-d6a7-4ec1-b911-8bf96a4319d2","Type":"ContainerStarted","Data":"d184f6b83e13194f659f6f81993cacc46f24b6ae59767d62101599f7c04bf521"} Jun 11 20:02:41.668070 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:41.667730 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k98nz" event={"ID":"dcc3087e-d6a7-4ec1-b911-8bf96a4319d2","Type":"ContainerStarted","Data":"c9ca786008157fe31b88f06d743422d24bc3beb02f06774c17ab4440ea5cace3"} Jun 11 20:02:41.714172 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:41.714124 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-k98nz" podStartSLOduration=252.837984175 podStartE2EDuration="4m13.714110258s" totalImagesPullingTime="876.126083ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:58:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:02:41.709032362 +0000 UTC m=+253.440194348" watchObservedRunningTime="2026-06-11 20:02:41.714110258 +0000 UTC m=+253.445272236" Jun 11 20:02:41.869968 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:41.869923 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:41.970684 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:41.970550 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:42.654487 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:42.654454 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-78d6f59854-q6vq6" Jun 11 20:02:46.140925 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:46.140888 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65fc9b89bd-j46lk" Jun 11 20:02:46.141434 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:46.140944 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65fc9b89bd-j46lk" Jun 11 20:02:46.142369 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:46.142343 2562 patch_prober.go:28] interesting pod/console-65fc9b89bd-j46lk container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" start-of-body= Jun 11 20:02:46.142504 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:46.142409 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-65fc9b89bd-j46lk" podUID="57500943-f9b4-4003-91e0-8d127cda69d2" containerName="console" probeResult="failure" output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" Jun 11 20:02:47.475108 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:47.475076 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:47.575489 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:47.575454 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:48.425098 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:48.425069 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:48.480441 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:48.480405 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:48.534782 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:48.534749 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:48.802198 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:48.802108 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:48.859615 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:48.859572 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:49.078320 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:49.078225 2562 patch_prober.go:28] interesting pod/console-b767d89f-2dhmp container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" start-of-body= Jun 11 20:02:49.078320 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:49.078283 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-b767d89f-2dhmp" podUID="17f3f6d7-5b4a-4917-baa9-b168d6b51233" containerName="console" probeResult="failure" output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" Jun 11 20:02:49.883074 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:49.883032 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:49.984352 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:49.984316 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:56.140903 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:56.140861 2562 patch_prober.go:28] interesting pod/console-65fc9b89bd-j46lk container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" start-of-body= Jun 11 20:02:56.141289 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:56.140924 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-65fc9b89bd-j46lk" podUID="57500943-f9b4-4003-91e0-8d127cda69d2" containerName="console" probeResult="failure" output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" Jun 11 20:02:58.278095 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:58.278056 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:58.378694 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:58.378655 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:59.078204 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:59.078168 2562 patch_prober.go:28] interesting pod/console-b767d89f-2dhmp container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" start-of-body= Jun 11 20:02:59.078395 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:02:59.078216 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-b767d89f-2dhmp" podUID="17f3f6d7-5b4a-4917-baa9-b168d6b51233" containerName="console" probeResult="failure" output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" Jun 11 20:03:00.813537 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:00.813496 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-fddddd577-qjfs8" podUID="4ffb068c-6d07-4f18-aa8c-e69057259a86" containerName="console" containerID="cri-o://61f16403467ee8763972a1c5f187d450b76d0096ab5d3ddec39cea46559e5f57" gracePeriod=15 Jun 11 20:03:01.752310 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:01.752225 2562 generic.go:356] "Generic (PLEG): container finished" podID="3e2eabc4-6dcb-442c-bfc3-d5d6d44f14c1" containerID="34054c22e17dd9026bf0856d65b6f693892b532e709d6a3c3d206f84b16f130b" exitCode=0 Jun 11 20:03:01.752310 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:01.752275 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-qtc8f" event={"ID":"3e2eabc4-6dcb-442c-bfc3-d5d6d44f14c1","Type":"ContainerDied","Data":"34054c22e17dd9026bf0856d65b6f693892b532e709d6a3c3d206f84b16f130b"} Jun 11 20:03:01.752637 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:01.752620 2562 scope.go:117] "RemoveContainer" containerID="34054c22e17dd9026bf0856d65b6f693892b532e709d6a3c3d206f84b16f130b" Jun 11 20:03:02.758124 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:02.758079 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-qtc8f" event={"ID":"3e2eabc4-6dcb-442c-bfc3-d5d6d44f14c1","Type":"ContainerStarted","Data":"81efa146e31148e28671448faccfa7e4237d25991ecd1c28f4bf373d27c06bac"} Jun 11 20:03:06.141232 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:06.141192 2562 patch_prober.go:28] interesting pod/console-65fc9b89bd-j46lk container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" start-of-body= Jun 11 20:03:06.141640 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:06.141250 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-65fc9b89bd-j46lk" podUID="57500943-f9b4-4003-91e0-8d127cda69d2" containerName="console" probeResult="failure" output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" Jun 11 20:03:07.866873 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:07.866829 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:03:07.965531 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:07.965493 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:03:09.078440 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:09.078328 2562 patch_prober.go:28] interesting pod/console-b767d89f-2dhmp container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" start-of-body= Jun 11 20:03:09.078440 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:09.078416 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-b767d89f-2dhmp" podUID="17f3f6d7-5b4a-4917-baa9-b168d6b51233" containerName="console" probeResult="failure" output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" Jun 11 20:03:10.318957 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:03:10.318911 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dwkpn" podUID="40c0e2f2-95f6-4cb1-8cc3-86669ea992b0" Jun 11 20:03:10.318957 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:03:10.318918 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7db79967bc-vgntv" podUID="7ff2c3b7-0b29-4122-a9cc-5948769be69b" Jun 11 20:03:10.788626 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:10.788599 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 20:03:10.788811 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:10.788599 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dwkpn" Jun 11 20:03:14.065467 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:14.065431 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-metrics-tls\") pod \"dns-default-dwkpn\" (UID: \"40c0e2f2-95f6-4cb1-8cc3-86669ea992b0\") " pod="openshift-dns/dns-default-dwkpn" Jun 11 20:03:14.065902 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:14.065513 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-tls\") pod \"image-registry-7db79967bc-vgntv\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 20:03:14.067903 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:14.067881 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/40c0e2f2-95f6-4cb1-8cc3-86669ea992b0-metrics-tls\") pod \"dns-default-dwkpn\" (UID: \"40c0e2f2-95f6-4cb1-8cc3-86669ea992b0\") " pod="openshift-dns/dns-default-dwkpn" Jun 11 20:03:14.068083 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:14.068064 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-tls\") pod \"image-registry-7db79967bc-vgntv\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 20:03:14.093829 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:14.093810 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7dg7r\"" Jun 11 20:03:14.093949 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:14.093813 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qrnmm\"" Jun 11 20:03:14.100156 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:14.100135 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 20:03:14.100238 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:14.100227 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dwkpn" Jun 11 20:03:14.239914 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:14.239885 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dwkpn"] Jun 11 20:03:14.242064 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:03:14.242034 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40c0e2f2_95f6_4cb1_8cc3_86669ea992b0.slice/crio-82c13defbb8d5a37fe77574367391adbc575f826747268e347fe7c4a9d0b1639 WatchSource:0}: Error finding container 82c13defbb8d5a37fe77574367391adbc575f826747268e347fe7c4a9d0b1639: Status 404 returned error can't find the container with id 82c13defbb8d5a37fe77574367391adbc575f826747268e347fe7c4a9d0b1639 Jun 11 20:03:14.258040 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:14.258019 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7db79967bc-vgntv"] Jun 11 20:03:14.260064 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:03:14.260038 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ff2c3b7_0b29_4122_a9cc_5948769be69b.slice/crio-2796749c0687b09587df0e98da99a6ab99b2afaf7054fdb27442d4a47ef2f78b WatchSource:0}: Error finding container 2796749c0687b09587df0e98da99a6ab99b2afaf7054fdb27442d4a47ef2f78b: Status 404 returned error can't find the container with id 2796749c0687b09587df0e98da99a6ab99b2afaf7054fdb27442d4a47ef2f78b Jun 11 20:03:14.805839 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:14.805796 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dwkpn" event={"ID":"40c0e2f2-95f6-4cb1-8cc3-86669ea992b0","Type":"ContainerStarted","Data":"82c13defbb8d5a37fe77574367391adbc575f826747268e347fe7c4a9d0b1639"} Jun 11 20:03:14.807542 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:14.807500 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7db79967bc-vgntv" event={"ID":"7ff2c3b7-0b29-4122-a9cc-5948769be69b","Type":"ContainerStarted","Data":"345653bde6ef552fb2997d1be9a0213556972c7140cd941ea1da5c320dcedd1d"} Jun 11 20:03:14.807542 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:14.807544 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7db79967bc-vgntv" event={"ID":"7ff2c3b7-0b29-4122-a9cc-5948769be69b","Type":"ContainerStarted","Data":"2796749c0687b09587df0e98da99a6ab99b2afaf7054fdb27442d4a47ef2f78b"} Jun 11 20:03:14.807725 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:14.807697 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 20:03:14.829843 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:14.829781 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7db79967bc-vgntv" podStartSLOduration=285.82976168 podStartE2EDuration="4m45.82976168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:58:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:03:14.827038496 +0000 UTC m=+286.558200510" watchObservedRunningTime="2026-06-11 20:03:14.82976168 +0000 UTC m=+286.560923656" Jun 11 20:03:16.052792 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:16.052557 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-fddddd577-qjfs8_4ffb068c-6d07-4f18-aa8c-e69057259a86/console/0.log" Jun 11 20:03:16.054187 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:16.054159 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fddddd577-qjfs8" Jun 11 20:03:16.140874 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:16.140840 2562 patch_prober.go:28] interesting pod/console-65fc9b89bd-j46lk container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" start-of-body= Jun 11 20:03:16.141046 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:16.140893 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-65fc9b89bd-j46lk" podUID="57500943-f9b4-4003-91e0-8d127cda69d2" containerName="console" probeResult="failure" output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" Jun 11 20:03:16.186105 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:16.186074 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtmcr\" (UniqueName: \"kubernetes.io/projected/4ffb068c-6d07-4f18-aa8c-e69057259a86-kube-api-access-wtmcr\") pod \"4ffb068c-6d07-4f18-aa8c-e69057259a86\" (UID: \"4ffb068c-6d07-4f18-aa8c-e69057259a86\") " Jun 11 20:03:16.186105 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:16.186115 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ffb068c-6d07-4f18-aa8c-e69057259a86-console-config\") pod \"4ffb068c-6d07-4f18-aa8c-e69057259a86\" (UID: \"4ffb068c-6d07-4f18-aa8c-e69057259a86\") " Jun 11 20:03:16.186328 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:16.186146 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ffb068c-6d07-4f18-aa8c-e69057259a86-service-ca\") pod \"4ffb068c-6d07-4f18-aa8c-e69057259a86\" (UID: \"4ffb068c-6d07-4f18-aa8c-e69057259a86\") " Jun 11 20:03:16.186328 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:16.186160 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ffb068c-6d07-4f18-aa8c-e69057259a86-oauth-serving-cert\") pod \"4ffb068c-6d07-4f18-aa8c-e69057259a86\" (UID: \"4ffb068c-6d07-4f18-aa8c-e69057259a86\") " Jun 11 20:03:16.186328 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:16.186220 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ffb068c-6d07-4f18-aa8c-e69057259a86-console-serving-cert\") pod \"4ffb068c-6d07-4f18-aa8c-e69057259a86\" (UID: \"4ffb068c-6d07-4f18-aa8c-e69057259a86\") " Jun 11 20:03:16.186328 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:16.186272 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ffb068c-6d07-4f18-aa8c-e69057259a86-console-oauth-config\") pod \"4ffb068c-6d07-4f18-aa8c-e69057259a86\" (UID: \"4ffb068c-6d07-4f18-aa8c-e69057259a86\") " Jun 11 20:03:16.186570 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:16.186542 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ffb068c-6d07-4f18-aa8c-e69057259a86-service-ca" (OuterVolumeSpecName: "service-ca") pod "4ffb068c-6d07-4f18-aa8c-e69057259a86" (UID: "4ffb068c-6d07-4f18-aa8c-e69057259a86"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 20:03:16.186640 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:16.186576 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ffb068c-6d07-4f18-aa8c-e69057259a86-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4ffb068c-6d07-4f18-aa8c-e69057259a86" (UID: "4ffb068c-6d07-4f18-aa8c-e69057259a86"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 20:03:16.186817 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:16.186790 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ffb068c-6d07-4f18-aa8c-e69057259a86-console-config" (OuterVolumeSpecName: "console-config") pod "4ffb068c-6d07-4f18-aa8c-e69057259a86" (UID: "4ffb068c-6d07-4f18-aa8c-e69057259a86"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 20:03:16.188675 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:16.188645 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ffb068c-6d07-4f18-aa8c-e69057259a86-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4ffb068c-6d07-4f18-aa8c-e69057259a86" (UID: "4ffb068c-6d07-4f18-aa8c-e69057259a86"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 20:03:16.188769 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:16.188686 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ffb068c-6d07-4f18-aa8c-e69057259a86-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4ffb068c-6d07-4f18-aa8c-e69057259a86" (UID: "4ffb068c-6d07-4f18-aa8c-e69057259a86"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 20:03:16.188769 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:16.188722 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ffb068c-6d07-4f18-aa8c-e69057259a86-kube-api-access-wtmcr" (OuterVolumeSpecName: "kube-api-access-wtmcr") pod "4ffb068c-6d07-4f18-aa8c-e69057259a86" (UID: "4ffb068c-6d07-4f18-aa8c-e69057259a86"). InnerVolumeSpecName "kube-api-access-wtmcr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:03:16.287800 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:16.287770 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ffb068c-6d07-4f18-aa8c-e69057259a86-console-oauth-config\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:03:16.287800 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:16.287795 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtmcr\" (UniqueName: \"kubernetes.io/projected/4ffb068c-6d07-4f18-aa8c-e69057259a86-kube-api-access-wtmcr\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:03:16.287800 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:16.287805 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ffb068c-6d07-4f18-aa8c-e69057259a86-console-config\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:03:16.288022 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:16.287813 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ffb068c-6d07-4f18-aa8c-e69057259a86-service-ca\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:03:16.288022 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:16.287821 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ffb068c-6d07-4f18-aa8c-e69057259a86-oauth-serving-cert\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:03:16.288022 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:16.287829 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ffb068c-6d07-4f18-aa8c-e69057259a86-console-serving-cert\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:03:16.817947 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:16.817903 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dwkpn" event={"ID":"40c0e2f2-95f6-4cb1-8cc3-86669ea992b0","Type":"ContainerStarted","Data":"48efa7535fe4d9e633af6ee4d4918e6f9fedb3a44c2a695fb08012b994e695bf"} Jun 11 20:03:16.818155 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:16.817969 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dwkpn" event={"ID":"40c0e2f2-95f6-4cb1-8cc3-86669ea992b0","Type":"ContainerStarted","Data":"5d60e8d6cd80939c42ffcd0a78e1f2464459fab8367d51c389d914a98fc6aef3"} Jun 11 20:03:16.818155 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:16.817999 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dwkpn" Jun 11 20:03:16.819206 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:16.819186 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-fddddd577-qjfs8_4ffb068c-6d07-4f18-aa8c-e69057259a86/console/0.log" Jun 11 20:03:16.819334 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:16.819222 2562 generic.go:356] "Generic (PLEG): container finished" podID="4ffb068c-6d07-4f18-aa8c-e69057259a86" containerID="61f16403467ee8763972a1c5f187d450b76d0096ab5d3ddec39cea46559e5f57" exitCode=137 Jun 11 20:03:16.819334 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:16.819258 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fddddd577-qjfs8" event={"ID":"4ffb068c-6d07-4f18-aa8c-e69057259a86","Type":"ContainerDied","Data":"61f16403467ee8763972a1c5f187d450b76d0096ab5d3ddec39cea46559e5f57"} Jun 11 20:03:16.819334 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:16.819284 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fddddd577-qjfs8" Jun 11 20:03:16.819334 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:16.819297 2562 scope.go:117] "RemoveContainer" containerID="61f16403467ee8763972a1c5f187d450b76d0096ab5d3ddec39cea46559e5f57" Jun 11 20:03:16.819534 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:16.819287 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fddddd577-qjfs8" event={"ID":"4ffb068c-6d07-4f18-aa8c-e69057259a86","Type":"ContainerDied","Data":"4c02e0b7dc72903f87ad1187499b6f993246ec89d48ea8507ec5522d57469110"} Jun 11 20:03:16.827757 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:16.827735 2562 scope.go:117] "RemoveContainer" containerID="61f16403467ee8763972a1c5f187d450b76d0096ab5d3ddec39cea46559e5f57" Jun 11 20:03:16.828041 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:03:16.828020 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61f16403467ee8763972a1c5f187d450b76d0096ab5d3ddec39cea46559e5f57\": container with ID starting with 61f16403467ee8763972a1c5f187d450b76d0096ab5d3ddec39cea46559e5f57 not found: ID does not exist" containerID="61f16403467ee8763972a1c5f187d450b76d0096ab5d3ddec39cea46559e5f57" Jun 11 20:03:16.828088 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:16.828049 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61f16403467ee8763972a1c5f187d450b76d0096ab5d3ddec39cea46559e5f57"} err="failed to get container status \"61f16403467ee8763972a1c5f187d450b76d0096ab5d3ddec39cea46559e5f57\": rpc error: code = NotFound desc = could not find container \"61f16403467ee8763972a1c5f187d450b76d0096ab5d3ddec39cea46559e5f57\": container with ID starting with 61f16403467ee8763972a1c5f187d450b76d0096ab5d3ddec39cea46559e5f57 not found: ID does not exist" Jun 11 20:03:16.839244 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:16.839199 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dwkpn" podStartSLOduration=251.151258278 podStartE2EDuration="4m12.839181683s" totalImagesPullingTime="1.687923405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:59:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:03:16.838973159 +0000 UTC m=+288.570135147" watchObservedRunningTime="2026-06-11 20:03:16.839181683 +0000 UTC m=+288.570343658" Jun 11 20:03:16.854126 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:16.854104 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fddddd577-qjfs8"] Jun 11 20:03:16.859821 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:16.859801 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-fddddd577-qjfs8"] Jun 11 20:03:17.253457 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:17.253426 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:03:17.355179 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:17.355146 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:03:18.734639 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:18.734599 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ffb068c-6d07-4f18-aa8c-e69057259a86" path="/var/lib/kubelet/pods/4ffb068c-6d07-4f18-aa8c-e69057259a86/volumes" Jun 11 20:03:19.078816 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:19.078730 2562 patch_prober.go:28] interesting pod/console-b767d89f-2dhmp container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" start-of-body= Jun 11 20:03:19.078816 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:19.078785 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-b767d89f-2dhmp" podUID="17f3f6d7-5b4a-4917-baa9-b168d6b51233" containerName="console" probeResult="failure" output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" Jun 11 20:03:25.122969 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:25.122941 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6d928dda-ae89-4559-8e89-7779fe6f2e97/init-config-reloader/0.log" Jun 11 20:03:25.320980 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:25.320949 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6d928dda-ae89-4559-8e89-7779fe6f2e97/alertmanager/0.log" Jun 11 20:03:25.520142 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:25.520044 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6d928dda-ae89-4559-8e89-7779fe6f2e97/config-reloader/0.log" Jun 11 20:03:25.721288 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:25.721216 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6d928dda-ae89-4559-8e89-7779fe6f2e97/kube-rbac-proxy-web/0.log" Jun 11 20:03:25.920552 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:25.920515 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6d928dda-ae89-4559-8e89-7779fe6f2e97/kube-rbac-proxy/0.log" Jun 11 20:03:26.120785 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:26.120753 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6d928dda-ae89-4559-8e89-7779fe6f2e97/kube-rbac-proxy-metric/0.log" Jun 11 20:03:26.141017 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:26.140989 2562 patch_prober.go:28] interesting pod/console-65fc9b89bd-j46lk container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" start-of-body= Jun 11 20:03:26.141319 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:26.141050 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-65fc9b89bd-j46lk" podUID="57500943-f9b4-4003-91e0-8d127cda69d2" containerName="console" probeResult="failure" output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" Jun 11 20:03:26.319626 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:26.319545 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6d928dda-ae89-4559-8e89-7779fe6f2e97/prom-label-proxy/0.log" Jun 11 20:03:26.520584 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:26.520550 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-44fbb_3f87ba75-1431-4113-a7df-cf35939bb63d/cluster-monitoring-operator/0.log" Jun 11 20:03:26.672962 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:26.672929 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:03:26.774563 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:26.774527 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:03:26.827551 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:26.827519 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dwkpn" Jun 11 20:03:27.719281 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:27.719254 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nsftk_6b854950-2217-420d-94c2-bbbe91c0e127/init-textfile/0.log" Jun 11 20:03:27.920284 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:27.920257 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nsftk_6b854950-2217-420d-94c2-bbbe91c0e127/node-exporter/0.log" Jun 11 20:03:28.120023 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:28.119998 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nsftk_6b854950-2217-420d-94c2-bbbe91c0e127/kube-rbac-proxy/0.log" Jun 11 20:03:28.673869 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:28.673840 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ckh6n_ba09d733-3024-4a3c-b49c-ab7213905587/console-operator/1.log" Jun 11 20:03:28.674702 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:28.674685 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ckh6n_ba09d733-3024-4a3c-b49c-ab7213905587/console-operator/1.log" Jun 11 20:03:28.685004 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:28.684987 2562 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 20:03:29.078863 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:29.078776 2562 patch_prober.go:28] interesting pod/console-b767d89f-2dhmp container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" start-of-body= Jun 11 20:03:29.078863 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:29.078835 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-b767d89f-2dhmp" podUID="17f3f6d7-5b4a-4917-baa9-b168d6b51233" containerName="console" probeResult="failure" output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" Jun 11 20:03:29.519695 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:29.519648 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-gngss_27c9d0e7-c6aa-4c34-af39-5bc0b661769c/kube-rbac-proxy-main/0.log" Jun 11 20:03:29.719955 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:29.719903 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-gngss_27c9d0e7-c6aa-4c34-af39-5bc0b661769c/kube-rbac-proxy-self/0.log" Jun 11 20:03:29.919636 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:29.919607 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-gngss_27c9d0e7-c6aa-4c34-af39-5bc0b661769c/openshift-state-metrics/0.log" Jun 11 20:03:32.120480 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:32.120442 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78d6f59854-q6vq6_7e0e0e02-15e4-4664-acaf-bc01a0e33e20/thanos-query/0.log" Jun 11 20:03:32.319909 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:32.319864 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78d6f59854-q6vq6_7e0e0e02-15e4-4664-acaf-bc01a0e33e20/kube-rbac-proxy-web/0.log" Jun 11 20:03:32.519995 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:32.519899 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78d6f59854-q6vq6_7e0e0e02-15e4-4664-acaf-bc01a0e33e20/kube-rbac-proxy/0.log" Jun 11 20:03:32.719801 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:32.719767 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78d6f59854-q6vq6_7e0e0e02-15e4-4664-acaf-bc01a0e33e20/prom-label-proxy/0.log" Jun 11 20:03:32.920308 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:32.920278 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78d6f59854-q6vq6_7e0e0e02-15e4-4664-acaf-bc01a0e33e20/kube-rbac-proxy-rules/0.log" Jun 11 20:03:33.119986 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:33.119927 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78d6f59854-q6vq6_7e0e0e02-15e4-4664-acaf-bc01a0e33e20/kube-rbac-proxy-metrics/0.log" Jun 11 20:03:33.326003 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:33.325928 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-nbq4r_9379570c-48c8-4906-80d9-8ec41b107a12/networking-console-plugin/0.log" Jun 11 20:03:33.520127 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:33.520099 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ckh6n_ba09d733-3024-4a3c-b49c-ab7213905587/console-operator/1.log" Jun 11 20:03:33.724212 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:33.724184 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ckh6n_ba09d733-3024-4a3c-b49c-ab7213905587/console-operator/2.log" Jun 11 20:03:33.920410 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:33.920367 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-65fc9b89bd-j46lk_57500943-f9b4-4003-91e0-8d127cda69d2/console/0.log" Jun 11 20:03:34.105164 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:34.105128 2562 patch_prober.go:28] interesting pod/image-registry-7db79967bc-vgntv container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 20:03:34.105339 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:34.105189 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7db79967bc-vgntv" podUID="7ff2c3b7-0b29-4122-a9cc-5948769be69b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 20:03:34.119231 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:34.119204 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b767d89f-2dhmp_17f3f6d7-5b4a-4917-baa9-b168d6b51233/console/0.log" Jun 11 20:03:34.920267 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:34.920238 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dwkpn_40c0e2f2-95f6-4cb1-8cc3-86669ea992b0/dns/0.log" Jun 11 20:03:35.119767 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:35.119739 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dwkpn_40c0e2f2-95f6-4cb1-8cc3-86669ea992b0/kube-rbac-proxy/0.log" Jun 11 20:03:35.816267 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:35.816241 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 20:03:35.966253 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:35.966225 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:03:36.120066 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:36.120040 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lb5qs_ad153657-154e-4342-b701-95873f67a210/dns-node-resolver/0.log" Jun 11 20:03:36.145314 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:36.145288 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65fc9b89bd-j46lk" Jun 11 20:03:36.149255 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:36.149233 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65fc9b89bd-j46lk" Jun 11 20:03:36.211398 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:36.211347 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b767d89f-2dhmp"] Jun 11 20:03:36.520189 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:36.520110 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7db79967bc-vgntv_7ff2c3b7-0b29-4122-a9cc-5948769be69b/registry/0.log" Jun 11 20:03:36.719575 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:36.719539 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-648xp_1b6c5b1c-65de-4fe3-9ccd-9c2996176ccb/node-ca/0.log" Jun 11 20:03:37.160531 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:37.160496 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:03:37.268833 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:37.268801 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:03:37.320583 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:37.320559 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64f5b86456-67889_d4de4ed2-f4f2-4c34-b919-8c553e9df39f/router/0.log" Jun 11 20:03:37.338295 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:37.338270 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:03:37.919168 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:37.919136 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nclx5_d5823bf3-bd2b-498e-b24c-5787b60f595c/serve-healthcheck-canary/0.log" Jun 11 20:03:44.951499 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:44.951458 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:03:45.014853 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:45.014821 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:03:45.513203 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:45.513169 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7db79967bc-vgntv"] Jun 11 20:03:45.597192 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:45.597157 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:03:45.651254 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:45.651217 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:03:45.781041 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:45.780958 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:03:45.835023 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:45.834989 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:03:49.369180 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:49.369138 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:03:49.578583 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:49.578546 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:03:49.814019 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:49.813935 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:03:49.994601 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:49.994558 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:03:54.825879 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:54.825839 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6645964bf-gv2km"] Jun 11 20:03:54.826255 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:54.826204 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ffb068c-6d07-4f18-aa8c-e69057259a86" containerName="console" Jun 11 20:03:54.826255 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:54.826215 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ffb068c-6d07-4f18-aa8c-e69057259a86" containerName="console" Jun 11 20:03:54.826327 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:54.826266 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ffb068c-6d07-4f18-aa8c-e69057259a86" containerName="console" Jun 11 20:03:54.829642 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:54.829612 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6645964bf-gv2km" Jun 11 20:03:54.832814 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:54.832787 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 11 20:03:54.832814 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:54.832808 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 11 20:03:54.832992 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:54.832923 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-xxbft\"" Jun 11 20:03:54.833215 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:54.833007 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 11 20:03:54.833215 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:54.833044 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 11 20:03:54.833410 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:54.833391 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 11 20:03:54.838432 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:54.838408 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 11 20:03:54.841296 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:54.841274 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6645964bf-gv2km"] Jun 11 20:03:54.926441 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:54.926408 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqrdd\" (UniqueName: \"kubernetes.io/projected/481581bc-1416-4b75-8c37-71645a6a57cf-kube-api-access-hqrdd\") pod \"telemeter-client-6645964bf-gv2km\" (UID: \"481581bc-1416-4b75-8c37-71645a6a57cf\") " pod="openshift-monitoring/telemeter-client-6645964bf-gv2km" Jun 11 20:03:54.926592 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:54.926449 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/481581bc-1416-4b75-8c37-71645a6a57cf-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6645964bf-gv2km\" (UID: \"481581bc-1416-4b75-8c37-71645a6a57cf\") " pod="openshift-monitoring/telemeter-client-6645964bf-gv2km" Jun 11 20:03:54.926592 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:54.926470 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/481581bc-1416-4b75-8c37-71645a6a57cf-metrics-client-ca\") pod \"telemeter-client-6645964bf-gv2km\" (UID: \"481581bc-1416-4b75-8c37-71645a6a57cf\") " pod="openshift-monitoring/telemeter-client-6645964bf-gv2km" Jun 11 20:03:54.926592 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:54.926503 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/481581bc-1416-4b75-8c37-71645a6a57cf-secret-telemeter-client\") pod \"telemeter-client-6645964bf-gv2km\" (UID: \"481581bc-1416-4b75-8c37-71645a6a57cf\") " pod="openshift-monitoring/telemeter-client-6645964bf-gv2km" Jun 11 20:03:54.926592 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:54.926526 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/481581bc-1416-4b75-8c37-71645a6a57cf-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6645964bf-gv2km\" (UID: \"481581bc-1416-4b75-8c37-71645a6a57cf\") " pod="openshift-monitoring/telemeter-client-6645964bf-gv2km" Jun 11 20:03:54.926592 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:54.926545 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/481581bc-1416-4b75-8c37-71645a6a57cf-federate-client-tls\") pod \"telemeter-client-6645964bf-gv2km\" (UID: \"481581bc-1416-4b75-8c37-71645a6a57cf\") " pod="openshift-monitoring/telemeter-client-6645964bf-gv2km" Jun 11 20:03:54.926762 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:54.926622 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/481581bc-1416-4b75-8c37-71645a6a57cf-serving-certs-ca-bundle\") pod \"telemeter-client-6645964bf-gv2km\" (UID: \"481581bc-1416-4b75-8c37-71645a6a57cf\") " pod="openshift-monitoring/telemeter-client-6645964bf-gv2km" Jun 11 20:03:54.926762 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:54.926710 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/481581bc-1416-4b75-8c37-71645a6a57cf-telemeter-client-tls\") pod \"telemeter-client-6645964bf-gv2km\" (UID: \"481581bc-1416-4b75-8c37-71645a6a57cf\") " pod="openshift-monitoring/telemeter-client-6645964bf-gv2km" Jun 11 20:03:55.027332 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:55.027294 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/481581bc-1416-4b75-8c37-71645a6a57cf-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6645964bf-gv2km\" (UID: \"481581bc-1416-4b75-8c37-71645a6a57cf\") " pod="openshift-monitoring/telemeter-client-6645964bf-gv2km" Jun 11 20:03:55.027332 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:55.027336 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/481581bc-1416-4b75-8c37-71645a6a57cf-metrics-client-ca\") pod \"telemeter-client-6645964bf-gv2km\" (UID: \"481581bc-1416-4b75-8c37-71645a6a57cf\") " pod="openshift-monitoring/telemeter-client-6645964bf-gv2km" Jun 11 20:03:55.027659 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:55.027363 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/481581bc-1416-4b75-8c37-71645a6a57cf-secret-telemeter-client\") pod \"telemeter-client-6645964bf-gv2km\" (UID: \"481581bc-1416-4b75-8c37-71645a6a57cf\") " pod="openshift-monitoring/telemeter-client-6645964bf-gv2km" Jun 11 20:03:55.027659 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:55.027417 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/481581bc-1416-4b75-8c37-71645a6a57cf-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6645964bf-gv2km\" (UID: \"481581bc-1416-4b75-8c37-71645a6a57cf\") " pod="openshift-monitoring/telemeter-client-6645964bf-gv2km" Jun 11 20:03:55.027659 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:55.027439 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/481581bc-1416-4b75-8c37-71645a6a57cf-federate-client-tls\") pod \"telemeter-client-6645964bf-gv2km\" (UID: \"481581bc-1416-4b75-8c37-71645a6a57cf\") " pod="openshift-monitoring/telemeter-client-6645964bf-gv2km" Jun 11 20:03:55.027659 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:55.027479 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/481581bc-1416-4b75-8c37-71645a6a57cf-serving-certs-ca-bundle\") pod \"telemeter-client-6645964bf-gv2km\" (UID: \"481581bc-1416-4b75-8c37-71645a6a57cf\") " pod="openshift-monitoring/telemeter-client-6645964bf-gv2km" Jun 11 20:03:55.027659 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:55.027618 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/481581bc-1416-4b75-8c37-71645a6a57cf-telemeter-client-tls\") pod \"telemeter-client-6645964bf-gv2km\" (UID: \"481581bc-1416-4b75-8c37-71645a6a57cf\") " pod="openshift-monitoring/telemeter-client-6645964bf-gv2km" Jun 11 20:03:55.027961 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:55.027710 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqrdd\" (UniqueName: \"kubernetes.io/projected/481581bc-1416-4b75-8c37-71645a6a57cf-kube-api-access-hqrdd\") pod \"telemeter-client-6645964bf-gv2km\" (UID: \"481581bc-1416-4b75-8c37-71645a6a57cf\") " pod="openshift-monitoring/telemeter-client-6645964bf-gv2km" Jun 11 20:03:55.028309 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:55.028239 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/481581bc-1416-4b75-8c37-71645a6a57cf-serving-certs-ca-bundle\") pod \"telemeter-client-6645964bf-gv2km\" (UID: \"481581bc-1416-4b75-8c37-71645a6a57cf\") " pod="openshift-monitoring/telemeter-client-6645964bf-gv2km" Jun 11 20:03:55.028485 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:55.028359 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/481581bc-1416-4b75-8c37-71645a6a57cf-metrics-client-ca\") pod \"telemeter-client-6645964bf-gv2km\" (UID: \"481581bc-1416-4b75-8c37-71645a6a57cf\") " pod="openshift-monitoring/telemeter-client-6645964bf-gv2km" Jun 11 20:03:55.028871 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:55.028846 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/481581bc-1416-4b75-8c37-71645a6a57cf-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6645964bf-gv2km\" (UID: \"481581bc-1416-4b75-8c37-71645a6a57cf\") " pod="openshift-monitoring/telemeter-client-6645964bf-gv2km" Jun 11 20:03:55.030318 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:55.030291 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/481581bc-1416-4b75-8c37-71645a6a57cf-federate-client-tls\") pod \"telemeter-client-6645964bf-gv2km\" (UID: \"481581bc-1416-4b75-8c37-71645a6a57cf\") " pod="openshift-monitoring/telemeter-client-6645964bf-gv2km" Jun 11 20:03:55.030423 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:55.030319 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/481581bc-1416-4b75-8c37-71645a6a57cf-secret-telemeter-client\") pod \"telemeter-client-6645964bf-gv2km\" (UID: \"481581bc-1416-4b75-8c37-71645a6a57cf\") " pod="openshift-monitoring/telemeter-client-6645964bf-gv2km" Jun 11 20:03:55.030471 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:55.030434 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/481581bc-1416-4b75-8c37-71645a6a57cf-telemeter-client-tls\") pod \"telemeter-client-6645964bf-gv2km\" (UID: \"481581bc-1416-4b75-8c37-71645a6a57cf\") " pod="openshift-monitoring/telemeter-client-6645964bf-gv2km" Jun 11 20:03:55.030506 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:55.030491 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/481581bc-1416-4b75-8c37-71645a6a57cf-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6645964bf-gv2km\" (UID: \"481581bc-1416-4b75-8c37-71645a6a57cf\") " pod="openshift-monitoring/telemeter-client-6645964bf-gv2km" Jun 11 20:03:55.036778 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:55.036759 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqrdd\" (UniqueName: \"kubernetes.io/projected/481581bc-1416-4b75-8c37-71645a6a57cf-kube-api-access-hqrdd\") pod \"telemeter-client-6645964bf-gv2km\" (UID: \"481581bc-1416-4b75-8c37-71645a6a57cf\") " pod="openshift-monitoring/telemeter-client-6645964bf-gv2km" Jun 11 20:03:55.141707 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:55.141679 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6645964bf-gv2km" Jun 11 20:03:55.302009 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:55.301985 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6645964bf-gv2km"] Jun 11 20:03:55.303493 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:03:55.303471 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod481581bc_1416_4b75_8c37_71645a6a57cf.slice/crio-457b7d171a3a5fbf23642adae4bcfeb255c772f62b57716c039f15d4b889f917 WatchSource:0}: Error finding container 457b7d171a3a5fbf23642adae4bcfeb255c772f62b57716c039f15d4b889f917: Status 404 returned error can't find the container with id 457b7d171a3a5fbf23642adae4bcfeb255c772f62b57716c039f15d4b889f917 Jun 11 20:03:55.305460 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:55.305444 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 20:03:55.979967 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:55.979931 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6645964bf-gv2km" event={"ID":"481581bc-1416-4b75-8c37-71645a6a57cf","Type":"ContainerStarted","Data":"457b7d171a3a5fbf23642adae4bcfeb255c772f62b57716c039f15d4b889f917"} Jun 11 20:03:58.832613 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:58.832580 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:03:58.892149 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:58.892115 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:03:58.994213 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:58.994178 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6645964bf-gv2km" event={"ID":"481581bc-1416-4b75-8c37-71645a6a57cf","Type":"ContainerStarted","Data":"009e616fc8ccd66f3d25e2e8207a56bc2e2dff0a975a10612028be796327079e"} Jun 11 20:03:58.994402 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:58.994258 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6645964bf-gv2km" event={"ID":"481581bc-1416-4b75-8c37-71645a6a57cf","Type":"ContainerStarted","Data":"32f2d1f5e92e5351eb6f7b63b47178f330b9ed067bc29fc95476ab6dce4004d7"} Jun 11 20:03:58.994402 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:58.994279 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6645964bf-gv2km" event={"ID":"481581bc-1416-4b75-8c37-71645a6a57cf","Type":"ContainerStarted","Data":"bd83c30f69e787aa72484f02e884272e84bf3858373f708be880fdf87d479b55"} Jun 11 20:03:59.018223 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:59.018175 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6645964bf-gv2km" podStartSLOduration=2.307164372 podStartE2EDuration="5.018161468s" totalImagesPullingTime="2.710997096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:03:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:03:59.016266286 +0000 UTC m=+330.747428261" watchObservedRunningTime="2026-06-11 20:03:59.018161468 +0000 UTC m=+330.749323472" Jun 11 20:03:59.957160 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:59.957096 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79ccc69d66-mj4tc"] Jun 11 20:03:59.959690 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:59.959663 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79ccc69d66-mj4tc" Jun 11 20:03:59.971262 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:03:59.971236 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79ccc69d66-mj4tc"] Jun 11 20:04:00.076569 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:00.076533 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-console-serving-cert\") pod \"console-79ccc69d66-mj4tc\" (UID: \"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f\") " pod="openshift-console/console-79ccc69d66-mj4tc" Jun 11 20:04:00.076775 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:00.076589 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-console-config\") pod \"console-79ccc69d66-mj4tc\" (UID: \"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f\") " pod="openshift-console/console-79ccc69d66-mj4tc" Jun 11 20:04:00.076849 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:00.076784 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqltq\" (UniqueName: \"kubernetes.io/projected/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-kube-api-access-wqltq\") pod \"console-79ccc69d66-mj4tc\" (UID: \"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f\") " pod="openshift-console/console-79ccc69d66-mj4tc" Jun 11 20:04:00.076849 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:00.076831 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-oauth-serving-cert\") pod \"console-79ccc69d66-mj4tc\" (UID: \"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f\") " pod="openshift-console/console-79ccc69d66-mj4tc" Jun 11 20:04:00.076969 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:00.076880 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-trusted-ca-bundle\") pod \"console-79ccc69d66-mj4tc\" (UID: \"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f\") " pod="openshift-console/console-79ccc69d66-mj4tc" Jun 11 20:04:00.076969 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:00.076914 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-console-oauth-config\") pod \"console-79ccc69d66-mj4tc\" (UID: \"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f\") " pod="openshift-console/console-79ccc69d66-mj4tc" Jun 11 20:04:00.076969 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:00.076945 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-service-ca\") pod \"console-79ccc69d66-mj4tc\" (UID: \"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f\") " pod="openshift-console/console-79ccc69d66-mj4tc" Jun 11 20:04:00.096147 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:00.096121 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:04:00.178503 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:00.178464 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-console-oauth-config\") pod \"console-79ccc69d66-mj4tc\" (UID: \"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f\") " pod="openshift-console/console-79ccc69d66-mj4tc" Jun 11 20:04:00.178503 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:00.178503 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-service-ca\") pod \"console-79ccc69d66-mj4tc\" (UID: \"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f\") " pod="openshift-console/console-79ccc69d66-mj4tc" Jun 11 20:04:00.178753 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:00.178551 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-console-serving-cert\") pod \"console-79ccc69d66-mj4tc\" (UID: \"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f\") " pod="openshift-console/console-79ccc69d66-mj4tc" Jun 11 20:04:00.178753 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:00.178572 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-console-config\") pod \"console-79ccc69d66-mj4tc\" (UID: \"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f\") " pod="openshift-console/console-79ccc69d66-mj4tc" Jun 11 20:04:00.178753 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:00.178616 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqltq\" (UniqueName: \"kubernetes.io/projected/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-kube-api-access-wqltq\") pod \"console-79ccc69d66-mj4tc\" (UID: \"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f\") " pod="openshift-console/console-79ccc69d66-mj4tc" Jun 11 20:04:00.178753 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:00.178636 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-oauth-serving-cert\") pod \"console-79ccc69d66-mj4tc\" (UID: \"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f\") " pod="openshift-console/console-79ccc69d66-mj4tc" Jun 11 20:04:00.178753 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:00.178676 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-trusted-ca-bundle\") pod \"console-79ccc69d66-mj4tc\" (UID: \"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f\") " pod="openshift-console/console-79ccc69d66-mj4tc" Jun 11 20:04:00.179429 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:00.179404 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-service-ca\") pod \"console-79ccc69d66-mj4tc\" (UID: \"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f\") " pod="openshift-console/console-79ccc69d66-mj4tc" Jun 11 20:04:00.179621 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:00.179597 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-oauth-serving-cert\") pod \"console-79ccc69d66-mj4tc\" (UID: \"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f\") " pod="openshift-console/console-79ccc69d66-mj4tc" Jun 11 20:04:00.179665 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:00.179639 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-trusted-ca-bundle\") pod \"console-79ccc69d66-mj4tc\" (UID: \"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f\") " pod="openshift-console/console-79ccc69d66-mj4tc" Jun 11 20:04:00.179704 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:00.179688 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-console-config\") pod \"console-79ccc69d66-mj4tc\" (UID: \"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f\") " pod="openshift-console/console-79ccc69d66-mj4tc" Jun 11 20:04:00.181107 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:00.181085 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-console-oauth-config\") pod \"console-79ccc69d66-mj4tc\" (UID: \"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f\") " pod="openshift-console/console-79ccc69d66-mj4tc" Jun 11 20:04:00.181259 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:00.181239 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-console-serving-cert\") pod \"console-79ccc69d66-mj4tc\" (UID: \"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f\") " pod="openshift-console/console-79ccc69d66-mj4tc" Jun 11 20:04:00.187436 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:00.187416 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqltq\" (UniqueName: \"kubernetes.io/projected/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-kube-api-access-wqltq\") pod \"console-79ccc69d66-mj4tc\" (UID: \"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f\") " pod="openshift-console/console-79ccc69d66-mj4tc" Jun 11 20:04:00.198356 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:00.198329 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:04:00.271593 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:00.271501 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79ccc69d66-mj4tc" Jun 11 20:04:00.296100 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:00.296068 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:04:00.410791 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:00.410766 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79ccc69d66-mj4tc"] Jun 11 20:04:00.413151 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:04:00.413119 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32090f2d_3903_45d3_86e6_9a5cd2ac3b4f.slice/crio-1bbfd3b717c76f0b8509aebf5a9652f40d7874b8880d71851f1e7a58bec7c332 WatchSource:0}: Error finding container 1bbfd3b717c76f0b8509aebf5a9652f40d7874b8880d71851f1e7a58bec7c332: Status 404 returned error can't find the container with id 1bbfd3b717c76f0b8509aebf5a9652f40d7874b8880d71851f1e7a58bec7c332 Jun 11 20:04:00.755878 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:00.755845 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:04:01.004043 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:01.004007 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79ccc69d66-mj4tc" event={"ID":"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f","Type":"ContainerStarted","Data":"e7a5d253c9d4bd8b2e630e06f2bc41a170221be3371786083b5f1f6506e1154a"} Jun 11 20:04:01.004556 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:01.004064 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79ccc69d66-mj4tc" event={"ID":"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f","Type":"ContainerStarted","Data":"1bbfd3b717c76f0b8509aebf5a9652f40d7874b8880d71851f1e7a58bec7c332"} Jun 11 20:04:01.022215 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:01.022131 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79ccc69d66-mj4tc" podStartSLOduration=2.022116906 podStartE2EDuration="2.022116906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:03:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:04:01.021587493 +0000 UTC m=+332.752749471" watchObservedRunningTime="2026-06-11 20:04:01.022116906 +0000 UTC m=+332.753278881" Jun 11 20:04:01.240629 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:01.240588 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-b767d89f-2dhmp" podUID="17f3f6d7-5b4a-4917-baa9-b168d6b51233" containerName="console" containerID="cri-o://dc7574877e481fd260f0a5f2c2e37906492570c5e306388eeaec499188837cca" gracePeriod=15 Jun 11 20:04:01.484615 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:01.484587 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b767d89f-2dhmp" Jun 11 20:04:01.590745 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:01.590705 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17f3f6d7-5b4a-4917-baa9-b168d6b51233-oauth-serving-cert\") pod \"17f3f6d7-5b4a-4917-baa9-b168d6b51233\" (UID: \"17f3f6d7-5b4a-4917-baa9-b168d6b51233\") " Jun 11 20:04:01.590745 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:01.590747 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17f3f6d7-5b4a-4917-baa9-b168d6b51233-trusted-ca-bundle\") pod \"17f3f6d7-5b4a-4917-baa9-b168d6b51233\" (UID: \"17f3f6d7-5b4a-4917-baa9-b168d6b51233\") " Jun 11 20:04:01.590978 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:01.590809 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17f3f6d7-5b4a-4917-baa9-b168d6b51233-console-serving-cert\") pod \"17f3f6d7-5b4a-4917-baa9-b168d6b51233\" (UID: \"17f3f6d7-5b4a-4917-baa9-b168d6b51233\") " Jun 11 20:04:01.590978 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:01.590831 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17f3f6d7-5b4a-4917-baa9-b168d6b51233-console-config\") pod \"17f3f6d7-5b4a-4917-baa9-b168d6b51233\" (UID: \"17f3f6d7-5b4a-4917-baa9-b168d6b51233\") " Jun 11 20:04:01.590978 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:01.590859 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17f3f6d7-5b4a-4917-baa9-b168d6b51233-service-ca\") pod \"17f3f6d7-5b4a-4917-baa9-b168d6b51233\" (UID: \"17f3f6d7-5b4a-4917-baa9-b168d6b51233\") " Jun 11 20:04:01.590978 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:01.590889 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17f3f6d7-5b4a-4917-baa9-b168d6b51233-console-oauth-config\") pod \"17f3f6d7-5b4a-4917-baa9-b168d6b51233\" (UID: \"17f3f6d7-5b4a-4917-baa9-b168d6b51233\") " Jun 11 20:04:01.590978 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:01.590917 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wv6mb\" (UniqueName: \"kubernetes.io/projected/17f3f6d7-5b4a-4917-baa9-b168d6b51233-kube-api-access-wv6mb\") pod \"17f3f6d7-5b4a-4917-baa9-b168d6b51233\" (UID: \"17f3f6d7-5b4a-4917-baa9-b168d6b51233\") " Jun 11 20:04:01.591237 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:01.591209 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17f3f6d7-5b4a-4917-baa9-b168d6b51233-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "17f3f6d7-5b4a-4917-baa9-b168d6b51233" (UID: "17f3f6d7-5b4a-4917-baa9-b168d6b51233"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 20:04:01.591351 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:01.591327 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17f3f6d7-5b4a-4917-baa9-b168d6b51233-console-config" (OuterVolumeSpecName: "console-config") pod "17f3f6d7-5b4a-4917-baa9-b168d6b51233" (UID: "17f3f6d7-5b4a-4917-baa9-b168d6b51233"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 20:04:01.591438 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:01.591333 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17f3f6d7-5b4a-4917-baa9-b168d6b51233-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "17f3f6d7-5b4a-4917-baa9-b168d6b51233" (UID: "17f3f6d7-5b4a-4917-baa9-b168d6b51233"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 20:04:01.591438 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:01.591366 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17f3f6d7-5b4a-4917-baa9-b168d6b51233-service-ca" (OuterVolumeSpecName: "service-ca") pod "17f3f6d7-5b4a-4917-baa9-b168d6b51233" (UID: "17f3f6d7-5b4a-4917-baa9-b168d6b51233"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 20:04:01.593241 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:01.593211 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17f3f6d7-5b4a-4917-baa9-b168d6b51233-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "17f3f6d7-5b4a-4917-baa9-b168d6b51233" (UID: "17f3f6d7-5b4a-4917-baa9-b168d6b51233"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 20:04:01.593241 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:01.593225 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17f3f6d7-5b4a-4917-baa9-b168d6b51233-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "17f3f6d7-5b4a-4917-baa9-b168d6b51233" (UID: "17f3f6d7-5b4a-4917-baa9-b168d6b51233"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 20:04:01.593241 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:01.593214 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17f3f6d7-5b4a-4917-baa9-b168d6b51233-kube-api-access-wv6mb" (OuterVolumeSpecName: "kube-api-access-wv6mb") pod "17f3f6d7-5b4a-4917-baa9-b168d6b51233" (UID: "17f3f6d7-5b4a-4917-baa9-b168d6b51233"). InnerVolumeSpecName "kube-api-access-wv6mb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:04:01.692659 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:01.692563 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17f3f6d7-5b4a-4917-baa9-b168d6b51233-console-serving-cert\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:04:01.692659 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:01.692606 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17f3f6d7-5b4a-4917-baa9-b168d6b51233-console-config\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:04:01.692659 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:01.692615 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17f3f6d7-5b4a-4917-baa9-b168d6b51233-service-ca\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:04:01.692659 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:01.692623 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17f3f6d7-5b4a-4917-baa9-b168d6b51233-console-oauth-config\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:04:01.692659 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:01.692633 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wv6mb\" (UniqueName: \"kubernetes.io/projected/17f3f6d7-5b4a-4917-baa9-b168d6b51233-kube-api-access-wv6mb\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:04:01.692659 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:01.692642 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17f3f6d7-5b4a-4917-baa9-b168d6b51233-oauth-serving-cert\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:04:01.692659 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:01.692651 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17f3f6d7-5b4a-4917-baa9-b168d6b51233-trusted-ca-bundle\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:04:02.009443 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:02.009329 2562 generic.go:356] "Generic (PLEG): container finished" podID="17f3f6d7-5b4a-4917-baa9-b168d6b51233" containerID="dc7574877e481fd260f0a5f2c2e37906492570c5e306388eeaec499188837cca" exitCode=0 Jun 11 20:04:02.009443 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:02.009398 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b767d89f-2dhmp" Jun 11 20:04:02.009443 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:02.009421 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b767d89f-2dhmp" event={"ID":"17f3f6d7-5b4a-4917-baa9-b168d6b51233","Type":"ContainerDied","Data":"dc7574877e481fd260f0a5f2c2e37906492570c5e306388eeaec499188837cca"} Jun 11 20:04:02.009993 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:02.009473 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b767d89f-2dhmp" event={"ID":"17f3f6d7-5b4a-4917-baa9-b168d6b51233","Type":"ContainerDied","Data":"dd0da5dfffdbaa5f738fa42f1bd049a82b98fae6178e320c90c5a22bd9f51619"} Jun 11 20:04:02.009993 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:02.009495 2562 scope.go:117] "RemoveContainer" containerID="dc7574877e481fd260f0a5f2c2e37906492570c5e306388eeaec499188837cca" Jun 11 20:04:02.017954 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:02.017934 2562 scope.go:117] "RemoveContainer" containerID="dc7574877e481fd260f0a5f2c2e37906492570c5e306388eeaec499188837cca" Jun 11 20:04:02.018188 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:04:02.018169 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc7574877e481fd260f0a5f2c2e37906492570c5e306388eeaec499188837cca\": container with ID starting with dc7574877e481fd260f0a5f2c2e37906492570c5e306388eeaec499188837cca not found: ID does not exist" containerID="dc7574877e481fd260f0a5f2c2e37906492570c5e306388eeaec499188837cca" Jun 11 20:04:02.018235 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:02.018196 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc7574877e481fd260f0a5f2c2e37906492570c5e306388eeaec499188837cca"} err="failed to get container status \"dc7574877e481fd260f0a5f2c2e37906492570c5e306388eeaec499188837cca\": rpc error: code = NotFound desc = could not find container \"dc7574877e481fd260f0a5f2c2e37906492570c5e306388eeaec499188837cca\": container with ID starting with dc7574877e481fd260f0a5f2c2e37906492570c5e306388eeaec499188837cca not found: ID does not exist" Jun 11 20:04:02.030315 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:02.030287 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b767d89f-2dhmp"] Jun 11 20:04:02.034034 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:02.034012 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b767d89f-2dhmp"] Jun 11 20:04:02.473429 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:02.473397 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:04:02.530521 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:02.530488 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:04:02.734512 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:02.734434 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17f3f6d7-5b4a-4917-baa9-b168d6b51233" path="/var/lib/kubelet/pods/17f3f6d7-5b4a-4917-baa9-b168d6b51233/volumes" Jun 11 20:04:04.851229 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:04.851186 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:04:04.906494 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:04.906459 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:04:06.428741 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:06.428708 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79ccc69d66-mj4tc"] Jun 11 20:04:06.464736 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:06.464705 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66bf9749cd-dnhnv"] Jun 11 20:04:06.465049 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:06.465036 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17f3f6d7-5b4a-4917-baa9-b168d6b51233" containerName="console" Jun 11 20:04:06.465105 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:06.465051 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="17f3f6d7-5b4a-4917-baa9-b168d6b51233" containerName="console" Jun 11 20:04:06.465141 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:06.465117 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="17f3f6d7-5b4a-4917-baa9-b168d6b51233" containerName="console" Jun 11 20:04:06.468120 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:06.468103 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66bf9749cd-dnhnv" Jun 11 20:04:06.480404 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:06.480347 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66bf9749cd-dnhnv"] Jun 11 20:04:06.637834 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:06.637796 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-service-ca\") pod \"console-66bf9749cd-dnhnv\" (UID: \"9208e0d9-b19e-4af8-a3c5-975c6d6f3286\") " pod="openshift-console/console-66bf9749cd-dnhnv" Jun 11 20:04:06.638110 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:06.637846 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-trusted-ca-bundle\") pod \"console-66bf9749cd-dnhnv\" (UID: \"9208e0d9-b19e-4af8-a3c5-975c6d6f3286\") " pod="openshift-console/console-66bf9749cd-dnhnv" Jun 11 20:04:06.638110 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:06.637935 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-oauth-serving-cert\") pod \"console-66bf9749cd-dnhnv\" (UID: \"9208e0d9-b19e-4af8-a3c5-975c6d6f3286\") " pod="openshift-console/console-66bf9749cd-dnhnv" Jun 11 20:04:06.638110 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:06.637984 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-console-config\") pod \"console-66bf9749cd-dnhnv\" (UID: \"9208e0d9-b19e-4af8-a3c5-975c6d6f3286\") " pod="openshift-console/console-66bf9749cd-dnhnv" Jun 11 20:04:06.638110 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:06.638033 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-console-oauth-config\") pod \"console-66bf9749cd-dnhnv\" (UID: \"9208e0d9-b19e-4af8-a3c5-975c6d6f3286\") " pod="openshift-console/console-66bf9749cd-dnhnv" Jun 11 20:04:06.638110 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:06.638051 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qx7b\" (UniqueName: \"kubernetes.io/projected/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-kube-api-access-6qx7b\") pod \"console-66bf9749cd-dnhnv\" (UID: \"9208e0d9-b19e-4af8-a3c5-975c6d6f3286\") " pod="openshift-console/console-66bf9749cd-dnhnv" Jun 11 20:04:06.638110 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:06.638070 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-console-serving-cert\") pod \"console-66bf9749cd-dnhnv\" (UID: \"9208e0d9-b19e-4af8-a3c5-975c6d6f3286\") " pod="openshift-console/console-66bf9749cd-dnhnv" Jun 11 20:04:06.739292 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:06.739206 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-service-ca\") pod \"console-66bf9749cd-dnhnv\" (UID: \"9208e0d9-b19e-4af8-a3c5-975c6d6f3286\") " pod="openshift-console/console-66bf9749cd-dnhnv" Jun 11 20:04:06.739292 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:06.739246 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-trusted-ca-bundle\") pod \"console-66bf9749cd-dnhnv\" (UID: \"9208e0d9-b19e-4af8-a3c5-975c6d6f3286\") " pod="openshift-console/console-66bf9749cd-dnhnv" Jun 11 20:04:06.739292 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:06.739279 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-oauth-serving-cert\") pod \"console-66bf9749cd-dnhnv\" (UID: \"9208e0d9-b19e-4af8-a3c5-975c6d6f3286\") " pod="openshift-console/console-66bf9749cd-dnhnv" Jun 11 20:04:06.739611 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:06.739310 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-console-config\") pod \"console-66bf9749cd-dnhnv\" (UID: \"9208e0d9-b19e-4af8-a3c5-975c6d6f3286\") " pod="openshift-console/console-66bf9749cd-dnhnv" Jun 11 20:04:06.739611 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:06.739336 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-console-oauth-config\") pod \"console-66bf9749cd-dnhnv\" (UID: \"9208e0d9-b19e-4af8-a3c5-975c6d6f3286\") " pod="openshift-console/console-66bf9749cd-dnhnv" Jun 11 20:04:06.739611 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:06.739352 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qx7b\" (UniqueName: \"kubernetes.io/projected/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-kube-api-access-6qx7b\") pod \"console-66bf9749cd-dnhnv\" (UID: \"9208e0d9-b19e-4af8-a3c5-975c6d6f3286\") " pod="openshift-console/console-66bf9749cd-dnhnv" Jun 11 20:04:06.739611 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:06.739369 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-console-serving-cert\") pod \"console-66bf9749cd-dnhnv\" (UID: \"9208e0d9-b19e-4af8-a3c5-975c6d6f3286\") " pod="openshift-console/console-66bf9749cd-dnhnv" Jun 11 20:04:06.740119 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:06.740040 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-service-ca\") pod \"console-66bf9749cd-dnhnv\" (UID: \"9208e0d9-b19e-4af8-a3c5-975c6d6f3286\") " pod="openshift-console/console-66bf9749cd-dnhnv" Jun 11 20:04:06.740334 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:06.740268 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-console-config\") pod \"console-66bf9749cd-dnhnv\" (UID: \"9208e0d9-b19e-4af8-a3c5-975c6d6f3286\") " pod="openshift-console/console-66bf9749cd-dnhnv" Jun 11 20:04:06.740334 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:06.740268 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-oauth-serving-cert\") pod \"console-66bf9749cd-dnhnv\" (UID: \"9208e0d9-b19e-4af8-a3c5-975c6d6f3286\") " pod="openshift-console/console-66bf9749cd-dnhnv" Jun 11 20:04:06.740485 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:06.740432 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-trusted-ca-bundle\") pod \"console-66bf9749cd-dnhnv\" (UID: \"9208e0d9-b19e-4af8-a3c5-975c6d6f3286\") " pod="openshift-console/console-66bf9749cd-dnhnv" Jun 11 20:04:06.741843 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:06.741817 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-console-oauth-config\") pod \"console-66bf9749cd-dnhnv\" (UID: \"9208e0d9-b19e-4af8-a3c5-975c6d6f3286\") " pod="openshift-console/console-66bf9749cd-dnhnv" Jun 11 20:04:06.741969 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:06.741950 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-console-serving-cert\") pod \"console-66bf9749cd-dnhnv\" (UID: \"9208e0d9-b19e-4af8-a3c5-975c6d6f3286\") " pod="openshift-console/console-66bf9749cd-dnhnv" Jun 11 20:04:06.748404 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:06.748347 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qx7b\" (UniqueName: \"kubernetes.io/projected/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-kube-api-access-6qx7b\") pod \"console-66bf9749cd-dnhnv\" (UID: \"9208e0d9-b19e-4af8-a3c5-975c6d6f3286\") " pod="openshift-console/console-66bf9749cd-dnhnv" Jun 11 20:04:06.777319 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:06.777281 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66bf9749cd-dnhnv" Jun 11 20:04:06.913583 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:06.913449 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66bf9749cd-dnhnv"] Jun 11 20:04:06.916692 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:04:06.916666 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9208e0d9_b19e_4af8_a3c5_975c6d6f3286.slice/crio-46ae883a42b9a4c40ffccc31813211b77e7f470fbe499b9ba328dd4173ff9b51 WatchSource:0}: Error finding container 46ae883a42b9a4c40ffccc31813211b77e7f470fbe499b9ba328dd4173ff9b51: Status 404 returned error can't find the container with id 46ae883a42b9a4c40ffccc31813211b77e7f470fbe499b9ba328dd4173ff9b51 Jun 11 20:04:07.040094 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:07.040004 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66bf9749cd-dnhnv" event={"ID":"9208e0d9-b19e-4af8-a3c5-975c6d6f3286","Type":"ContainerStarted","Data":"0bbd7cef919f609c5cdb809478e5f8cbceeee0d32efd7556beddc7f57240c109"} Jun 11 20:04:07.040094 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:07.040062 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66bf9749cd-dnhnv" event={"ID":"9208e0d9-b19e-4af8-a3c5-975c6d6f3286","Type":"ContainerStarted","Data":"46ae883a42b9a4c40ffccc31813211b77e7f470fbe499b9ba328dd4173ff9b51"} Jun 11 20:04:07.063216 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:07.063016 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66bf9749cd-dnhnv" podStartSLOduration=1.062994219 podStartE2EDuration="1.062994219s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:04:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:04:07.061553052 +0000 UTC m=+338.792715069" watchObservedRunningTime="2026-06-11 20:04:07.062994219 +0000 UTC m=+338.794156197" Jun 11 20:04:10.271915 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:10.271860 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79ccc69d66-mj4tc" Jun 11 20:04:10.541335 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:10.541243 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7db79967bc-vgntv" podUID="7ff2c3b7-0b29-4122-a9cc-5948769be69b" containerName="registry" containerID="cri-o://345653bde6ef552fb2997d1be9a0213556972c7140cd941ea1da5c320dcedd1d" gracePeriod=30 Jun 11 20:04:11.794240 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:11.794210 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 20:04:11.886503 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:11.886395 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-tls\") pod \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " Jun 11 20:04:11.886503 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:11.886486 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ff2c3b7-0b29-4122-a9cc-5948769be69b-image-registry-private-configuration\") pod \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " Jun 11 20:04:11.886766 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:11.886520 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ff2c3b7-0b29-4122-a9cc-5948769be69b-trusted-ca\") pod \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " Jun 11 20:04:11.886766 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:11.886550 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ff2c3b7-0b29-4122-a9cc-5948769be69b-installation-pull-secrets\") pod \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " Jun 11 20:04:11.886766 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:11.886607 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhshr\" (UniqueName: \"kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-kube-api-access-qhshr\") pod \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " Jun 11 20:04:11.886766 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:11.886646 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ff2c3b7-0b29-4122-a9cc-5948769be69b-ca-trust-extracted\") pod \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " Jun 11 20:04:11.886766 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:11.886706 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-certificates\") pod \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " Jun 11 20:04:11.886766 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:11.886738 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-bound-sa-token\") pod \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\" (UID: \"7ff2c3b7-0b29-4122-a9cc-5948769be69b\") " Jun 11 20:04:11.887190 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:11.887119 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7ff2c3b7-0b29-4122-a9cc-5948769be69b" (UID: "7ff2c3b7-0b29-4122-a9cc-5948769be69b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 20:04:11.887606 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:11.887566 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ff2c3b7-0b29-4122-a9cc-5948769be69b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7ff2c3b7-0b29-4122-a9cc-5948769be69b" (UID: "7ff2c3b7-0b29-4122-a9cc-5948769be69b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 20:04:11.889175 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:11.889147 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7ff2c3b7-0b29-4122-a9cc-5948769be69b" (UID: "7ff2c3b7-0b29-4122-a9cc-5948769be69b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:04:11.889325 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:11.889274 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ff2c3b7-0b29-4122-a9cc-5948769be69b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7ff2c3b7-0b29-4122-a9cc-5948769be69b" (UID: "7ff2c3b7-0b29-4122-a9cc-5948769be69b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 20:04:11.889461 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:11.889442 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ff2c3b7-0b29-4122-a9cc-5948769be69b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7ff2c3b7-0b29-4122-a9cc-5948769be69b" (UID: "7ff2c3b7-0b29-4122-a9cc-5948769be69b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 20:04:11.889528 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:11.889487 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7ff2c3b7-0b29-4122-a9cc-5948769be69b" (UID: "7ff2c3b7-0b29-4122-a9cc-5948769be69b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:04:11.889575 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:11.889550 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-kube-api-access-qhshr" (OuterVolumeSpecName: "kube-api-access-qhshr") pod "7ff2c3b7-0b29-4122-a9cc-5948769be69b" (UID: "7ff2c3b7-0b29-4122-a9cc-5948769be69b"). InnerVolumeSpecName "kube-api-access-qhshr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:04:11.894955 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:11.894917 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ff2c3b7-0b29-4122-a9cc-5948769be69b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7ff2c3b7-0b29-4122-a9cc-5948769be69b" (UID: "7ff2c3b7-0b29-4122-a9cc-5948769be69b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:04:11.988421 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:11.988354 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-tls\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:04:11.988421 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:11.988411 2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ff2c3b7-0b29-4122-a9cc-5948769be69b-image-registry-private-configuration\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:04:11.988421 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:11.988423 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ff2c3b7-0b29-4122-a9cc-5948769be69b-trusted-ca\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:04:11.988686 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:11.988439 2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ff2c3b7-0b29-4122-a9cc-5948769be69b-installation-pull-secrets\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:04:11.988686 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:11.988451 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhshr\" (UniqueName: \"kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-kube-api-access-qhshr\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:04:11.988686 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:11.988459 2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ff2c3b7-0b29-4122-a9cc-5948769be69b-ca-trust-extracted\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:04:11.988686 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:11.988467 2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ff2c3b7-0b29-4122-a9cc-5948769be69b-registry-certificates\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:04:11.988686 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:11.988475 2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ff2c3b7-0b29-4122-a9cc-5948769be69b-bound-sa-token\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:04:12.064036 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:12.064005 2562 generic.go:356] "Generic (PLEG): container finished" podID="7ff2c3b7-0b29-4122-a9cc-5948769be69b" containerID="345653bde6ef552fb2997d1be9a0213556972c7140cd941ea1da5c320dcedd1d" exitCode=0 Jun 11 20:04:12.064199 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:12.064045 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7db79967bc-vgntv" Jun 11 20:04:12.064199 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:12.064061 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7db79967bc-vgntv" event={"ID":"7ff2c3b7-0b29-4122-a9cc-5948769be69b","Type":"ContainerDied","Data":"345653bde6ef552fb2997d1be9a0213556972c7140cd941ea1da5c320dcedd1d"} Jun 11 20:04:12.064199 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:12.064102 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7db79967bc-vgntv" event={"ID":"7ff2c3b7-0b29-4122-a9cc-5948769be69b","Type":"ContainerDied","Data":"2796749c0687b09587df0e98da99a6ab99b2afaf7054fdb27442d4a47ef2f78b"} Jun 11 20:04:12.064199 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:12.064123 2562 scope.go:117] "RemoveContainer" containerID="345653bde6ef552fb2997d1be9a0213556972c7140cd941ea1da5c320dcedd1d" Jun 11 20:04:12.073456 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:12.073426 2562 scope.go:117] "RemoveContainer" containerID="345653bde6ef552fb2997d1be9a0213556972c7140cd941ea1da5c320dcedd1d" Jun 11 20:04:12.073682 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:04:12.073666 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"345653bde6ef552fb2997d1be9a0213556972c7140cd941ea1da5c320dcedd1d\": container with ID starting with 345653bde6ef552fb2997d1be9a0213556972c7140cd941ea1da5c320dcedd1d not found: ID does not exist" containerID="345653bde6ef552fb2997d1be9a0213556972c7140cd941ea1da5c320dcedd1d" Jun 11 20:04:12.073743 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:12.073693 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"345653bde6ef552fb2997d1be9a0213556972c7140cd941ea1da5c320dcedd1d"} err="failed to get container status \"345653bde6ef552fb2997d1be9a0213556972c7140cd941ea1da5c320dcedd1d\": rpc error: code = NotFound desc = could not find container \"345653bde6ef552fb2997d1be9a0213556972c7140cd941ea1da5c320dcedd1d\": container with ID starting with 345653bde6ef552fb2997d1be9a0213556972c7140cd941ea1da5c320dcedd1d not found: ID does not exist" Jun 11 20:04:12.085429 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:12.085409 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7db79967bc-vgntv"] Jun 11 20:04:12.088902 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:12.088881 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7db79967bc-vgntv"] Jun 11 20:04:12.739538 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:12.739499 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ff2c3b7-0b29-4122-a9cc-5948769be69b" path="/var/lib/kubelet/pods/7ff2c3b7-0b29-4122-a9cc-5948769be69b/volumes" Jun 11 20:04:16.777529 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:16.777476 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66bf9749cd-dnhnv" Jun 11 20:04:16.777529 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:16.777543 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66bf9749cd-dnhnv" Jun 11 20:04:16.782552 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:16.782530 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66bf9749cd-dnhnv" Jun 11 20:04:17.091406 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:17.091367 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66bf9749cd-dnhnv" Jun 11 20:04:17.151296 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:17.151262 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65fc9b89bd-j46lk"] Jun 11 20:04:17.319010 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:17.318976 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:04:17.445034 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:17.444961 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:04:17.550106 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:17.550074 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:04:21.259619 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:21.259585 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:04:21.310774 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:21.310742 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:04:31.449341 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:31.449274 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-79ccc69d66-mj4tc" podUID="32090f2d-3903-45d3-86e6-9a5cd2ac3b4f" containerName="console" containerID="cri-o://e7a5d253c9d4bd8b2e630e06f2bc41a170221be3371786083b5f1f6506e1154a" gracePeriod=15 Jun 11 20:04:31.697105 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:31.697081 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79ccc69d66-mj4tc" Jun 11 20:04:31.751427 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:31.751327 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-oauth-serving-cert\") pod \"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f\" (UID: \"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f\") " Jun 11 20:04:31.751427 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:31.751363 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-console-oauth-config\") pod \"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f\" (UID: \"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f\") " Jun 11 20:04:31.751427 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:31.751399 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-trusted-ca-bundle\") pod \"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f\" (UID: \"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f\") " Jun 11 20:04:31.751427 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:31.751417 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqltq\" (UniqueName: \"kubernetes.io/projected/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-kube-api-access-wqltq\") pod \"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f\" (UID: \"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f\") " Jun 11 20:04:31.751682 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:31.751539 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-service-ca\") pod \"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f\" (UID: \"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f\") " Jun 11 20:04:31.751682 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:31.751605 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-console-serving-cert\") pod \"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f\" (UID: \"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f\") " Jun 11 20:04:31.751682 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:31.751659 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-console-config\") pod \"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f\" (UID: \"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f\") " Jun 11 20:04:31.751843 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:31.751817 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "32090f2d-3903-45d3-86e6-9a5cd2ac3b4f" (UID: "32090f2d-3903-45d3-86e6-9a5cd2ac3b4f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 20:04:31.751843 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:31.751816 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "32090f2d-3903-45d3-86e6-9a5cd2ac3b4f" (UID: "32090f2d-3903-45d3-86e6-9a5cd2ac3b4f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 20:04:31.751952 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:31.751891 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-service-ca" (OuterVolumeSpecName: "service-ca") pod "32090f2d-3903-45d3-86e6-9a5cd2ac3b4f" (UID: "32090f2d-3903-45d3-86e6-9a5cd2ac3b4f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 20:04:31.752144 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:31.752121 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-console-config" (OuterVolumeSpecName: "console-config") pod "32090f2d-3903-45d3-86e6-9a5cd2ac3b4f" (UID: "32090f2d-3903-45d3-86e6-9a5cd2ac3b4f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 20:04:31.752417 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:31.752272 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-oauth-serving-cert\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:04:31.752417 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:31.752294 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-trusted-ca-bundle\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:04:31.752417 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:31.752308 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-service-ca\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:04:31.753725 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:31.753692 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "32090f2d-3903-45d3-86e6-9a5cd2ac3b4f" (UID: "32090f2d-3903-45d3-86e6-9a5cd2ac3b4f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 20:04:31.753820 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:31.753797 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "32090f2d-3903-45d3-86e6-9a5cd2ac3b4f" (UID: "32090f2d-3903-45d3-86e6-9a5cd2ac3b4f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 20:04:31.753860 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:31.753834 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-kube-api-access-wqltq" (OuterVolumeSpecName: "kube-api-access-wqltq") pod "32090f2d-3903-45d3-86e6-9a5cd2ac3b4f" (UID: "32090f2d-3903-45d3-86e6-9a5cd2ac3b4f"). InnerVolumeSpecName "kube-api-access-wqltq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:04:31.852774 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:31.852731 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-console-config\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:04:31.852774 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:31.852762 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-console-oauth-config\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:04:31.852774 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:31.852778 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqltq\" (UniqueName: \"kubernetes.io/projected/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-kube-api-access-wqltq\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:04:31.852994 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:31.852791 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f-console-serving-cert\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:04:32.150570 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:32.150524 2562 generic.go:356] "Generic (PLEG): container finished" podID="32090f2d-3903-45d3-86e6-9a5cd2ac3b4f" containerID="e7a5d253c9d4bd8b2e630e06f2bc41a170221be3371786083b5f1f6506e1154a" exitCode=0 Jun 11 20:04:32.150717 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:32.150574 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79ccc69d66-mj4tc" Jun 11 20:04:32.150717 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:32.150578 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79ccc69d66-mj4tc" event={"ID":"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f","Type":"ContainerDied","Data":"e7a5d253c9d4bd8b2e630e06f2bc41a170221be3371786083b5f1f6506e1154a"} Jun 11 20:04:32.150717 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:32.150693 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79ccc69d66-mj4tc" event={"ID":"32090f2d-3903-45d3-86e6-9a5cd2ac3b4f","Type":"ContainerDied","Data":"1bbfd3b717c76f0b8509aebf5a9652f40d7874b8880d71851f1e7a58bec7c332"} Jun 11 20:04:32.150717 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:32.150716 2562 scope.go:117] "RemoveContainer" containerID="e7a5d253c9d4bd8b2e630e06f2bc41a170221be3371786083b5f1f6506e1154a" Jun 11 20:04:32.159736 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:32.159719 2562 scope.go:117] "RemoveContainer" containerID="e7a5d253c9d4bd8b2e630e06f2bc41a170221be3371786083b5f1f6506e1154a" Jun 11 20:04:32.159980 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:04:32.159964 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7a5d253c9d4bd8b2e630e06f2bc41a170221be3371786083b5f1f6506e1154a\": container with ID starting with e7a5d253c9d4bd8b2e630e06f2bc41a170221be3371786083b5f1f6506e1154a not found: ID does not exist" containerID="e7a5d253c9d4bd8b2e630e06f2bc41a170221be3371786083b5f1f6506e1154a" Jun 11 20:04:32.160026 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:32.159988 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7a5d253c9d4bd8b2e630e06f2bc41a170221be3371786083b5f1f6506e1154a"} err="failed to get container status \"e7a5d253c9d4bd8b2e630e06f2bc41a170221be3371786083b5f1f6506e1154a\": rpc error: code = NotFound desc = could not find container \"e7a5d253c9d4bd8b2e630e06f2bc41a170221be3371786083b5f1f6506e1154a\": container with ID starting with e7a5d253c9d4bd8b2e630e06f2bc41a170221be3371786083b5f1f6506e1154a not found: ID does not exist" Jun 11 20:04:32.171623 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:32.171596 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79ccc69d66-mj4tc"] Jun 11 20:04:32.177212 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:32.177188 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79ccc69d66-mj4tc"] Jun 11 20:04:32.596880 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:32.596822 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:04:32.734679 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:32.734637 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32090f2d-3903-45d3-86e6-9a5cd2ac3b4f" path="/var/lib/kubelet/pods/32090f2d-3903-45d3-86e6-9a5cd2ac3b4f/volumes" Jun 11 20:04:32.737987 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:32.737965 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:04:42.175030 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:42.174966 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-65fc9b89bd-j46lk" podUID="57500943-f9b4-4003-91e0-8d127cda69d2" containerName="console" containerID="cri-o://cdbff50a7199c2557c13c2342b05e414a6d7ae157e0b3277789bbebaa6647366" gracePeriod=15 Jun 11 20:04:42.437965 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:42.437907 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65fc9b89bd-j46lk" Jun 11 20:04:42.544395 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:42.544341 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57500943-f9b4-4003-91e0-8d127cda69d2-oauth-serving-cert\") pod \"57500943-f9b4-4003-91e0-8d127cda69d2\" (UID: \"57500943-f9b4-4003-91e0-8d127cda69d2\") " Jun 11 20:04:42.544584 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:42.544416 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57500943-f9b4-4003-91e0-8d127cda69d2-console-serving-cert\") pod \"57500943-f9b4-4003-91e0-8d127cda69d2\" (UID: \"57500943-f9b4-4003-91e0-8d127cda69d2\") " Jun 11 20:04:42.544584 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:42.544516 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57500943-f9b4-4003-91e0-8d127cda69d2-console-oauth-config\") pod \"57500943-f9b4-4003-91e0-8d127cda69d2\" (UID: \"57500943-f9b4-4003-91e0-8d127cda69d2\") " Jun 11 20:04:42.544584 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:42.544566 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57500943-f9b4-4003-91e0-8d127cda69d2-service-ca\") pod \"57500943-f9b4-4003-91e0-8d127cda69d2\" (UID: \"57500943-f9b4-4003-91e0-8d127cda69d2\") " Jun 11 20:04:42.544747 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:42.544600 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57500943-f9b4-4003-91e0-8d127cda69d2-console-config\") pod \"57500943-f9b4-4003-91e0-8d127cda69d2\" (UID: \"57500943-f9b4-4003-91e0-8d127cda69d2\") " Jun 11 20:04:42.544747 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:42.544667 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85nsq\" (UniqueName: \"kubernetes.io/projected/57500943-f9b4-4003-91e0-8d127cda69d2-kube-api-access-85nsq\") pod \"57500943-f9b4-4003-91e0-8d127cda69d2\" (UID: \"57500943-f9b4-4003-91e0-8d127cda69d2\") " Jun 11 20:04:42.544747 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:42.544695 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57500943-f9b4-4003-91e0-8d127cda69d2-trusted-ca-bundle\") pod \"57500943-f9b4-4003-91e0-8d127cda69d2\" (UID: \"57500943-f9b4-4003-91e0-8d127cda69d2\") " Jun 11 20:04:42.544871 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:42.544769 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57500943-f9b4-4003-91e0-8d127cda69d2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "57500943-f9b4-4003-91e0-8d127cda69d2" (UID: "57500943-f9b4-4003-91e0-8d127cda69d2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 20:04:42.544991 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:42.544976 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57500943-f9b4-4003-91e0-8d127cda69d2-oauth-serving-cert\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:04:42.545062 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:42.544979 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57500943-f9b4-4003-91e0-8d127cda69d2-service-ca" (OuterVolumeSpecName: "service-ca") pod "57500943-f9b4-4003-91e0-8d127cda69d2" (UID: "57500943-f9b4-4003-91e0-8d127cda69d2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 20:04:42.545164 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:42.545022 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57500943-f9b4-4003-91e0-8d127cda69d2-console-config" (OuterVolumeSpecName: "console-config") pod "57500943-f9b4-4003-91e0-8d127cda69d2" (UID: "57500943-f9b4-4003-91e0-8d127cda69d2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 20:04:42.545469 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:42.545403 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57500943-f9b4-4003-91e0-8d127cda69d2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "57500943-f9b4-4003-91e0-8d127cda69d2" (UID: "57500943-f9b4-4003-91e0-8d127cda69d2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 20:04:42.546775 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:42.546749 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57500943-f9b4-4003-91e0-8d127cda69d2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "57500943-f9b4-4003-91e0-8d127cda69d2" (UID: "57500943-f9b4-4003-91e0-8d127cda69d2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 20:04:42.546859 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:42.546835 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57500943-f9b4-4003-91e0-8d127cda69d2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "57500943-f9b4-4003-91e0-8d127cda69d2" (UID: "57500943-f9b4-4003-91e0-8d127cda69d2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 20:04:42.546859 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:42.546839 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57500943-f9b4-4003-91e0-8d127cda69d2-kube-api-access-85nsq" (OuterVolumeSpecName: "kube-api-access-85nsq") pod "57500943-f9b4-4003-91e0-8d127cda69d2" (UID: "57500943-f9b4-4003-91e0-8d127cda69d2"). InnerVolumeSpecName "kube-api-access-85nsq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:04:42.645803 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:42.645767 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85nsq\" (UniqueName: \"kubernetes.io/projected/57500943-f9b4-4003-91e0-8d127cda69d2-kube-api-access-85nsq\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:04:42.645803 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:42.645802 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57500943-f9b4-4003-91e0-8d127cda69d2-trusted-ca-bundle\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:04:42.645999 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:42.645817 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57500943-f9b4-4003-91e0-8d127cda69d2-console-serving-cert\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:04:42.645999 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:42.645833 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57500943-f9b4-4003-91e0-8d127cda69d2-console-oauth-config\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:04:42.645999 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:42.645847 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57500943-f9b4-4003-91e0-8d127cda69d2-service-ca\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:04:42.645999 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:42.645861 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57500943-f9b4-4003-91e0-8d127cda69d2-console-config\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:04:43.193686 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:43.193655 2562 generic.go:356] "Generic (PLEG): container finished" podID="57500943-f9b4-4003-91e0-8d127cda69d2" containerID="cdbff50a7199c2557c13c2342b05e414a6d7ae157e0b3277789bbebaa6647366" exitCode=0 Jun 11 20:04:43.194095 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:43.193700 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65fc9b89bd-j46lk" Jun 11 20:04:43.194095 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:43.193714 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65fc9b89bd-j46lk" event={"ID":"57500943-f9b4-4003-91e0-8d127cda69d2","Type":"ContainerDied","Data":"cdbff50a7199c2557c13c2342b05e414a6d7ae157e0b3277789bbebaa6647366"} Jun 11 20:04:43.194095 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:43.193754 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65fc9b89bd-j46lk" event={"ID":"57500943-f9b4-4003-91e0-8d127cda69d2","Type":"ContainerDied","Data":"5864c9693f31c682b1e6c9eeeb977584c82b4e8f25b463ff850a479bb60537b4"} Jun 11 20:04:43.194095 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:43.193774 2562 scope.go:117] "RemoveContainer" containerID="cdbff50a7199c2557c13c2342b05e414a6d7ae157e0b3277789bbebaa6647366" Jun 11 20:04:43.204214 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:43.204195 2562 scope.go:117] "RemoveContainer" containerID="cdbff50a7199c2557c13c2342b05e414a6d7ae157e0b3277789bbebaa6647366" Jun 11 20:04:43.204489 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:04:43.204469 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdbff50a7199c2557c13c2342b05e414a6d7ae157e0b3277789bbebaa6647366\": container with ID starting with cdbff50a7199c2557c13c2342b05e414a6d7ae157e0b3277789bbebaa6647366 not found: ID does not exist" containerID="cdbff50a7199c2557c13c2342b05e414a6d7ae157e0b3277789bbebaa6647366" Jun 11 20:04:43.204556 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:43.204499 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdbff50a7199c2557c13c2342b05e414a6d7ae157e0b3277789bbebaa6647366"} err="failed to get container status \"cdbff50a7199c2557c13c2342b05e414a6d7ae157e0b3277789bbebaa6647366\": rpc error: code = NotFound desc = could not find container \"cdbff50a7199c2557c13c2342b05e414a6d7ae157e0b3277789bbebaa6647366\": container with ID starting with cdbff50a7199c2557c13c2342b05e414a6d7ae157e0b3277789bbebaa6647366 not found: ID does not exist" Jun 11 20:04:43.211662 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:43.211624 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65fc9b89bd-j46lk"] Jun 11 20:04:43.213678 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:43.213657 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65fc9b89bd-j46lk"] Jun 11 20:04:44.735357 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:44.735322 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57500943-f9b4-4003-91e0-8d127cda69d2" path="/var/lib/kubelet/pods/57500943-f9b4-4003-91e0-8d127cda69d2/volumes" Jun 11 20:04:46.611338 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:46.611266 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:04:46.666903 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:46.666863 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:04:53.174647 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:04:53.174615 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:05:00.523452 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:00.523408 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:05:00.624140 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:00.624095 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:05:01.096324 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:01.096288 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbzvq9"] Jun 11 20:05:01.096630 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:01.096618 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ff2c3b7-0b29-4122-a9cc-5948769be69b" containerName="registry" Jun 11 20:05:01.096768 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:01.096632 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ff2c3b7-0b29-4122-a9cc-5948769be69b" containerName="registry" Jun 11 20:05:01.096768 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:01.096644 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32090f2d-3903-45d3-86e6-9a5cd2ac3b4f" containerName="console" Jun 11 20:05:01.096768 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:01.096649 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="32090f2d-3903-45d3-86e6-9a5cd2ac3b4f" containerName="console" Jun 11 20:05:01.096768 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:01.096658 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57500943-f9b4-4003-91e0-8d127cda69d2" containerName="console" Jun 11 20:05:01.096768 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:01.096664 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="57500943-f9b4-4003-91e0-8d127cda69d2" containerName="console" Jun 11 20:05:01.096768 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:01.096723 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ff2c3b7-0b29-4122-a9cc-5948769be69b" containerName="registry" Jun 11 20:05:01.096768 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:01.096733 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="32090f2d-3903-45d3-86e6-9a5cd2ac3b4f" containerName="console" Jun 11 20:05:01.096768 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:01.096739 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="57500943-f9b4-4003-91e0-8d127cda69d2" containerName="console" Jun 11 20:05:01.099787 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:01.099769 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbzvq9" Jun 11 20:05:01.102508 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:01.102487 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 20:05:01.103470 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:01.103454 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n7jmt\"" Jun 11 20:05:01.103523 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:01.103458 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 20:05:01.111726 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:01.111705 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbzvq9"] Jun 11 20:05:01.207782 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:01.207715 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b89756c-bfb8-4324-8827-fd368e71c44c-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbzvq9\" (UID: \"4b89756c-bfb8-4324-8827-fd368e71c44c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbzvq9" Jun 11 20:05:01.207972 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:01.207845 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b89756c-bfb8-4324-8827-fd368e71c44c-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbzvq9\" (UID: \"4b89756c-bfb8-4324-8827-fd368e71c44c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbzvq9" Jun 11 20:05:01.207972 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:01.207921 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8dvz\" (UniqueName: \"kubernetes.io/projected/4b89756c-bfb8-4324-8827-fd368e71c44c-kube-api-access-w8dvz\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbzvq9\" (UID: \"4b89756c-bfb8-4324-8827-fd368e71c44c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbzvq9" Jun 11 20:05:01.308354 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:01.308318 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8dvz\" (UniqueName: \"kubernetes.io/projected/4b89756c-bfb8-4324-8827-fd368e71c44c-kube-api-access-w8dvz\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbzvq9\" (UID: \"4b89756c-bfb8-4324-8827-fd368e71c44c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbzvq9" Jun 11 20:05:01.308542 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:01.308408 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b89756c-bfb8-4324-8827-fd368e71c44c-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbzvq9\" (UID: \"4b89756c-bfb8-4324-8827-fd368e71c44c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbzvq9" Jun 11 20:05:01.308542 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:01.308432 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b89756c-bfb8-4324-8827-fd368e71c44c-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbzvq9\" (UID: \"4b89756c-bfb8-4324-8827-fd368e71c44c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbzvq9" Jun 11 20:05:01.308803 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:01.308783 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b89756c-bfb8-4324-8827-fd368e71c44c-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbzvq9\" (UID: \"4b89756c-bfb8-4324-8827-fd368e71c44c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbzvq9" Jun 11 20:05:01.308842 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:01.308807 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b89756c-bfb8-4324-8827-fd368e71c44c-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbzvq9\" (UID: \"4b89756c-bfb8-4324-8827-fd368e71c44c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbzvq9" Jun 11 20:05:01.316719 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:01.316684 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8dvz\" (UniqueName: \"kubernetes.io/projected/4b89756c-bfb8-4324-8827-fd368e71c44c-kube-api-access-w8dvz\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbzvq9\" (UID: \"4b89756c-bfb8-4324-8827-fd368e71c44c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbzvq9" Jun 11 20:05:01.409342 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:01.409245 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbzvq9" Jun 11 20:05:01.538492 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:01.538464 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbzvq9"] Jun 11 20:05:01.540890 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:05:01.540865 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b89756c_bfb8_4324_8827_fd368e71c44c.slice/crio-f1f9fd3ec865d6f5d116174d673ea2bfb533d521fd558a678e6e95e80457754d WatchSource:0}: Error finding container f1f9fd3ec865d6f5d116174d673ea2bfb533d521fd558a678e6e95e80457754d: Status 404 returned error can't find the container with id f1f9fd3ec865d6f5d116174d673ea2bfb533d521fd558a678e6e95e80457754d Jun 11 20:05:02.273021 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:02.272984 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbzvq9" event={"ID":"4b89756c-bfb8-4324-8827-fd368e71c44c","Type":"ContainerStarted","Data":"f1f9fd3ec865d6f5d116174d673ea2bfb533d521fd558a678e6e95e80457754d"} Jun 11 20:05:11.315615 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:11.315530 2562 generic.go:356] "Generic (PLEG): container finished" podID="4b89756c-bfb8-4324-8827-fd368e71c44c" containerID="3756a001527442733b1e5bf5a1ea66c6df976ae82c935e7ee41ceeaff3d4c225" exitCode=0 Jun 11 20:05:11.315958 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:11.315615 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbzvq9" event={"ID":"4b89756c-bfb8-4324-8827-fd368e71c44c","Type":"ContainerDied","Data":"3756a001527442733b1e5bf5a1ea66c6df976ae82c935e7ee41ceeaff3d4c225"} Jun 11 20:05:14.331205 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:14.331171 2562 generic.go:356] "Generic (PLEG): container finished" podID="4b89756c-bfb8-4324-8827-fd368e71c44c" containerID="2e01ef339a946acff9cace22ebb59fb2fa98f765c0bb325234c82c14ecb36c44" exitCode=0 Jun 11 20:05:14.331604 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:14.331246 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbzvq9" event={"ID":"4b89756c-bfb8-4324-8827-fd368e71c44c","Type":"ContainerDied","Data":"2e01ef339a946acff9cace22ebb59fb2fa98f765c0bb325234c82c14ecb36c44"} Jun 11 20:05:23.373321 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:23.373288 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbzvq9" event={"ID":"4b89756c-bfb8-4324-8827-fd368e71c44c","Type":"ContainerStarted","Data":"d92f54b31b7b42bb8cf71f59f1c08271cade94d83815b34f52036e46f77b6bea"} Jun 11 20:05:23.392630 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:23.392581 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbzvq9" podStartSLOduration=1.6910482679999999 podStartE2EDuration="22.392563889s" totalImagesPullingTime="20.701515621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:05:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:05:23.391184323 +0000 UTC m=+415.122346300" watchObservedRunningTime="2026-06-11 20:05:23.392563889 +0000 UTC m=+415.123725863" Jun 11 20:05:24.379175 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:24.379139 2562 generic.go:356] "Generic (PLEG): container finished" podID="4b89756c-bfb8-4324-8827-fd368e71c44c" containerID="d92f54b31b7b42bb8cf71f59f1c08271cade94d83815b34f52036e46f77b6bea" exitCode=0 Jun 11 20:05:24.379574 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:24.379223 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbzvq9" event={"ID":"4b89756c-bfb8-4324-8827-fd368e71c44c","Type":"ContainerDied","Data":"d92f54b31b7b42bb8cf71f59f1c08271cade94d83815b34f52036e46f77b6bea"} Jun 11 20:05:25.569245 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:25.569206 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbzvq9" Jun 11 20:05:25.630892 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:25.630858 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b89756c-bfb8-4324-8827-fd368e71c44c-util\") pod \"4b89756c-bfb8-4324-8827-fd368e71c44c\" (UID: \"4b89756c-bfb8-4324-8827-fd368e71c44c\") " Jun 11 20:05:25.631077 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:25.630926 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b89756c-bfb8-4324-8827-fd368e71c44c-bundle\") pod \"4b89756c-bfb8-4324-8827-fd368e71c44c\" (UID: \"4b89756c-bfb8-4324-8827-fd368e71c44c\") " Jun 11 20:05:25.631077 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:25.630964 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8dvz\" (UniqueName: \"kubernetes.io/projected/4b89756c-bfb8-4324-8827-fd368e71c44c-kube-api-access-w8dvz\") pod \"4b89756c-bfb8-4324-8827-fd368e71c44c\" (UID: \"4b89756c-bfb8-4324-8827-fd368e71c44c\") " Jun 11 20:05:25.631601 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:25.631577 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b89756c-bfb8-4324-8827-fd368e71c44c-bundle" (OuterVolumeSpecName: "bundle") pod "4b89756c-bfb8-4324-8827-fd368e71c44c" (UID: "4b89756c-bfb8-4324-8827-fd368e71c44c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:05:25.633321 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:25.633297 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b89756c-bfb8-4324-8827-fd368e71c44c-kube-api-access-w8dvz" (OuterVolumeSpecName: "kube-api-access-w8dvz") pod "4b89756c-bfb8-4324-8827-fd368e71c44c" (UID: "4b89756c-bfb8-4324-8827-fd368e71c44c"). InnerVolumeSpecName "kube-api-access-w8dvz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:05:25.635653 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:25.635597 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b89756c-bfb8-4324-8827-fd368e71c44c-util" (OuterVolumeSpecName: "util") pod "4b89756c-bfb8-4324-8827-fd368e71c44c" (UID: "4b89756c-bfb8-4324-8827-fd368e71c44c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:05:25.732088 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:25.732050 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b89756c-bfb8-4324-8827-fd368e71c44c-util\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:05:25.732088 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:25.732080 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b89756c-bfb8-4324-8827-fd368e71c44c-bundle\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:05:25.732088 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:25.732090 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8dvz\" (UniqueName: \"kubernetes.io/projected/4b89756c-bfb8-4324-8827-fd368e71c44c-kube-api-access-w8dvz\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:05:26.388530 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:26.388498 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbzvq9" event={"ID":"4b89756c-bfb8-4324-8827-fd368e71c44c","Type":"ContainerDied","Data":"f1f9fd3ec865d6f5d116174d673ea2bfb533d521fd558a678e6e95e80457754d"} Jun 11 20:05:26.388697 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:26.388544 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f1f9fd3ec865d6f5d116174d673ea2bfb533d521fd558a678e6e95e80457754d" Jun 11 20:05:26.388697 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:26.388514 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbzvq9" Jun 11 20:05:32.207894 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:32.207863 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:05:33.013672 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:33.013641 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:05:34.190789 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:34.190757 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-j6tcz"] Jun 11 20:05:34.191164 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:34.191091 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b89756c-bfb8-4324-8827-fd368e71c44c" containerName="extract" Jun 11 20:05:34.191164 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:34.191101 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b89756c-bfb8-4324-8827-fd368e71c44c" containerName="extract" Jun 11 20:05:34.191164 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:34.191113 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b89756c-bfb8-4324-8827-fd368e71c44c" containerName="pull" Jun 11 20:05:34.191164 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:34.191118 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b89756c-bfb8-4324-8827-fd368e71c44c" containerName="pull" Jun 11 20:05:34.191164 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:34.191131 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b89756c-bfb8-4324-8827-fd368e71c44c" containerName="util" Jun 11 20:05:34.191164 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:34.191136 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b89756c-bfb8-4324-8827-fd368e71c44c" containerName="util" Jun 11 20:05:34.191359 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:34.191194 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b89756c-bfb8-4324-8827-fd368e71c44c" containerName="extract" Jun 11 20:05:34.194039 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:34.194023 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-j6tcz" Jun 11 20:05:34.197060 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:34.197039 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 11 20:05:34.197177 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:34.197125 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 11 20:05:34.197228 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:34.197201 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-sr5w8\"" Jun 11 20:05:34.209222 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:34.209200 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-j6tcz"] Jun 11 20:05:34.309803 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:34.309773 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrrst\" (UniqueName: \"kubernetes.io/projected/f13b905d-1e18-4dc7-9d4c-7e2b77d9afd8-kube-api-access-hrrst\") pod \"cert-manager-operator-controller-manager-57757f7cfc-j6tcz\" (UID: \"f13b905d-1e18-4dc7-9d4c-7e2b77d9afd8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-j6tcz" Jun 11 20:05:34.309985 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:34.309820 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f13b905d-1e18-4dc7-9d4c-7e2b77d9afd8-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-j6tcz\" (UID: \"f13b905d-1e18-4dc7-9d4c-7e2b77d9afd8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-j6tcz" Jun 11 20:05:34.410466 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:34.410439 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrrst\" (UniqueName: \"kubernetes.io/projected/f13b905d-1e18-4dc7-9d4c-7e2b77d9afd8-kube-api-access-hrrst\") pod \"cert-manager-operator-controller-manager-57757f7cfc-j6tcz\" (UID: \"f13b905d-1e18-4dc7-9d4c-7e2b77d9afd8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-j6tcz" Jun 11 20:05:34.410591 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:34.410486 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f13b905d-1e18-4dc7-9d4c-7e2b77d9afd8-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-j6tcz\" (UID: \"f13b905d-1e18-4dc7-9d4c-7e2b77d9afd8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-j6tcz" Jun 11 20:05:34.410924 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:34.410905 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f13b905d-1e18-4dc7-9d4c-7e2b77d9afd8-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-j6tcz\" (UID: \"f13b905d-1e18-4dc7-9d4c-7e2b77d9afd8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-j6tcz" Jun 11 20:05:34.422221 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:34.422198 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrrst\" (UniqueName: \"kubernetes.io/projected/f13b905d-1e18-4dc7-9d4c-7e2b77d9afd8-kube-api-access-hrrst\") pod \"cert-manager-operator-controller-manager-57757f7cfc-j6tcz\" (UID: \"f13b905d-1e18-4dc7-9d4c-7e2b77d9afd8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-j6tcz" Jun 11 20:05:34.503250 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:34.503173 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-j6tcz" Jun 11 20:05:34.638365 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:34.638335 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-j6tcz"] Jun 11 20:05:34.642199 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:05:34.642172 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf13b905d_1e18_4dc7_9d4c_7e2b77d9afd8.slice/crio-05fc8649bc5119f2b3767218a9374b1e65c4937d42a0c575b2ec368c1a5447b2 WatchSource:0}: Error finding container 05fc8649bc5119f2b3767218a9374b1e65c4937d42a0c575b2ec368c1a5447b2: Status 404 returned error can't find the container with id 05fc8649bc5119f2b3767218a9374b1e65c4937d42a0c575b2ec368c1a5447b2 Jun 11 20:05:35.427211 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:35.427164 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-j6tcz" event={"ID":"f13b905d-1e18-4dc7-9d4c-7e2b77d9afd8","Type":"ContainerStarted","Data":"05fc8649bc5119f2b3767218a9374b1e65c4937d42a0c575b2ec368c1a5447b2"} Jun 11 20:05:36.005979 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:36.005939 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:05:36.116631 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:36.116595 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:05:36.439097 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:36.439061 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-j6tcz" event={"ID":"f13b905d-1e18-4dc7-9d4c-7e2b77d9afd8","Type":"ContainerStarted","Data":"1b727341d223b4fa4d56a24085cddc2155d6ebc4d95d1f5b944386974ea71ce1"} Jun 11 20:05:36.460263 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:36.460213 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-j6tcz" podStartSLOduration=0.88985336 podStartE2EDuration="2.460199472s" totalImagesPullingTime="1.570346112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:05:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:05:36.45849285 +0000 UTC m=+428.189654865" watchObservedRunningTime="2026-06-11 20:05:36.460199472 +0000 UTC m=+428.191361446" Jun 11 20:05:36.881780 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:36.881745 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:05:36.995951 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:36.995917 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:05:37.226745 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:37.226667 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:05:37.345444 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:37.345407 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:05:37.665026 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:37.664993 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxs847"] Jun 11 20:05:37.667447 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:37.667431 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxs847" Jun 11 20:05:37.670148 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:37.670130 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 20:05:37.671361 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:37.671340 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 20:05:37.671479 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:37.671370 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n7jmt\"" Jun 11 20:05:37.677603 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:37.677584 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxs847"] Jun 11 20:05:37.839715 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:37.839675 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0a8ab5c-7737-444c-a292-a6c0c4f4fb96-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxs847\" (UID: \"a0a8ab5c-7737-444c-a292-a6c0c4f4fb96\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxs847" Jun 11 20:05:37.839715 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:37.839717 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0a8ab5c-7737-444c-a292-a6c0c4f4fb96-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxs847\" (UID: \"a0a8ab5c-7737-444c-a292-a6c0c4f4fb96\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxs847" Jun 11 20:05:37.839937 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:37.839812 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc7vr\" (UniqueName: \"kubernetes.io/projected/a0a8ab5c-7737-444c-a292-a6c0c4f4fb96-kube-api-access-jc7vr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxs847\" (UID: \"a0a8ab5c-7737-444c-a292-a6c0c4f4fb96\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxs847" Jun 11 20:05:37.940848 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:37.940756 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc7vr\" (UniqueName: \"kubernetes.io/projected/a0a8ab5c-7737-444c-a292-a6c0c4f4fb96-kube-api-access-jc7vr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxs847\" (UID: \"a0a8ab5c-7737-444c-a292-a6c0c4f4fb96\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxs847" Jun 11 20:05:37.940848 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:37.940839 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0a8ab5c-7737-444c-a292-a6c0c4f4fb96-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxs847\" (UID: \"a0a8ab5c-7737-444c-a292-a6c0c4f4fb96\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxs847" Jun 11 20:05:37.941061 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:37.940869 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0a8ab5c-7737-444c-a292-a6c0c4f4fb96-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxs847\" (UID: \"a0a8ab5c-7737-444c-a292-a6c0c4f4fb96\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxs847" Jun 11 20:05:37.941237 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:37.941213 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0a8ab5c-7737-444c-a292-a6c0c4f4fb96-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxs847\" (UID: \"a0a8ab5c-7737-444c-a292-a6c0c4f4fb96\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxs847" Jun 11 20:05:37.941305 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:37.941246 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0a8ab5c-7737-444c-a292-a6c0c4f4fb96-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxs847\" (UID: \"a0a8ab5c-7737-444c-a292-a6c0c4f4fb96\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxs847" Jun 11 20:05:37.952426 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:37.952391 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc7vr\" (UniqueName: \"kubernetes.io/projected/a0a8ab5c-7737-444c-a292-a6c0c4f4fb96-kube-api-access-jc7vr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxs847\" (UID: \"a0a8ab5c-7737-444c-a292-a6c0c4f4fb96\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxs847" Jun 11 20:05:37.977555 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:37.977527 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxs847" Jun 11 20:05:38.115035 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:38.115014 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxs847"] Jun 11 20:05:38.117533 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:05:38.117502 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0a8ab5c_7737_444c_a292_a6c0c4f4fb96.slice/crio-511f364950b3885a14ad63c2c0daad6e7ca3e74ab46a4cc68dfc2e21173a493c WatchSource:0}: Error finding container 511f364950b3885a14ad63c2c0daad6e7ca3e74ab46a4cc68dfc2e21173a493c: Status 404 returned error can't find the container with id 511f364950b3885a14ad63c2c0daad6e7ca3e74ab46a4cc68dfc2e21173a493c Jun 11 20:05:38.451465 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:38.451427 2562 generic.go:356] "Generic (PLEG): container finished" podID="a0a8ab5c-7737-444c-a292-a6c0c4f4fb96" containerID="22adcac30c13a1e6a8bf601876e31969eb8a69566fa4c34f58f0e2800347b8ce" exitCode=0 Jun 11 20:05:38.451616 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:38.451518 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxs847" event={"ID":"a0a8ab5c-7737-444c-a292-a6c0c4f4fb96","Type":"ContainerDied","Data":"22adcac30c13a1e6a8bf601876e31969eb8a69566fa4c34f58f0e2800347b8ce"} Jun 11 20:05:38.451616 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:38.451570 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxs847" event={"ID":"a0a8ab5c-7737-444c-a292-a6c0c4f4fb96","Type":"ContainerStarted","Data":"511f364950b3885a14ad63c2c0daad6e7ca3e74ab46a4cc68dfc2e21173a493c"} Jun 11 20:05:39.855670 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:39.855628 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-pmplx"] Jun 11 20:05:39.858266 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:39.858246 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-pmplx" Jun 11 20:05:39.861170 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:39.861150 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 20:05:39.862247 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:39.862228 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-l69mg\"" Jun 11 20:05:39.862342 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:39.862230 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 20:05:39.870824 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:39.870796 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-pmplx"] Jun 11 20:05:39.956431 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:39.956396 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qcd7\" (UniqueName: \"kubernetes.io/projected/f076b959-4daa-44e2-82fc-f34a05fdfe04-kube-api-access-6qcd7\") pod \"cert-manager-webhook-7dc76cbb94-pmplx\" (UID: \"f076b959-4daa-44e2-82fc-f34a05fdfe04\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-pmplx" Jun 11 20:05:39.956431 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:39.956437 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f076b959-4daa-44e2-82fc-f34a05fdfe04-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-pmplx\" (UID: \"f076b959-4daa-44e2-82fc-f34a05fdfe04\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-pmplx" Jun 11 20:05:40.057211 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:40.057171 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qcd7\" (UniqueName: \"kubernetes.io/projected/f076b959-4daa-44e2-82fc-f34a05fdfe04-kube-api-access-6qcd7\") pod \"cert-manager-webhook-7dc76cbb94-pmplx\" (UID: \"f076b959-4daa-44e2-82fc-f34a05fdfe04\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-pmplx" Jun 11 20:05:40.057394 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:40.057225 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f076b959-4daa-44e2-82fc-f34a05fdfe04-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-pmplx\" (UID: \"f076b959-4daa-44e2-82fc-f34a05fdfe04\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-pmplx" Jun 11 20:05:40.066353 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:40.066322 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f076b959-4daa-44e2-82fc-f34a05fdfe04-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-pmplx\" (UID: \"f076b959-4daa-44e2-82fc-f34a05fdfe04\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-pmplx" Jun 11 20:05:40.066523 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:40.066468 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qcd7\" (UniqueName: \"kubernetes.io/projected/f076b959-4daa-44e2-82fc-f34a05fdfe04-kube-api-access-6qcd7\") pod \"cert-manager-webhook-7dc76cbb94-pmplx\" (UID: \"f076b959-4daa-44e2-82fc-f34a05fdfe04\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-pmplx" Jun 11 20:05:40.181097 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:40.181009 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-pmplx" Jun 11 20:05:40.326065 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:40.325946 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-pmplx"] Jun 11 20:05:40.328925 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:05:40.328882 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf076b959_4daa_44e2_82fc_f34a05fdfe04.slice/crio-fd7c9004e1137545d849c4eb6b7cd26d8bb8d2e12248799e0615a7ae61650b4e WatchSource:0}: Error finding container fd7c9004e1137545d849c4eb6b7cd26d8bb8d2e12248799e0615a7ae61650b4e: Status 404 returned error can't find the container with id fd7c9004e1137545d849c4eb6b7cd26d8bb8d2e12248799e0615a7ae61650b4e Jun 11 20:05:40.462472 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:40.462359 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-pmplx" event={"ID":"f076b959-4daa-44e2-82fc-f34a05fdfe04","Type":"ContainerStarted","Data":"fd7c9004e1137545d849c4eb6b7cd26d8bb8d2e12248799e0615a7ae61650b4e"} Jun 11 20:05:40.639879 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:40.639848 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:05:41.042662 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:41.042617 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:05:41.470460 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:41.470424 2562 generic.go:356] "Generic (PLEG): container finished" podID="a0a8ab5c-7737-444c-a292-a6c0c4f4fb96" containerID="41c3ad3f3163b5188372922b9a2039d8f56255edf1865e458f0ea4e47980fe1d" exitCode=0 Jun 11 20:05:41.470668 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:41.470516 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxs847" event={"ID":"a0a8ab5c-7737-444c-a292-a6c0c4f4fb96","Type":"ContainerDied","Data":"41c3ad3f3163b5188372922b9a2039d8f56255edf1865e458f0ea4e47980fe1d"} Jun 11 20:05:42.477748 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:42.477649 2562 generic.go:356] "Generic (PLEG): container finished" podID="a0a8ab5c-7737-444c-a292-a6c0c4f4fb96" containerID="4724e6859d23635819befde48c7d762152743290c3577521d753dccc82343a3b" exitCode=0 Jun 11 20:05:42.477748 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:42.477686 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxs847" event={"ID":"a0a8ab5c-7737-444c-a292-a6c0c4f4fb96","Type":"ContainerDied","Data":"4724e6859d23635819befde48c7d762152743290c3577521d753dccc82343a3b"} Jun 11 20:05:42.600617 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:42.600567 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:05:42.696353 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:42.696292 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:05:43.483576 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:43.483537 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-pmplx" event={"ID":"f076b959-4daa-44e2-82fc-f34a05fdfe04","Type":"ContainerStarted","Data":"5b95c7a343e56747d0f34ea1c35401e4833b07bb316ffaf8d810516b7cd08dd0"} Jun 11 20:05:43.484009 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:43.483619 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-pmplx" Jun 11 20:05:43.501055 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:43.501005 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-pmplx" podStartSLOduration=1.513046321 podStartE2EDuration="4.500990156s" totalImagesPullingTime="2.987943835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:05:43.499579116 +0000 UTC m=+435.230741122" watchObservedRunningTime="2026-06-11 20:05:43.500990156 +0000 UTC m=+435.232152135" Jun 11 20:05:43.615007 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:43.614978 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxs847" Jun 11 20:05:43.789669 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:43.789632 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0a8ab5c-7737-444c-a292-a6c0c4f4fb96-bundle\") pod \"a0a8ab5c-7737-444c-a292-a6c0c4f4fb96\" (UID: \"a0a8ab5c-7737-444c-a292-a6c0c4f4fb96\") " Jun 11 20:05:43.789669 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:43.789672 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jc7vr\" (UniqueName: \"kubernetes.io/projected/a0a8ab5c-7737-444c-a292-a6c0c4f4fb96-kube-api-access-jc7vr\") pod \"a0a8ab5c-7737-444c-a292-a6c0c4f4fb96\" (UID: \"a0a8ab5c-7737-444c-a292-a6c0c4f4fb96\") " Jun 11 20:05:43.789914 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:43.789704 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0a8ab5c-7737-444c-a292-a6c0c4f4fb96-util\") pod \"a0a8ab5c-7737-444c-a292-a6c0c4f4fb96\" (UID: \"a0a8ab5c-7737-444c-a292-a6c0c4f4fb96\") " Jun 11 20:05:43.790062 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:43.790026 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0a8ab5c-7737-444c-a292-a6c0c4f4fb96-bundle" (OuterVolumeSpecName: "bundle") pod "a0a8ab5c-7737-444c-a292-a6c0c4f4fb96" (UID: "a0a8ab5c-7737-444c-a292-a6c0c4f4fb96"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:05:43.791899 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:43.791879 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0a8ab5c-7737-444c-a292-a6c0c4f4fb96-kube-api-access-jc7vr" (OuterVolumeSpecName: "kube-api-access-jc7vr") pod "a0a8ab5c-7737-444c-a292-a6c0c4f4fb96" (UID: "a0a8ab5c-7737-444c-a292-a6c0c4f4fb96"). InnerVolumeSpecName "kube-api-access-jc7vr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:05:43.795025 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:43.795000 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0a8ab5c-7737-444c-a292-a6c0c4f4fb96-util" (OuterVolumeSpecName: "util") pod "a0a8ab5c-7737-444c-a292-a6c0c4f4fb96" (UID: "a0a8ab5c-7737-444c-a292-a6c0c4f4fb96"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:05:43.891159 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:43.891072 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0a8ab5c-7737-444c-a292-a6c0c4f4fb96-bundle\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:05:43.891159 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:43.891105 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jc7vr\" (UniqueName: \"kubernetes.io/projected/a0a8ab5c-7737-444c-a292-a6c0c4f4fb96-kube-api-access-jc7vr\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:05:43.891159 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:43.891115 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0a8ab5c-7737-444c-a292-a6c0c4f4fb96-util\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:05:44.489885 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:44.489851 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxs847" event={"ID":"a0a8ab5c-7737-444c-a292-a6c0c4f4fb96","Type":"ContainerDied","Data":"511f364950b3885a14ad63c2c0daad6e7ca3e74ab46a4cc68dfc2e21173a493c"} Jun 11 20:05:44.489885 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:44.489878 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxs847" Jun 11 20:05:44.490327 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:44.489899 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="511f364950b3885a14ad63c2c0daad6e7ca3e74ab46a4cc68dfc2e21173a493c" Jun 11 20:05:46.013867 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:46.013835 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:05:46.116573 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:46.116545 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:05:47.862533 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:47.862505 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:05:48.022132 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:48.022094 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k8bwv"] Jun 11 20:05:48.022463 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:48.022449 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0a8ab5c-7737-444c-a292-a6c0c4f4fb96" containerName="util" Jun 11 20:05:48.022522 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:48.022465 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0a8ab5c-7737-444c-a292-a6c0c4f4fb96" containerName="util" Jun 11 20:05:48.022522 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:48.022480 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0a8ab5c-7737-444c-a292-a6c0c4f4fb96" containerName="pull" Jun 11 20:05:48.022522 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:48.022485 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0a8ab5c-7737-444c-a292-a6c0c4f4fb96" containerName="pull" Jun 11 20:05:48.022522 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:48.022503 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0a8ab5c-7737-444c-a292-a6c0c4f4fb96" containerName="extract" Jun 11 20:05:48.022522 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:48.022509 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0a8ab5c-7737-444c-a292-a6c0c4f4fb96" containerName="extract" Jun 11 20:05:48.022679 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:48.022558 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0a8ab5c-7737-444c-a292-a6c0c4f4fb96" containerName="extract" Jun 11 20:05:48.024549 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:48.024534 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k8bwv" Jun 11 20:05:48.027059 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:48.027036 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-fxmj9\"" Jun 11 20:05:48.027195 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:48.027062 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 20:05:48.028023 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:48.028004 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 20:05:48.035532 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:48.035507 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k8bwv"] Jun 11 20:05:48.128442 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:48.128340 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl9f6\" (UniqueName: \"kubernetes.io/projected/864a9b3b-6254-4d53-b7d0-32f840171a16-kube-api-access-cl9f6\") pod \"openshift-lws-operator-fd8ccff4c-k8bwv\" (UID: \"864a9b3b-6254-4d53-b7d0-32f840171a16\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k8bwv" Jun 11 20:05:48.128577 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:48.128457 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/864a9b3b-6254-4d53-b7d0-32f840171a16-tmp\") pod \"openshift-lws-operator-fd8ccff4c-k8bwv\" (UID: \"864a9b3b-6254-4d53-b7d0-32f840171a16\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k8bwv" Jun 11 20:05:48.229121 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:48.229084 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/864a9b3b-6254-4d53-b7d0-32f840171a16-tmp\") pod \"openshift-lws-operator-fd8ccff4c-k8bwv\" (UID: \"864a9b3b-6254-4d53-b7d0-32f840171a16\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k8bwv" Jun 11 20:05:48.229265 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:48.229140 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl9f6\" (UniqueName: \"kubernetes.io/projected/864a9b3b-6254-4d53-b7d0-32f840171a16-kube-api-access-cl9f6\") pod \"openshift-lws-operator-fd8ccff4c-k8bwv\" (UID: \"864a9b3b-6254-4d53-b7d0-32f840171a16\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k8bwv" Jun 11 20:05:48.229493 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:48.229475 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/864a9b3b-6254-4d53-b7d0-32f840171a16-tmp\") pod \"openshift-lws-operator-fd8ccff4c-k8bwv\" (UID: \"864a9b3b-6254-4d53-b7d0-32f840171a16\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k8bwv" Jun 11 20:05:48.237434 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:48.237412 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl9f6\" (UniqueName: \"kubernetes.io/projected/864a9b3b-6254-4d53-b7d0-32f840171a16-kube-api-access-cl9f6\") pod \"openshift-lws-operator-fd8ccff4c-k8bwv\" (UID: \"864a9b3b-6254-4d53-b7d0-32f840171a16\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k8bwv" Jun 11 20:05:48.333755 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:48.333717 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k8bwv" Jun 11 20:05:48.460972 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:48.460945 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k8bwv"] Jun 11 20:05:48.463151 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:05:48.463123 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod864a9b3b_6254_4d53_b7d0_32f840171a16.slice/crio-83e6106ca5ce3f8dabdbd2483d81f7955aea68cccd3b23f62515986d9636a60e WatchSource:0}: Error finding container 83e6106ca5ce3f8dabdbd2483d81f7955aea68cccd3b23f62515986d9636a60e: Status 404 returned error can't find the container with id 83e6106ca5ce3f8dabdbd2483d81f7955aea68cccd3b23f62515986d9636a60e Jun 11 20:05:48.508007 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:48.507975 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k8bwv" event={"ID":"864a9b3b-6254-4d53-b7d0-32f840171a16","Type":"ContainerStarted","Data":"83e6106ca5ce3f8dabdbd2483d81f7955aea68cccd3b23f62515986d9636a60e"} Jun 11 20:05:49.334832 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:49.334799 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:05:49.403307 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:49.403248 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:05:49.492836 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:49.492808 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-pmplx" Jun 11 20:05:50.519682 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:50.519650 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k8bwv" event={"ID":"864a9b3b-6254-4d53-b7d0-32f840171a16","Type":"ContainerStarted","Data":"b6c5e58f89ea6949eec8910599ef33e1b1dca959199ae7bbf5972d85390a4a0a"} Jun 11 20:05:50.537602 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:50.537552 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-k8bwv" podStartSLOduration=0.576665318 podStartE2EDuration="2.537537396s" totalImagesPullingTime="1.960872078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:05:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:05:50.535600351 +0000 UTC m=+442.266762331" watchObservedRunningTime="2026-06-11 20:05:50.537537396 +0000 UTC m=+442.268699370" Jun 11 20:05:51.212462 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:51.212429 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:05:51.313418 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:51.313352 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:05:53.074329 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:53.074296 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7prkh"] Jun 11 20:05:53.106778 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:53.106745 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7prkh"] Jun 11 20:05:53.106925 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:53.106857 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7prkh" Jun 11 20:05:53.109930 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:53.109907 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 20:05:53.110034 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:53.109934 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n7jmt\"" Jun 11 20:05:53.110921 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:53.110896 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 20:05:53.166193 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:53.166168 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/020fad75-3469-4af1-8e7a-ac191900d8a7-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7prkh\" (UID: \"020fad75-3469-4af1-8e7a-ac191900d8a7\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7prkh" Jun 11 20:05:53.166315 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:53.166196 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/020fad75-3469-4af1-8e7a-ac191900d8a7-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7prkh\" (UID: \"020fad75-3469-4af1-8e7a-ac191900d8a7\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7prkh" Jun 11 20:05:53.166315 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:53.166228 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlfxt\" (UniqueName: \"kubernetes.io/projected/020fad75-3469-4af1-8e7a-ac191900d8a7-kube-api-access-jlfxt\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7prkh\" (UID: \"020fad75-3469-4af1-8e7a-ac191900d8a7\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7prkh" Jun 11 20:05:53.267572 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:53.267531 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/020fad75-3469-4af1-8e7a-ac191900d8a7-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7prkh\" (UID: \"020fad75-3469-4af1-8e7a-ac191900d8a7\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7prkh" Jun 11 20:05:53.267765 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:53.267616 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlfxt\" (UniqueName: \"kubernetes.io/projected/020fad75-3469-4af1-8e7a-ac191900d8a7-kube-api-access-jlfxt\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7prkh\" (UID: \"020fad75-3469-4af1-8e7a-ac191900d8a7\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7prkh" Jun 11 20:05:53.267765 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:53.267703 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/020fad75-3469-4af1-8e7a-ac191900d8a7-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7prkh\" (UID: \"020fad75-3469-4af1-8e7a-ac191900d8a7\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7prkh" Jun 11 20:05:53.267922 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:53.267902 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/020fad75-3469-4af1-8e7a-ac191900d8a7-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7prkh\" (UID: \"020fad75-3469-4af1-8e7a-ac191900d8a7\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7prkh" Jun 11 20:05:53.268024 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:53.268003 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/020fad75-3469-4af1-8e7a-ac191900d8a7-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7prkh\" (UID: \"020fad75-3469-4af1-8e7a-ac191900d8a7\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7prkh" Jun 11 20:05:53.275704 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:53.275674 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlfxt\" (UniqueName: \"kubernetes.io/projected/020fad75-3469-4af1-8e7a-ac191900d8a7-kube-api-access-jlfxt\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7prkh\" (UID: \"020fad75-3469-4af1-8e7a-ac191900d8a7\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7prkh" Jun 11 20:05:53.416474 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:53.416442 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7prkh" Jun 11 20:05:53.565406 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:53.565365 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7prkh"] Jun 11 20:05:53.568013 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:05:53.567984 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod020fad75_3469_4af1_8e7a_ac191900d8a7.slice/crio-7355228f4db135ab0c42e57d03f251f7072a363055544f66b6b8aaf6cc6eaa5e WatchSource:0}: Error finding container 7355228f4db135ab0c42e57d03f251f7072a363055544f66b6b8aaf6cc6eaa5e: Status 404 returned error can't find the container with id 7355228f4db135ab0c42e57d03f251f7072a363055544f66b6b8aaf6cc6eaa5e Jun 11 20:05:53.675340 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:53.675275 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:05:54.546761 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:54.546671 2562 generic.go:356] "Generic (PLEG): container finished" podID="020fad75-3469-4af1-8e7a-ac191900d8a7" containerID="7e5f4af8d82ab09fb9a20c6721af0ce6494f01736e7f40c7cecd59b960d2b25c" exitCode=0 Jun 11 20:05:54.546761 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:54.546725 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7prkh" event={"ID":"020fad75-3469-4af1-8e7a-ac191900d8a7","Type":"ContainerDied","Data":"7e5f4af8d82ab09fb9a20c6721af0ce6494f01736e7f40c7cecd59b960d2b25c"} Jun 11 20:05:54.547158 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:54.546770 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7prkh" event={"ID":"020fad75-3469-4af1-8e7a-ac191900d8a7","Type":"ContainerStarted","Data":"7355228f4db135ab0c42e57d03f251f7072a363055544f66b6b8aaf6cc6eaa5e"} Jun 11 20:05:56.558433 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:56.558368 2562 generic.go:356] "Generic (PLEG): container finished" podID="020fad75-3469-4af1-8e7a-ac191900d8a7" containerID="0bb237105513f87281ae8dcf244eb86c8a43a9b0b0d5409a514bd89817894325" exitCode=0 Jun 11 20:05:56.558433 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:56.558410 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7prkh" event={"ID":"020fad75-3469-4af1-8e7a-ac191900d8a7","Type":"ContainerDied","Data":"0bb237105513f87281ae8dcf244eb86c8a43a9b0b0d5409a514bd89817894325"} Jun 11 20:05:57.564647 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:57.564614 2562 generic.go:356] "Generic (PLEG): container finished" podID="020fad75-3469-4af1-8e7a-ac191900d8a7" containerID="14b70ab7e786d8f1ab15f5a22306560c2063f2943720a6757bcb300cabba3e82" exitCode=0 Jun 11 20:05:57.565055 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:57.564708 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7prkh" event={"ID":"020fad75-3469-4af1-8e7a-ac191900d8a7","Type":"ContainerDied","Data":"14b70ab7e786d8f1ab15f5a22306560c2063f2943720a6757bcb300cabba3e82"} Jun 11 20:05:58.060701 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:58.060664 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-8swtg"] Jun 11 20:05:58.063171 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:58.063154 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-8swtg" Jun 11 20:05:58.065711 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:58.065683 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-k5vb8\"" Jun 11 20:05:58.072833 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:58.072811 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-8swtg"] Jun 11 20:05:58.109180 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:58.109140 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppzkt\" (UniqueName: \"kubernetes.io/projected/ba3fa6c0-75a2-44e3-a02d-3d038d594f23-kube-api-access-ppzkt\") pod \"cert-manager-59c77684cc-8swtg\" (UID: \"ba3fa6c0-75a2-44e3-a02d-3d038d594f23\") " pod="cert-manager/cert-manager-59c77684cc-8swtg" Jun 11 20:05:58.109180 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:58.109184 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba3fa6c0-75a2-44e3-a02d-3d038d594f23-bound-sa-token\") pod \"cert-manager-59c77684cc-8swtg\" (UID: \"ba3fa6c0-75a2-44e3-a02d-3d038d594f23\") " pod="cert-manager/cert-manager-59c77684cc-8swtg" Jun 11 20:05:58.209941 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:58.209901 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppzkt\" (UniqueName: \"kubernetes.io/projected/ba3fa6c0-75a2-44e3-a02d-3d038d594f23-kube-api-access-ppzkt\") pod \"cert-manager-59c77684cc-8swtg\" (UID: \"ba3fa6c0-75a2-44e3-a02d-3d038d594f23\") " pod="cert-manager/cert-manager-59c77684cc-8swtg" Jun 11 20:05:58.209941 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:58.209945 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba3fa6c0-75a2-44e3-a02d-3d038d594f23-bound-sa-token\") pod \"cert-manager-59c77684cc-8swtg\" (UID: \"ba3fa6c0-75a2-44e3-a02d-3d038d594f23\") " pod="cert-manager/cert-manager-59c77684cc-8swtg" Jun 11 20:05:58.218921 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:58.218886 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ba3fa6c0-75a2-44e3-a02d-3d038d594f23-bound-sa-token\") pod \"cert-manager-59c77684cc-8swtg\" (UID: \"ba3fa6c0-75a2-44e3-a02d-3d038d594f23\") " pod="cert-manager/cert-manager-59c77684cc-8swtg" Jun 11 20:05:58.219407 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:58.219365 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppzkt\" (UniqueName: \"kubernetes.io/projected/ba3fa6c0-75a2-44e3-a02d-3d038d594f23-kube-api-access-ppzkt\") pod \"cert-manager-59c77684cc-8swtg\" (UID: \"ba3fa6c0-75a2-44e3-a02d-3d038d594f23\") " pod="cert-manager/cert-manager-59c77684cc-8swtg" Jun 11 20:05:58.372827 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:58.372793 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-8swtg" Jun 11 20:05:58.503424 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:58.503397 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-8swtg"] Jun 11 20:05:58.505402 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:05:58.505354 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podba3fa6c0_75a2_44e3_a02d_3d038d594f23.slice/crio-d4dc6e63924da748902e3354900dd0ca7ea3ba11fdd18ca80a6ac1f1142ec406 WatchSource:0}: Error finding container d4dc6e63924da748902e3354900dd0ca7ea3ba11fdd18ca80a6ac1f1142ec406: Status 404 returned error can't find the container with id d4dc6e63924da748902e3354900dd0ca7ea3ba11fdd18ca80a6ac1f1142ec406 Jun 11 20:05:58.571312 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:58.571278 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-8swtg" event={"ID":"ba3fa6c0-75a2-44e3-a02d-3d038d594f23","Type":"ContainerStarted","Data":"bfcd0198f77ed195c79741c9fb579808ff388ca10a620a3912a94acae35bf2ee"} Jun 11 20:05:58.571696 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:58.571329 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-8swtg" event={"ID":"ba3fa6c0-75a2-44e3-a02d-3d038d594f23","Type":"ContainerStarted","Data":"d4dc6e63924da748902e3354900dd0ca7ea3ba11fdd18ca80a6ac1f1142ec406"} Jun 11 20:05:58.588544 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:58.588488 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-8swtg" podStartSLOduration=0.588466281 podStartE2EDuration="588.466281ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:05:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:05:58.586067805 +0000 UTC m=+450.317229781" watchObservedRunningTime="2026-06-11 20:05:58.588466281 +0000 UTC m=+450.319628258" Jun 11 20:05:58.692884 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:58.692860 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7prkh" Jun 11 20:05:58.713974 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:58.713948 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlfxt\" (UniqueName: \"kubernetes.io/projected/020fad75-3469-4af1-8e7a-ac191900d8a7-kube-api-access-jlfxt\") pod \"020fad75-3469-4af1-8e7a-ac191900d8a7\" (UID: \"020fad75-3469-4af1-8e7a-ac191900d8a7\") " Jun 11 20:05:58.714133 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:58.713990 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/020fad75-3469-4af1-8e7a-ac191900d8a7-bundle\") pod \"020fad75-3469-4af1-8e7a-ac191900d8a7\" (UID: \"020fad75-3469-4af1-8e7a-ac191900d8a7\") " Jun 11 20:05:58.714133 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:58.714118 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/020fad75-3469-4af1-8e7a-ac191900d8a7-util\") pod \"020fad75-3469-4af1-8e7a-ac191900d8a7\" (UID: \"020fad75-3469-4af1-8e7a-ac191900d8a7\") " Jun 11 20:05:58.714880 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:58.714853 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/020fad75-3469-4af1-8e7a-ac191900d8a7-bundle" (OuterVolumeSpecName: "bundle") pod "020fad75-3469-4af1-8e7a-ac191900d8a7" (UID: "020fad75-3469-4af1-8e7a-ac191900d8a7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:05:58.716210 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:58.716187 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/020fad75-3469-4af1-8e7a-ac191900d8a7-kube-api-access-jlfxt" (OuterVolumeSpecName: "kube-api-access-jlfxt") pod "020fad75-3469-4af1-8e7a-ac191900d8a7" (UID: "020fad75-3469-4af1-8e7a-ac191900d8a7"). InnerVolumeSpecName "kube-api-access-jlfxt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:05:58.719775 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:58.719749 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/020fad75-3469-4af1-8e7a-ac191900d8a7-util" (OuterVolumeSpecName: "util") pod "020fad75-3469-4af1-8e7a-ac191900d8a7" (UID: "020fad75-3469-4af1-8e7a-ac191900d8a7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:05:58.814804 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:58.814773 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/020fad75-3469-4af1-8e7a-ac191900d8a7-util\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:05:58.814804 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:58.814805 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlfxt\" (UniqueName: \"kubernetes.io/projected/020fad75-3469-4af1-8e7a-ac191900d8a7-kube-api-access-jlfxt\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:05:58.814804 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:58.814818 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/020fad75-3469-4af1-8e7a-ac191900d8a7-bundle\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:05:59.577473 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:59.577367 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7prkh" Jun 11 20:05:59.577473 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:59.577405 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd7prkh" event={"ID":"020fad75-3469-4af1-8e7a-ac191900d8a7","Type":"ContainerDied","Data":"7355228f4db135ab0c42e57d03f251f7072a363055544f66b6b8aaf6cc6eaa5e"} Jun 11 20:05:59.577473 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:05:59.577450 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7355228f4db135ab0c42e57d03f251f7072a363055544f66b6b8aaf6cc6eaa5e" Jun 11 20:06:11.999661 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:11.999629 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:12.095834 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:12.095797 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:12.610713 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:12.610679 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:12.904055 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:12.903961 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:13.006213 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.006177 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:13.046081 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.046052 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7878f89495-h5gr5"] Jun 11 20:06:13.046444 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.046427 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="020fad75-3469-4af1-8e7a-ac191900d8a7" containerName="extract" Jun 11 20:06:13.046501 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.046446 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="020fad75-3469-4af1-8e7a-ac191900d8a7" containerName="extract" Jun 11 20:06:13.046501 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.046456 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="020fad75-3469-4af1-8e7a-ac191900d8a7" containerName="util" Jun 11 20:06:13.046501 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.046461 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="020fad75-3469-4af1-8e7a-ac191900d8a7" containerName="util" Jun 11 20:06:13.046501 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.046484 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="020fad75-3469-4af1-8e7a-ac191900d8a7" containerName="pull" Jun 11 20:06:13.046501 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.046489 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="020fad75-3469-4af1-8e7a-ac191900d8a7" containerName="pull" Jun 11 20:06:13.046662 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.046541 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="020fad75-3469-4af1-8e7a-ac191900d8a7" containerName="extract" Jun 11 20:06:13.048499 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.048480 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7878f89495-h5gr5" Jun 11 20:06:13.054772 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.054748 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 20:06:13.054870 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.054759 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 20:06:13.054870 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.054794 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4n6n7\"" Jun 11 20:06:13.056414 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.056400 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 20:06:13.060601 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.060585 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 20:06:13.085662 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.085638 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7878f89495-h5gr5"] Jun 11 20:06:13.133191 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.133150 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/14d88d3b-766c-4372-92f5-eeb6ba517635-manifests\") pod \"opendatahub-operator-controller-manager-7878f89495-h5gr5\" (UID: \"14d88d3b-766c-4372-92f5-eeb6ba517635\") " pod="opendatahub/opendatahub-operator-controller-manager-7878f89495-h5gr5" Jun 11 20:06:13.133434 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.133221 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14d88d3b-766c-4372-92f5-eeb6ba517635-webhook-cert\") pod \"opendatahub-operator-controller-manager-7878f89495-h5gr5\" (UID: \"14d88d3b-766c-4372-92f5-eeb6ba517635\") " pod="opendatahub/opendatahub-operator-controller-manager-7878f89495-h5gr5" Jun 11 20:06:13.133434 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.133255 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14d88d3b-766c-4372-92f5-eeb6ba517635-tmp\") pod \"opendatahub-operator-controller-manager-7878f89495-h5gr5\" (UID: \"14d88d3b-766c-4372-92f5-eeb6ba517635\") " pod="opendatahub/opendatahub-operator-controller-manager-7878f89495-h5gr5" Jun 11 20:06:13.133434 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.133288 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/14d88d3b-766c-4372-92f5-eeb6ba517635-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7878f89495-h5gr5\" (UID: \"14d88d3b-766c-4372-92f5-eeb6ba517635\") " pod="opendatahub/opendatahub-operator-controller-manager-7878f89495-h5gr5" Jun 11 20:06:13.133434 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.133345 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq4v7\" (UniqueName: \"kubernetes.io/projected/14d88d3b-766c-4372-92f5-eeb6ba517635-kube-api-access-dq4v7\") pod \"opendatahub-operator-controller-manager-7878f89495-h5gr5\" (UID: \"14d88d3b-766c-4372-92f5-eeb6ba517635\") " pod="opendatahub/opendatahub-operator-controller-manager-7878f89495-h5gr5" Jun 11 20:06:13.210656 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.210508 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:13.234802 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.234772 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14d88d3b-766c-4372-92f5-eeb6ba517635-tmp\") pod \"opendatahub-operator-controller-manager-7878f89495-h5gr5\" (UID: \"14d88d3b-766c-4372-92f5-eeb6ba517635\") " pod="opendatahub/opendatahub-operator-controller-manager-7878f89495-h5gr5" Jun 11 20:06:13.234983 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.234833 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/14d88d3b-766c-4372-92f5-eeb6ba517635-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7878f89495-h5gr5\" (UID: \"14d88d3b-766c-4372-92f5-eeb6ba517635\") " pod="opendatahub/opendatahub-operator-controller-manager-7878f89495-h5gr5" Jun 11 20:06:13.234983 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.234866 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq4v7\" (UniqueName: \"kubernetes.io/projected/14d88d3b-766c-4372-92f5-eeb6ba517635-kube-api-access-dq4v7\") pod \"opendatahub-operator-controller-manager-7878f89495-h5gr5\" (UID: \"14d88d3b-766c-4372-92f5-eeb6ba517635\") " pod="opendatahub/opendatahub-operator-controller-manager-7878f89495-h5gr5" Jun 11 20:06:13.234983 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.234924 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/14d88d3b-766c-4372-92f5-eeb6ba517635-manifests\") pod \"opendatahub-operator-controller-manager-7878f89495-h5gr5\" (UID: \"14d88d3b-766c-4372-92f5-eeb6ba517635\") " pod="opendatahub/opendatahub-operator-controller-manager-7878f89495-h5gr5" Jun 11 20:06:13.234983 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.234973 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14d88d3b-766c-4372-92f5-eeb6ba517635-webhook-cert\") pod \"opendatahub-operator-controller-manager-7878f89495-h5gr5\" (UID: \"14d88d3b-766c-4372-92f5-eeb6ba517635\") " pod="opendatahub/opendatahub-operator-controller-manager-7878f89495-h5gr5" Jun 11 20:06:13.235350 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.235326 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/14d88d3b-766c-4372-92f5-eeb6ba517635-manifests\") pod \"opendatahub-operator-controller-manager-7878f89495-h5gr5\" (UID: \"14d88d3b-766c-4372-92f5-eeb6ba517635\") " pod="opendatahub/opendatahub-operator-controller-manager-7878f89495-h5gr5" Jun 11 20:06:13.237158 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.237134 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14d88d3b-766c-4372-92f5-eeb6ba517635-tmp\") pod \"opendatahub-operator-controller-manager-7878f89495-h5gr5\" (UID: \"14d88d3b-766c-4372-92f5-eeb6ba517635\") " pod="opendatahub/opendatahub-operator-controller-manager-7878f89495-h5gr5" Jun 11 20:06:13.237414 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.237396 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/14d88d3b-766c-4372-92f5-eeb6ba517635-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7878f89495-h5gr5\" (UID: \"14d88d3b-766c-4372-92f5-eeb6ba517635\") " pod="opendatahub/opendatahub-operator-controller-manager-7878f89495-h5gr5" Jun 11 20:06:13.237463 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.237449 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14d88d3b-766c-4372-92f5-eeb6ba517635-webhook-cert\") pod \"opendatahub-operator-controller-manager-7878f89495-h5gr5\" (UID: \"14d88d3b-766c-4372-92f5-eeb6ba517635\") " pod="opendatahub/opendatahub-operator-controller-manager-7878f89495-h5gr5" Jun 11 20:06:13.254107 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.254078 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq4v7\" (UniqueName: \"kubernetes.io/projected/14d88d3b-766c-4372-92f5-eeb6ba517635-kube-api-access-dq4v7\") pod \"opendatahub-operator-controller-manager-7878f89495-h5gr5\" (UID: \"14d88d3b-766c-4372-92f5-eeb6ba517635\") " pod="opendatahub/opendatahub-operator-controller-manager-7878f89495-h5gr5" Jun 11 20:06:13.311199 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.311165 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:13.359119 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.359087 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7878f89495-h5gr5" Jun 11 20:06:13.411910 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.411865 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:13.500876 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.500850 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7878f89495-h5gr5"] Jun 11 20:06:13.502708 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.502678 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:13.503109 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:06:13.503085 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14d88d3b_766c_4372_92f5_eeb6ba517635.slice/crio-caccdb43522a0cd33339d2faca3de30f61e80a70e918e62ac2a9ac2d4fea9501 WatchSource:0}: Error finding container caccdb43522a0cd33339d2faca3de30f61e80a70e918e62ac2a9ac2d4fea9501: Status 404 returned error can't find the container with id caccdb43522a0cd33339d2faca3de30f61e80a70e918e62ac2a9ac2d4fea9501 Jun 11 20:06:13.554422 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.554369 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:13.648904 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.648867 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7878f89495-h5gr5" event={"ID":"14d88d3b-766c-4372-92f5-eeb6ba517635","Type":"ContainerStarted","Data":"caccdb43522a0cd33339d2faca3de30f61e80a70e918e62ac2a9ac2d4fea9501"} Jun 11 20:06:13.655553 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.655517 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:13.756014 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.755931 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:13.857772 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:13.857732 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:16.666911 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:16.666828 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7878f89495-h5gr5" event={"ID":"14d88d3b-766c-4372-92f5-eeb6ba517635","Type":"ContainerStarted","Data":"be2342bf0001c1d46b5bef3f8cf7aee6c51ec7b99a5bdf46e2a6836f4429525d"} Jun 11 20:06:17.673557 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:17.673475 2562 generic.go:356] "Generic (PLEG): container finished" podID="14d88d3b-766c-4372-92f5-eeb6ba517635" containerID="be2342bf0001c1d46b5bef3f8cf7aee6c51ec7b99a5bdf46e2a6836f4429525d" exitCode=0 Jun 11 20:06:17.673905 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:17.673555 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7878f89495-h5gr5" event={"ID":"14d88d3b-766c-4372-92f5-eeb6ba517635","Type":"ContainerDied","Data":"be2342bf0001c1d46b5bef3f8cf7aee6c51ec7b99a5bdf46e2a6836f4429525d"} Jun 11 20:06:18.680223 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:18.680185 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7878f89495-h5gr5" event={"ID":"14d88d3b-766c-4372-92f5-eeb6ba517635","Type":"ContainerStarted","Data":"34d7e2bd1d1e7607efae3fcf8a4f6cd879181e8e788521a0875f625567cbb2c2"} Jun 11 20:06:18.680650 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:18.680308 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7878f89495-h5gr5" Jun 11 20:06:18.704951 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:18.704908 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7878f89495-h5gr5" podStartSLOduration=1.520234634 podStartE2EDuration="5.704893958s" totalImagesPullingTime="3.189505755s" totalInitContainerRuntime="995.153569ms" isStatefulPod=false podCreationTimestamp="2026-06-11 20:06:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:06:18.703090629 +0000 UTC m=+470.434252605" watchObservedRunningTime="2026-06-11 20:06:18.704893958 +0000 UTC m=+470.436055933" Jun 11 20:06:28.590817 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:28.590778 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:28.695453 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:28.695425 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:29.687257 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:29.687226 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7878f89495-h5gr5" Jun 11 20:06:31.801886 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:31.801854 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:31.958428 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:31.958365 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:32.511881 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:32.511847 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:32.805571 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:32.805484 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:32.913623 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:32.913589 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-59446c6fd7-sh7b5"] Jun 11 20:06:32.921088 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:32.921058 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59446c6fd7-sh7b5" Jun 11 20:06:32.923747 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:32.923721 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9slj5\"" Jun 11 20:06:32.923858 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:32.923802 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 20:06:32.924764 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:32.924748 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 20:06:32.929196 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:32.929076 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59446c6fd7-sh7b5"] Jun 11 20:06:33.004007 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.003962 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-5tzp4"] Jun 11 20:06:33.006537 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.006513 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-5tzp4" Jun 11 20:06:33.009162 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.009123 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-7g7kr\"" Jun 11 20:06:33.009302 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.009246 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 11 20:06:33.014178 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.014135 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:33.018577 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.018554 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-5tzp4"] Jun 11 20:06:33.018783 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.018764 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9525d310-8a99-4e98-8398-4b26851cde18-tls-certs\") pod \"kube-auth-proxy-59446c6fd7-sh7b5\" (UID: \"9525d310-8a99-4e98-8398-4b26851cde18\") " pod="openshift-ingress/kube-auth-proxy-59446c6fd7-sh7b5" Jun 11 20:06:33.018896 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.018879 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhrx2\" (UniqueName: \"kubernetes.io/projected/9525d310-8a99-4e98-8398-4b26851cde18-kube-api-access-bhrx2\") pod \"kube-auth-proxy-59446c6fd7-sh7b5\" (UID: \"9525d310-8a99-4e98-8398-4b26851cde18\") " pod="openshift-ingress/kube-auth-proxy-59446c6fd7-sh7b5" Jun 11 20:06:33.018944 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.018909 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9525d310-8a99-4e98-8398-4b26851cde18-tmp\") pod \"kube-auth-proxy-59446c6fd7-sh7b5\" (UID: \"9525d310-8a99-4e98-8398-4b26851cde18\") " pod="openshift-ingress/kube-auth-proxy-59446c6fd7-sh7b5" Jun 11 20:06:33.112967 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.112930 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:33.120176 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.120145 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cdea2e11-c0d5-43a7-be42-8ec414ff0a85-cert\") pod \"odh-model-controller-6dc94f689f-5tzp4\" (UID: \"cdea2e11-c0d5-43a7-be42-8ec414ff0a85\") " pod="opendatahub/odh-model-controller-6dc94f689f-5tzp4" Jun 11 20:06:33.120299 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.120259 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhrx2\" (UniqueName: \"kubernetes.io/projected/9525d310-8a99-4e98-8398-4b26851cde18-kube-api-access-bhrx2\") pod \"kube-auth-proxy-59446c6fd7-sh7b5\" (UID: \"9525d310-8a99-4e98-8398-4b26851cde18\") " pod="openshift-ingress/kube-auth-proxy-59446c6fd7-sh7b5" Jun 11 20:06:33.120299 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.120284 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9525d310-8a99-4e98-8398-4b26851cde18-tmp\") pod \"kube-auth-proxy-59446c6fd7-sh7b5\" (UID: \"9525d310-8a99-4e98-8398-4b26851cde18\") " pod="openshift-ingress/kube-auth-proxy-59446c6fd7-sh7b5" Jun 11 20:06:33.120448 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.120328 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9525d310-8a99-4e98-8398-4b26851cde18-tls-certs\") pod \"kube-auth-proxy-59446c6fd7-sh7b5\" (UID: \"9525d310-8a99-4e98-8398-4b26851cde18\") " pod="openshift-ingress/kube-auth-proxy-59446c6fd7-sh7b5" Jun 11 20:06:33.120448 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.120350 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44m9b\" (UniqueName: \"kubernetes.io/projected/cdea2e11-c0d5-43a7-be42-8ec414ff0a85-kube-api-access-44m9b\") pod \"odh-model-controller-6dc94f689f-5tzp4\" (UID: \"cdea2e11-c0d5-43a7-be42-8ec414ff0a85\") " pod="opendatahub/odh-model-controller-6dc94f689f-5tzp4" Jun 11 20:06:33.122820 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.122788 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9525d310-8a99-4e98-8398-4b26851cde18-tmp\") pod \"kube-auth-proxy-59446c6fd7-sh7b5\" (UID: \"9525d310-8a99-4e98-8398-4b26851cde18\") " pod="openshift-ingress/kube-auth-proxy-59446c6fd7-sh7b5" Jun 11 20:06:33.122990 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.122969 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9525d310-8a99-4e98-8398-4b26851cde18-tls-certs\") pod \"kube-auth-proxy-59446c6fd7-sh7b5\" (UID: \"9525d310-8a99-4e98-8398-4b26851cde18\") " pod="openshift-ingress/kube-auth-proxy-59446c6fd7-sh7b5" Jun 11 20:06:33.128922 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.128898 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhrx2\" (UniqueName: \"kubernetes.io/projected/9525d310-8a99-4e98-8398-4b26851cde18-kube-api-access-bhrx2\") pod \"kube-auth-proxy-59446c6fd7-sh7b5\" (UID: \"9525d310-8a99-4e98-8398-4b26851cde18\") " pod="openshift-ingress/kube-auth-proxy-59446c6fd7-sh7b5" Jun 11 20:06:33.216678 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.216648 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:33.221766 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.221738 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44m9b\" (UniqueName: \"kubernetes.io/projected/cdea2e11-c0d5-43a7-be42-8ec414ff0a85-kube-api-access-44m9b\") pod \"odh-model-controller-6dc94f689f-5tzp4\" (UID: \"cdea2e11-c0d5-43a7-be42-8ec414ff0a85\") " pod="opendatahub/odh-model-controller-6dc94f689f-5tzp4" Jun 11 20:06:33.221893 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.221777 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cdea2e11-c0d5-43a7-be42-8ec414ff0a85-cert\") pod \"odh-model-controller-6dc94f689f-5tzp4\" (UID: \"cdea2e11-c0d5-43a7-be42-8ec414ff0a85\") " pod="opendatahub/odh-model-controller-6dc94f689f-5tzp4" Jun 11 20:06:33.221952 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:06:33.221938 2562 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 11 20:06:33.222013 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:06:33.222004 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdea2e11-c0d5-43a7-be42-8ec414ff0a85-cert podName:cdea2e11-c0d5-43a7-be42-8ec414ff0a85 nodeName:}" failed. No retries permitted until 2026-06-11 20:06:33.721987392 +0000 UTC m=+485.453149346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cdea2e11-c0d5-43a7-be42-8ec414ff0a85-cert") pod "odh-model-controller-6dc94f689f-5tzp4" (UID: "cdea2e11-c0d5-43a7-be42-8ec414ff0a85") : secret "odh-model-controller-webhook-cert" not found Jun 11 20:06:33.231053 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.231019 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44m9b\" (UniqueName: \"kubernetes.io/projected/cdea2e11-c0d5-43a7-be42-8ec414ff0a85-kube-api-access-44m9b\") pod \"odh-model-controller-6dc94f689f-5tzp4\" (UID: \"cdea2e11-c0d5-43a7-be42-8ec414ff0a85\") " pod="opendatahub/odh-model-controller-6dc94f689f-5tzp4" Jun 11 20:06:33.232810 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.232792 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59446c6fd7-sh7b5" Jun 11 20:06:33.312771 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.312719 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:33.373429 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.373403 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59446c6fd7-sh7b5"] Jun 11 20:06:33.375243 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:06:33.375213 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9525d310_8a99_4e98_8398_4b26851cde18.slice/crio-5fc1ab765a64ea6e5b8910d9a670df5fa9f86e6193e6748dc978da2291a67f88 WatchSource:0}: Error finding container 5fc1ab765a64ea6e5b8910d9a670df5fa9f86e6193e6748dc978da2291a67f88: Status 404 returned error can't find the container with id 5fc1ab765a64ea6e5b8910d9a670df5fa9f86e6193e6748dc978da2291a67f88 Jun 11 20:06:33.442754 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.442720 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:33.727560 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.727449 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cdea2e11-c0d5-43a7-be42-8ec414ff0a85-cert\") pod \"odh-model-controller-6dc94f689f-5tzp4\" (UID: \"cdea2e11-c0d5-43a7-be42-8ec414ff0a85\") " pod="opendatahub/odh-model-controller-6dc94f689f-5tzp4" Jun 11 20:06:33.730000 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.729978 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cdea2e11-c0d5-43a7-be42-8ec414ff0a85-cert\") pod \"odh-model-controller-6dc94f689f-5tzp4\" (UID: \"cdea2e11-c0d5-43a7-be42-8ec414ff0a85\") " pod="opendatahub/odh-model-controller-6dc94f689f-5tzp4" Jun 11 20:06:33.753851 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.753819 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59446c6fd7-sh7b5" event={"ID":"9525d310-8a99-4e98-8398-4b26851cde18","Type":"ContainerStarted","Data":"5fc1ab765a64ea6e5b8910d9a670df5fa9f86e6193e6748dc978da2291a67f88"} Jun 11 20:06:33.808058 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.808016 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-j62p9"] Jun 11 20:06:33.811560 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.811536 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-j62p9" Jun 11 20:06:33.815180 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.815158 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 11 20:06:33.829366 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.829341 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-j62p9"] Jun 11 20:06:33.835828 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.835805 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:33.917422 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.917360 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-5tzp4" Jun 11 20:06:33.929987 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.929962 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/687973f1-c1c3-48cb-aabb-03674a0f4580-tls-certs\") pod \"model-serving-api-5dd488fc48-j62p9\" (UID: \"687973f1-c1c3-48cb-aabb-03674a0f4580\") " pod="opendatahub/model-serving-api-5dd488fc48-j62p9" Jun 11 20:06:33.930100 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:33.930023 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khkgc\" (UniqueName: \"kubernetes.io/projected/687973f1-c1c3-48cb-aabb-03674a0f4580-kube-api-access-khkgc\") pod \"model-serving-api-5dd488fc48-j62p9\" (UID: \"687973f1-c1c3-48cb-aabb-03674a0f4580\") " pod="opendatahub/model-serving-api-5dd488fc48-j62p9" Jun 11 20:06:34.031599 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:34.031553 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/687973f1-c1c3-48cb-aabb-03674a0f4580-tls-certs\") pod \"model-serving-api-5dd488fc48-j62p9\" (UID: \"687973f1-c1c3-48cb-aabb-03674a0f4580\") " pod="opendatahub/model-serving-api-5dd488fc48-j62p9" Jun 11 20:06:34.031774 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:34.031673 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khkgc\" (UniqueName: \"kubernetes.io/projected/687973f1-c1c3-48cb-aabb-03674a0f4580-kube-api-access-khkgc\") pod \"model-serving-api-5dd488fc48-j62p9\" (UID: \"687973f1-c1c3-48cb-aabb-03674a0f4580\") " pod="opendatahub/model-serving-api-5dd488fc48-j62p9" Jun 11 20:06:34.031774 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:06:34.031733 2562 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 11 20:06:34.031891 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:06:34.031808 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/687973f1-c1c3-48cb-aabb-03674a0f4580-tls-certs podName:687973f1-c1c3-48cb-aabb-03674a0f4580 nodeName:}" failed. No retries permitted until 2026-06-11 20:06:34.5317864 +0000 UTC m=+486.262948376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/687973f1-c1c3-48cb-aabb-03674a0f4580-tls-certs") pod "model-serving-api-5dd488fc48-j62p9" (UID: "687973f1-c1c3-48cb-aabb-03674a0f4580") : secret "model-serving-api-tls" not found Jun 11 20:06:34.045203 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:34.045114 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khkgc\" (UniqueName: \"kubernetes.io/projected/687973f1-c1c3-48cb-aabb-03674a0f4580-kube-api-access-khkgc\") pod \"model-serving-api-5dd488fc48-j62p9\" (UID: \"687973f1-c1c3-48cb-aabb-03674a0f4580\") " pod="opendatahub/model-serving-api-5dd488fc48-j62p9" Jun 11 20:06:34.055992 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:34.055927 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-5tzp4"] Jun 11 20:06:34.058609 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:06:34.058573 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdea2e11_c0d5_43a7_be42_8ec414ff0a85.slice/crio-83bc5c9b6e0200fa298f0fc7e2733ba5c3bcb5d086ebab9fa2e59de3bc281356 WatchSource:0}: Error finding container 83bc5c9b6e0200fa298f0fc7e2733ba5c3bcb5d086ebab9fa2e59de3bc281356: Status 404 returned error can't find the container with id 83bc5c9b6e0200fa298f0fc7e2733ba5c3bcb5d086ebab9fa2e59de3bc281356 Jun 11 20:06:34.209286 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:34.209244 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:34.409793 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:34.409756 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tx88j"] Jun 11 20:06:34.412696 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:34.412675 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tx88j" Jun 11 20:06:34.415648 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:34.415628 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 20:06:34.416617 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:34.416595 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n7jmt\"" Jun 11 20:06:34.416733 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:34.416642 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 20:06:34.422304 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:34.422242 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tx88j"] Jun 11 20:06:34.537999 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:34.537922 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6bf4\" (UniqueName: \"kubernetes.io/projected/d725e38a-0aaf-43b7-b627-69dfd2e55f74-kube-api-access-b6bf4\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tx88j\" (UID: \"d725e38a-0aaf-43b7-b627-69dfd2e55f74\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tx88j" Jun 11 20:06:34.538193 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:34.538029 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d725e38a-0aaf-43b7-b627-69dfd2e55f74-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tx88j\" (UID: \"d725e38a-0aaf-43b7-b627-69dfd2e55f74\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tx88j" Jun 11 20:06:34.538193 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:34.538130 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d725e38a-0aaf-43b7-b627-69dfd2e55f74-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tx88j\" (UID: \"d725e38a-0aaf-43b7-b627-69dfd2e55f74\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tx88j" Jun 11 20:06:34.538193 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:34.538186 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/687973f1-c1c3-48cb-aabb-03674a0f4580-tls-certs\") pod \"model-serving-api-5dd488fc48-j62p9\" (UID: \"687973f1-c1c3-48cb-aabb-03674a0f4580\") " pod="opendatahub/model-serving-api-5dd488fc48-j62p9" Jun 11 20:06:34.542266 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:34.542240 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/687973f1-c1c3-48cb-aabb-03674a0f4580-tls-certs\") pod \"model-serving-api-5dd488fc48-j62p9\" (UID: \"687973f1-c1c3-48cb-aabb-03674a0f4580\") " pod="opendatahub/model-serving-api-5dd488fc48-j62p9" Jun 11 20:06:34.639498 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:34.639443 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6bf4\" (UniqueName: \"kubernetes.io/projected/d725e38a-0aaf-43b7-b627-69dfd2e55f74-kube-api-access-b6bf4\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tx88j\" (UID: \"d725e38a-0aaf-43b7-b627-69dfd2e55f74\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tx88j" Jun 11 20:06:34.639701 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:34.639523 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d725e38a-0aaf-43b7-b627-69dfd2e55f74-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tx88j\" (UID: \"d725e38a-0aaf-43b7-b627-69dfd2e55f74\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tx88j" Jun 11 20:06:34.639701 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:34.639579 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d725e38a-0aaf-43b7-b627-69dfd2e55f74-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tx88j\" (UID: \"d725e38a-0aaf-43b7-b627-69dfd2e55f74\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tx88j" Jun 11 20:06:34.640136 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:34.640070 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d725e38a-0aaf-43b7-b627-69dfd2e55f74-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tx88j\" (UID: \"d725e38a-0aaf-43b7-b627-69dfd2e55f74\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tx88j" Jun 11 20:06:34.640136 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:34.640127 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d725e38a-0aaf-43b7-b627-69dfd2e55f74-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tx88j\" (UID: \"d725e38a-0aaf-43b7-b627-69dfd2e55f74\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tx88j" Jun 11 20:06:34.649197 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:34.649159 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6bf4\" (UniqueName: \"kubernetes.io/projected/d725e38a-0aaf-43b7-b627-69dfd2e55f74-kube-api-access-b6bf4\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tx88j\" (UID: \"d725e38a-0aaf-43b7-b627-69dfd2e55f74\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tx88j" Jun 11 20:06:34.721751 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:34.721636 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-j62p9" Jun 11 20:06:34.727213 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:34.727172 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tx88j" Jun 11 20:06:34.763683 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:34.763243 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-5tzp4" event={"ID":"cdea2e11-c0d5-43a7-be42-8ec414ff0a85","Type":"ContainerStarted","Data":"83bc5c9b6e0200fa298f0fc7e2733ba5c3bcb5d086ebab9fa2e59de3bc281356"} Jun 11 20:06:34.927224 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:34.927189 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-j62p9"] Jun 11 20:06:34.928711 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:06:34.928680 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod687973f1_c1c3_48cb_aabb_03674a0f4580.slice/crio-e21679dae7da55b1d62c6bc78fd7f8b7dd55a44452fefcffb41a8ad65cf1a5f1 WatchSource:0}: Error finding container e21679dae7da55b1d62c6bc78fd7f8b7dd55a44452fefcffb41a8ad65cf1a5f1: Status 404 returned error can't find the container with id e21679dae7da55b1d62c6bc78fd7f8b7dd55a44452fefcffb41a8ad65cf1a5f1 Jun 11 20:06:34.950291 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:34.950215 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tx88j"] Jun 11 20:06:34.954750 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:06:34.954715 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd725e38a_0aaf_43b7_b627_69dfd2e55f74.slice/crio-8e69324fcb4b5fc7bd06eb3f89d4b55abd4e4bfd8e2cece60e60f2d31c327dd4 WatchSource:0}: Error finding container 8e69324fcb4b5fc7bd06eb3f89d4b55abd4e4bfd8e2cece60e60f2d31c327dd4: Status 404 returned error can't find the container with id 8e69324fcb4b5fc7bd06eb3f89d4b55abd4e4bfd8e2cece60e60f2d31c327dd4 Jun 11 20:06:35.771141 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:35.771109 2562 generic.go:356] "Generic (PLEG): container finished" podID="d725e38a-0aaf-43b7-b627-69dfd2e55f74" containerID="d64c1aca5291e9862adb92f058bb91191dd6c7724c33f237de52a8b8895a82a1" exitCode=0 Jun 11 20:06:35.771322 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:35.771193 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tx88j" event={"ID":"d725e38a-0aaf-43b7-b627-69dfd2e55f74","Type":"ContainerDied","Data":"d64c1aca5291e9862adb92f058bb91191dd6c7724c33f237de52a8b8895a82a1"} Jun 11 20:06:35.771322 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:35.771247 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tx88j" event={"ID":"d725e38a-0aaf-43b7-b627-69dfd2e55f74","Type":"ContainerStarted","Data":"8e69324fcb4b5fc7bd06eb3f89d4b55abd4e4bfd8e2cece60e60f2d31c327dd4"} Jun 11 20:06:35.773044 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:35.773021 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-j62p9" event={"ID":"687973f1-c1c3-48cb-aabb-03674a0f4580","Type":"ContainerStarted","Data":"e21679dae7da55b1d62c6bc78fd7f8b7dd55a44452fefcffb41a8ad65cf1a5f1"} Jun 11 20:06:38.234114 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:38.234066 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:38.791018 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:38.790908 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-5tzp4" event={"ID":"cdea2e11-c0d5-43a7-be42-8ec414ff0a85","Type":"ContainerStarted","Data":"90dedc168c81df97b480d73fb04dc669bf6a1fb877640c11711d57f7de696889"} Jun 11 20:06:38.791206 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:38.791039 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-5tzp4" Jun 11 20:06:38.792709 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:38.792668 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59446c6fd7-sh7b5" event={"ID":"9525d310-8a99-4e98-8398-4b26851cde18","Type":"ContainerStarted","Data":"a34c160c6a2311592bf9e068e3b4aeacbe80a44922eae3d3de6b499ec8e602dd"} Jun 11 20:06:38.795108 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:38.795086 2562 generic.go:356] "Generic (PLEG): container finished" podID="d725e38a-0aaf-43b7-b627-69dfd2e55f74" containerID="8711d261e2d460a95775578972a30175b6ae760e4447fbf37c314f57ba24a3da" exitCode=0 Jun 11 20:06:38.795221 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:38.795171 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tx88j" event={"ID":"d725e38a-0aaf-43b7-b627-69dfd2e55f74","Type":"ContainerDied","Data":"8711d261e2d460a95775578972a30175b6ae760e4447fbf37c314f57ba24a3da"} Jun 11 20:06:38.797101 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:38.797075 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-j62p9" event={"ID":"687973f1-c1c3-48cb-aabb-03674a0f4580","Type":"ContainerStarted","Data":"16642f146b3efc2f91affe094938e37ecb74ea42e350b3d1c8209c245fca3bad"} Jun 11 20:06:38.797223 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:38.797206 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-j62p9" Jun 11 20:06:38.810433 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:38.810362 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-5tzp4" podStartSLOduration=2.51079128 podStartE2EDuration="6.810343732s" totalImagesPullingTime="4.299552452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:06:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:06:38.807716601 +0000 UTC m=+490.538878586" watchObservedRunningTime="2026-06-11 20:06:38.810343732 +0000 UTC m=+490.541505708" Jun 11 20:06:38.824853 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:38.824801 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-59446c6fd7-sh7b5" podStartSLOduration=1.809625616 podStartE2EDuration="6.824788656s" totalImagesPullingTime="5.01516304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:06:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:06:38.824330536 +0000 UTC m=+490.555492511" watchObservedRunningTime="2026-06-11 20:06:38.824788656 +0000 UTC m=+490.555950632" Jun 11 20:06:38.865420 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:38.865346 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-j62p9" podStartSLOduration=2.393723494 podStartE2EDuration="5.865329346s" totalImagesPullingTime="3.471605852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:06:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:06:38.86299672 +0000 UTC m=+490.594158692" watchObservedRunningTime="2026-06-11 20:06:38.865329346 +0000 UTC m=+490.596491320" Jun 11 20:06:39.804762 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:39.804726 2562 generic.go:356] "Generic (PLEG): container finished" podID="d725e38a-0aaf-43b7-b627-69dfd2e55f74" containerID="2718219fcf69d683c0c5448363e7fc2e709087e68455b54fc672f83a9b9f35ea" exitCode=0 Jun 11 20:06:39.805254 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:39.804799 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tx88j" event={"ID":"d725e38a-0aaf-43b7-b627-69dfd2e55f74","Type":"ContainerDied","Data":"2718219fcf69d683c0c5448363e7fc2e709087e68455b54fc672f83a9b9f35ea"} Jun 11 20:06:40.666799 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:40.666761 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:40.767592 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:40.767556 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:40.943093 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:40.943068 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tx88j" Jun 11 20:06:41.106248 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:41.106203 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6bf4\" (UniqueName: \"kubernetes.io/projected/d725e38a-0aaf-43b7-b627-69dfd2e55f74-kube-api-access-b6bf4\") pod \"d725e38a-0aaf-43b7-b627-69dfd2e55f74\" (UID: \"d725e38a-0aaf-43b7-b627-69dfd2e55f74\") " Jun 11 20:06:41.106450 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:41.106268 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d725e38a-0aaf-43b7-b627-69dfd2e55f74-bundle\") pod \"d725e38a-0aaf-43b7-b627-69dfd2e55f74\" (UID: \"d725e38a-0aaf-43b7-b627-69dfd2e55f74\") " Jun 11 20:06:41.106450 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:41.106438 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d725e38a-0aaf-43b7-b627-69dfd2e55f74-util\") pod \"d725e38a-0aaf-43b7-b627-69dfd2e55f74\" (UID: \"d725e38a-0aaf-43b7-b627-69dfd2e55f74\") " Jun 11 20:06:41.107484 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:41.107454 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d725e38a-0aaf-43b7-b627-69dfd2e55f74-bundle" (OuterVolumeSpecName: "bundle") pod "d725e38a-0aaf-43b7-b627-69dfd2e55f74" (UID: "d725e38a-0aaf-43b7-b627-69dfd2e55f74"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:06:41.108567 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:41.108547 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d725e38a-0aaf-43b7-b627-69dfd2e55f74-kube-api-access-b6bf4" (OuterVolumeSpecName: "kube-api-access-b6bf4") pod "d725e38a-0aaf-43b7-b627-69dfd2e55f74" (UID: "d725e38a-0aaf-43b7-b627-69dfd2e55f74"). InnerVolumeSpecName "kube-api-access-b6bf4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:06:41.111992 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:41.111968 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d725e38a-0aaf-43b7-b627-69dfd2e55f74-util" (OuterVolumeSpecName: "util") pod "d725e38a-0aaf-43b7-b627-69dfd2e55f74" (UID: "d725e38a-0aaf-43b7-b627-69dfd2e55f74"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:06:41.207131 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:41.207048 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d725e38a-0aaf-43b7-b627-69dfd2e55f74-util\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:06:41.207131 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:41.207077 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6bf4\" (UniqueName: \"kubernetes.io/projected/d725e38a-0aaf-43b7-b627-69dfd2e55f74-kube-api-access-b6bf4\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:06:41.207131 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:41.207087 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d725e38a-0aaf-43b7-b627-69dfd2e55f74-bundle\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:06:41.816362 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:41.816319 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tx88j" event={"ID":"d725e38a-0aaf-43b7-b627-69dfd2e55f74","Type":"ContainerDied","Data":"8e69324fcb4b5fc7bd06eb3f89d4b55abd4e4bfd8e2cece60e60f2d31c327dd4"} Jun 11 20:06:41.816362 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:41.816350 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06tx88j" Jun 11 20:06:41.816577 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:41.816370 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8e69324fcb4b5fc7bd06eb3f89d4b55abd4e4bfd8e2cece60e60f2d31c327dd4" Jun 11 20:06:42.980639 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:42.980609 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:43.069031 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:43.068998 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:43.464842 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:43.464812 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:43.579989 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:43.579951 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:43.680341 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:43.680311 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:43.682013 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:43.681993 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-lz7x9"] Jun 11 20:06:43.682501 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:43.682454 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d725e38a-0aaf-43b7-b627-69dfd2e55f74" containerName="util" Jun 11 20:06:43.682501 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:43.682474 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d725e38a-0aaf-43b7-b627-69dfd2e55f74" containerName="util" Jun 11 20:06:43.682501 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:43.682491 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d725e38a-0aaf-43b7-b627-69dfd2e55f74" containerName="extract" Jun 11 20:06:43.682501 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:43.682498 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d725e38a-0aaf-43b7-b627-69dfd2e55f74" containerName="extract" Jun 11 20:06:43.682677 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:43.682522 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d725e38a-0aaf-43b7-b627-69dfd2e55f74" containerName="pull" Jun 11 20:06:43.682677 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:43.682528 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d725e38a-0aaf-43b7-b627-69dfd2e55f74" containerName="pull" Jun 11 20:06:43.682677 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:43.682590 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d725e38a-0aaf-43b7-b627-69dfd2e55f74" containerName="extract" Jun 11 20:06:43.685630 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:43.685615 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-lz7x9" Jun 11 20:06:43.688402 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:43.688367 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 11 20:06:43.688596 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:43.688579 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-wss6g\"" Jun 11 20:06:43.695439 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:43.695413 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-fcsgz"] Jun 11 20:06:43.698798 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:43.698778 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fcsgz" Jun 11 20:06:43.700551 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:43.700527 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-lz7x9"] Jun 11 20:06:43.701477 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:43.701454 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-d7xgm\"" Jun 11 20:06:43.701583 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:43.701460 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 11 20:06:43.718476 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:43.718405 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-fcsgz"] Jun 11 20:06:43.725772 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:43.725739 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxr6h\" (UniqueName: \"kubernetes.io/projected/76515318-fcd6-4033-9844-1526375a58d1-kube-api-access-mxr6h\") pod \"kserve-controller-manager-69fc866d76-lz7x9\" (UID: \"76515318-fcd6-4033-9844-1526375a58d1\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lz7x9" Jun 11 20:06:43.725906 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:43.725851 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd0ac29f-247b-4357-a237-5c6ec750b9d0-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-fcsgz\" (UID: \"bd0ac29f-247b-4357-a237-5c6ec750b9d0\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fcsgz" Jun 11 20:06:43.725951 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:43.725903 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76515318-fcd6-4033-9844-1526375a58d1-cert\") pod \"kserve-controller-manager-69fc866d76-lz7x9\" (UID: \"76515318-fcd6-4033-9844-1526375a58d1\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lz7x9" Jun 11 20:06:43.726006 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:43.725984 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpzhl\" (UniqueName: \"kubernetes.io/projected/bd0ac29f-247b-4357-a237-5c6ec750b9d0-kube-api-access-xpzhl\") pod \"llmisvc-controller-manager-864bfd7bc9-fcsgz\" (UID: \"bd0ac29f-247b-4357-a237-5c6ec750b9d0\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fcsgz" Jun 11 20:06:43.750625 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:43.750597 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:43.826497 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:43.826470 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd0ac29f-247b-4357-a237-5c6ec750b9d0-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-fcsgz\" (UID: \"bd0ac29f-247b-4357-a237-5c6ec750b9d0\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fcsgz" Jun 11 20:06:43.826654 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:43.826507 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76515318-fcd6-4033-9844-1526375a58d1-cert\") pod \"kserve-controller-manager-69fc866d76-lz7x9\" (UID: \"76515318-fcd6-4033-9844-1526375a58d1\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lz7x9" Jun 11 20:06:43.826654 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:43.826585 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpzhl\" (UniqueName: \"kubernetes.io/projected/bd0ac29f-247b-4357-a237-5c6ec750b9d0-kube-api-access-xpzhl\") pod \"llmisvc-controller-manager-864bfd7bc9-fcsgz\" (UID: \"bd0ac29f-247b-4357-a237-5c6ec750b9d0\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fcsgz" Jun 11 20:06:43.826654 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:06:43.826610 2562 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 11 20:06:43.826654 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:43.826636 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxr6h\" (UniqueName: \"kubernetes.io/projected/76515318-fcd6-4033-9844-1526375a58d1-kube-api-access-mxr6h\") pod \"kserve-controller-manager-69fc866d76-lz7x9\" (UID: \"76515318-fcd6-4033-9844-1526375a58d1\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lz7x9" Jun 11 20:06:43.826654 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:06:43.826639 2562 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 11 20:06:43.826915 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:06:43.826672 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd0ac29f-247b-4357-a237-5c6ec750b9d0-cert podName:bd0ac29f-247b-4357-a237-5c6ec750b9d0 nodeName:}" failed. No retries permitted until 2026-06-11 20:06:44.326656544 +0000 UTC m=+496.057818500 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bd0ac29f-247b-4357-a237-5c6ec750b9d0-cert") pod "llmisvc-controller-manager-864bfd7bc9-fcsgz" (UID: "bd0ac29f-247b-4357-a237-5c6ec750b9d0") : secret "llmisvc-webhook-server-cert" not found Jun 11 20:06:43.826915 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:06:43.826704 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76515318-fcd6-4033-9844-1526375a58d1-cert podName:76515318-fcd6-4033-9844-1526375a58d1 nodeName:}" failed. No retries permitted until 2026-06-11 20:06:44.326687274 +0000 UTC m=+496.057849230 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/76515318-fcd6-4033-9844-1526375a58d1-cert") pod "kserve-controller-manager-69fc866d76-lz7x9" (UID: "76515318-fcd6-4033-9844-1526375a58d1") : secret "kserve-webhook-server-cert" not found Jun 11 20:06:43.836720 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:43.836693 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpzhl\" (UniqueName: \"kubernetes.io/projected/bd0ac29f-247b-4357-a237-5c6ec750b9d0-kube-api-access-xpzhl\") pod \"llmisvc-controller-manager-864bfd7bc9-fcsgz\" (UID: \"bd0ac29f-247b-4357-a237-5c6ec750b9d0\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fcsgz" Jun 11 20:06:43.837010 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:43.836989 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxr6h\" (UniqueName: \"kubernetes.io/projected/76515318-fcd6-4033-9844-1526375a58d1-kube-api-access-mxr6h\") pod \"kserve-controller-manager-69fc866d76-lz7x9\" (UID: \"76515318-fcd6-4033-9844-1526375a58d1\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lz7x9" Jun 11 20:06:44.037404 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:44.037300 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:44.241668 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:44.241638 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:44.331486 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:44.331457 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd0ac29f-247b-4357-a237-5c6ec750b9d0-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-fcsgz\" (UID: \"bd0ac29f-247b-4357-a237-5c6ec750b9d0\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fcsgz" Jun 11 20:06:44.331650 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:44.331502 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76515318-fcd6-4033-9844-1526375a58d1-cert\") pod \"kserve-controller-manager-69fc866d76-lz7x9\" (UID: \"76515318-fcd6-4033-9844-1526375a58d1\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lz7x9" Jun 11 20:06:44.334077 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:44.334050 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76515318-fcd6-4033-9844-1526375a58d1-cert\") pod \"kserve-controller-manager-69fc866d76-lz7x9\" (UID: \"76515318-fcd6-4033-9844-1526375a58d1\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lz7x9" Jun 11 20:06:44.334197 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:44.334157 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd0ac29f-247b-4357-a237-5c6ec750b9d0-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-fcsgz\" (UID: \"bd0ac29f-247b-4357-a237-5c6ec750b9d0\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fcsgz" Jun 11 20:06:44.596332 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:44.596236 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-lz7x9" Jun 11 20:06:44.609585 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:44.609564 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fcsgz" Jun 11 20:06:44.744315 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:44.744288 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-lz7x9"] Jun 11 20:06:44.746332 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:06:44.746302 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76515318_fcd6_4033_9844_1526375a58d1.slice/crio-5f3811812dc397c37a508dd8dd270a3d13d9dca4a3f00bcdadf8cd087c766797 WatchSource:0}: Error finding container 5f3811812dc397c37a508dd8dd270a3d13d9dca4a3f00bcdadf8cd087c766797: Status 404 returned error can't find the container with id 5f3811812dc397c37a508dd8dd270a3d13d9dca4a3f00bcdadf8cd087c766797 Jun 11 20:06:44.773621 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:44.773599 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-fcsgz"] Jun 11 20:06:44.775295 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:06:44.775255 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbd0ac29f_247b_4357_a237_5c6ec750b9d0.slice/crio-17bee04077b7475750c7675fac141a63e5c4f7875275c73e215777318b9ede50 WatchSource:0}: Error finding container 17bee04077b7475750c7675fac141a63e5c4f7875275c73e215777318b9ede50: Status 404 returned error can't find the container with id 17bee04077b7475750c7675fac141a63e5c4f7875275c73e215777318b9ede50 Jun 11 20:06:44.832299 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:44.832258 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fcsgz" event={"ID":"bd0ac29f-247b-4357-a237-5c6ec750b9d0","Type":"ContainerStarted","Data":"17bee04077b7475750c7675fac141a63e5c4f7875275c73e215777318b9ede50"} Jun 11 20:06:44.833352 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:44.833330 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-lz7x9" event={"ID":"76515318-fcd6-4033-9844-1526375a58d1","Type":"ContainerStarted","Data":"5f3811812dc397c37a508dd8dd270a3d13d9dca4a3f00bcdadf8cd087c766797"} Jun 11 20:06:44.968764 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:44.968680 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:45.105309 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:45.105278 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:47.854731 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:47.854679 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-lz7x9" event={"ID":"76515318-fcd6-4033-9844-1526375a58d1","Type":"ContainerStarted","Data":"5f99d846f0828f27885ba6488c07e477019c86a7eb849e94734ee4b728473d17"} Jun 11 20:06:47.855128 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:47.854778 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-lz7x9" Jun 11 20:06:47.901089 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:47.901023 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-lz7x9" podStartSLOduration=2.45141466 podStartE2EDuration="4.901003739s" totalImagesPullingTime="2.449589079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:06:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:06:47.897016019 +0000 UTC m=+499.628178006" watchObservedRunningTime="2026-06-11 20:06:47.901003739 +0000 UTC m=+499.632165715" Jun 11 20:06:48.861792 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:48.861757 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fcsgz" event={"ID":"bd0ac29f-247b-4357-a237-5c6ec750b9d0","Type":"ContainerStarted","Data":"c044b9f0ddc85f79061f2d69a8ca5bcc3131d2f1500672991e443378af0e3c25"} Jun 11 20:06:48.862175 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:48.861996 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fcsgz" Jun 11 20:06:48.907096 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:48.907036 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fcsgz" podStartSLOduration=2.618630651 podStartE2EDuration="5.906983548s" totalImagesPullingTime="3.288352897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:06:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:06:48.905199738 +0000 UTC m=+500.636361712" watchObservedRunningTime="2026-06-11 20:06:48.906983548 +0000 UTC m=+500.638145522" Jun 11 20:06:49.802794 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:49.802763 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:49.807537 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:49.807516 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-5tzp4" Jun 11 20:06:49.809388 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:49.809350 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-j62p9" Jun 11 20:06:53.857996 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:53.857938 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:53.955571 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:53.955539 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:55.087164 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:55.087132 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:55.212082 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:55.212052 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:55.837930 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:55.837902 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:55.945722 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:55.945689 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ak7v2k"] Jun 11 20:06:55.952396 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:55.952360 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:55.955404 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:55.955368 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ak7v2k" Jun 11 20:06:55.958178 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:55.958154 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 20:06:55.959434 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:55.959418 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n7jmt\"" Jun 11 20:06:55.959532 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:55.959434 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 20:06:55.970687 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:55.970667 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ak7v2k"] Jun 11 20:06:56.035702 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:56.035669 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc0ae559-75bf-4e8a-a996-5fdb1d3b07db-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ak7v2k\" (UID: \"dc0ae559-75bf-4e8a-a996-5fdb1d3b07db\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ak7v2k" Jun 11 20:06:56.035877 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:56.035709 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc0ae559-75bf-4e8a-a996-5fdb1d3b07db-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ak7v2k\" (UID: \"dc0ae559-75bf-4e8a-a996-5fdb1d3b07db\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ak7v2k" Jun 11 20:06:56.035877 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:56.035777 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwgts\" (UniqueName: \"kubernetes.io/projected/dc0ae559-75bf-4e8a-a996-5fdb1d3b07db-kube-api-access-bwgts\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ak7v2k\" (UID: \"dc0ae559-75bf-4e8a-a996-5fdb1d3b07db\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ak7v2k" Jun 11 20:06:56.136872 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:56.136788 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc0ae559-75bf-4e8a-a996-5fdb1d3b07db-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ak7v2k\" (UID: \"dc0ae559-75bf-4e8a-a996-5fdb1d3b07db\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ak7v2k" Jun 11 20:06:56.136872 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:56.136834 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc0ae559-75bf-4e8a-a996-5fdb1d3b07db-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ak7v2k\" (UID: \"dc0ae559-75bf-4e8a-a996-5fdb1d3b07db\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ak7v2k" Jun 11 20:06:56.136872 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:56.136864 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwgts\" (UniqueName: \"kubernetes.io/projected/dc0ae559-75bf-4e8a-a996-5fdb1d3b07db-kube-api-access-bwgts\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ak7v2k\" (UID: \"dc0ae559-75bf-4e8a-a996-5fdb1d3b07db\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ak7v2k" Jun 11 20:06:56.137309 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:56.137228 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc0ae559-75bf-4e8a-a996-5fdb1d3b07db-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ak7v2k\" (UID: \"dc0ae559-75bf-4e8a-a996-5fdb1d3b07db\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ak7v2k" Jun 11 20:06:56.137309 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:56.137239 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc0ae559-75bf-4e8a-a996-5fdb1d3b07db-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ak7v2k\" (UID: \"dc0ae559-75bf-4e8a-a996-5fdb1d3b07db\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ak7v2k" Jun 11 20:06:56.152893 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:56.152865 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwgts\" (UniqueName: \"kubernetes.io/projected/dc0ae559-75bf-4e8a-a996-5fdb1d3b07db-kube-api-access-bwgts\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ak7v2k\" (UID: \"dc0ae559-75bf-4e8a-a996-5fdb1d3b07db\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ak7v2k" Jun 11 20:06:56.247597 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:56.247565 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:56.265147 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:56.265118 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ak7v2k" Jun 11 20:06:56.410445 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:56.410054 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ak7v2k"] Jun 11 20:06:56.410801 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:06:56.410771 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc0ae559_75bf_4e8a_a996_5fdb1d3b07db.slice/crio-7d4e430279f23808a83755734cd23802161344ae485672239d967414efb7ed16 WatchSource:0}: Error finding container 7d4e430279f23808a83755734cd23802161344ae485672239d967414efb7ed16: Status 404 returned error can't find the container with id 7d4e430279f23808a83755734cd23802161344ae485672239d967414efb7ed16 Jun 11 20:06:56.904980 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:56.904944 2562 generic.go:356] "Generic (PLEG): container finished" podID="dc0ae559-75bf-4e8a-a996-5fdb1d3b07db" containerID="268e177531ba00628123365799f4cc9e517a2b6c63d7caea5534dd21e0c135fa" exitCode=0 Jun 11 20:06:56.905158 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:56.905027 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ak7v2k" event={"ID":"dc0ae559-75bf-4e8a-a996-5fdb1d3b07db","Type":"ContainerDied","Data":"268e177531ba00628123365799f4cc9e517a2b6c63d7caea5534dd21e0c135fa"} Jun 11 20:06:56.905158 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:56.905073 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ak7v2k" event={"ID":"dc0ae559-75bf-4e8a-a996-5fdb1d3b07db","Type":"ContainerStarted","Data":"7d4e430279f23808a83755734cd23802161344ae485672239d967414efb7ed16"} Jun 11 20:06:57.288966 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:57.288936 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:57.468281 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:57.468198 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:06:58.161937 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:58.161905 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-h9z5k"] Jun 11 20:06:58.164784 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:58.164761 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-h9z5k" Jun 11 20:06:58.171162 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:58.171132 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-nl22g\"" Jun 11 20:06:58.171294 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:58.171243 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 11 20:06:58.176218 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:58.176200 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 11 20:06:58.200641 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:58.200601 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-h9z5k"] Jun 11 20:06:58.254781 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:58.254748 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/f22c38af-6224-4c80-aa72-875a36abceaa-operator-config\") pod \"servicemesh-operator3-57f65f65fb-h9z5k\" (UID: \"f22c38af-6224-4c80-aa72-875a36abceaa\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-h9z5k" Jun 11 20:06:58.254962 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:58.254795 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6b7k\" (UniqueName: \"kubernetes.io/projected/f22c38af-6224-4c80-aa72-875a36abceaa-kube-api-access-r6b7k\") pod \"servicemesh-operator3-57f65f65fb-h9z5k\" (UID: \"f22c38af-6224-4c80-aa72-875a36abceaa\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-h9z5k" Jun 11 20:06:58.355244 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:58.355208 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/f22c38af-6224-4c80-aa72-875a36abceaa-operator-config\") pod \"servicemesh-operator3-57f65f65fb-h9z5k\" (UID: \"f22c38af-6224-4c80-aa72-875a36abceaa\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-h9z5k" Jun 11 20:06:58.355753 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:58.355255 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6b7k\" (UniqueName: \"kubernetes.io/projected/f22c38af-6224-4c80-aa72-875a36abceaa-kube-api-access-r6b7k\") pod \"servicemesh-operator3-57f65f65fb-h9z5k\" (UID: \"f22c38af-6224-4c80-aa72-875a36abceaa\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-h9z5k" Jun 11 20:06:58.357998 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:58.357975 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/f22c38af-6224-4c80-aa72-875a36abceaa-operator-config\") pod \"servicemesh-operator3-57f65f65fb-h9z5k\" (UID: \"f22c38af-6224-4c80-aa72-875a36abceaa\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-h9z5k" Jun 11 20:06:58.365095 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:58.365072 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6b7k\" (UniqueName: \"kubernetes.io/projected/f22c38af-6224-4c80-aa72-875a36abceaa-kube-api-access-r6b7k\") pod \"servicemesh-operator3-57f65f65fb-h9z5k\" (UID: \"f22c38af-6224-4c80-aa72-875a36abceaa\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-h9z5k" Jun 11 20:06:58.474210 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:58.474121 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-h9z5k" Jun 11 20:06:58.619033 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:58.619005 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-h9z5k"] Jun 11 20:06:58.664891 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:06:58.664857 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf22c38af_6224_4c80_aa72_875a36abceaa.slice/crio-0fd0f4b02d954e539a269858b25b29590b8ac15e4c71ca26d051b37fa2369597 WatchSource:0}: Error finding container 0fd0f4b02d954e539a269858b25b29590b8ac15e4c71ca26d051b37fa2369597: Status 404 returned error can't find the container with id 0fd0f4b02d954e539a269858b25b29590b8ac15e4c71ca26d051b37fa2369597 Jun 11 20:06:58.918567 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:58.918535 2562 generic.go:356] "Generic (PLEG): container finished" podID="dc0ae559-75bf-4e8a-a996-5fdb1d3b07db" containerID="c5b15dcff1c5d75ab2c1bb1219008e1fa09bf705774a6f4eaa023c4a1c86b943" exitCode=0 Jun 11 20:06:58.918745 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:58.918619 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ak7v2k" event={"ID":"dc0ae559-75bf-4e8a-a996-5fdb1d3b07db","Type":"ContainerDied","Data":"c5b15dcff1c5d75ab2c1bb1219008e1fa09bf705774a6f4eaa023c4a1c86b943"} Jun 11 20:06:58.920224 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:58.920205 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-h9z5k" event={"ID":"f22c38af-6224-4c80-aa72-875a36abceaa","Type":"ContainerStarted","Data":"0fd0f4b02d954e539a269858b25b29590b8ac15e4c71ca26d051b37fa2369597"} Jun 11 20:06:59.927574 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:59.927539 2562 generic.go:356] "Generic (PLEG): container finished" podID="dc0ae559-75bf-4e8a-a996-5fdb1d3b07db" containerID="02a357c2bc41221af948eeb5a5e4d718008d352488aaf5953b3f69cc29121275" exitCode=0 Jun 11 20:06:59.927574 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:06:59.927575 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ak7v2k" event={"ID":"dc0ae559-75bf-4e8a-a996-5fdb1d3b07db","Type":"ContainerDied","Data":"02a357c2bc41221af948eeb5a5e4d718008d352488aaf5953b3f69cc29121275"} Jun 11 20:07:01.085413 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:01.085367 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ak7v2k" Jun 11 20:07:01.179696 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:01.179662 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc0ae559-75bf-4e8a-a996-5fdb1d3b07db-util\") pod \"dc0ae559-75bf-4e8a-a996-5fdb1d3b07db\" (UID: \"dc0ae559-75bf-4e8a-a996-5fdb1d3b07db\") " Jun 11 20:07:01.179888 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:01.179708 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc0ae559-75bf-4e8a-a996-5fdb1d3b07db-bundle\") pod \"dc0ae559-75bf-4e8a-a996-5fdb1d3b07db\" (UID: \"dc0ae559-75bf-4e8a-a996-5fdb1d3b07db\") " Jun 11 20:07:01.179888 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:01.179765 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwgts\" (UniqueName: \"kubernetes.io/projected/dc0ae559-75bf-4e8a-a996-5fdb1d3b07db-kube-api-access-bwgts\") pod \"dc0ae559-75bf-4e8a-a996-5fdb1d3b07db\" (UID: \"dc0ae559-75bf-4e8a-a996-5fdb1d3b07db\") " Jun 11 20:07:01.180971 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:01.180937 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc0ae559-75bf-4e8a-a996-5fdb1d3b07db-bundle" (OuterVolumeSpecName: "bundle") pod "dc0ae559-75bf-4e8a-a996-5fdb1d3b07db" (UID: "dc0ae559-75bf-4e8a-a996-5fdb1d3b07db"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:07:01.182244 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:01.182212 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc0ae559-75bf-4e8a-a996-5fdb1d3b07db-kube-api-access-bwgts" (OuterVolumeSpecName: "kube-api-access-bwgts") pod "dc0ae559-75bf-4e8a-a996-5fdb1d3b07db" (UID: "dc0ae559-75bf-4e8a-a996-5fdb1d3b07db"). InnerVolumeSpecName "kube-api-access-bwgts". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:07:01.187684 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:01.187610 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc0ae559-75bf-4e8a-a996-5fdb1d3b07db-util" (OuterVolumeSpecName: "util") pod "dc0ae559-75bf-4e8a-a996-5fdb1d3b07db" (UID: "dc0ae559-75bf-4e8a-a996-5fdb1d3b07db"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:07:01.281231 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:01.281198 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc0ae559-75bf-4e8a-a996-5fdb1d3b07db-util\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:07:01.281231 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:01.281232 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc0ae559-75bf-4e8a-a996-5fdb1d3b07db-bundle\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:07:01.281534 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:01.281247 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwgts\" (UniqueName: \"kubernetes.io/projected/dc0ae559-75bf-4e8a-a996-5fdb1d3b07db-kube-api-access-bwgts\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:07:01.942292 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:01.942236 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ak7v2k" event={"ID":"dc0ae559-75bf-4e8a-a996-5fdb1d3b07db","Type":"ContainerDied","Data":"7d4e430279f23808a83755734cd23802161344ae485672239d967414efb7ed16"} Jun 11 20:07:01.942292 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:01.942301 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d4e430279f23808a83755734cd23802161344ae485672239d967414efb7ed16" Jun 11 20:07:01.942553 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:01.942253 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ak7v2k" Jun 11 20:07:02.950082 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:02.950048 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-h9z5k" event={"ID":"f22c38af-6224-4c80-aa72-875a36abceaa","Type":"ContainerStarted","Data":"330e9f17403721fe5557f6580bc8d0ea8e044e5bd5d9b25df5279cdd0aeedf94"} Jun 11 20:07:02.950532 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:02.950212 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-h9z5k" Jun 11 20:07:02.996868 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:02.996815 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-h9z5k" podStartSLOduration=1.362645384 podStartE2EDuration="4.99679989s" totalImagesPullingTime="3.634154506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:06:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:07:02.995370412 +0000 UTC m=+514.726532387" watchObservedRunningTime="2026-06-11 20:07:02.99679989 +0000 UTC m=+514.727961918" Jun 11 20:07:07.254210 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.254164 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:07:07.258978 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.258953 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-8v7zj"] Jun 11 20:07:07.259329 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.259317 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc0ae559-75bf-4e8a-a996-5fdb1d3b07db" containerName="extract" Jun 11 20:07:07.259420 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.259330 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc0ae559-75bf-4e8a-a996-5fdb1d3b07db" containerName="extract" Jun 11 20:07:07.259420 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.259341 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc0ae559-75bf-4e8a-a996-5fdb1d3b07db" containerName="pull" Jun 11 20:07:07.259420 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.259346 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc0ae559-75bf-4e8a-a996-5fdb1d3b07db" containerName="pull" Jun 11 20:07:07.259420 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.259367 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc0ae559-75bf-4e8a-a996-5fdb1d3b07db" containerName="util" Jun 11 20:07:07.259420 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.259389 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc0ae559-75bf-4e8a-a996-5fdb1d3b07db" containerName="util" Jun 11 20:07:07.259576 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.259455 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc0ae559-75bf-4e8a-a996-5fdb1d3b07db" containerName="extract" Jun 11 20:07:07.261593 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.261572 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8v7zj" Jun 11 20:07:07.264926 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.264902 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 20:07:07.265112 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.265087 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-thzsx\"" Jun 11 20:07:07.265217 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.265136 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 11 20:07:07.265273 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.265233 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 11 20:07:07.265871 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.265856 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 11 20:07:07.286720 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.286687 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-8v7zj"] Jun 11 20:07:07.334717 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.334681 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/373380a2-bd6c-4b56-8c91-e0076d6853d1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-8v7zj\" (UID: \"373380a2-bd6c-4b56-8c91-e0076d6853d1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8v7zj" Jun 11 20:07:07.334965 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.334945 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/373380a2-bd6c-4b56-8c91-e0076d6853d1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-8v7zj\" (UID: \"373380a2-bd6c-4b56-8c91-e0076d6853d1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8v7zj" Jun 11 20:07:07.335101 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.335088 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/373380a2-bd6c-4b56-8c91-e0076d6853d1-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-8v7zj\" (UID: \"373380a2-bd6c-4b56-8c91-e0076d6853d1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8v7zj" Jun 11 20:07:07.335233 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.335203 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/373380a2-bd6c-4b56-8c91-e0076d6853d1-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-8v7zj\" (UID: \"373380a2-bd6c-4b56-8c91-e0076d6853d1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8v7zj" Jun 11 20:07:07.335367 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.335241 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mldj\" (UniqueName: \"kubernetes.io/projected/373380a2-bd6c-4b56-8c91-e0076d6853d1-kube-api-access-4mldj\") pod \"istiod-openshift-gateway-75c67f8887-8v7zj\" (UID: \"373380a2-bd6c-4b56-8c91-e0076d6853d1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8v7zj" Jun 11 20:07:07.335367 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.335340 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/373380a2-bd6c-4b56-8c91-e0076d6853d1-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-8v7zj\" (UID: \"373380a2-bd6c-4b56-8c91-e0076d6853d1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8v7zj" Jun 11 20:07:07.335509 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.335427 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/373380a2-bd6c-4b56-8c91-e0076d6853d1-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-8v7zj\" (UID: \"373380a2-bd6c-4b56-8c91-e0076d6853d1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8v7zj" Jun 11 20:07:07.364051 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.364021 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:07:07.435978 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.435939 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/373380a2-bd6c-4b56-8c91-e0076d6853d1-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-8v7zj\" (UID: \"373380a2-bd6c-4b56-8c91-e0076d6853d1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8v7zj" Jun 11 20:07:07.436180 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.435985 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/373380a2-bd6c-4b56-8c91-e0076d6853d1-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-8v7zj\" (UID: \"373380a2-bd6c-4b56-8c91-e0076d6853d1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8v7zj" Jun 11 20:07:07.436180 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.436008 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mldj\" (UniqueName: \"kubernetes.io/projected/373380a2-bd6c-4b56-8c91-e0076d6853d1-kube-api-access-4mldj\") pod \"istiod-openshift-gateway-75c67f8887-8v7zj\" (UID: \"373380a2-bd6c-4b56-8c91-e0076d6853d1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8v7zj" Jun 11 20:07:07.436180 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.436049 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/373380a2-bd6c-4b56-8c91-e0076d6853d1-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-8v7zj\" (UID: \"373380a2-bd6c-4b56-8c91-e0076d6853d1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8v7zj" Jun 11 20:07:07.436180 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.436095 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/373380a2-bd6c-4b56-8c91-e0076d6853d1-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-8v7zj\" (UID: \"373380a2-bd6c-4b56-8c91-e0076d6853d1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8v7zj" Jun 11 20:07:07.436180 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.436156 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/373380a2-bd6c-4b56-8c91-e0076d6853d1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-8v7zj\" (UID: \"373380a2-bd6c-4b56-8c91-e0076d6853d1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8v7zj" Jun 11 20:07:07.436506 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.436184 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/373380a2-bd6c-4b56-8c91-e0076d6853d1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-8v7zj\" (UID: \"373380a2-bd6c-4b56-8c91-e0076d6853d1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8v7zj" Jun 11 20:07:07.437239 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.437209 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/373380a2-bd6c-4b56-8c91-e0076d6853d1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-8v7zj\" (UID: \"373380a2-bd6c-4b56-8c91-e0076d6853d1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8v7zj" Jun 11 20:07:07.439096 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.439070 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/373380a2-bd6c-4b56-8c91-e0076d6853d1-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-8v7zj\" (UID: \"373380a2-bd6c-4b56-8c91-e0076d6853d1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8v7zj" Jun 11 20:07:07.439222 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.439157 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/373380a2-bd6c-4b56-8c91-e0076d6853d1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-8v7zj\" (UID: \"373380a2-bd6c-4b56-8c91-e0076d6853d1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8v7zj" Jun 11 20:07:07.439305 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.439284 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/373380a2-bd6c-4b56-8c91-e0076d6853d1-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-8v7zj\" (UID: \"373380a2-bd6c-4b56-8c91-e0076d6853d1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8v7zj" Jun 11 20:07:07.439365 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.439350 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/373380a2-bd6c-4b56-8c91-e0076d6853d1-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-8v7zj\" (UID: \"373380a2-bd6c-4b56-8c91-e0076d6853d1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8v7zj" Jun 11 20:07:07.448452 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.447964 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/373380a2-bd6c-4b56-8c91-e0076d6853d1-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-8v7zj\" (UID: \"373380a2-bd6c-4b56-8c91-e0076d6853d1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8v7zj" Jun 11 20:07:07.448452 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.448287 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mldj\" (UniqueName: \"kubernetes.io/projected/373380a2-bd6c-4b56-8c91-e0076d6853d1-kube-api-access-4mldj\") pod \"istiod-openshift-gateway-75c67f8887-8v7zj\" (UID: \"373380a2-bd6c-4b56-8c91-e0076d6853d1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8v7zj" Jun 11 20:07:07.571882 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.571778 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8v7zj" Jun 11 20:07:07.730129 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.730098 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-8v7zj"] Jun 11 20:07:07.732296 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:07:07.732272 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod373380a2_bd6c_4b56_8c91_e0076d6853d1.slice/crio-aa17c49de95780e96d4ebcb0ab19cea8e6567f58a39490a44181c2e517daa62d WatchSource:0}: Error finding container aa17c49de95780e96d4ebcb0ab19cea8e6567f58a39490a44181c2e517daa62d: Status 404 returned error can't find the container with id aa17c49de95780e96d4ebcb0ab19cea8e6567f58a39490a44181c2e517daa62d Jun 11 20:07:07.979514 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:07.979479 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8v7zj" event={"ID":"373380a2-bd6c-4b56-8c91-e0076d6853d1","Type":"ContainerStarted","Data":"aa17c49de95780e96d4ebcb0ab19cea8e6567f58a39490a44181c2e517daa62d"} Jun 11 20:07:08.015843 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:08.015812 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:07:08.177951 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:08.177914 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:07:08.351772 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:08.351743 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:07:10.014796 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:10.014762 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jun 11 20:07:10.015056 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:10.014828 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jun 11 20:07:10.852689 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:10.852650 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:07:10.973764 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:10.973723 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:07:10.999672 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:10.999636 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8v7zj" event={"ID":"373380a2-bd6c-4b56-8c91-e0076d6853d1","Type":"ContainerStarted","Data":"d4e6271e491caeccbeef9a3659860d72709621716d71b1878b836a342d3d4021"} Jun 11 20:07:10.999884 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:10.999753 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8v7zj" Jun 11 20:07:11.056829 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:11.056777 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8v7zj" podStartSLOduration=1.77656601 podStartE2EDuration="4.056762322s" totalImagesPullingTime="2.280196312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:07:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:07:11.055272143 +0000 UTC m=+522.786434111" watchObservedRunningTime="2026-06-11 20:07:11.056762322 +0000 UTC m=+522.787924297" Jun 11 20:07:11.300767 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:11.300685 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:07:11.501575 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:11.501546 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:07:11.611067 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:11.611037 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:07:12.007846 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:12.007759 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-8v7zj" Jun 11 20:07:13.957370 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:13.957339 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-h9z5k" Jun 11 20:07:15.857290 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:15.857252 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:07:18.867154 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:18.867127 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-lz7x9" Jun 11 20:07:19.869275 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:19.869245 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fcsgz" Jun 11 20:07:33.330775 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:33.330736 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:07:33.475882 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:33.475852 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:07:33.553863 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:33.553832 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:07:34.279528 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:34.279496 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:07:34.506952 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:34.506904 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:07:45.287042 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:45.287001 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9brs"] Jun 11 20:07:45.293124 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:45.293105 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9brs" Jun 11 20:07:45.296015 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:45.295989 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 20:07:45.296137 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:45.296056 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 20:07:45.296885 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:45.296865 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2lwk4\"" Jun 11 20:07:45.298781 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:45.298763 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9brs"] Jun 11 20:07:45.393091 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:45.393060 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c34fbd41-e792-443b-8979-ec5056f5d46e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9brs\" (UID: \"c34fbd41-e792-443b-8979-ec5056f5d46e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9brs" Jun 11 20:07:45.393292 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:45.393109 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxn54\" (UniqueName: \"kubernetes.io/projected/c34fbd41-e792-443b-8979-ec5056f5d46e-kube-api-access-gxn54\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9brs\" (UID: \"c34fbd41-e792-443b-8979-ec5056f5d46e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9brs" Jun 11 20:07:45.393292 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:45.393133 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c34fbd41-e792-443b-8979-ec5056f5d46e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9brs\" (UID: \"c34fbd41-e792-443b-8979-ec5056f5d46e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9brs" Jun 11 20:07:45.493844 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:45.493806 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c34fbd41-e792-443b-8979-ec5056f5d46e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9brs\" (UID: \"c34fbd41-e792-443b-8979-ec5056f5d46e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9brs" Jun 11 20:07:45.494050 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:45.493868 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxn54\" (UniqueName: \"kubernetes.io/projected/c34fbd41-e792-443b-8979-ec5056f5d46e-kube-api-access-gxn54\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9brs\" (UID: \"c34fbd41-e792-443b-8979-ec5056f5d46e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9brs" Jun 11 20:07:45.494050 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:45.493903 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c34fbd41-e792-443b-8979-ec5056f5d46e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9brs\" (UID: \"c34fbd41-e792-443b-8979-ec5056f5d46e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9brs" Jun 11 20:07:45.494246 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:45.494224 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c34fbd41-e792-443b-8979-ec5056f5d46e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9brs\" (UID: \"c34fbd41-e792-443b-8979-ec5056f5d46e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9brs" Jun 11 20:07:45.494408 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:45.494360 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c34fbd41-e792-443b-8979-ec5056f5d46e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9brs\" (UID: \"c34fbd41-e792-443b-8979-ec5056f5d46e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9brs" Jun 11 20:07:45.502012 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:45.501983 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxn54\" (UniqueName: \"kubernetes.io/projected/c34fbd41-e792-443b-8979-ec5056f5d46e-kube-api-access-gxn54\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9brs\" (UID: \"c34fbd41-e792-443b-8979-ec5056f5d46e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9brs" Jun 11 20:07:45.604333 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:45.604301 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9brs" Jun 11 20:07:45.739969 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:45.739947 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9brs"] Jun 11 20:07:45.741671 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:07:45.741643 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc34fbd41_e792_443b_8979_ec5056f5d46e.slice/crio-a698a65586a7b93a79cd5c7fd9abdf6d397a5354af6af443874bd0d0161e1cb1 WatchSource:0}: Error finding container a698a65586a7b93a79cd5c7fd9abdf6d397a5354af6af443874bd0d0161e1cb1: Status 404 returned error can't find the container with id a698a65586a7b93a79cd5c7fd9abdf6d397a5354af6af443874bd0d0161e1cb1 Jun 11 20:07:45.879765 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:45.879686 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kbzh"] Jun 11 20:07:45.882418 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:45.882401 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kbzh" Jun 11 20:07:45.891350 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:45.891323 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kbzh"] Jun 11 20:07:45.997094 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:45.997058 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea28fb6a-92c4-43b1-ab58-f9085e74ea1b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kbzh\" (UID: \"ea28fb6a-92c4-43b1-ab58-f9085e74ea1b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kbzh" Jun 11 20:07:45.997308 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:45.997136 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea28fb6a-92c4-43b1-ab58-f9085e74ea1b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kbzh\" (UID: \"ea28fb6a-92c4-43b1-ab58-f9085e74ea1b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kbzh" Jun 11 20:07:45.997308 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:45.997251 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vfgp\" (UniqueName: \"kubernetes.io/projected/ea28fb6a-92c4-43b1-ab58-f9085e74ea1b-kube-api-access-4vfgp\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kbzh\" (UID: \"ea28fb6a-92c4-43b1-ab58-f9085e74ea1b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kbzh" Jun 11 20:07:46.098616 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:46.098569 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vfgp\" (UniqueName: \"kubernetes.io/projected/ea28fb6a-92c4-43b1-ab58-f9085e74ea1b-kube-api-access-4vfgp\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kbzh\" (UID: \"ea28fb6a-92c4-43b1-ab58-f9085e74ea1b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kbzh" Jun 11 20:07:46.098616 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:46.098620 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea28fb6a-92c4-43b1-ab58-f9085e74ea1b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kbzh\" (UID: \"ea28fb6a-92c4-43b1-ab58-f9085e74ea1b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kbzh" Jun 11 20:07:46.098885 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:46.098697 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea28fb6a-92c4-43b1-ab58-f9085e74ea1b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kbzh\" (UID: \"ea28fb6a-92c4-43b1-ab58-f9085e74ea1b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kbzh" Jun 11 20:07:46.099073 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:46.099051 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea28fb6a-92c4-43b1-ab58-f9085e74ea1b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kbzh\" (UID: \"ea28fb6a-92c4-43b1-ab58-f9085e74ea1b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kbzh" Jun 11 20:07:46.099146 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:46.099085 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea28fb6a-92c4-43b1-ab58-f9085e74ea1b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kbzh\" (UID: \"ea28fb6a-92c4-43b1-ab58-f9085e74ea1b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kbzh" Jun 11 20:07:46.107301 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:46.107268 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vfgp\" (UniqueName: \"kubernetes.io/projected/ea28fb6a-92c4-43b1-ab58-f9085e74ea1b-kube-api-access-4vfgp\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kbzh\" (UID: \"ea28fb6a-92c4-43b1-ab58-f9085e74ea1b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kbzh" Jun 11 20:07:46.193071 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:46.192988 2562 generic.go:356] "Generic (PLEG): container finished" podID="c34fbd41-e792-443b-8979-ec5056f5d46e" containerID="8b5f8fdf17652d7c80f7b3bd9d1e32734b66b7bb2a57c72d4e12b2b10ee57625" exitCode=0 Jun 11 20:07:46.193220 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:46.193078 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9brs" event={"ID":"c34fbd41-e792-443b-8979-ec5056f5d46e","Type":"ContainerDied","Data":"8b5f8fdf17652d7c80f7b3bd9d1e32734b66b7bb2a57c72d4e12b2b10ee57625"} Jun 11 20:07:46.193220 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:46.193136 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9brs" event={"ID":"c34fbd41-e792-443b-8979-ec5056f5d46e","Type":"ContainerStarted","Data":"a698a65586a7b93a79cd5c7fd9abdf6d397a5354af6af443874bd0d0161e1cb1"} Jun 11 20:07:46.223967 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:46.223927 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kbzh" Jun 11 20:07:46.360507 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:46.360481 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kbzh"] Jun 11 20:07:46.363448 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:07:46.363417 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea28fb6a_92c4_43b1_ab58_f9085e74ea1b.slice/crio-9228c57df0aebcccde38a9d93af84af00fc9a1fdbb11c15fb891e53c9bea9240 WatchSource:0}: Error finding container 9228c57df0aebcccde38a9d93af84af00fc9a1fdbb11c15fb891e53c9bea9240: Status 404 returned error can't find the container with id 9228c57df0aebcccde38a9d93af84af00fc9a1fdbb11c15fb891e53c9bea9240 Jun 11 20:07:46.483206 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:46.483175 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mdltg"] Jun 11 20:07:46.488341 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:46.488306 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mdltg" Jun 11 20:07:46.495860 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:46.495831 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mdltg"] Jun 11 20:07:46.602355 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:46.602320 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b72c6ce6-361d-4dba-8880-da335f685099-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mdltg\" (UID: \"b72c6ce6-361d-4dba-8880-da335f685099\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mdltg" Jun 11 20:07:46.602560 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:46.602370 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7t4w\" (UniqueName: \"kubernetes.io/projected/b72c6ce6-361d-4dba-8880-da335f685099-kube-api-access-b7t4w\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mdltg\" (UID: \"b72c6ce6-361d-4dba-8880-da335f685099\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mdltg" Jun 11 20:07:46.602560 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:46.602491 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b72c6ce6-361d-4dba-8880-da335f685099-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mdltg\" (UID: \"b72c6ce6-361d-4dba-8880-da335f685099\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mdltg" Jun 11 20:07:46.703272 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:46.703237 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b72c6ce6-361d-4dba-8880-da335f685099-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mdltg\" (UID: \"b72c6ce6-361d-4dba-8880-da335f685099\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mdltg" Jun 11 20:07:46.703484 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:46.703287 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7t4w\" (UniqueName: \"kubernetes.io/projected/b72c6ce6-361d-4dba-8880-da335f685099-kube-api-access-b7t4w\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mdltg\" (UID: \"b72c6ce6-361d-4dba-8880-da335f685099\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mdltg" Jun 11 20:07:46.703484 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:46.703320 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b72c6ce6-361d-4dba-8880-da335f685099-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mdltg\" (UID: \"b72c6ce6-361d-4dba-8880-da335f685099\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mdltg" Jun 11 20:07:46.703753 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:46.703737 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b72c6ce6-361d-4dba-8880-da335f685099-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mdltg\" (UID: \"b72c6ce6-361d-4dba-8880-da335f685099\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mdltg" Jun 11 20:07:46.703792 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:46.703738 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b72c6ce6-361d-4dba-8880-da335f685099-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mdltg\" (UID: \"b72c6ce6-361d-4dba-8880-da335f685099\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mdltg" Jun 11 20:07:46.712120 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:46.712099 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7t4w\" (UniqueName: \"kubernetes.io/projected/b72c6ce6-361d-4dba-8880-da335f685099-kube-api-access-b7t4w\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mdltg\" (UID: \"b72c6ce6-361d-4dba-8880-da335f685099\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mdltg" Jun 11 20:07:46.846140 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:46.845991 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mdltg" Jun 11 20:07:46.905920 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:46.905889 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k9dlj"] Jun 11 20:07:46.912105 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:46.912087 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k9dlj" Jun 11 20:07:46.926969 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:46.926940 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k9dlj"] Jun 11 20:07:47.005873 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:47.005837 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fffe2942-d8a4-45d8-90f4-3197f5981f1d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k9dlj\" (UID: \"fffe2942-d8a4-45d8-90f4-3197f5981f1d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k9dlj" Jun 11 20:07:47.006103 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:47.005935 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2kc9\" (UniqueName: \"kubernetes.io/projected/fffe2942-d8a4-45d8-90f4-3197f5981f1d-kube-api-access-s2kc9\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k9dlj\" (UID: \"fffe2942-d8a4-45d8-90f4-3197f5981f1d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k9dlj" Jun 11 20:07:47.006103 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:47.005994 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fffe2942-d8a4-45d8-90f4-3197f5981f1d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k9dlj\" (UID: \"fffe2942-d8a4-45d8-90f4-3197f5981f1d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k9dlj" Jun 11 20:07:47.008695 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:47.008672 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mdltg"] Jun 11 20:07:47.010339 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:07:47.010317 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb72c6ce6_361d_4dba_8880_da335f685099.slice/crio-17e9f2f56b3d30298d96c70f07f2d7dfa718571a88a368aaf24449dbb430556a WatchSource:0}: Error finding container 17e9f2f56b3d30298d96c70f07f2d7dfa718571a88a368aaf24449dbb430556a: Status 404 returned error can't find the container with id 17e9f2f56b3d30298d96c70f07f2d7dfa718571a88a368aaf24449dbb430556a Jun 11 20:07:47.106768 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:47.106741 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fffe2942-d8a4-45d8-90f4-3197f5981f1d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k9dlj\" (UID: \"fffe2942-d8a4-45d8-90f4-3197f5981f1d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k9dlj" Jun 11 20:07:47.106891 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:47.106784 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2kc9\" (UniqueName: \"kubernetes.io/projected/fffe2942-d8a4-45d8-90f4-3197f5981f1d-kube-api-access-s2kc9\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k9dlj\" (UID: \"fffe2942-d8a4-45d8-90f4-3197f5981f1d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k9dlj" Jun 11 20:07:47.106891 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:47.106824 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fffe2942-d8a4-45d8-90f4-3197f5981f1d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k9dlj\" (UID: \"fffe2942-d8a4-45d8-90f4-3197f5981f1d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k9dlj" Jun 11 20:07:47.107205 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:47.107180 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fffe2942-d8a4-45d8-90f4-3197f5981f1d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k9dlj\" (UID: \"fffe2942-d8a4-45d8-90f4-3197f5981f1d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k9dlj" Jun 11 20:07:47.107247 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:47.107194 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fffe2942-d8a4-45d8-90f4-3197f5981f1d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k9dlj\" (UID: \"fffe2942-d8a4-45d8-90f4-3197f5981f1d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k9dlj" Jun 11 20:07:47.118432 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:47.118405 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2kc9\" (UniqueName: \"kubernetes.io/projected/fffe2942-d8a4-45d8-90f4-3197f5981f1d-kube-api-access-s2kc9\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k9dlj\" (UID: \"fffe2942-d8a4-45d8-90f4-3197f5981f1d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k9dlj" Jun 11 20:07:47.203425 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:47.203369 2562 generic.go:356] "Generic (PLEG): container finished" podID="ea28fb6a-92c4-43b1-ab58-f9085e74ea1b" containerID="2ca63486affac28ef5c5ac1de0d6661de2dfc0565738c70e6b45131cb93a7fc3" exitCode=0 Jun 11 20:07:47.203630 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:47.203468 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kbzh" event={"ID":"ea28fb6a-92c4-43b1-ab58-f9085e74ea1b","Type":"ContainerDied","Data":"2ca63486affac28ef5c5ac1de0d6661de2dfc0565738c70e6b45131cb93a7fc3"} Jun 11 20:07:47.203630 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:47.203524 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kbzh" event={"ID":"ea28fb6a-92c4-43b1-ab58-f9085e74ea1b","Type":"ContainerStarted","Data":"9228c57df0aebcccde38a9d93af84af00fc9a1fdbb11c15fb891e53c9bea9240"} Jun 11 20:07:47.205121 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:47.205096 2562 generic.go:356] "Generic (PLEG): container finished" podID="b72c6ce6-361d-4dba-8880-da335f685099" containerID="894b997d031b09fb5105280fd14d2daf652574b3926294a8c9cdb239019a179e" exitCode=0 Jun 11 20:07:47.205207 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:47.205173 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mdltg" event={"ID":"b72c6ce6-361d-4dba-8880-da335f685099","Type":"ContainerDied","Data":"894b997d031b09fb5105280fd14d2daf652574b3926294a8c9cdb239019a179e"} Jun 11 20:07:47.205247 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:47.205212 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mdltg" event={"ID":"b72c6ce6-361d-4dba-8880-da335f685099","Type":"ContainerStarted","Data":"17e9f2f56b3d30298d96c70f07f2d7dfa718571a88a368aaf24449dbb430556a"} Jun 11 20:07:47.207286 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:47.207261 2562 generic.go:356] "Generic (PLEG): container finished" podID="c34fbd41-e792-443b-8979-ec5056f5d46e" containerID="1a7ccf85eb0deb2c8ad87303d66d7d40eee70717e4afac2dfedc06c1cb51b768" exitCode=0 Jun 11 20:07:47.207422 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:47.207343 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9brs" event={"ID":"c34fbd41-e792-443b-8979-ec5056f5d46e","Type":"ContainerDied","Data":"1a7ccf85eb0deb2c8ad87303d66d7d40eee70717e4afac2dfedc06c1cb51b768"} Jun 11 20:07:47.224852 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:47.224827 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k9dlj" Jun 11 20:07:47.401720 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:47.401654 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k9dlj"] Jun 11 20:07:47.412294 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:07:47.412263 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfffe2942_d8a4_45d8_90f4_3197f5981f1d.slice/crio-e46ef38aaa1b6023abb01ce76d9232747cec364bc6bfec3f7a25a1a4626741c3 WatchSource:0}: Error finding container e46ef38aaa1b6023abb01ce76d9232747cec364bc6bfec3f7a25a1a4626741c3: Status 404 returned error can't find the container with id e46ef38aaa1b6023abb01ce76d9232747cec364bc6bfec3f7a25a1a4626741c3 Jun 11 20:07:48.217751 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:48.217664 2562 generic.go:356] "Generic (PLEG): container finished" podID="b72c6ce6-361d-4dba-8880-da335f685099" containerID="3b46d8e1b01265a4929464c8223a845821283339617f04aa67306c5051496b41" exitCode=0 Jun 11 20:07:48.217922 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:48.217742 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mdltg" event={"ID":"b72c6ce6-361d-4dba-8880-da335f685099","Type":"ContainerDied","Data":"3b46d8e1b01265a4929464c8223a845821283339617f04aa67306c5051496b41"} Jun 11 20:07:48.219250 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:48.219184 2562 generic.go:356] "Generic (PLEG): container finished" podID="fffe2942-d8a4-45d8-90f4-3197f5981f1d" containerID="6a8813641af36b588cbe283205a65616ef14086717e36ee33dee794aae3f6955" exitCode=0 Jun 11 20:07:48.219321 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:48.219263 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k9dlj" event={"ID":"fffe2942-d8a4-45d8-90f4-3197f5981f1d","Type":"ContainerDied","Data":"6a8813641af36b588cbe283205a65616ef14086717e36ee33dee794aae3f6955"} Jun 11 20:07:48.219321 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:48.219299 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k9dlj" event={"ID":"fffe2942-d8a4-45d8-90f4-3197f5981f1d","Type":"ContainerStarted","Data":"e46ef38aaa1b6023abb01ce76d9232747cec364bc6bfec3f7a25a1a4626741c3"} Jun 11 20:07:48.221729 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:48.221612 2562 generic.go:356] "Generic (PLEG): container finished" podID="c34fbd41-e792-443b-8979-ec5056f5d46e" containerID="9e061924f23470d2196b25d36dda0fb27fe2dad4782fe1ea4b326046e29852b3" exitCode=0 Jun 11 20:07:48.221729 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:48.221676 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9brs" event={"ID":"c34fbd41-e792-443b-8979-ec5056f5d46e","Type":"ContainerDied","Data":"9e061924f23470d2196b25d36dda0fb27fe2dad4782fe1ea4b326046e29852b3"} Jun 11 20:07:48.223696 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:48.223676 2562 generic.go:356] "Generic (PLEG): container finished" podID="ea28fb6a-92c4-43b1-ab58-f9085e74ea1b" containerID="0218ff8414b4eab73b33ad77e96950b37a8c701df1513a9da8c205fe71e8910d" exitCode=0 Jun 11 20:07:48.223810 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:48.223704 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kbzh" event={"ID":"ea28fb6a-92c4-43b1-ab58-f9085e74ea1b","Type":"ContainerDied","Data":"0218ff8414b4eab73b33ad77e96950b37a8c701df1513a9da8c205fe71e8910d"} Jun 11 20:07:49.231542 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:49.231498 2562 generic.go:356] "Generic (PLEG): container finished" podID="ea28fb6a-92c4-43b1-ab58-f9085e74ea1b" containerID="bfef19e1fe4046b7f4fb6dc842e16f33a67af516f823288dbd62da6792667980" exitCode=0 Jun 11 20:07:49.231941 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:49.231615 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kbzh" event={"ID":"ea28fb6a-92c4-43b1-ab58-f9085e74ea1b","Type":"ContainerDied","Data":"bfef19e1fe4046b7f4fb6dc842e16f33a67af516f823288dbd62da6792667980"} Jun 11 20:07:49.233675 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:49.233650 2562 generic.go:356] "Generic (PLEG): container finished" podID="b72c6ce6-361d-4dba-8880-da335f685099" containerID="9bf2f53ee2f5c42be3f27e895fcbc22d261872829bd28def1feb65da7bd62816" exitCode=0 Jun 11 20:07:49.233787 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:49.233712 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mdltg" event={"ID":"b72c6ce6-361d-4dba-8880-da335f685099","Type":"ContainerDied","Data":"9bf2f53ee2f5c42be3f27e895fcbc22d261872829bd28def1feb65da7bd62816"} Jun 11 20:07:49.235603 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:49.235575 2562 generic.go:356] "Generic (PLEG): container finished" podID="fffe2942-d8a4-45d8-90f4-3197f5981f1d" containerID="07c2c7365d71f866db3445674ce97285e2884e8330ff97fe87a0cb95e984151c" exitCode=0 Jun 11 20:07:49.235710 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:49.235656 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k9dlj" event={"ID":"fffe2942-d8a4-45d8-90f4-3197f5981f1d","Type":"ContainerDied","Data":"07c2c7365d71f866db3445674ce97285e2884e8330ff97fe87a0cb95e984151c"} Jun 11 20:07:49.371957 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:49.371930 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9brs" Jun 11 20:07:49.430431 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:49.430355 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c34fbd41-e792-443b-8979-ec5056f5d46e-util\") pod \"c34fbd41-e792-443b-8979-ec5056f5d46e\" (UID: \"c34fbd41-e792-443b-8979-ec5056f5d46e\") " Jun 11 20:07:49.430575 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:49.430476 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c34fbd41-e792-443b-8979-ec5056f5d46e-bundle\") pod \"c34fbd41-e792-443b-8979-ec5056f5d46e\" (UID: \"c34fbd41-e792-443b-8979-ec5056f5d46e\") " Jun 11 20:07:49.430652 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:49.430579 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxn54\" (UniqueName: \"kubernetes.io/projected/c34fbd41-e792-443b-8979-ec5056f5d46e-kube-api-access-gxn54\") pod \"c34fbd41-e792-443b-8979-ec5056f5d46e\" (UID: \"c34fbd41-e792-443b-8979-ec5056f5d46e\") " Jun 11 20:07:49.430996 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:49.430968 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c34fbd41-e792-443b-8979-ec5056f5d46e-bundle" (OuterVolumeSpecName: "bundle") pod "c34fbd41-e792-443b-8979-ec5056f5d46e" (UID: "c34fbd41-e792-443b-8979-ec5056f5d46e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:07:49.432910 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:49.432888 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c34fbd41-e792-443b-8979-ec5056f5d46e-kube-api-access-gxn54" (OuterVolumeSpecName: "kube-api-access-gxn54") pod "c34fbd41-e792-443b-8979-ec5056f5d46e" (UID: "c34fbd41-e792-443b-8979-ec5056f5d46e"). InnerVolumeSpecName "kube-api-access-gxn54". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:07:49.436083 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:49.436063 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c34fbd41-e792-443b-8979-ec5056f5d46e-util" (OuterVolumeSpecName: "util") pod "c34fbd41-e792-443b-8979-ec5056f5d46e" (UID: "c34fbd41-e792-443b-8979-ec5056f5d46e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:07:49.531875 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:49.531842 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c34fbd41-e792-443b-8979-ec5056f5d46e-util\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:07:49.531875 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:49.531871 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c34fbd41-e792-443b-8979-ec5056f5d46e-bundle\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:07:49.532036 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:49.531881 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxn54\" (UniqueName: \"kubernetes.io/projected/c34fbd41-e792-443b-8979-ec5056f5d46e-kube-api-access-gxn54\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:07:50.243067 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:50.243034 2562 generic.go:356] "Generic (PLEG): container finished" podID="fffe2942-d8a4-45d8-90f4-3197f5981f1d" containerID="9a5b8bdc0974bf40820a2b4d96900225bef9df9a3fb36be7df243cc9e3eb73d9" exitCode=0 Jun 11 20:07:50.243535 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:50.243152 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k9dlj" event={"ID":"fffe2942-d8a4-45d8-90f4-3197f5981f1d","Type":"ContainerDied","Data":"9a5b8bdc0974bf40820a2b4d96900225bef9df9a3fb36be7df243cc9e3eb73d9"} Jun 11 20:07:50.245080 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:50.245059 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9brs" Jun 11 20:07:50.245203 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:50.245099 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9brs" event={"ID":"c34fbd41-e792-443b-8979-ec5056f5d46e","Type":"ContainerDied","Data":"a698a65586a7b93a79cd5c7fd9abdf6d397a5354af6af443874bd0d0161e1cb1"} Jun 11 20:07:50.245203 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:50.245134 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a698a65586a7b93a79cd5c7fd9abdf6d397a5354af6af443874bd0d0161e1cb1" Jun 11 20:07:50.392761 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:50.392732 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kbzh" Jun 11 20:07:50.421150 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:50.421119 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mdltg" Jun 11 20:07:50.539581 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:50.539490 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea28fb6a-92c4-43b1-ab58-f9085e74ea1b-util\") pod \"ea28fb6a-92c4-43b1-ab58-f9085e74ea1b\" (UID: \"ea28fb6a-92c4-43b1-ab58-f9085e74ea1b\") " Jun 11 20:07:50.539581 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:50.539553 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7t4w\" (UniqueName: \"kubernetes.io/projected/b72c6ce6-361d-4dba-8880-da335f685099-kube-api-access-b7t4w\") pod \"b72c6ce6-361d-4dba-8880-da335f685099\" (UID: \"b72c6ce6-361d-4dba-8880-da335f685099\") " Jun 11 20:07:50.539812 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:50.539591 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b72c6ce6-361d-4dba-8880-da335f685099-util\") pod \"b72c6ce6-361d-4dba-8880-da335f685099\" (UID: \"b72c6ce6-361d-4dba-8880-da335f685099\") " Jun 11 20:07:50.539812 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:50.539632 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea28fb6a-92c4-43b1-ab58-f9085e74ea1b-bundle\") pod \"ea28fb6a-92c4-43b1-ab58-f9085e74ea1b\" (UID: \"ea28fb6a-92c4-43b1-ab58-f9085e74ea1b\") " Jun 11 20:07:50.539812 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:50.539661 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b72c6ce6-361d-4dba-8880-da335f685099-bundle\") pod \"b72c6ce6-361d-4dba-8880-da335f685099\" (UID: \"b72c6ce6-361d-4dba-8880-da335f685099\") " Jun 11 20:07:50.539812 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:50.539703 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vfgp\" (UniqueName: \"kubernetes.io/projected/ea28fb6a-92c4-43b1-ab58-f9085e74ea1b-kube-api-access-4vfgp\") pod \"ea28fb6a-92c4-43b1-ab58-f9085e74ea1b\" (UID: \"ea28fb6a-92c4-43b1-ab58-f9085e74ea1b\") " Jun 11 20:07:50.540141 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:50.540109 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea28fb6a-92c4-43b1-ab58-f9085e74ea1b-bundle" (OuterVolumeSpecName: "bundle") pod "ea28fb6a-92c4-43b1-ab58-f9085e74ea1b" (UID: "ea28fb6a-92c4-43b1-ab58-f9085e74ea1b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:07:50.540324 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:50.540299 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b72c6ce6-361d-4dba-8880-da335f685099-bundle" (OuterVolumeSpecName: "bundle") pod "b72c6ce6-361d-4dba-8880-da335f685099" (UID: "b72c6ce6-361d-4dba-8880-da335f685099"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:07:50.542024 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:50.541985 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b72c6ce6-361d-4dba-8880-da335f685099-kube-api-access-b7t4w" (OuterVolumeSpecName: "kube-api-access-b7t4w") pod "b72c6ce6-361d-4dba-8880-da335f685099" (UID: "b72c6ce6-361d-4dba-8880-da335f685099"). InnerVolumeSpecName "kube-api-access-b7t4w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:07:50.542128 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:50.542092 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea28fb6a-92c4-43b1-ab58-f9085e74ea1b-kube-api-access-4vfgp" (OuterVolumeSpecName: "kube-api-access-4vfgp") pod "ea28fb6a-92c4-43b1-ab58-f9085e74ea1b" (UID: "ea28fb6a-92c4-43b1-ab58-f9085e74ea1b"). InnerVolumeSpecName "kube-api-access-4vfgp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:07:50.548786 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:50.548755 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b72c6ce6-361d-4dba-8880-da335f685099-util" (OuterVolumeSpecName: "util") pod "b72c6ce6-361d-4dba-8880-da335f685099" (UID: "b72c6ce6-361d-4dba-8880-da335f685099"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:07:50.548997 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:50.548980 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea28fb6a-92c4-43b1-ab58-f9085e74ea1b-util" (OuterVolumeSpecName: "util") pod "ea28fb6a-92c4-43b1-ab58-f9085e74ea1b" (UID: "ea28fb6a-92c4-43b1-ab58-f9085e74ea1b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:07:50.640560 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:50.640519 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea28fb6a-92c4-43b1-ab58-f9085e74ea1b-bundle\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:07:50.640560 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:50.640553 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b72c6ce6-361d-4dba-8880-da335f685099-bundle\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:07:50.640770 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:50.640562 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vfgp\" (UniqueName: \"kubernetes.io/projected/ea28fb6a-92c4-43b1-ab58-f9085e74ea1b-kube-api-access-4vfgp\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:07:50.640770 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:50.640591 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea28fb6a-92c4-43b1-ab58-f9085e74ea1b-util\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:07:50.640770 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:50.640600 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7t4w\" (UniqueName: \"kubernetes.io/projected/b72c6ce6-361d-4dba-8880-da335f685099-kube-api-access-b7t4w\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:07:50.640770 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:50.640608 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b72c6ce6-361d-4dba-8880-da335f685099-util\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:07:51.252965 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:51.252934 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kbzh" Jun 11 20:07:51.253447 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:51.252937 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kbzh" event={"ID":"ea28fb6a-92c4-43b1-ab58-f9085e74ea1b","Type":"ContainerDied","Data":"9228c57df0aebcccde38a9d93af84af00fc9a1fdbb11c15fb891e53c9bea9240"} Jun 11 20:07:51.253447 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:51.253039 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9228c57df0aebcccde38a9d93af84af00fc9a1fdbb11c15fb891e53c9bea9240" Jun 11 20:07:51.254936 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:51.254908 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mdltg" event={"ID":"b72c6ce6-361d-4dba-8880-da335f685099","Type":"ContainerDied","Data":"17e9f2f56b3d30298d96c70f07f2d7dfa718571a88a368aaf24449dbb430556a"} Jun 11 20:07:51.255083 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:51.254957 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="17e9f2f56b3d30298d96c70f07f2d7dfa718571a88a368aaf24449dbb430556a" Jun 11 20:07:51.255083 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:51.254964 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mdltg" Jun 11 20:07:51.390611 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:51.390581 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k9dlj" Jun 11 20:07:51.447902 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:51.447872 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fffe2942-d8a4-45d8-90f4-3197f5981f1d-util\") pod \"fffe2942-d8a4-45d8-90f4-3197f5981f1d\" (UID: \"fffe2942-d8a4-45d8-90f4-3197f5981f1d\") " Jun 11 20:07:51.448058 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:51.447928 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2kc9\" (UniqueName: \"kubernetes.io/projected/fffe2942-d8a4-45d8-90f4-3197f5981f1d-kube-api-access-s2kc9\") pod \"fffe2942-d8a4-45d8-90f4-3197f5981f1d\" (UID: \"fffe2942-d8a4-45d8-90f4-3197f5981f1d\") " Jun 11 20:07:51.448058 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:51.448047 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fffe2942-d8a4-45d8-90f4-3197f5981f1d-bundle\") pod \"fffe2942-d8a4-45d8-90f4-3197f5981f1d\" (UID: \"fffe2942-d8a4-45d8-90f4-3197f5981f1d\") " Jun 11 20:07:51.448675 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:51.448638 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fffe2942-d8a4-45d8-90f4-3197f5981f1d-bundle" (OuterVolumeSpecName: "bundle") pod "fffe2942-d8a4-45d8-90f4-3197f5981f1d" (UID: "fffe2942-d8a4-45d8-90f4-3197f5981f1d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:07:51.450282 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:51.450260 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fffe2942-d8a4-45d8-90f4-3197f5981f1d-kube-api-access-s2kc9" (OuterVolumeSpecName: "kube-api-access-s2kc9") pod "fffe2942-d8a4-45d8-90f4-3197f5981f1d" (UID: "fffe2942-d8a4-45d8-90f4-3197f5981f1d"). InnerVolumeSpecName "kube-api-access-s2kc9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:07:51.453426 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:51.453391 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fffe2942-d8a4-45d8-90f4-3197f5981f1d-util" (OuterVolumeSpecName: "util") pod "fffe2942-d8a4-45d8-90f4-3197f5981f1d" (UID: "fffe2942-d8a4-45d8-90f4-3197f5981f1d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:07:51.549327 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:51.549229 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fffe2942-d8a4-45d8-90f4-3197f5981f1d-util\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:07:51.549327 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:51.549265 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2kc9\" (UniqueName: \"kubernetes.io/projected/fffe2942-d8a4-45d8-90f4-3197f5981f1d-kube-api-access-s2kc9\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:07:51.549327 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:51.549277 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fffe2942-d8a4-45d8-90f4-3197f5981f1d-bundle\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:07:52.262621 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:52.262590 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k9dlj" Jun 11 20:07:52.263021 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:52.262589 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k9dlj" event={"ID":"fffe2942-d8a4-45d8-90f4-3197f5981f1d","Type":"ContainerDied","Data":"e46ef38aaa1b6023abb01ce76d9232747cec364bc6bfec3f7a25a1a4626741c3"} Jun 11 20:07:52.263021 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:52.262716 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e46ef38aaa1b6023abb01ce76d9232747cec364bc6bfec3f7a25a1a4626741c3" Jun 11 20:07:59.049182 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:07:59.049116 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:08:03.247899 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:03.247841 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:08:05.702007 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:05.701975 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:08:05.831458 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:05.831428 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:08:06.423659 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:06.423627 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:08:09.138317 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.138279 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jd8bn"] Jun 11 20:08:09.138734 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.138699 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c34fbd41-e792-443b-8979-ec5056f5d46e" containerName="util" Jun 11 20:08:09.138734 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.138712 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c34fbd41-e792-443b-8979-ec5056f5d46e" containerName="util" Jun 11 20:08:09.138734 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.138722 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c34fbd41-e792-443b-8979-ec5056f5d46e" containerName="pull" Jun 11 20:08:09.138734 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.138727 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c34fbd41-e792-443b-8979-ec5056f5d46e" containerName="pull" Jun 11 20:08:09.138734 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.138736 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea28fb6a-92c4-43b1-ab58-f9085e74ea1b" containerName="extract" Jun 11 20:08:09.138928 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.138743 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea28fb6a-92c4-43b1-ab58-f9085e74ea1b" containerName="extract" Jun 11 20:08:09.138928 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.138749 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fffe2942-d8a4-45d8-90f4-3197f5981f1d" containerName="pull" Jun 11 20:08:09.138928 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.138754 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fffe2942-d8a4-45d8-90f4-3197f5981f1d" containerName="pull" Jun 11 20:08:09.138928 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.138768 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea28fb6a-92c4-43b1-ab58-f9085e74ea1b" containerName="util" Jun 11 20:08:09.138928 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.138773 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea28fb6a-92c4-43b1-ab58-f9085e74ea1b" containerName="util" Jun 11 20:08:09.138928 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.138779 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b72c6ce6-361d-4dba-8880-da335f685099" containerName="util" Jun 11 20:08:09.138928 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.138783 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b72c6ce6-361d-4dba-8880-da335f685099" containerName="util" Jun 11 20:08:09.138928 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.138791 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b72c6ce6-361d-4dba-8880-da335f685099" containerName="extract" Jun 11 20:08:09.138928 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.138795 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b72c6ce6-361d-4dba-8880-da335f685099" containerName="extract" Jun 11 20:08:09.138928 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.138801 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fffe2942-d8a4-45d8-90f4-3197f5981f1d" containerName="util" Jun 11 20:08:09.138928 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.138806 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fffe2942-d8a4-45d8-90f4-3197f5981f1d" containerName="util" Jun 11 20:08:09.138928 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.138812 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fffe2942-d8a4-45d8-90f4-3197f5981f1d" containerName="extract" Jun 11 20:08:09.138928 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.138817 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fffe2942-d8a4-45d8-90f4-3197f5981f1d" containerName="extract" Jun 11 20:08:09.138928 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.138821 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b72c6ce6-361d-4dba-8880-da335f685099" containerName="pull" Jun 11 20:08:09.138928 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.138826 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b72c6ce6-361d-4dba-8880-da335f685099" containerName="pull" Jun 11 20:08:09.138928 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.138834 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c34fbd41-e792-443b-8979-ec5056f5d46e" containerName="extract" Jun 11 20:08:09.138928 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.138838 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c34fbd41-e792-443b-8979-ec5056f5d46e" containerName="extract" Jun 11 20:08:09.138928 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.138844 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea28fb6a-92c4-43b1-ab58-f9085e74ea1b" containerName="pull" Jun 11 20:08:09.138928 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.138849 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea28fb6a-92c4-43b1-ab58-f9085e74ea1b" containerName="pull" Jun 11 20:08:09.138928 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.138906 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b72c6ce6-361d-4dba-8880-da335f685099" containerName="extract" Jun 11 20:08:09.138928 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.138913 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fffe2942-d8a4-45d8-90f4-3197f5981f1d" containerName="extract" Jun 11 20:08:09.138928 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.138918 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c34fbd41-e792-443b-8979-ec5056f5d46e" containerName="extract" Jun 11 20:08:09.138928 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.138925 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea28fb6a-92c4-43b1-ab58-f9085e74ea1b" containerName="extract" Jun 11 20:08:09.142278 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.142257 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jd8bn" Jun 11 20:08:09.145054 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.145036 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 20:08:09.146063 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.146045 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 20:08:09.146162 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.146053 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-gs2f9\"" Jun 11 20:08:09.151964 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.151932 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jd8bn"] Jun 11 20:08:09.309348 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.309307 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrrlg\" (UniqueName: \"kubernetes.io/projected/50d6ae9b-b181-427f-8f8f-7d2707c7d13f-kube-api-access-xrrlg\") pod \"authorino-operator-75cc8d5cb7-jd8bn\" (UID: \"50d6ae9b-b181-427f-8f8f-7d2707c7d13f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jd8bn" Jun 11 20:08:09.410087 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.409995 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrrlg\" (UniqueName: \"kubernetes.io/projected/50d6ae9b-b181-427f-8f8f-7d2707c7d13f-kube-api-access-xrrlg\") pod \"authorino-operator-75cc8d5cb7-jd8bn\" (UID: \"50d6ae9b-b181-427f-8f8f-7d2707c7d13f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jd8bn" Jun 11 20:08:09.420939 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.420913 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrrlg\" (UniqueName: \"kubernetes.io/projected/50d6ae9b-b181-427f-8f8f-7d2707c7d13f-kube-api-access-xrrlg\") pod \"authorino-operator-75cc8d5cb7-jd8bn\" (UID: \"50d6ae9b-b181-427f-8f8f-7d2707c7d13f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jd8bn" Jun 11 20:08:09.453930 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.453897 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jd8bn" Jun 11 20:08:09.597856 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.597830 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jd8bn"] Jun 11 20:08:09.599977 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:08:09.599950 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50d6ae9b_b181_427f_8f8f_7d2707c7d13f.slice/crio-65ecb73b2fd9b53a618c497ab3488f0f822bf927a92c7bd0acd6b29b5a07b38a WatchSource:0}: Error finding container 65ecb73b2fd9b53a618c497ab3488f0f822bf927a92c7bd0acd6b29b5a07b38a: Status 404 returned error can't find the container with id 65ecb73b2fd9b53a618c497ab3488f0f822bf927a92c7bd0acd6b29b5a07b38a Jun 11 20:08:09.849290 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:09.849258 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:08:10.374003 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:10.373957 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jd8bn" event={"ID":"50d6ae9b-b181-427f-8f8f-7d2707c7d13f","Type":"ContainerStarted","Data":"65ecb73b2fd9b53a618c497ab3488f0f822bf927a92c7bd0acd6b29b5a07b38a"} Jun 11 20:08:10.550647 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:10.550593 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:08:10.731565 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:10.731475 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:08:12.501507 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:12.501474 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:08:13.402325 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:13.402291 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jd8bn" event={"ID":"50d6ae9b-b181-427f-8f8f-7d2707c7d13f","Type":"ContainerStarted","Data":"2aa54fb279ce92a62285f5735cb43bcf30e44de89ae2c2a79b512538a6636f6e"} Jun 11 20:08:13.402534 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:13.402425 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jd8bn" Jun 11 20:08:13.420856 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:13.420804 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jd8bn" podStartSLOduration=1.666235489 podStartE2EDuration="4.420790198s" totalImagesPullingTime="2.754554709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:08:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:08:13.420117673 +0000 UTC m=+585.151279648" watchObservedRunningTime="2026-06-11 20:08:13.420790198 +0000 UTC m=+585.151952176" Jun 11 20:08:14.317073 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:14.317039 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:08:16.112574 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:16.112542 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:08:16.245734 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:16.245701 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:08:19.452647 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:19.452616 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:08:19.526551 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:19.526510 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:08:23.283186 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:23.283150 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:08:23.520230 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:23.520191 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:08:23.707066 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:23.707034 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:08:23.808578 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:23.808540 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:08:23.874631 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:23.874597 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:08:24.410884 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:24.410857 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jd8bn" Jun 11 20:08:27.411807 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:27.411769 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:08:27.511535 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:27.511496 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:08:28.719471 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:28.719442 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ckh6n_ba09d733-3024-4a3c-b49c-ab7213905587/console-operator/1.log" Jun 11 20:08:28.719471 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:28.719463 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ckh6n_ba09d733-3024-4a3c-b49c-ab7213905587/console-operator/1.log" Jun 11 20:08:33.302777 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:33.302736 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kcjph"] Jun 11 20:08:33.306277 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:33.306258 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kcjph" Jun 11 20:08:33.310686 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:33.310665 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5x6fn\"" Jun 11 20:08:33.321402 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:33.321360 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kcjph"] Jun 11 20:08:33.413545 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:33.413508 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kcjph"] Jun 11 20:08:33.413816 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:08:33.413797 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-6pl9n], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kcjph" podUID="2a0177c2-93fa-4480-bd9d-7c7f15ef45e4" Jun 11 20:08:33.418158 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:33.418129 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a0177c2-93fa-4480-bd9d-7c7f15ef45e4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kcjph\" (UID: \"2a0177c2-93fa-4480-bd9d-7c7f15ef45e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kcjph" Jun 11 20:08:33.418235 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:33.418219 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pl9n\" (UniqueName: \"kubernetes.io/projected/2a0177c2-93fa-4480-bd9d-7c7f15ef45e4-kube-api-access-6pl9n\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kcjph\" (UID: \"2a0177c2-93fa-4480-bd9d-7c7f15ef45e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kcjph" Jun 11 20:08:33.519144 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:33.519114 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kcjph" Jun 11 20:08:33.519321 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:33.519204 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a0177c2-93fa-4480-bd9d-7c7f15ef45e4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kcjph\" (UID: \"2a0177c2-93fa-4480-bd9d-7c7f15ef45e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kcjph" Jun 11 20:08:33.519321 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:33.519310 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pl9n\" (UniqueName: \"kubernetes.io/projected/2a0177c2-93fa-4480-bd9d-7c7f15ef45e4-kube-api-access-6pl9n\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kcjph\" (UID: \"2a0177c2-93fa-4480-bd9d-7c7f15ef45e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kcjph" Jun 11 20:08:33.519753 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:33.519726 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a0177c2-93fa-4480-bd9d-7c7f15ef45e4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kcjph\" (UID: \"2a0177c2-93fa-4480-bd9d-7c7f15ef45e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kcjph" Jun 11 20:08:33.526134 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:33.526103 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kcjph" Jun 11 20:08:33.536890 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:33.536867 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pl9n\" (UniqueName: \"kubernetes.io/projected/2a0177c2-93fa-4480-bd9d-7c7f15ef45e4-kube-api-access-6pl9n\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kcjph\" (UID: \"2a0177c2-93fa-4480-bd9d-7c7f15ef45e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kcjph" Jun 11 20:08:33.620302 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:33.620271 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a0177c2-93fa-4480-bd9d-7c7f15ef45e4-extensions-socket-volume\") pod \"2a0177c2-93fa-4480-bd9d-7c7f15ef45e4\" (UID: \"2a0177c2-93fa-4480-bd9d-7c7f15ef45e4\") " Jun 11 20:08:33.620497 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:33.620337 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pl9n\" (UniqueName: \"kubernetes.io/projected/2a0177c2-93fa-4480-bd9d-7c7f15ef45e4-kube-api-access-6pl9n\") pod \"2a0177c2-93fa-4480-bd9d-7c7f15ef45e4\" (UID: \"2a0177c2-93fa-4480-bd9d-7c7f15ef45e4\") " Jun 11 20:08:33.620574 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:33.620549 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a0177c2-93fa-4480-bd9d-7c7f15ef45e4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2a0177c2-93fa-4480-bd9d-7c7f15ef45e4" (UID: "2a0177c2-93fa-4480-bd9d-7c7f15ef45e4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:08:33.622662 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:33.622625 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a0177c2-93fa-4480-bd9d-7c7f15ef45e4-kube-api-access-6pl9n" (OuterVolumeSpecName: "kube-api-access-6pl9n") pod "2a0177c2-93fa-4480-bd9d-7c7f15ef45e4" (UID: "2a0177c2-93fa-4480-bd9d-7c7f15ef45e4"). InnerVolumeSpecName "kube-api-access-6pl9n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:08:33.721859 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:33.721828 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a0177c2-93fa-4480-bd9d-7c7f15ef45e4-extensions-socket-volume\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:08:33.721859 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:33.721855 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pl9n\" (UniqueName: \"kubernetes.io/projected/2a0177c2-93fa-4480-bd9d-7c7f15ef45e4-kube-api-access-6pl9n\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:08:33.866494 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:33.866457 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kcjph"] Jun 11 20:08:33.875158 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:33.875094 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kcjph"] Jun 11 20:08:33.971341 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:33.971308 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lczf5"] Jun 11 20:08:33.975096 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:33.975074 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lczf5" Jun 11 20:08:33.978259 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:33.978238 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-dksth\"" Jun 11 20:08:33.988893 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:33.988867 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lczf5"] Jun 11 20:08:34.024971 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:34.024927 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5hgz\" (UniqueName: \"kubernetes.io/projected/563f9bbe-310b-4433-aeee-b59c1eedf8b5-kube-api-access-c5hgz\") pod \"limitador-operator-controller-manager-859d7b78bd-lczf5\" (UID: \"563f9bbe-310b-4433-aeee-b59c1eedf8b5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lczf5" Jun 11 20:08:34.116157 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:34.116093 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:08:34.125976 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:34.125902 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5hgz\" (UniqueName: \"kubernetes.io/projected/563f9bbe-310b-4433-aeee-b59c1eedf8b5-kube-api-access-c5hgz\") pod \"limitador-operator-controller-manager-859d7b78bd-lczf5\" (UID: \"563f9bbe-310b-4433-aeee-b59c1eedf8b5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lczf5" Jun 11 20:08:34.136788 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:34.136762 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5hgz\" (UniqueName: \"kubernetes.io/projected/563f9bbe-310b-4433-aeee-b59c1eedf8b5-kube-api-access-c5hgz\") pod \"limitador-operator-controller-manager-859d7b78bd-lczf5\" (UID: \"563f9bbe-310b-4433-aeee-b59c1eedf8b5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lczf5" Jun 11 20:08:34.281633 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:34.281601 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:08:34.286438 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:34.286417 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lczf5" Jun 11 20:08:34.433608 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:34.433584 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lczf5"] Jun 11 20:08:34.435336 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:08:34.435312 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod563f9bbe_310b_4433_aeee_b59c1eedf8b5.slice/crio-258c543b6ba96fdeea91d7ef983350e758229c233cc821724dfcc94656b46ea2 WatchSource:0}: Error finding container 258c543b6ba96fdeea91d7ef983350e758229c233cc821724dfcc94656b46ea2: Status 404 returned error can't find the container with id 258c543b6ba96fdeea91d7ef983350e758229c233cc821724dfcc94656b46ea2 Jun 11 20:08:34.533039 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:34.533013 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kcjph" Jun 11 20:08:34.533039 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:34.533021 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lczf5" event={"ID":"563f9bbe-310b-4433-aeee-b59c1eedf8b5","Type":"ContainerStarted","Data":"258c543b6ba96fdeea91d7ef983350e758229c233cc821724dfcc94656b46ea2"} Jun 11 20:08:34.536014 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:08:34.535987 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-kcjph\" is forbidden: User \"system:node:ip-10-0-137-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-142.ec2.internal' and this object" podUID="2a0177c2-93fa-4480-bd9d-7c7f15ef45e4" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kcjph" Jun 11 20:08:34.549244 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:08:34.549211 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-kcjph\" is forbidden: User \"system:node:ip-10-0-137-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-142.ec2.internal' and this object" podUID="2a0177c2-93fa-4480-bd9d-7c7f15ef45e4" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kcjph" Jun 11 20:08:34.736124 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:34.736048 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a0177c2-93fa-4480-bd9d-7c7f15ef45e4" path="/var/lib/kubelet/pods/2a0177c2-93fa-4480-bd9d-7c7f15ef45e4/volumes" Jun 11 20:08:36.546726 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:36.546687 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lczf5" event={"ID":"563f9bbe-310b-4433-aeee-b59c1eedf8b5","Type":"ContainerStarted","Data":"0e85bef890afac32901ccba581ff6052ea1e32cd879e3b6d3b6434c8fd833d50"} Jun 11 20:08:36.547105 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:36.546764 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lczf5" Jun 11 20:08:36.566082 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:36.566030 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lczf5" podStartSLOduration=1.9994121630000001 podStartE2EDuration="3.566014005s" totalImagesPullingTime="1.566601842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:08:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:08:36.56462467 +0000 UTC m=+608.295786671" watchObservedRunningTime="2026-06-11 20:08:36.566014005 +0000 UTC m=+608.297175980" Jun 11 20:08:37.300972 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:37.300936 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:08:38.365213 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:38.365172 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:08:41.882334 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:41.882299 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:08:42.153525 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:42.153418 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:08:42.322490 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:42.322454 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:08:42.417157 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:42.417078 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:08:47.279343 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:47.279301 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:08:47.391453 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:47.391417 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:08:47.556838 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:47.556749 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lczf5" Jun 11 20:08:48.169609 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:08:48.169569 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:09:08.354998 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:08.354961 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57fd4d894c-g2cjm"] Jun 11 20:09:08.360985 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:08.360960 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57fd4d894c-g2cjm" Jun 11 20:09:08.373588 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:08.373562 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57fd4d894c-g2cjm"] Jun 11 20:09:08.409458 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:08.409428 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:09:08.428146 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:08.428109 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3410b9fd-fc53-4c71-b2d7-b9248b01a8d9-trusted-ca-bundle\") pod \"console-57fd4d894c-g2cjm\" (UID: \"3410b9fd-fc53-4c71-b2d7-b9248b01a8d9\") " pod="openshift-console/console-57fd4d894c-g2cjm" Jun 11 20:09:08.428146 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:08.428142 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3410b9fd-fc53-4c71-b2d7-b9248b01a8d9-oauth-serving-cert\") pod \"console-57fd4d894c-g2cjm\" (UID: \"3410b9fd-fc53-4c71-b2d7-b9248b01a8d9\") " pod="openshift-console/console-57fd4d894c-g2cjm" Jun 11 20:09:08.428406 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:08.428218 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6dtr\" (UniqueName: \"kubernetes.io/projected/3410b9fd-fc53-4c71-b2d7-b9248b01a8d9-kube-api-access-l6dtr\") pod \"console-57fd4d894c-g2cjm\" (UID: \"3410b9fd-fc53-4c71-b2d7-b9248b01a8d9\") " pod="openshift-console/console-57fd4d894c-g2cjm" Jun 11 20:09:08.428406 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:08.428272 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3410b9fd-fc53-4c71-b2d7-b9248b01a8d9-console-oauth-config\") pod \"console-57fd4d894c-g2cjm\" (UID: \"3410b9fd-fc53-4c71-b2d7-b9248b01a8d9\") " pod="openshift-console/console-57fd4d894c-g2cjm" Jun 11 20:09:08.428406 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:08.428289 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3410b9fd-fc53-4c71-b2d7-b9248b01a8d9-console-config\") pod \"console-57fd4d894c-g2cjm\" (UID: \"3410b9fd-fc53-4c71-b2d7-b9248b01a8d9\") " pod="openshift-console/console-57fd4d894c-g2cjm" Jun 11 20:09:08.428406 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:08.428335 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3410b9fd-fc53-4c71-b2d7-b9248b01a8d9-console-serving-cert\") pod \"console-57fd4d894c-g2cjm\" (UID: \"3410b9fd-fc53-4c71-b2d7-b9248b01a8d9\") " pod="openshift-console/console-57fd4d894c-g2cjm" Jun 11 20:09:08.428406 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:08.428363 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3410b9fd-fc53-4c71-b2d7-b9248b01a8d9-service-ca\") pod \"console-57fd4d894c-g2cjm\" (UID: \"3410b9fd-fc53-4c71-b2d7-b9248b01a8d9\") " pod="openshift-console/console-57fd4d894c-g2cjm" Jun 11 20:09:08.469100 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:08.469060 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:09:08.529083 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:08.529041 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6dtr\" (UniqueName: \"kubernetes.io/projected/3410b9fd-fc53-4c71-b2d7-b9248b01a8d9-kube-api-access-l6dtr\") pod \"console-57fd4d894c-g2cjm\" (UID: \"3410b9fd-fc53-4c71-b2d7-b9248b01a8d9\") " pod="openshift-console/console-57fd4d894c-g2cjm" Jun 11 20:09:08.529283 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:08.529104 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3410b9fd-fc53-4c71-b2d7-b9248b01a8d9-console-oauth-config\") pod \"console-57fd4d894c-g2cjm\" (UID: \"3410b9fd-fc53-4c71-b2d7-b9248b01a8d9\") " pod="openshift-console/console-57fd4d894c-g2cjm" Jun 11 20:09:08.529283 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:08.529121 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3410b9fd-fc53-4c71-b2d7-b9248b01a8d9-console-config\") pod \"console-57fd4d894c-g2cjm\" (UID: \"3410b9fd-fc53-4c71-b2d7-b9248b01a8d9\") " pod="openshift-console/console-57fd4d894c-g2cjm" Jun 11 20:09:08.529283 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:08.529137 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3410b9fd-fc53-4c71-b2d7-b9248b01a8d9-console-serving-cert\") pod \"console-57fd4d894c-g2cjm\" (UID: \"3410b9fd-fc53-4c71-b2d7-b9248b01a8d9\") " pod="openshift-console/console-57fd4d894c-g2cjm" Jun 11 20:09:08.529283 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:08.529171 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3410b9fd-fc53-4c71-b2d7-b9248b01a8d9-service-ca\") pod \"console-57fd4d894c-g2cjm\" (UID: \"3410b9fd-fc53-4c71-b2d7-b9248b01a8d9\") " pod="openshift-console/console-57fd4d894c-g2cjm" Jun 11 20:09:08.529283 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:08.529242 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3410b9fd-fc53-4c71-b2d7-b9248b01a8d9-trusted-ca-bundle\") pod \"console-57fd4d894c-g2cjm\" (UID: \"3410b9fd-fc53-4c71-b2d7-b9248b01a8d9\") " pod="openshift-console/console-57fd4d894c-g2cjm" Jun 11 20:09:08.529283 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:08.529271 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3410b9fd-fc53-4c71-b2d7-b9248b01a8d9-oauth-serving-cert\") pod \"console-57fd4d894c-g2cjm\" (UID: \"3410b9fd-fc53-4c71-b2d7-b9248b01a8d9\") " pod="openshift-console/console-57fd4d894c-g2cjm" Jun 11 20:09:08.530001 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:08.529972 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3410b9fd-fc53-4c71-b2d7-b9248b01a8d9-console-config\") pod \"console-57fd4d894c-g2cjm\" (UID: \"3410b9fd-fc53-4c71-b2d7-b9248b01a8d9\") " pod="openshift-console/console-57fd4d894c-g2cjm" Jun 11 20:09:08.530198 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:08.530046 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3410b9fd-fc53-4c71-b2d7-b9248b01a8d9-service-ca\") pod \"console-57fd4d894c-g2cjm\" (UID: \"3410b9fd-fc53-4c71-b2d7-b9248b01a8d9\") " pod="openshift-console/console-57fd4d894c-g2cjm" Jun 11 20:09:08.530307 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:08.530227 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3410b9fd-fc53-4c71-b2d7-b9248b01a8d9-oauth-serving-cert\") pod \"console-57fd4d894c-g2cjm\" (UID: \"3410b9fd-fc53-4c71-b2d7-b9248b01a8d9\") " pod="openshift-console/console-57fd4d894c-g2cjm" Jun 11 20:09:08.530307 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:08.530258 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3410b9fd-fc53-4c71-b2d7-b9248b01a8d9-trusted-ca-bundle\") pod \"console-57fd4d894c-g2cjm\" (UID: \"3410b9fd-fc53-4c71-b2d7-b9248b01a8d9\") " pod="openshift-console/console-57fd4d894c-g2cjm" Jun 11 20:09:08.531840 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:08.531814 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3410b9fd-fc53-4c71-b2d7-b9248b01a8d9-console-oauth-config\") pod \"console-57fd4d894c-g2cjm\" (UID: \"3410b9fd-fc53-4c71-b2d7-b9248b01a8d9\") " pod="openshift-console/console-57fd4d894c-g2cjm" Jun 11 20:09:08.531942 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:08.531927 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3410b9fd-fc53-4c71-b2d7-b9248b01a8d9-console-serving-cert\") pod \"console-57fd4d894c-g2cjm\" (UID: \"3410b9fd-fc53-4c71-b2d7-b9248b01a8d9\") " pod="openshift-console/console-57fd4d894c-g2cjm" Jun 11 20:09:08.537336 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:08.537315 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6dtr\" (UniqueName: \"kubernetes.io/projected/3410b9fd-fc53-4c71-b2d7-b9248b01a8d9-kube-api-access-l6dtr\") pod \"console-57fd4d894c-g2cjm\" (UID: \"3410b9fd-fc53-4c71-b2d7-b9248b01a8d9\") " pod="openshift-console/console-57fd4d894c-g2cjm" Jun 11 20:09:08.671145 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:08.671056 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57fd4d894c-g2cjm" Jun 11 20:09:08.814710 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:08.814673 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57fd4d894c-g2cjm"] Jun 11 20:09:08.816148 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:09:08.816123 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3410b9fd_fc53_4c71_b2d7_b9248b01a8d9.slice/crio-199106d4fb0dd6c5692fc866e3ec6d13d9c64064f64319e472653b65de9f9e87 WatchSource:0}: Error finding container 199106d4fb0dd6c5692fc866e3ec6d13d9c64064f64319e472653b65de9f9e87: Status 404 returned error can't find the container with id 199106d4fb0dd6c5692fc866e3ec6d13d9c64064f64319e472653b65de9f9e87 Jun 11 20:09:09.743609 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:09.743577 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57fd4d894c-g2cjm" event={"ID":"3410b9fd-fc53-4c71-b2d7-b9248b01a8d9","Type":"ContainerStarted","Data":"35bd97157924a308cc1f373a7559cb7360d53147d6308f9a033d74ffcfd6d6eb"} Jun 11 20:09:09.743975 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:09.743624 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57fd4d894c-g2cjm" event={"ID":"3410b9fd-fc53-4c71-b2d7-b9248b01a8d9","Type":"ContainerStarted","Data":"199106d4fb0dd6c5692fc866e3ec6d13d9c64064f64319e472653b65de9f9e87"} Jun 11 20:09:09.764487 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:09.764435 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57fd4d894c-g2cjm" podStartSLOduration=1.7644209119999998 podStartE2EDuration="1.764420912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:09:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:09:09.762101768 +0000 UTC m=+641.493263754" watchObservedRunningTime="2026-06-11 20:09:09.764420912 +0000 UTC m=+641.495582888" Jun 11 20:09:18.164438 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:18.164402 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:09:18.392889 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:18.392854 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:09:18.671673 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:18.671624 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57fd4d894c-g2cjm" Jun 11 20:09:18.671861 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:18.671708 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57fd4d894c-g2cjm" Jun 11 20:09:18.676277 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:18.676255 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57fd4d894c-g2cjm" Jun 11 20:09:18.802153 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:18.802121 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57fd4d894c-g2cjm" Jun 11 20:09:18.856613 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:18.856578 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66bf9749cd-dnhnv"] Jun 11 20:09:18.962808 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:18.962705 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:09:19.063858 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:19.063821 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:09:19.164632 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:19.164596 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:09:19.978611 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:19.978575 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:09:20.085418 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:20.085364 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:09:20.146971 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:20.146939 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:09:20.829519 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:20.829466 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:09:20.895657 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:20.895628 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:09:33.837841 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:33.837797 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:09:41.119459 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:41.119424 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:09:43.890743 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:43.890686 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-66bf9749cd-dnhnv" podUID="9208e0d9-b19e-4af8-a3c5-975c6d6f3286" containerName="console" containerID="cri-o://0bbd7cef919f609c5cdb809478e5f8cbceeee0d32efd7556beddc7f57240c109" gracePeriod=15 Jun 11 20:09:44.142924 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:44.142854 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66bf9749cd-dnhnv" Jun 11 20:09:44.254843 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:44.254803 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-service-ca\") pod \"9208e0d9-b19e-4af8-a3c5-975c6d6f3286\" (UID: \"9208e0d9-b19e-4af8-a3c5-975c6d6f3286\") " Jun 11 20:09:44.254843 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:44.254863 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-console-oauth-config\") pod \"9208e0d9-b19e-4af8-a3c5-975c6d6f3286\" (UID: \"9208e0d9-b19e-4af8-a3c5-975c6d6f3286\") " Jun 11 20:09:44.255115 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:44.254891 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-oauth-serving-cert\") pod \"9208e0d9-b19e-4af8-a3c5-975c6d6f3286\" (UID: \"9208e0d9-b19e-4af8-a3c5-975c6d6f3286\") " Jun 11 20:09:44.255115 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:44.254913 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-console-config\") pod \"9208e0d9-b19e-4af8-a3c5-975c6d6f3286\" (UID: \"9208e0d9-b19e-4af8-a3c5-975c6d6f3286\") " Jun 11 20:09:44.255115 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:44.255038 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-console-serving-cert\") pod \"9208e0d9-b19e-4af8-a3c5-975c6d6f3286\" (UID: \"9208e0d9-b19e-4af8-a3c5-975c6d6f3286\") " Jun 11 20:09:44.255115 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:44.255090 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qx7b\" (UniqueName: \"kubernetes.io/projected/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-kube-api-access-6qx7b\") pod \"9208e0d9-b19e-4af8-a3c5-975c6d6f3286\" (UID: \"9208e0d9-b19e-4af8-a3c5-975c6d6f3286\") " Jun 11 20:09:44.255327 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:44.255117 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-trusted-ca-bundle\") pod \"9208e0d9-b19e-4af8-a3c5-975c6d6f3286\" (UID: \"9208e0d9-b19e-4af8-a3c5-975c6d6f3286\") " Jun 11 20:09:44.255327 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:44.255201 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-service-ca" (OuterVolumeSpecName: "service-ca") pod "9208e0d9-b19e-4af8-a3c5-975c6d6f3286" (UID: "9208e0d9-b19e-4af8-a3c5-975c6d6f3286"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 20:09:44.255327 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:44.255277 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9208e0d9-b19e-4af8-a3c5-975c6d6f3286" (UID: "9208e0d9-b19e-4af8-a3c5-975c6d6f3286"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 20:09:44.255534 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:44.255346 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-console-config" (OuterVolumeSpecName: "console-config") pod "9208e0d9-b19e-4af8-a3c5-975c6d6f3286" (UID: "9208e0d9-b19e-4af8-a3c5-975c6d6f3286"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 20:09:44.255534 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:44.255490 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-service-ca\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:09:44.255534 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:44.255516 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-oauth-serving-cert\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:09:44.255534 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:44.255535 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-console-config\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:09:44.255702 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:44.255600 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9208e0d9-b19e-4af8-a3c5-975c6d6f3286" (UID: "9208e0d9-b19e-4af8-a3c5-975c6d6f3286"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 20:09:44.257320 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:44.257297 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9208e0d9-b19e-4af8-a3c5-975c6d6f3286" (UID: "9208e0d9-b19e-4af8-a3c5-975c6d6f3286"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 20:09:44.257721 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:44.257702 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-kube-api-access-6qx7b" (OuterVolumeSpecName: "kube-api-access-6qx7b") pod "9208e0d9-b19e-4af8-a3c5-975c6d6f3286" (UID: "9208e0d9-b19e-4af8-a3c5-975c6d6f3286"). InnerVolumeSpecName "kube-api-access-6qx7b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:09:44.257790 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:44.257718 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9208e0d9-b19e-4af8-a3c5-975c6d6f3286" (UID: "9208e0d9-b19e-4af8-a3c5-975c6d6f3286"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 20:09:44.356845 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:44.356795 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-console-serving-cert\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:09:44.356845 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:44.356835 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qx7b\" (UniqueName: \"kubernetes.io/projected/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-kube-api-access-6qx7b\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:09:44.356845 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:44.356845 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-trusted-ca-bundle\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:09:44.356845 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:44.356854 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9208e0d9-b19e-4af8-a3c5-975c6d6f3286-console-oauth-config\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:09:44.952068 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:44.952031 2562 generic.go:356] "Generic (PLEG): container finished" podID="9208e0d9-b19e-4af8-a3c5-975c6d6f3286" containerID="0bbd7cef919f609c5cdb809478e5f8cbceeee0d32efd7556beddc7f57240c109" exitCode=0 Jun 11 20:09:44.952542 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:44.952077 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66bf9749cd-dnhnv" Jun 11 20:09:44.952542 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:44.952118 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66bf9749cd-dnhnv" event={"ID":"9208e0d9-b19e-4af8-a3c5-975c6d6f3286","Type":"ContainerDied","Data":"0bbd7cef919f609c5cdb809478e5f8cbceeee0d32efd7556beddc7f57240c109"} Jun 11 20:09:44.952542 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:44.952170 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66bf9749cd-dnhnv" event={"ID":"9208e0d9-b19e-4af8-a3c5-975c6d6f3286","Type":"ContainerDied","Data":"46ae883a42b9a4c40ffccc31813211b77e7f470fbe499b9ba328dd4173ff9b51"} Jun 11 20:09:44.952542 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:44.952191 2562 scope.go:117] "RemoveContainer" containerID="0bbd7cef919f609c5cdb809478e5f8cbceeee0d32efd7556beddc7f57240c109" Jun 11 20:09:44.961462 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:44.961446 2562 scope.go:117] "RemoveContainer" containerID="0bbd7cef919f609c5cdb809478e5f8cbceeee0d32efd7556beddc7f57240c109" Jun 11 20:09:44.961722 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:09:44.961700 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bbd7cef919f609c5cdb809478e5f8cbceeee0d32efd7556beddc7f57240c109\": container with ID starting with 0bbd7cef919f609c5cdb809478e5f8cbceeee0d32efd7556beddc7f57240c109 not found: ID does not exist" containerID="0bbd7cef919f609c5cdb809478e5f8cbceeee0d32efd7556beddc7f57240c109" Jun 11 20:09:44.961791 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:44.961734 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bbd7cef919f609c5cdb809478e5f8cbceeee0d32efd7556beddc7f57240c109"} err="failed to get container status \"0bbd7cef919f609c5cdb809478e5f8cbceeee0d32efd7556beddc7f57240c109\": rpc error: code = NotFound desc = could not find container \"0bbd7cef919f609c5cdb809478e5f8cbceeee0d32efd7556beddc7f57240c109\": container with ID starting with 0bbd7cef919f609c5cdb809478e5f8cbceeee0d32efd7556beddc7f57240c109 not found: ID does not exist" Jun 11 20:09:44.969780 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:44.969749 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66bf9749cd-dnhnv"] Jun 11 20:09:44.973287 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:44.973265 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66bf9749cd-dnhnv"] Jun 11 20:09:46.735837 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:46.735793 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9208e0d9-b19e-4af8-a3c5-975c6d6f3286" path="/var/lib/kubelet/pods/9208e0d9-b19e-4af8-a3c5-975c6d6f3286/volumes" Jun 11 20:09:50.399867 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:50.399829 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:09:50.538507 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:50.538465 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:09:50.666503 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:50.666420 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:09:52.441691 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:52.441656 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bptvn"] Jun 11 20:09:52.442179 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:52.442044 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9208e0d9-b19e-4af8-a3c5-975c6d6f3286" containerName="console" Jun 11 20:09:52.442179 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:52.442056 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9208e0d9-b19e-4af8-a3c5-975c6d6f3286" containerName="console" Jun 11 20:09:52.442179 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:52.442135 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9208e0d9-b19e-4af8-a3c5-975c6d6f3286" containerName="console" Jun 11 20:09:52.446597 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:52.446580 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bptvn" Jun 11 20:09:52.451574 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:52.451554 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 20:09:52.452550 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:52.452529 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 20:09:52.452664 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:52.452553 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n7jmt\"" Jun 11 20:09:52.478763 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:52.478733 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bptvn"] Jun 11 20:09:52.537366 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:52.537324 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f087911-1027-4dc4-983b-bc312d2c1c8a-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bptvn\" (UID: \"0f087911-1027-4dc4-983b-bc312d2c1c8a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bptvn" Jun 11 20:09:52.537366 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:52.537367 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldjf9\" (UniqueName: \"kubernetes.io/projected/0f087911-1027-4dc4-983b-bc312d2c1c8a-kube-api-access-ldjf9\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bptvn\" (UID: \"0f087911-1027-4dc4-983b-bc312d2c1c8a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bptvn" Jun 11 20:09:52.537644 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:52.537482 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f087911-1027-4dc4-983b-bc312d2c1c8a-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bptvn\" (UID: \"0f087911-1027-4dc4-983b-bc312d2c1c8a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bptvn" Jun 11 20:09:52.638738 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:52.638693 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f087911-1027-4dc4-983b-bc312d2c1c8a-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bptvn\" (UID: \"0f087911-1027-4dc4-983b-bc312d2c1c8a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bptvn" Jun 11 20:09:52.638942 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:52.638825 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f087911-1027-4dc4-983b-bc312d2c1c8a-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bptvn\" (UID: \"0f087911-1027-4dc4-983b-bc312d2c1c8a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bptvn" Jun 11 20:09:52.638942 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:52.638854 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldjf9\" (UniqueName: \"kubernetes.io/projected/0f087911-1027-4dc4-983b-bc312d2c1c8a-kube-api-access-ldjf9\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bptvn\" (UID: \"0f087911-1027-4dc4-983b-bc312d2c1c8a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bptvn" Jun 11 20:09:52.639092 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:52.639067 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f087911-1027-4dc4-983b-bc312d2c1c8a-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bptvn\" (UID: \"0f087911-1027-4dc4-983b-bc312d2c1c8a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bptvn" Jun 11 20:09:52.639155 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:52.639118 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f087911-1027-4dc4-983b-bc312d2c1c8a-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bptvn\" (UID: \"0f087911-1027-4dc4-983b-bc312d2c1c8a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bptvn" Jun 11 20:09:52.652450 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:52.652414 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldjf9\" (UniqueName: \"kubernetes.io/projected/0f087911-1027-4dc4-983b-bc312d2c1c8a-kube-api-access-ldjf9\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bptvn\" (UID: \"0f087911-1027-4dc4-983b-bc312d2c1c8a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bptvn" Jun 11 20:09:52.756399 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:52.756283 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bptvn" Jun 11 20:09:52.925494 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:52.923939 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bptvn"] Jun 11 20:09:53.001059 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:53.001026 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bptvn" event={"ID":"0f087911-1027-4dc4-983b-bc312d2c1c8a","Type":"ContainerStarted","Data":"6a69fae33307b4469bdfc5e86d83bdc93b386366b00ecc6f70f7d0391477256b"} Jun 11 20:09:53.001167 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:53.001084 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bptvn" event={"ID":"0f087911-1027-4dc4-983b-bc312d2c1c8a","Type":"ContainerStarted","Data":"40baa6ec92d78a040434cd7523a65a805151613bf00d3a9ee113a9f4caa23516"} Jun 11 20:09:54.008238 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:54.008147 2562 generic.go:356] "Generic (PLEG): container finished" podID="0f087911-1027-4dc4-983b-bc312d2c1c8a" containerID="6a69fae33307b4469bdfc5e86d83bdc93b386366b00ecc6f70f7d0391477256b" exitCode=0 Jun 11 20:09:54.008643 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:54.008237 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bptvn" event={"ID":"0f087911-1027-4dc4-983b-bc312d2c1c8a","Type":"ContainerDied","Data":"6a69fae33307b4469bdfc5e86d83bdc93b386366b00ecc6f70f7d0391477256b"} Jun 11 20:09:54.009286 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:54.009272 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 20:09:55.016226 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:55.016186 2562 generic.go:356] "Generic (PLEG): container finished" podID="0f087911-1027-4dc4-983b-bc312d2c1c8a" containerID="5d2a868e91cb3ee15ffaecb2f7fc95994f046235b89733a00d21888e2097f0e4" exitCode=0 Jun 11 20:09:55.016226 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:55.016230 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bptvn" event={"ID":"0f087911-1027-4dc4-983b-bc312d2c1c8a","Type":"ContainerDied","Data":"5d2a868e91cb3ee15ffaecb2f7fc95994f046235b89733a00d21888e2097f0e4"} Jun 11 20:09:56.024661 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:56.024627 2562 generic.go:356] "Generic (PLEG): container finished" podID="0f087911-1027-4dc4-983b-bc312d2c1c8a" containerID="091859cbe240b004ee77a794c858205682d9c08b3f2ef1b2e15bb84e31f0da87" exitCode=0 Jun 11 20:09:56.025054 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:56.024693 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bptvn" event={"ID":"0f087911-1027-4dc4-983b-bc312d2c1c8a","Type":"ContainerDied","Data":"091859cbe240b004ee77a794c858205682d9c08b3f2ef1b2e15bb84e31f0da87"} Jun 11 20:09:57.168571 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:57.168542 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bptvn" Jun 11 20:09:57.277652 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:57.277607 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f087911-1027-4dc4-983b-bc312d2c1c8a-util\") pod \"0f087911-1027-4dc4-983b-bc312d2c1c8a\" (UID: \"0f087911-1027-4dc4-983b-bc312d2c1c8a\") " Jun 11 20:09:57.277847 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:57.277671 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldjf9\" (UniqueName: \"kubernetes.io/projected/0f087911-1027-4dc4-983b-bc312d2c1c8a-kube-api-access-ldjf9\") pod \"0f087911-1027-4dc4-983b-bc312d2c1c8a\" (UID: \"0f087911-1027-4dc4-983b-bc312d2c1c8a\") " Jun 11 20:09:57.277847 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:57.277777 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f087911-1027-4dc4-983b-bc312d2c1c8a-bundle\") pod \"0f087911-1027-4dc4-983b-bc312d2c1c8a\" (UID: \"0f087911-1027-4dc4-983b-bc312d2c1c8a\") " Jun 11 20:09:57.278266 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:57.278241 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f087911-1027-4dc4-983b-bc312d2c1c8a-bundle" (OuterVolumeSpecName: "bundle") pod "0f087911-1027-4dc4-983b-bc312d2c1c8a" (UID: "0f087911-1027-4dc4-983b-bc312d2c1c8a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:09:57.279997 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:57.279972 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f087911-1027-4dc4-983b-bc312d2c1c8a-kube-api-access-ldjf9" (OuterVolumeSpecName: "kube-api-access-ldjf9") pod "0f087911-1027-4dc4-983b-bc312d2c1c8a" (UID: "0f087911-1027-4dc4-983b-bc312d2c1c8a"). InnerVolumeSpecName "kube-api-access-ldjf9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:09:57.284012 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:57.283951 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f087911-1027-4dc4-983b-bc312d2c1c8a-util" (OuterVolumeSpecName: "util") pod "0f087911-1027-4dc4-983b-bc312d2c1c8a" (UID: "0f087911-1027-4dc4-983b-bc312d2c1c8a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:09:57.378704 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:57.378667 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldjf9\" (UniqueName: \"kubernetes.io/projected/0f087911-1027-4dc4-983b-bc312d2c1c8a-kube-api-access-ldjf9\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:09:57.378704 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:57.378697 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f087911-1027-4dc4-983b-bc312d2c1c8a-bundle\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:09:57.378704 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:57.378714 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f087911-1027-4dc4-983b-bc312d2c1c8a-util\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:09:58.038220 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:58.038193 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bptvn" Jun 11 20:09:58.038220 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:58.038213 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bptvn" event={"ID":"0f087911-1027-4dc4-983b-bc312d2c1c8a","Type":"ContainerDied","Data":"40baa6ec92d78a040434cd7523a65a805151613bf00d3a9ee113a9f4caa23516"} Jun 11 20:09:58.038480 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:09:58.038264 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="40baa6ec92d78a040434cd7523a65a805151613bf00d3a9ee113a9f4caa23516" Jun 11 20:10:16.885111 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:16.885005 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:10:16.996167 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:16.995980 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:10:28.373735 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:28.373700 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:10:47.441559 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:47.441517 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:10:47.594300 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:47.594262 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:10:53.375794 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:53.375764 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:10:53.381940 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:53.381913 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6659ddc54b-lzsgz"] Jun 11 20:10:53.382367 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:53.382352 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f087911-1027-4dc4-983b-bc312d2c1c8a" containerName="pull" Jun 11 20:10:53.382438 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:53.382368 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f087911-1027-4dc4-983b-bc312d2c1c8a" containerName="pull" Jun 11 20:10:53.382438 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:53.382393 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f087911-1027-4dc4-983b-bc312d2c1c8a" containerName="extract" Jun 11 20:10:53.382438 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:53.382399 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f087911-1027-4dc4-983b-bc312d2c1c8a" containerName="extract" Jun 11 20:10:53.382438 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:53.382419 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f087911-1027-4dc4-983b-bc312d2c1c8a" containerName="util" Jun 11 20:10:53.382438 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:53.382424 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f087911-1027-4dc4-983b-bc312d2c1c8a" containerName="util" Jun 11 20:10:53.382613 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:53.382495 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f087911-1027-4dc4-983b-bc312d2c1c8a" containerName="extract" Jun 11 20:10:53.385590 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:53.385572 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6659ddc54b-lzsgz" Jun 11 20:10:53.388245 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:53.388225 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 20:10:53.388685 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:53.388672 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-spwr7\"" Jun 11 20:10:53.389435 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:53.389419 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 20:10:53.400471 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:53.400448 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6659ddc54b-lzsgz"] Jun 11 20:10:53.468251 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:53.468219 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:10:53.481542 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:53.481512 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jhnx\" (UniqueName: \"kubernetes.io/projected/6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9-kube-api-access-7jhnx\") pod \"maas-controller-6659ddc54b-lzsgz\" (UID: \"6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9\") " pod="opendatahub/maas-controller-6659ddc54b-lzsgz" Jun 11 20:10:53.481654 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:53.481595 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9-webhook-cert\") pod \"maas-controller-6659ddc54b-lzsgz\" (UID: \"6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9\") " pod="opendatahub/maas-controller-6659ddc54b-lzsgz" Jun 11 20:10:53.564363 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:53.564330 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:10:53.573210 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:53.573183 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6499fc5bd-lvxzs"] Jun 11 20:10:53.576792 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:53.576774 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6499fc5bd-lvxzs" Jun 11 20:10:53.582348 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:53.582323 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jhnx\" (UniqueName: \"kubernetes.io/projected/6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9-kube-api-access-7jhnx\") pod \"maas-controller-6659ddc54b-lzsgz\" (UID: \"6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9\") " pod="opendatahub/maas-controller-6659ddc54b-lzsgz" Jun 11 20:10:53.582694 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:53.582672 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9-webhook-cert\") pod \"maas-controller-6659ddc54b-lzsgz\" (UID: \"6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9\") " pod="opendatahub/maas-controller-6659ddc54b-lzsgz" Jun 11 20:10:53.585985 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:53.585956 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9-webhook-cert\") pod \"maas-controller-6659ddc54b-lzsgz\" (UID: \"6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9\") " pod="opendatahub/maas-controller-6659ddc54b-lzsgz" Jun 11 20:10:53.587053 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:53.587033 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6499fc5bd-lvxzs"] Jun 11 20:10:53.592390 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:53.592353 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jhnx\" (UniqueName: \"kubernetes.io/projected/6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9-kube-api-access-7jhnx\") pod \"maas-controller-6659ddc54b-lzsgz\" (UID: \"6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9\") " pod="opendatahub/maas-controller-6659ddc54b-lzsgz" Jun 11 20:10:53.683845 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:53.683746 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eab23c33-9c53-4d55-b108-f1ae0f54efeb-webhook-cert\") pod \"maas-controller-6499fc5bd-lvxzs\" (UID: \"eab23c33-9c53-4d55-b108-f1ae0f54efeb\") " pod="opendatahub/maas-controller-6499fc5bd-lvxzs" Jun 11 20:10:53.683845 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:53.683838 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v82x\" (UniqueName: \"kubernetes.io/projected/eab23c33-9c53-4d55-b108-f1ae0f54efeb-kube-api-access-6v82x\") pod \"maas-controller-6499fc5bd-lvxzs\" (UID: \"eab23c33-9c53-4d55-b108-f1ae0f54efeb\") " pod="opendatahub/maas-controller-6499fc5bd-lvxzs" Jun 11 20:10:53.695698 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:53.695664 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6659ddc54b-lzsgz" Jun 11 20:10:53.785453 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:53.785227 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v82x\" (UniqueName: \"kubernetes.io/projected/eab23c33-9c53-4d55-b108-f1ae0f54efeb-kube-api-access-6v82x\") pod \"maas-controller-6499fc5bd-lvxzs\" (UID: \"eab23c33-9c53-4d55-b108-f1ae0f54efeb\") " pod="opendatahub/maas-controller-6499fc5bd-lvxzs" Jun 11 20:10:53.785453 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:53.785362 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eab23c33-9c53-4d55-b108-f1ae0f54efeb-webhook-cert\") pod \"maas-controller-6499fc5bd-lvxzs\" (UID: \"eab23c33-9c53-4d55-b108-f1ae0f54efeb\") " pod="opendatahub/maas-controller-6499fc5bd-lvxzs" Jun 11 20:10:53.788956 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:53.788918 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eab23c33-9c53-4d55-b108-f1ae0f54efeb-webhook-cert\") pod \"maas-controller-6499fc5bd-lvxzs\" (UID: \"eab23c33-9c53-4d55-b108-f1ae0f54efeb\") " pod="opendatahub/maas-controller-6499fc5bd-lvxzs" Jun 11 20:10:53.794256 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:53.794227 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v82x\" (UniqueName: \"kubernetes.io/projected/eab23c33-9c53-4d55-b108-f1ae0f54efeb-kube-api-access-6v82x\") pod \"maas-controller-6499fc5bd-lvxzs\" (UID: \"eab23c33-9c53-4d55-b108-f1ae0f54efeb\") " pod="opendatahub/maas-controller-6499fc5bd-lvxzs" Jun 11 20:10:53.837931 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:53.837898 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6659ddc54b-lzsgz"] Jun 11 20:10:53.839169 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:10:53.839141 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cfbab57_2e5a_4ede_8a69_c6e1fd792ba9.slice/crio-0b818ebf6120698593fa022f073258ebbb32111ae3b28943af2eb4fe5f723b97 WatchSource:0}: Error finding container 0b818ebf6120698593fa022f073258ebbb32111ae3b28943af2eb4fe5f723b97: Status 404 returned error can't find the container with id 0b818ebf6120698593fa022f073258ebbb32111ae3b28943af2eb4fe5f723b97 Jun 11 20:10:53.887970 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:53.887936 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6499fc5bd-lvxzs" Jun 11 20:10:54.031060 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:54.031023 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6499fc5bd-lvxzs"] Jun 11 20:10:54.364168 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:54.364128 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6499fc5bd-lvxzs" event={"ID":"eab23c33-9c53-4d55-b108-f1ae0f54efeb","Type":"ContainerStarted","Data":"836dab048d1a0a89637a6d94500cc0ae652df755057fe61ed1361aa64ab61520"} Jun 11 20:10:54.365263 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:54.365235 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6659ddc54b-lzsgz" event={"ID":"6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9","Type":"ContainerStarted","Data":"0b818ebf6120698593fa022f073258ebbb32111ae3b28943af2eb4fe5f723b97"} Jun 11 20:10:56.826393 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:56.826339 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:10:56.948668 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:56.948563 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:10:57.393161 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:57.393122 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6499fc5bd-lvxzs" event={"ID":"eab23c33-9c53-4d55-b108-f1ae0f54efeb","Type":"ContainerStarted","Data":"cea7e288cc15373f36edb0a5c68a8f7a07a068ded61c4f917e6e70338d508af1"} Jun 11 20:10:57.393395 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:57.393315 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6499fc5bd-lvxzs" Jun 11 20:10:57.399090 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:57.399061 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6659ddc54b-lzsgz" event={"ID":"6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9","Type":"ContainerStarted","Data":"d396fec3f7d677ad2e9c23da6a9ad87cd0ce8856b9f66f0d176da9bb6b9fd0e1"} Jun 11 20:10:57.399243 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:57.399149 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6659ddc54b-lzsgz" Jun 11 20:10:57.447239 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:57.447182 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6499fc5bd-lvxzs" podStartSLOduration=1.869992711 podStartE2EDuration="4.447166605s" totalImagesPullingTime="2.577173894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:10:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:10:57.44496435 +0000 UTC m=+749.176126326" watchObservedRunningTime="2026-06-11 20:10:57.447166605 +0000 UTC m=+749.178328611" Jun 11 20:10:57.484435 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:10:57.484365 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6659ddc54b-lzsgz" podStartSLOduration=1.7227189250000001 podStartE2EDuration="4.484347725s" totalImagesPullingTime="2.7616288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:10:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:10:57.480466885 +0000 UTC m=+749.211628859" watchObservedRunningTime="2026-06-11 20:10:57.484347725 +0000 UTC m=+749.215509699" Jun 11 20:11:08.413038 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:08.413008 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6659ddc54b-lzsgz" Jun 11 20:11:08.413573 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:08.413509 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6499fc5bd-lvxzs" Jun 11 20:11:08.490135 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:08.490081 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6659ddc54b-lzsgz"] Jun 11 20:11:08.490434 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:08.490402 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6659ddc54b-lzsgz" podUID="6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9" containerName="manager" containerID="cri-o://d396fec3f7d677ad2e9c23da6a9ad87cd0ce8856b9f66f0d176da9bb6b9fd0e1" gracePeriod=30 Jun 11 20:11:08.742648 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:08.742625 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6659ddc54b-lzsgz" Jun 11 20:11:08.834594 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:08.834560 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jhnx\" (UniqueName: \"kubernetes.io/projected/6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9-kube-api-access-7jhnx\") pod \"6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9\" (UID: \"6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9\") " Jun 11 20:11:08.834800 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:08.834610 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9-webhook-cert\") pod \"6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9\" (UID: \"6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9\") " Jun 11 20:11:08.836877 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:08.836843 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9-kube-api-access-7jhnx" (OuterVolumeSpecName: "kube-api-access-7jhnx") pod "6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9" (UID: "6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9"). InnerVolumeSpecName "kube-api-access-7jhnx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:11:08.837004 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:08.836959 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9" (UID: "6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 20:11:08.935845 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:08.935813 2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9-webhook-cert\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:11:08.935845 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:08.935839 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jhnx\" (UniqueName: \"kubernetes.io/projected/6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9-kube-api-access-7jhnx\") on node \"ip-10-0-137-142.ec2.internal\" DevicePath \"\"" Jun 11 20:11:09.479588 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:09.479548 2562 generic.go:356] "Generic (PLEG): container finished" podID="6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9" containerID="d396fec3f7d677ad2e9c23da6a9ad87cd0ce8856b9f66f0d176da9bb6b9fd0e1" exitCode=0 Jun 11 20:11:09.479588 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:09.479591 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6659ddc54b-lzsgz" Jun 11 20:11:09.480136 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:09.479634 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6659ddc54b-lzsgz" event={"ID":"6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9","Type":"ContainerDied","Data":"d396fec3f7d677ad2e9c23da6a9ad87cd0ce8856b9f66f0d176da9bb6b9fd0e1"} Jun 11 20:11:09.480136 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:09.479687 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6659ddc54b-lzsgz" event={"ID":"6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9","Type":"ContainerDied","Data":"0b818ebf6120698593fa022f073258ebbb32111ae3b28943af2eb4fe5f723b97"} Jun 11 20:11:09.480136 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:09.479709 2562 scope.go:117] "RemoveContainer" containerID="d396fec3f7d677ad2e9c23da6a9ad87cd0ce8856b9f66f0d176da9bb6b9fd0e1" Jun 11 20:11:09.489670 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:09.489654 2562 scope.go:117] "RemoveContainer" containerID="d396fec3f7d677ad2e9c23da6a9ad87cd0ce8856b9f66f0d176da9bb6b9fd0e1" Jun 11 20:11:09.489922 ip-10-0-137-142 kubenswrapper[2562]: E0611 20:11:09.489902 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d396fec3f7d677ad2e9c23da6a9ad87cd0ce8856b9f66f0d176da9bb6b9fd0e1\": container with ID starting with d396fec3f7d677ad2e9c23da6a9ad87cd0ce8856b9f66f0d176da9bb6b9fd0e1 not found: ID does not exist" containerID="d396fec3f7d677ad2e9c23da6a9ad87cd0ce8856b9f66f0d176da9bb6b9fd0e1" Jun 11 20:11:09.489998 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:09.489935 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d396fec3f7d677ad2e9c23da6a9ad87cd0ce8856b9f66f0d176da9bb6b9fd0e1"} err="failed to get container status \"d396fec3f7d677ad2e9c23da6a9ad87cd0ce8856b9f66f0d176da9bb6b9fd0e1\": rpc error: code = NotFound desc = could not find container \"d396fec3f7d677ad2e9c23da6a9ad87cd0ce8856b9f66f0d176da9bb6b9fd0e1\": container with ID starting with d396fec3f7d677ad2e9c23da6a9ad87cd0ce8856b9f66f0d176da9bb6b9fd0e1 not found: ID does not exist" Jun 11 20:11:09.501544 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:09.501522 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6659ddc54b-lzsgz"] Jun 11 20:11:09.507136 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:09.507115 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6659ddc54b-lzsgz"] Jun 11 20:11:10.736197 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:10.736162 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9" path="/var/lib/kubelet/pods/6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9/volumes" Jun 11 20:11:27.908421 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:27.908386 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:11:27.960540 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:27.960502 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-c9886dd47-qw6h6"] Jun 11 20:11:27.961043 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:27.961023 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9" containerName="manager" Jun 11 20:11:27.961043 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:27.961045 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9" containerName="manager" Jun 11 20:11:27.961199 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:27.961168 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cfbab57-2e5a-4ede-8a69-c6e1fd792ba9" containerName="manager" Jun 11 20:11:27.964551 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:27.964530 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-c9886dd47-qw6h6" Jun 11 20:11:27.967558 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:27.967531 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 11 20:11:27.967659 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:27.967630 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-n2sm9\"" Jun 11 20:11:27.975138 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:27.975116 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-c9886dd47-qw6h6"] Jun 11 20:11:28.014655 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:28.014624 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82c2f442-7d4e-4af6-8892-92eef6ee2f56-maas-api-tls\") pod \"maas-api-c9886dd47-qw6h6\" (UID: \"82c2f442-7d4e-4af6-8892-92eef6ee2f56\") " pod="opendatahub/maas-api-c9886dd47-qw6h6" Jun 11 20:11:28.014772 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:28.014669 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82c2f442-7d4e-4af6-8892-92eef6ee2f56-openshift-service-ca\") pod \"maas-api-c9886dd47-qw6h6\" (UID: \"82c2f442-7d4e-4af6-8892-92eef6ee2f56\") " pod="opendatahub/maas-api-c9886dd47-qw6h6" Jun 11 20:11:28.014846 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:28.014805 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2q8r\" (UniqueName: \"kubernetes.io/projected/82c2f442-7d4e-4af6-8892-92eef6ee2f56-kube-api-access-d2q8r\") pod \"maas-api-c9886dd47-qw6h6\" (UID: \"82c2f442-7d4e-4af6-8892-92eef6ee2f56\") " pod="opendatahub/maas-api-c9886dd47-qw6h6" Jun 11 20:11:28.077203 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:28.077172 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:11:28.115723 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:28.115697 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2q8r\" (UniqueName: \"kubernetes.io/projected/82c2f442-7d4e-4af6-8892-92eef6ee2f56-kube-api-access-d2q8r\") pod \"maas-api-c9886dd47-qw6h6\" (UID: \"82c2f442-7d4e-4af6-8892-92eef6ee2f56\") " pod="opendatahub/maas-api-c9886dd47-qw6h6" Jun 11 20:11:28.115866 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:28.115736 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82c2f442-7d4e-4af6-8892-92eef6ee2f56-maas-api-tls\") pod \"maas-api-c9886dd47-qw6h6\" (UID: \"82c2f442-7d4e-4af6-8892-92eef6ee2f56\") " pod="opendatahub/maas-api-c9886dd47-qw6h6" Jun 11 20:11:28.115866 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:28.115765 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82c2f442-7d4e-4af6-8892-92eef6ee2f56-openshift-service-ca\") pod \"maas-api-c9886dd47-qw6h6\" (UID: \"82c2f442-7d4e-4af6-8892-92eef6ee2f56\") " pod="opendatahub/maas-api-c9886dd47-qw6h6" Jun 11 20:11:28.116346 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:28.116327 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82c2f442-7d4e-4af6-8892-92eef6ee2f56-openshift-service-ca\") pod \"maas-api-c9886dd47-qw6h6\" (UID: \"82c2f442-7d4e-4af6-8892-92eef6ee2f56\") " pod="opendatahub/maas-api-c9886dd47-qw6h6" Jun 11 20:11:28.118360 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:28.118339 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82c2f442-7d4e-4af6-8892-92eef6ee2f56-maas-api-tls\") pod \"maas-api-c9886dd47-qw6h6\" (UID: \"82c2f442-7d4e-4af6-8892-92eef6ee2f56\") " pod="opendatahub/maas-api-c9886dd47-qw6h6" Jun 11 20:11:28.124713 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:28.124689 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2q8r\" (UniqueName: \"kubernetes.io/projected/82c2f442-7d4e-4af6-8892-92eef6ee2f56-kube-api-access-d2q8r\") pod \"maas-api-c9886dd47-qw6h6\" (UID: \"82c2f442-7d4e-4af6-8892-92eef6ee2f56\") " pod="opendatahub/maas-api-c9886dd47-qw6h6" Jun 11 20:11:28.276338 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:28.276253 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-c9886dd47-qw6h6" Jun 11 20:11:28.329243 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:28.329197 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:11:28.450199 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:28.450173 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-c9886dd47-qw6h6"] Jun 11 20:11:28.451882 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:11:28.451855 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82c2f442_7d4e_4af6_8892_92eef6ee2f56.slice/crio-7b924fada39a4433056d7570790987426bcfa80f82b8e24d18b1aeda99499bad WatchSource:0}: Error finding container 7b924fada39a4433056d7570790987426bcfa80f82b8e24d18b1aeda99499bad: Status 404 returned error can't find the container with id 7b924fada39a4433056d7570790987426bcfa80f82b8e24d18b1aeda99499bad Jun 11 20:11:28.461422 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:28.461399 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:11:28.595332 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:28.595295 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-c9886dd47-qw6h6" event={"ID":"82c2f442-7d4e-4af6-8892-92eef6ee2f56","Type":"ContainerStarted","Data":"7b924fada39a4433056d7570790987426bcfa80f82b8e24d18b1aeda99499bad"} Jun 11 20:11:31.615802 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:31.615763 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-c9886dd47-qw6h6" event={"ID":"82c2f442-7d4e-4af6-8892-92eef6ee2f56","Type":"ContainerStarted","Data":"1bc196251c283354a52dbe336b335bf8e970d65959dc4ed39ed4c6fd96e36e00"} Jun 11 20:11:31.616173 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:31.615832 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-c9886dd47-qw6h6" Jun 11 20:11:31.640975 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:31.640927 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-c9886dd47-qw6h6" podStartSLOduration=2.496356321 podStartE2EDuration="4.640912123s" totalImagesPullingTime="2.144555802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:11:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:11:31.640472334 +0000 UTC m=+783.371634311" watchObservedRunningTime="2026-06-11 20:11:31.640912123 +0000 UTC m=+783.372074097" Jun 11 20:11:37.627429 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:11:37.627393 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-c9886dd47-qw6h6" Jun 11 20:12:14.313340 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:12:14.313304 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:13:28.761097 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:13:28.761013 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ckh6n_ba09d733-3024-4a3c-b49c-ab7213905587/console-operator/1.log" Jun 11 20:13:28.762728 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:13:28.762696 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ckh6n_ba09d733-3024-4a3c-b49c-ab7213905587/console-operator/1.log" Jun 11 20:13:36.199069 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:13:36.199039 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:14:21.448174 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:21.448138 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:14:22.618865 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:22.618807 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:14:38.233244 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:38.233206 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9"] Jun 11 20:14:38.236024 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:38.236007 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9" Jun 11 20:14:38.239516 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:38.239488 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32a7c4a5-1597-4c87-b792-2e095e01fe67-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9\" (UID: \"32a7c4a5-1597-4c87-b792-2e095e01fe67\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9" Jun 11 20:14:38.239645 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:38.239546 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/32a7c4a5-1597-4c87-b792-2e095e01fe67-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9\" (UID: \"32a7c4a5-1597-4c87-b792-2e095e01fe67\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9" Jun 11 20:14:38.239645 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:38.239574 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32a7c4a5-1597-4c87-b792-2e095e01fe67-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9\" (UID: \"32a7c4a5-1597-4c87-b792-2e095e01fe67\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9" Jun 11 20:14:38.239645 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:38.239605 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxngf\" (UniqueName: \"kubernetes.io/projected/32a7c4a5-1597-4c87-b792-2e095e01fe67-kube-api-access-dxngf\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9\" (UID: \"32a7c4a5-1597-4c87-b792-2e095e01fe67\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9" Jun 11 20:14:38.239805 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:38.239649 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32a7c4a5-1597-4c87-b792-2e095e01fe67-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9\" (UID: \"32a7c4a5-1597-4c87-b792-2e095e01fe67\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9" Jun 11 20:14:38.239805 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:38.239680 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32a7c4a5-1597-4c87-b792-2e095e01fe67-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9\" (UID: \"32a7c4a5-1597-4c87-b792-2e095e01fe67\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9" Jun 11 20:14:38.243179 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:38.243161 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qrhx2\"" Jun 11 20:14:38.244294 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:38.244272 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 20:14:38.245801 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:38.245778 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 20:14:38.247386 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:38.247359 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 11 20:14:38.254588 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:38.254563 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:14:38.312713 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:38.312681 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9"] Jun 11 20:14:38.340106 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:38.340071 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32a7c4a5-1597-4c87-b792-2e095e01fe67-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9\" (UID: \"32a7c4a5-1597-4c87-b792-2e095e01fe67\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9" Jun 11 20:14:38.340106 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:38.340107 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/32a7c4a5-1597-4c87-b792-2e095e01fe67-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9\" (UID: \"32a7c4a5-1597-4c87-b792-2e095e01fe67\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9" Jun 11 20:14:38.340353 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:38.340129 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32a7c4a5-1597-4c87-b792-2e095e01fe67-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9\" (UID: \"32a7c4a5-1597-4c87-b792-2e095e01fe67\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9" Jun 11 20:14:38.340353 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:38.340322 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxngf\" (UniqueName: \"kubernetes.io/projected/32a7c4a5-1597-4c87-b792-2e095e01fe67-kube-api-access-dxngf\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9\" (UID: \"32a7c4a5-1597-4c87-b792-2e095e01fe67\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9" Jun 11 20:14:38.340518 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:38.340402 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32a7c4a5-1597-4c87-b792-2e095e01fe67-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9\" (UID: \"32a7c4a5-1597-4c87-b792-2e095e01fe67\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9" Jun 11 20:14:38.340518 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:38.340452 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32a7c4a5-1597-4c87-b792-2e095e01fe67-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9\" (UID: \"32a7c4a5-1597-4c87-b792-2e095e01fe67\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9" Jun 11 20:14:38.340626 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:38.340559 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/32a7c4a5-1597-4c87-b792-2e095e01fe67-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9\" (UID: \"32a7c4a5-1597-4c87-b792-2e095e01fe67\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9" Jun 11 20:14:38.340766 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:38.340742 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32a7c4a5-1597-4c87-b792-2e095e01fe67-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9\" (UID: \"32a7c4a5-1597-4c87-b792-2e095e01fe67\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9" Jun 11 20:14:38.340810 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:38.340788 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32a7c4a5-1597-4c87-b792-2e095e01fe67-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9\" (UID: \"32a7c4a5-1597-4c87-b792-2e095e01fe67\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9" Jun 11 20:14:38.342656 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:38.342630 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32a7c4a5-1597-4c87-b792-2e095e01fe67-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9\" (UID: \"32a7c4a5-1597-4c87-b792-2e095e01fe67\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9" Jun 11 20:14:38.342869 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:38.342852 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32a7c4a5-1597-4c87-b792-2e095e01fe67-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9\" (UID: \"32a7c4a5-1597-4c87-b792-2e095e01fe67\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9" Jun 11 20:14:38.362177 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:38.362145 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxngf\" (UniqueName: \"kubernetes.io/projected/32a7c4a5-1597-4c87-b792-2e095e01fe67-kube-api-access-dxngf\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9\" (UID: \"32a7c4a5-1597-4c87-b792-2e095e01fe67\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9" Jun 11 20:14:38.547360 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:38.547272 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9" Jun 11 20:14:38.697193 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:38.697164 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9"] Jun 11 20:14:38.698748 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:14:38.698720 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32a7c4a5_1597_4c87_b792_2e095e01fe67.slice/crio-542b03a9eea5f154c9e6c7962b263f58707fd793a2115b7f3602d672a453cee6 WatchSource:0}: Error finding container 542b03a9eea5f154c9e6c7962b263f58707fd793a2115b7f3602d672a453cee6: Status 404 returned error can't find the container with id 542b03a9eea5f154c9e6c7962b263f58707fd793a2115b7f3602d672a453cee6 Jun 11 20:14:38.735936 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:38.735899 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9" event={"ID":"32a7c4a5-1597-4c87-b792-2e095e01fe67","Type":"ContainerStarted","Data":"542b03a9eea5f154c9e6c7962b263f58707fd793a2115b7f3602d672a453cee6"} Jun 11 20:14:39.956791 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:39.956746 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:14:42.768559 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:42.765509 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9" event={"ID":"32a7c4a5-1597-4c87-b792-2e095e01fe67","Type":"ContainerStarted","Data":"0b5d31d5d4a3b9cee2b5bedb1c035fbdc8f4ca8cb196098701651475a6ca15bc"} Jun 11 20:14:46.655611 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:46.655562 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-wrljd"] Jun 11 20:14:46.659842 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:46.659818 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wrljd" Jun 11 20:14:46.662505 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:46.662485 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 11 20:14:46.669741 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:46.669718 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-wrljd"] Jun 11 20:14:46.724352 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:46.724319 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2c1a45a-d53b-400b-918c-a3882874db55-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-wrljd\" (UID: \"e2c1a45a-d53b-400b-918c-a3882874db55\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wrljd" Jun 11 20:14:46.724532 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:46.724363 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2c1a45a-d53b-400b-918c-a3882874db55-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-wrljd\" (UID: \"e2c1a45a-d53b-400b-918c-a3882874db55\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wrljd" Jun 11 20:14:46.724532 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:46.724398 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2c1a45a-d53b-400b-918c-a3882874db55-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-wrljd\" (UID: \"e2c1a45a-d53b-400b-918c-a3882874db55\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wrljd" Jun 11 20:14:46.724532 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:46.724477 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc9wl\" (UniqueName: \"kubernetes.io/projected/e2c1a45a-d53b-400b-918c-a3882874db55-kube-api-access-nc9wl\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-wrljd\" (UID: \"e2c1a45a-d53b-400b-918c-a3882874db55\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wrljd" Jun 11 20:14:46.724650 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:46.724554 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e2c1a45a-d53b-400b-918c-a3882874db55-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-wrljd\" (UID: \"e2c1a45a-d53b-400b-918c-a3882874db55\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wrljd" Jun 11 20:14:46.724650 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:46.724596 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2c1a45a-d53b-400b-918c-a3882874db55-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-wrljd\" (UID: \"e2c1a45a-d53b-400b-918c-a3882874db55\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wrljd" Jun 11 20:14:46.750488 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:46.750454 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:14:46.825584 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:46.825549 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2c1a45a-d53b-400b-918c-a3882874db55-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-wrljd\" (UID: \"e2c1a45a-d53b-400b-918c-a3882874db55\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wrljd" Jun 11 20:14:46.825584 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:46.825582 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2c1a45a-d53b-400b-918c-a3882874db55-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-wrljd\" (UID: \"e2c1a45a-d53b-400b-918c-a3882874db55\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wrljd" Jun 11 20:14:46.825845 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:46.825626 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc9wl\" (UniqueName: \"kubernetes.io/projected/e2c1a45a-d53b-400b-918c-a3882874db55-kube-api-access-nc9wl\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-wrljd\" (UID: \"e2c1a45a-d53b-400b-918c-a3882874db55\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wrljd" Jun 11 20:14:46.825845 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:46.825671 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e2c1a45a-d53b-400b-918c-a3882874db55-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-wrljd\" (UID: \"e2c1a45a-d53b-400b-918c-a3882874db55\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wrljd" Jun 11 20:14:46.825845 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:46.825708 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2c1a45a-d53b-400b-918c-a3882874db55-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-wrljd\" (UID: \"e2c1a45a-d53b-400b-918c-a3882874db55\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wrljd" Jun 11 20:14:46.825845 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:46.825817 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2c1a45a-d53b-400b-918c-a3882874db55-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-wrljd\" (UID: \"e2c1a45a-d53b-400b-918c-a3882874db55\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wrljd" Jun 11 20:14:46.826062 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:46.826012 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2c1a45a-d53b-400b-918c-a3882874db55-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-wrljd\" (UID: \"e2c1a45a-d53b-400b-918c-a3882874db55\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wrljd" Jun 11 20:14:46.826137 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:46.826112 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2c1a45a-d53b-400b-918c-a3882874db55-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-wrljd\" (UID: \"e2c1a45a-d53b-400b-918c-a3882874db55\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wrljd" Jun 11 20:14:46.826181 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:46.826125 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e2c1a45a-d53b-400b-918c-a3882874db55-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-wrljd\" (UID: \"e2c1a45a-d53b-400b-918c-a3882874db55\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wrljd" Jun 11 20:14:46.829086 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:46.829059 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2c1a45a-d53b-400b-918c-a3882874db55-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-wrljd\" (UID: \"e2c1a45a-d53b-400b-918c-a3882874db55\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wrljd" Jun 11 20:14:46.829405 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:46.829361 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2c1a45a-d53b-400b-918c-a3882874db55-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-wrljd\" (UID: \"e2c1a45a-d53b-400b-918c-a3882874db55\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wrljd" Jun 11 20:14:46.833676 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:46.833652 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc9wl\" (UniqueName: \"kubernetes.io/projected/e2c1a45a-d53b-400b-918c-a3882874db55-kube-api-access-nc9wl\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-wrljd\" (UID: \"e2c1a45a-d53b-400b-918c-a3882874db55\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wrljd" Jun 11 20:14:46.971635 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:46.971536 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wrljd" Jun 11 20:14:47.144201 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:47.144175 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-wrljd"] Jun 11 20:14:47.145405 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:14:47.145364 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2c1a45a_d53b_400b_918c_a3882874db55.slice/crio-1fb51e6b4bc3b836f979a6ffb9de7d0c214ae1005599f35e13dc555aadc82555 WatchSource:0}: Error finding container 1fb51e6b4bc3b836f979a6ffb9de7d0c214ae1005599f35e13dc555aadc82555: Status 404 returned error can't find the container with id 1fb51e6b4bc3b836f979a6ffb9de7d0c214ae1005599f35e13dc555aadc82555 Jun 11 20:14:47.797466 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:47.797428 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wrljd" event={"ID":"e2c1a45a-d53b-400b-918c-a3882874db55","Type":"ContainerStarted","Data":"179ab18db1a0c8928308278c50271b06c1851719158ee8dcfd0ccdf152411d27"} Jun 11 20:14:47.797960 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:47.797499 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wrljd" event={"ID":"e2c1a45a-d53b-400b-918c-a3882874db55","Type":"ContainerStarted","Data":"1fb51e6b4bc3b836f979a6ffb9de7d0c214ae1005599f35e13dc555aadc82555"} Jun 11 20:14:47.826867 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:47.826839 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:14:47.961874 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:47.961838 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:14:56.377807 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:56.377771 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:14:58.866622 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:58.866590 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:14:58.966731 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:14:58.966699 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:15:02.665886 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:02.665844 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc"] Jun 11 20:15:02.671354 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:02.671331 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc" Jun 11 20:15:02.674534 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:02.674511 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 11 20:15:02.682659 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:02.682637 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc"] Jun 11 20:15:02.760241 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:02.760208 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:15:02.786295 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:02.786261 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9458e1e4-c716-4cb8-a877-fa9916ed6a6c-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc\" (UID: \"9458e1e4-c716-4cb8-a877-fa9916ed6a6c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc" Jun 11 20:15:02.786487 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:02.786317 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9458e1e4-c716-4cb8-a877-fa9916ed6a6c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc\" (UID: \"9458e1e4-c716-4cb8-a877-fa9916ed6a6c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc" Jun 11 20:15:02.786487 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:02.786344 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9458e1e4-c716-4cb8-a877-fa9916ed6a6c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc\" (UID: \"9458e1e4-c716-4cb8-a877-fa9916ed6a6c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc" Jun 11 20:15:02.786487 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:02.786453 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxnzw\" (UniqueName: \"kubernetes.io/projected/9458e1e4-c716-4cb8-a877-fa9916ed6a6c-kube-api-access-bxnzw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc\" (UID: \"9458e1e4-c716-4cb8-a877-fa9916ed6a6c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc" Jun 11 20:15:02.786602 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:02.786493 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9458e1e4-c716-4cb8-a877-fa9916ed6a6c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc\" (UID: \"9458e1e4-c716-4cb8-a877-fa9916ed6a6c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc" Jun 11 20:15:02.786602 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:02.786574 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9458e1e4-c716-4cb8-a877-fa9916ed6a6c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc\" (UID: \"9458e1e4-c716-4cb8-a877-fa9916ed6a6c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc" Jun 11 20:15:02.887266 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:02.887228 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9458e1e4-c716-4cb8-a877-fa9916ed6a6c-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc\" (UID: \"9458e1e4-c716-4cb8-a877-fa9916ed6a6c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc" Jun 11 20:15:02.887467 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:02.887305 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9458e1e4-c716-4cb8-a877-fa9916ed6a6c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc\" (UID: \"9458e1e4-c716-4cb8-a877-fa9916ed6a6c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc" Jun 11 20:15:02.887467 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:02.887335 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9458e1e4-c716-4cb8-a877-fa9916ed6a6c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc\" (UID: \"9458e1e4-c716-4cb8-a877-fa9916ed6a6c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc" Jun 11 20:15:02.887467 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:02.887402 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxnzw\" (UniqueName: \"kubernetes.io/projected/9458e1e4-c716-4cb8-a877-fa9916ed6a6c-kube-api-access-bxnzw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc\" (UID: \"9458e1e4-c716-4cb8-a877-fa9916ed6a6c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc" Jun 11 20:15:02.887467 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:02.887456 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9458e1e4-c716-4cb8-a877-fa9916ed6a6c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc\" (UID: \"9458e1e4-c716-4cb8-a877-fa9916ed6a6c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc" Jun 11 20:15:02.887749 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:02.887540 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9458e1e4-c716-4cb8-a877-fa9916ed6a6c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc\" (UID: \"9458e1e4-c716-4cb8-a877-fa9916ed6a6c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc" Jun 11 20:15:02.887749 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:02.887674 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9458e1e4-c716-4cb8-a877-fa9916ed6a6c-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc\" (UID: \"9458e1e4-c716-4cb8-a877-fa9916ed6a6c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc" Jun 11 20:15:02.888073 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:02.888041 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9458e1e4-c716-4cb8-a877-fa9916ed6a6c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc\" (UID: \"9458e1e4-c716-4cb8-a877-fa9916ed6a6c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc" Jun 11 20:15:02.888073 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:02.888053 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9458e1e4-c716-4cb8-a877-fa9916ed6a6c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc\" (UID: \"9458e1e4-c716-4cb8-a877-fa9916ed6a6c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc" Jun 11 20:15:02.890188 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:02.890167 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9458e1e4-c716-4cb8-a877-fa9916ed6a6c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc\" (UID: \"9458e1e4-c716-4cb8-a877-fa9916ed6a6c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc" Jun 11 20:15:02.890331 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:02.890314 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9458e1e4-c716-4cb8-a877-fa9916ed6a6c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc\" (UID: \"9458e1e4-c716-4cb8-a877-fa9916ed6a6c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc" Jun 11 20:15:02.895859 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:02.895836 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxnzw\" (UniqueName: \"kubernetes.io/projected/9458e1e4-c716-4cb8-a877-fa9916ed6a6c-kube-api-access-bxnzw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc\" (UID: \"9458e1e4-c716-4cb8-a877-fa9916ed6a6c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc" Jun 11 20:15:02.983149 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:02.983057 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc" Jun 11 20:15:03.128938 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:15:03.128908 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9458e1e4_c716_4cb8_a877_fa9916ed6a6c.slice/crio-1b71fb3c40ad3638e58f710707a12914e38bbf33f7d773d430ab2bdd74b138da WatchSource:0}: Error finding container 1b71fb3c40ad3638e58f710707a12914e38bbf33f7d773d430ab2bdd74b138da: Status 404 returned error can't find the container with id 1b71fb3c40ad3638e58f710707a12914e38bbf33f7d773d430ab2bdd74b138da Jun 11 20:15:03.129871 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:03.129798 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc"] Jun 11 20:15:03.896609 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:03.896574 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc" event={"ID":"9458e1e4-c716-4cb8-a877-fa9916ed6a6c","Type":"ContainerStarted","Data":"05bdc8dd83786ef95e4fe98870e9b7725cd1e117ff5cba7b7c1c46a23155da4a"} Jun 11 20:15:03.897000 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:03.896651 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc" event={"ID":"9458e1e4-c716-4cb8-a877-fa9916ed6a6c","Type":"ContainerStarted","Data":"1b71fb3c40ad3638e58f710707a12914e38bbf33f7d773d430ab2bdd74b138da"} Jun 11 20:15:04.904175 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:04.904140 2562 generic.go:356] "Generic (PLEG): container finished" podID="9458e1e4-c716-4cb8-a877-fa9916ed6a6c" containerID="05bdc8dd83786ef95e4fe98870e9b7725cd1e117ff5cba7b7c1c46a23155da4a" exitCode=0 Jun 11 20:15:04.904595 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:04.904177 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc" event={"ID":"9458e1e4-c716-4cb8-a877-fa9916ed6a6c","Type":"ContainerDied","Data":"05bdc8dd83786ef95e4fe98870e9b7725cd1e117ff5cba7b7c1c46a23155da4a"} Jun 11 20:15:04.904812 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:04.904798 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 20:15:06.918684 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:06.918649 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc" event={"ID":"9458e1e4-c716-4cb8-a877-fa9916ed6a6c","Type":"ContainerStarted","Data":"bc1f38c1f303f3b1355b11fc203b7bcd0428c276db138916b3a067286e731019"} Jun 11 20:15:06.942968 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:06.942912 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc" podStartSLOduration=2.60290207 podStartE2EDuration="4.942895671s" totalImagesPullingTime="1.061643279s" totalInitContainerRuntime="1.278350322s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:15:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:15:06.94171347 +0000 UTC m=+998.672875455" watchObservedRunningTime="2026-06-11 20:15:06.942895671 +0000 UTC m=+998.674057647" Jun 11 20:15:12.983434 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:12.983369 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc" Jun 11 20:15:12.983955 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:12.983451 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc" Jun 11 20:15:12.996846 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:12.996822 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc" Jun 11 20:15:13.974424 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:13.974392 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc" Jun 11 20:15:25.542875 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:25.542828 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:15:34.784117 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:34.784079 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:15:38.122109 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:38.122079 2562 generic.go:356] "Generic (PLEG): container finished" podID="32a7c4a5-1597-4c87-b792-2e095e01fe67" containerID="0b5d31d5d4a3b9cee2b5bedb1c035fbdc8f4ca8cb196098701651475a6ca15bc" exitCode=0 Jun 11 20:15:38.122565 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:38.122163 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9" event={"ID":"32a7c4a5-1597-4c87-b792-2e095e01fe67","Type":"ContainerDied","Data":"0b5d31d5d4a3b9cee2b5bedb1c035fbdc8f4ca8cb196098701651475a6ca15bc"} Jun 11 20:15:39.130555 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:39.130517 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9" event={"ID":"32a7c4a5-1597-4c87-b792-2e095e01fe67","Type":"ContainerStarted","Data":"80b203082f2d82772d1cc22cd0457fdebc813052f2bb61a356df902fb593e80c"} Jun 11 20:15:39.158225 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:39.158171 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9" podStartSLOduration=1.972002198 podStartE2EDuration="1m1.158155783s" totalImagesPullingTime="4.039052533s" totalInitContainerRuntime="55.147101052s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:14:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:15:39.156671209 +0000 UTC m=+1030.887833187" watchObservedRunningTime="2026-06-11 20:15:39.158155783 +0000 UTC m=+1030.889317758" Jun 11 20:15:48.548183 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:48.548137 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9" Jun 11 20:15:48.548757 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:48.548213 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9" Jun 11 20:15:48.560986 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:48.560961 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9" Jun 11 20:15:49.202457 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:15:49.202428 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9" Jun 11 20:16:01.972682 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:16:01.972647 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:17:20.772145 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:17:20.772114 2562 generic.go:356] "Generic (PLEG): container finished" podID="e2c1a45a-d53b-400b-918c-a3882874db55" containerID="179ab18db1a0c8928308278c50271b06c1851719158ee8dcfd0ccdf152411d27" exitCode=0 Jun 11 20:17:20.772600 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:17:20.772187 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wrljd" event={"ID":"e2c1a45a-d53b-400b-918c-a3882874db55","Type":"ContainerDied","Data":"179ab18db1a0c8928308278c50271b06c1851719158ee8dcfd0ccdf152411d27"} Jun 11 20:17:21.787183 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:17:21.787145 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wrljd" event={"ID":"e2c1a45a-d53b-400b-918c-a3882874db55","Type":"ContainerStarted","Data":"f8b98a7043f558ba76bd7b6f71e3c012e6834899d0564f18dce9113d30b9524c"} Jun 11 20:17:21.810573 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:17:21.810520 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wrljd" podStartSLOduration=2.207131172 podStartE2EDuration="2m35.810505793s" totalImagesPullingTime="248.928167ms" totalInitContainerRuntime="2m33.354446454s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:14:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:17:21.808003291 +0000 UTC m=+1133.539165267" watchObservedRunningTime="2026-06-11 20:17:21.810505793 +0000 UTC m=+1133.541667768" Jun 11 20:17:26.971823 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:17:26.971780 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wrljd" Jun 11 20:17:26.972265 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:17:26.971846 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wrljd" Jun 11 20:17:26.984673 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:17:26.984634 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wrljd" Jun 11 20:17:27.834803 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:17:27.834771 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-wrljd" Jun 11 20:18:28.805539 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:18:28.805509 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ckh6n_ba09d733-3024-4a3c-b49c-ab7213905587/console-operator/1.log" Jun 11 20:18:28.808630 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:18:28.808605 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ckh6n_ba09d733-3024-4a3c-b49c-ab7213905587/console-operator/1.log" Jun 11 20:19:30.337150 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:30.337073 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-lz7x9_76515318-fcd6-4033-9844-1526375a58d1/manager/0.log" Jun 11 20:19:30.463482 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:30.463439 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-fcsgz_bd0ac29f-247b-4357-a237-5c6ec750b9d0/manager/0.log" Jun 11 20:19:30.585810 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:30.585781 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-c9886dd47-qw6h6_82c2f442-7d4e-4af6-8892-92eef6ee2f56/maas-api/0.log" Jun 11 20:19:30.829508 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:30.829482 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6499fc5bd-lvxzs_eab23c33-9c53-4d55-b108-f1ae0f54efeb/manager/0.log" Jun 11 20:19:30.957500 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:30.957473 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-j62p9_687973f1-c1c3-48cb-aabb-03674a0f4580/server/0.log" Jun 11 20:19:31.087179 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:31.087091 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-5tzp4_cdea2e11-c0d5-43a7-be42-8ec414ff0a85/manager/0.log" Jun 11 20:19:31.349815 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:31.349739 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7878f89495-h5gr5_14d88d3b-766c-4372-92f5-eeb6ba517635/copy-manifests/0.log" Jun 11 20:19:31.360169 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:31.360144 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7878f89495-h5gr5_14d88d3b-766c-4372-92f5-eeb6ba517635/manager/0.log" Jun 11 20:19:32.412796 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:32.412766 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kbzh_ea28fb6a-92c4-43b1-ab58-f9085e74ea1b/pull/0.log" Jun 11 20:19:32.426446 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:32.426421 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kbzh_ea28fb6a-92c4-43b1-ab58-f9085e74ea1b/extract/0.log" Jun 11 20:19:32.437247 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:32.437215 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kbzh_ea28fb6a-92c4-43b1-ab58-f9085e74ea1b/util/0.log" Jun 11 20:19:32.556387 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:32.556339 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9brs_c34fbd41-e792-443b-8979-ec5056f5d46e/pull/0.log" Jun 11 20:19:32.574805 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:32.574774 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9brs_c34fbd41-e792-443b-8979-ec5056f5d46e/extract/0.log" Jun 11 20:19:32.591846 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:32.591811 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9brs_c34fbd41-e792-443b-8979-ec5056f5d46e/util/0.log" Jun 11 20:19:32.717853 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:32.717771 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mdltg_b72c6ce6-361d-4dba-8880-da335f685099/util/0.log" Jun 11 20:19:32.725791 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:32.725760 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mdltg_b72c6ce6-361d-4dba-8880-da335f685099/pull/0.log" Jun 11 20:19:32.735596 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:32.735573 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mdltg_b72c6ce6-361d-4dba-8880-da335f685099/extract/0.log" Jun 11 20:19:32.851186 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:32.851160 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k9dlj_fffe2942-d8a4-45d8-90f4-3197f5981f1d/util/0.log" Jun 11 20:19:32.862108 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:32.862083 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k9dlj_fffe2942-d8a4-45d8-90f4-3197f5981f1d/pull/0.log" Jun 11 20:19:32.874075 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:32.874055 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k9dlj_fffe2942-d8a4-45d8-90f4-3197f5981f1d/extract/0.log" Jun 11 20:19:33.119230 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:33.119197 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-jd8bn_50d6ae9b-b181-427f-8f8f-7d2707c7d13f/manager/0.log" Jun 11 20:19:33.865126 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:33.865098 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-lczf5_563f9bbe-310b-4433-aeee-b59c1eedf8b5/manager/0.log" Jun 11 20:19:34.341527 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:34.341497 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-8v7zj_373380a2-bd6c-4b56-8c91-e0076d6853d1/discovery/0.log" Jun 11 20:19:34.563418 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:34.563389 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59446c6fd7-sh7b5_9525d310-8a99-4e98-8398-4b26851cde18/kube-auth-proxy/0.log" Jun 11 20:19:34.998695 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:34.998664 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64f5b86456-67889_d4de4ed2-f4f2-4c34-b919-8c553e9df39f/router/0.log" Jun 11 20:19:35.352757 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:35.352728 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9_32a7c4a5-1597-4c87-b792-2e095e01fe67/storage-initializer/0.log" Jun 11 20:19:35.360298 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:35.360274 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-6b4s9_32a7c4a5-1597-4c87-b792-2e095e01fe67/main/0.log" Jun 11 20:19:35.472122 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:35.472088 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-wrljd_e2c1a45a-d53b-400b-918c-a3882874db55/storage-initializer/0.log" Jun 11 20:19:35.479712 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:35.479680 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-wrljd_e2c1a45a-d53b-400b-918c-a3882874db55/main/0.log" Jun 11 20:19:35.709402 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:35.709309 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc_9458e1e4-c716-4cb8-a877-fa9916ed6a6c/storage-initializer/0.log" Jun 11 20:19:35.717243 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:35.717202 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c869hc_9458e1e4-c716-4cb8-a877-fa9916ed6a6c/main/0.log" Jun 11 20:19:40.587175 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:40.587137 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:19:41.744451 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:41.744418 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" limit=1024 Jun 11 20:19:43.744258 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:43.744210 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-g9g8h_ebe82df4-c733-4be3-924b-3f32111102b7/global-pull-secret-syncer/0.log" Jun 11 20:19:43.792725 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:43.792690 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4k7kz_c76c354d-881c-4879-b7f6-9d9ddc209100/konnectivity-agent/0.log" Jun 11 20:19:43.870758 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:43.870733 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-142.ec2.internal_d4265531fa51f38220398935b4c5d991/haproxy/0.log" Jun 11 20:19:47.008008 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:47.007978 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-h9z5k_f22c38af-6224-4c80-aa72-875a36abceaa/sail-operator/0.log" Jun 11 20:19:48.838688 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:48.838652 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kbzh_ea28fb6a-92c4-43b1-ab58-f9085e74ea1b/extract/0.log" Jun 11 20:19:48.880920 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:48.880847 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kbzh_ea28fb6a-92c4-43b1-ab58-f9085e74ea1b/util/0.log" Jun 11 20:19:48.920275 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:48.920246 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596kbzh_ea28fb6a-92c4-43b1-ab58-f9085e74ea1b/pull/0.log" Jun 11 20:19:48.961964 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:48.961939 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9brs_c34fbd41-e792-443b-8979-ec5056f5d46e/extract/0.log" Jun 11 20:19:48.998900 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:48.998868 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9brs_c34fbd41-e792-443b-8979-ec5056f5d46e/util/0.log" Jun 11 20:19:49.043033 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:49.043005 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l9brs_c34fbd41-e792-443b-8979-ec5056f5d46e/pull/0.log" Jun 11 20:19:49.073555 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:49.073528 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mdltg_b72c6ce6-361d-4dba-8880-da335f685099/extract/0.log" Jun 11 20:19:49.103416 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:49.103327 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mdltg_b72c6ce6-361d-4dba-8880-da335f685099/util/0.log" Jun 11 20:19:49.132239 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:49.132208 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mdltg_b72c6ce6-361d-4dba-8880-da335f685099/pull/0.log" Jun 11 20:19:49.161820 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:49.161797 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k9dlj_fffe2942-d8a4-45d8-90f4-3197f5981f1d/extract/0.log" Jun 11 20:19:49.189283 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:49.189254 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k9dlj_fffe2942-d8a4-45d8-90f4-3197f5981f1d/util/0.log" Jun 11 20:19:49.213444 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:49.213424 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k9dlj_fffe2942-d8a4-45d8-90f4-3197f5981f1d/pull/0.log" Jun 11 20:19:49.292508 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:49.292485 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-jd8bn_50d6ae9b-b181-427f-8f8f-7d2707c7d13f/manager/0.log" Jun 11 20:19:49.481871 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:49.481784 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-lczf5_563f9bbe-310b-4433-aeee-b59c1eedf8b5/manager/0.log" Jun 11 20:19:51.342205 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:51.342171 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6d928dda-ae89-4559-8e89-7779fe6f2e97/alertmanager/0.log" Jun 11 20:19:51.370675 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:51.370596 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6d928dda-ae89-4559-8e89-7779fe6f2e97/config-reloader/0.log" Jun 11 20:19:51.402009 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:51.401981 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6d928dda-ae89-4559-8e89-7779fe6f2e97/kube-rbac-proxy-web/0.log" Jun 11 20:19:51.433047 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:51.433024 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6d928dda-ae89-4559-8e89-7779fe6f2e97/kube-rbac-proxy/0.log" Jun 11 20:19:51.458390 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:51.458356 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6d928dda-ae89-4559-8e89-7779fe6f2e97/kube-rbac-proxy-metric/0.log" Jun 11 20:19:51.485719 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:51.485692 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6d928dda-ae89-4559-8e89-7779fe6f2e97/prom-label-proxy/0.log" Jun 11 20:19:51.517615 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:51.517593 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6d928dda-ae89-4559-8e89-7779fe6f2e97/init-config-reloader/0.log" Jun 11 20:19:51.560454 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:51.560423 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-44fbb_3f87ba75-1431-4113-a7df-cf35939bb63d/cluster-monitoring-operator/0.log" Jun 11 20:19:51.772482 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:51.772368 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nsftk_6b854950-2217-420d-94c2-bbbe91c0e127/node-exporter/0.log" Jun 11 20:19:51.802571 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:51.802541 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nsftk_6b854950-2217-420d-94c2-bbbe91c0e127/kube-rbac-proxy/0.log" Jun 11 20:19:51.833233 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:51.833210 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nsftk_6b854950-2217-420d-94c2-bbbe91c0e127/init-textfile/0.log" Jun 11 20:19:52.092078 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:52.092049 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-gngss_27c9d0e7-c6aa-4c34-af39-5bc0b661769c/kube-rbac-proxy-main/0.log" Jun 11 20:19:52.120654 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:52.120627 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-gngss_27c9d0e7-c6aa-4c34-af39-5bc0b661769c/kube-rbac-proxy-self/0.log" Jun 11 20:19:52.154369 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:52.154350 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-gngss_27c9d0e7-c6aa-4c34-af39-5bc0b661769c/openshift-state-metrics/0.log" Jun 11 20:19:52.469002 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:52.468906 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6645964bf-gv2km_481581bc-1416-4b75-8c37-71645a6a57cf/telemeter-client/0.log" Jun 11 20:19:52.492616 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:52.492591 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6645964bf-gv2km_481581bc-1416-4b75-8c37-71645a6a57cf/reload/0.log" Jun 11 20:19:52.514617 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:52.514591 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6645964bf-gv2km_481581bc-1416-4b75-8c37-71645a6a57cf/kube-rbac-proxy/0.log" Jun 11 20:19:52.546476 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:52.546447 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78d6f59854-q6vq6_7e0e0e02-15e4-4664-acaf-bc01a0e33e20/thanos-query/0.log" Jun 11 20:19:52.569556 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:52.569534 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78d6f59854-q6vq6_7e0e0e02-15e4-4664-acaf-bc01a0e33e20/kube-rbac-proxy-web/0.log" Jun 11 20:19:52.593806 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:52.593782 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78d6f59854-q6vq6_7e0e0e02-15e4-4664-acaf-bc01a0e33e20/kube-rbac-proxy/0.log" Jun 11 20:19:52.615193 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:52.615169 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78d6f59854-q6vq6_7e0e0e02-15e4-4664-acaf-bc01a0e33e20/prom-label-proxy/0.log" Jun 11 20:19:52.638858 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:52.638834 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78d6f59854-q6vq6_7e0e0e02-15e4-4664-acaf-bc01a0e33e20/kube-rbac-proxy-rules/0.log" Jun 11 20:19:52.661486 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:52.661463 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78d6f59854-q6vq6_7e0e0e02-15e4-4664-acaf-bc01a0e33e20/kube-rbac-proxy-metrics/0.log" Jun 11 20:19:53.804953 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:53.804925 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-nbq4r_9379570c-48c8-4906-80d9-8ec41b107a12/networking-console-plugin/0.log" Jun 11 20:19:54.228237 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:54.228203 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d4tfg/perf-node-gather-daemonset-lj29j"] Jun 11 20:19:54.231871 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:54.231855 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d4tfg/perf-node-gather-daemonset-lj29j" Jun 11 20:19:54.235312 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:54.235292 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d4tfg\"/\"kube-root-ca.crt\"" Jun 11 20:19:54.236481 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:54.236462 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d4tfg\"/\"openshift-service-ca.crt\"" Jun 11 20:19:54.236591 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:54.236498 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-d4tfg\"/\"default-dockercfg-thwsr\"" Jun 11 20:19:54.243808 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:54.243786 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d4tfg/perf-node-gather-daemonset-lj29j"] Jun 11 20:19:54.290920 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:54.290893 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/44274854-4fbc-4af0-b8ea-73aec030e941-proc\") pod \"perf-node-gather-daemonset-lj29j\" (UID: \"44274854-4fbc-4af0-b8ea-73aec030e941\") " pod="openshift-must-gather-d4tfg/perf-node-gather-daemonset-lj29j" Jun 11 20:19:54.291102 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:54.290947 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9fxw\" (UniqueName: \"kubernetes.io/projected/44274854-4fbc-4af0-b8ea-73aec030e941-kube-api-access-z9fxw\") pod \"perf-node-gather-daemonset-lj29j\" (UID: \"44274854-4fbc-4af0-b8ea-73aec030e941\") " pod="openshift-must-gather-d4tfg/perf-node-gather-daemonset-lj29j" Jun 11 20:19:54.291102 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:54.291041 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/44274854-4fbc-4af0-b8ea-73aec030e941-lib-modules\") pod \"perf-node-gather-daemonset-lj29j\" (UID: \"44274854-4fbc-4af0-b8ea-73aec030e941\") " pod="openshift-must-gather-d4tfg/perf-node-gather-daemonset-lj29j" Jun 11 20:19:54.291102 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:54.291074 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/44274854-4fbc-4af0-b8ea-73aec030e941-podres\") pod \"perf-node-gather-daemonset-lj29j\" (UID: \"44274854-4fbc-4af0-b8ea-73aec030e941\") " pod="openshift-must-gather-d4tfg/perf-node-gather-daemonset-lj29j" Jun 11 20:19:54.291255 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:54.291160 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44274854-4fbc-4af0-b8ea-73aec030e941-sys\") pod \"perf-node-gather-daemonset-lj29j\" (UID: \"44274854-4fbc-4af0-b8ea-73aec030e941\") " pod="openshift-must-gather-d4tfg/perf-node-gather-daemonset-lj29j" Jun 11 20:19:54.391818 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:54.391778 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/44274854-4fbc-4af0-b8ea-73aec030e941-proc\") pod \"perf-node-gather-daemonset-lj29j\" (UID: \"44274854-4fbc-4af0-b8ea-73aec030e941\") " pod="openshift-must-gather-d4tfg/perf-node-gather-daemonset-lj29j" Jun 11 20:19:54.391989 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:54.391851 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9fxw\" (UniqueName: \"kubernetes.io/projected/44274854-4fbc-4af0-b8ea-73aec030e941-kube-api-access-z9fxw\") pod \"perf-node-gather-daemonset-lj29j\" (UID: \"44274854-4fbc-4af0-b8ea-73aec030e941\") " pod="openshift-must-gather-d4tfg/perf-node-gather-daemonset-lj29j" Jun 11 20:19:54.391989 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:54.391907 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/44274854-4fbc-4af0-b8ea-73aec030e941-lib-modules\") pod \"perf-node-gather-daemonset-lj29j\" (UID: \"44274854-4fbc-4af0-b8ea-73aec030e941\") " pod="openshift-must-gather-d4tfg/perf-node-gather-daemonset-lj29j" Jun 11 20:19:54.391989 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:54.391913 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/44274854-4fbc-4af0-b8ea-73aec030e941-proc\") pod \"perf-node-gather-daemonset-lj29j\" (UID: \"44274854-4fbc-4af0-b8ea-73aec030e941\") " pod="openshift-must-gather-d4tfg/perf-node-gather-daemonset-lj29j" Jun 11 20:19:54.391989 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:54.391933 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/44274854-4fbc-4af0-b8ea-73aec030e941-podres\") pod \"perf-node-gather-daemonset-lj29j\" (UID: \"44274854-4fbc-4af0-b8ea-73aec030e941\") " pod="openshift-must-gather-d4tfg/perf-node-gather-daemonset-lj29j" Jun 11 20:19:54.391989 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:54.391984 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44274854-4fbc-4af0-b8ea-73aec030e941-sys\") pod \"perf-node-gather-daemonset-lj29j\" (UID: \"44274854-4fbc-4af0-b8ea-73aec030e941\") " pod="openshift-must-gather-d4tfg/perf-node-gather-daemonset-lj29j" Jun 11 20:19:54.392160 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:54.392068 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/44274854-4fbc-4af0-b8ea-73aec030e941-lib-modules\") pod \"perf-node-gather-daemonset-lj29j\" (UID: \"44274854-4fbc-4af0-b8ea-73aec030e941\") " pod="openshift-must-gather-d4tfg/perf-node-gather-daemonset-lj29j" Jun 11 20:19:54.392160 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:54.392071 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44274854-4fbc-4af0-b8ea-73aec030e941-sys\") pod \"perf-node-gather-daemonset-lj29j\" (UID: \"44274854-4fbc-4af0-b8ea-73aec030e941\") " pod="openshift-must-gather-d4tfg/perf-node-gather-daemonset-lj29j" Jun 11 20:19:54.392160 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:54.392076 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/44274854-4fbc-4af0-b8ea-73aec030e941-podres\") pod \"perf-node-gather-daemonset-lj29j\" (UID: \"44274854-4fbc-4af0-b8ea-73aec030e941\") " pod="openshift-must-gather-d4tfg/perf-node-gather-daemonset-lj29j" Jun 11 20:19:54.403436 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:54.403411 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9fxw\" (UniqueName: \"kubernetes.io/projected/44274854-4fbc-4af0-b8ea-73aec030e941-kube-api-access-z9fxw\") pod \"perf-node-gather-daemonset-lj29j\" (UID: \"44274854-4fbc-4af0-b8ea-73aec030e941\") " pod="openshift-must-gather-d4tfg/perf-node-gather-daemonset-lj29j" Jun 11 20:19:54.452822 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:54.452791 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ckh6n_ba09d733-3024-4a3c-b49c-ab7213905587/console-operator/1.log" Jun 11 20:19:54.457741 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:54.457720 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-ckh6n_ba09d733-3024-4a3c-b49c-ab7213905587/console-operator/2.log" Jun 11 20:19:54.542207 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:54.542123 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d4tfg/perf-node-gather-daemonset-lj29j" Jun 11 20:19:54.694981 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:54.694938 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d4tfg/perf-node-gather-daemonset-lj29j"] Jun 11 20:19:54.696066 ip-10-0-137-142 kubenswrapper[2562]: W0611 20:19:54.696031 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod44274854_4fbc_4af0_b8ea_73aec030e941.slice/crio-43429f163810094ca5d0eddb2b367156fc8d62132c236c4be9d36d93f407eeaa WatchSource:0}: Error finding container 43429f163810094ca5d0eddb2b367156fc8d62132c236c4be9d36d93f407eeaa: Status 404 returned error can't find the container with id 43429f163810094ca5d0eddb2b367156fc8d62132c236c4be9d36d93f407eeaa Jun 11 20:19:54.737998 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:54.737964 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d4tfg/perf-node-gather-daemonset-lj29j" event={"ID":"44274854-4fbc-4af0-b8ea-73aec030e941","Type":"ContainerStarted","Data":"43429f163810094ca5d0eddb2b367156fc8d62132c236c4be9d36d93f407eeaa"} Jun 11 20:19:55.056764 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:55.056685 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-57fd4d894c-g2cjm_3410b9fd-fc53-4c71-b2d7-b9248b01a8d9/console/0.log" Jun 11 20:19:55.744643 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:55.744601 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d4tfg/perf-node-gather-daemonset-lj29j" event={"ID":"44274854-4fbc-4af0-b8ea-73aec030e941","Type":"ContainerStarted","Data":"ebfeaf7924468ad99dc3b19d4dc72193444cbf2c8336f406f9b25dadbf8b2dd6"} Jun 11 20:19:55.744824 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:55.744667 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-d4tfg/perf-node-gather-daemonset-lj29j" Jun 11 20:19:55.763479 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:55.763428 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-d4tfg/perf-node-gather-daemonset-lj29j" podStartSLOduration=1.7634132999999999 podStartE2EDuration="1.7634133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 20:19:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:19:55.761425235 +0000 UTC m=+1287.492587210" watchObservedRunningTime="2026-06-11 20:19:55.7634133 +0000 UTC m=+1287.494575275" Jun 11 20:19:55.828298 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:55.828269 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-bd4ccd799-skt66_41492016-27bc-4186-aa74-739aae388ab0/volume-data-source-validator/0.log" Jun 11 20:19:57.010045 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:57.010021 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dwkpn_40c0e2f2-95f6-4cb1-8cc3-86669ea992b0/dns/0.log" Jun 11 20:19:57.041640 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:57.041618 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dwkpn_40c0e2f2-95f6-4cb1-8cc3-86669ea992b0/kube-rbac-proxy/0.log" Jun 11 20:19:57.206634 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:57.206604 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lb5qs_ad153657-154e-4342-b701-95873f67a210/dns-node-resolver/0.log" Jun 11 20:19:57.778779 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:57.778753 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-648xp_1b6c5b1c-65de-4fe3-9ccd-9c2996176ccb/node-ca/0.log" Jun 11 20:19:58.871250 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:58.871218 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-8v7zj_373380a2-bd6c-4b56-8c91-e0076d6853d1/discovery/0.log" Jun 11 20:19:58.984720 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:58.984690 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59446c6fd7-sh7b5_9525d310-8a99-4e98-8398-4b26851cde18/kube-auth-proxy/0.log" Jun 11 20:19:59.184282 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:59.184203 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64f5b86456-67889_d4de4ed2-f4f2-4c34-b919-8c553e9df39f/router/0.log" Jun 11 20:19:59.870871 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:19:59.870842 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nclx5_d5823bf3-bd2b-498e-b24c-5787b60f595c/serve-healthcheck-canary/0.log" Jun 11 20:20:00.490710 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:20:00.490672 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g7qbq_9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792/kube-rbac-proxy/0.log" Jun 11 20:20:00.512890 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:20:00.512859 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g7qbq_9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792/exporter/0.log" Jun 11 20:20:00.536627 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:20:00.536603 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g7qbq_9e9d7a1b-cbe8-4e53-84b0-e5b5f69e6792/extractor/0.log" Jun 11 20:20:01.762540 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:20:01.762514 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-d4tfg/perf-node-gather-daemonset-lj29j" Jun 11 20:20:03.205042 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:20:03.205002 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-lz7x9_76515318-fcd6-4033-9844-1526375a58d1/manager/0.log" Jun 11 20:20:03.247204 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:20:03.247172 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-fcsgz_bd0ac29f-247b-4357-a237-5c6ec750b9d0/manager/0.log" Jun 11 20:20:03.272179 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:20:03.272153 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-c9886dd47-qw6h6_82c2f442-7d4e-4af6-8892-92eef6ee2f56/maas-api/0.log" Jun 11 20:20:03.334936 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:20:03.334898 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6499fc5bd-lvxzs_eab23c33-9c53-4d55-b108-f1ae0f54efeb/manager/0.log" Jun 11 20:20:03.357704 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:20:03.357679 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-j62p9_687973f1-c1c3-48cb-aabb-03674a0f4580/server/0.log" Jun 11 20:20:03.408722 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:20:03.408694 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-5tzp4_cdea2e11-c0d5-43a7-be42-8ec414ff0a85/manager/0.log" Jun 11 20:20:03.493117 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:20:03.493029 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7878f89495-h5gr5_14d88d3b-766c-4372-92f5-eeb6ba517635/manager/0.log" Jun 11 20:20:03.519218 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:20:03.519185 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7878f89495-h5gr5_14d88d3b-766c-4372-92f5-eeb6ba517635/copy-manifests/0.log" Jun 11 20:20:05.372957 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:20:05.372925 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-k8bwv_864a9b3b-6254-4d53-b7d0-32f840171a16/openshift-lws-operator/0.log" Jun 11 20:20:08.586757 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:20:08.586730 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-8v7zj_373380a2-bd6c-4b56-8c91-e0076d6853d1/discovery/0.log" Jun 11 20:20:08.618016 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:20:08.617986 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59446c6fd7-sh7b5_9525d310-8a99-4e98-8398-4b26851cde18/kube-auth-proxy/0.log" Jun 11 20:20:08.686912 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:20:08.686883 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64f5b86456-67889_d4de4ed2-f4f2-4c34-b919-8c553e9df39f/router/0.log" Jun 11 20:20:09.871020 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:20:09.870986 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-8v7zj_373380a2-bd6c-4b56-8c91-e0076d6853d1/discovery/0.log" Jun 11 20:20:09.900751 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:20:09.900726 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59446c6fd7-sh7b5_9525d310-8a99-4e98-8398-4b26851cde18/kube-auth-proxy/0.log" Jun 11 20:20:09.977133 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:20:09.977099 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64f5b86456-67889_d4de4ed2-f4f2-4c34-b919-8c553e9df39f/router/0.log" Jun 11 20:20:11.201109 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:20:11.201073 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-qtc8f_3e2eabc4-6dcb-442c-bfc3-d5d6d44f14c1/kube-storage-version-migrator-operator/1.log" Jun 11 20:20:11.201895 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:20:11.201874 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-qtc8f_3e2eabc4-6dcb-442c-bfc3-d5d6d44f14c1/kube-storage-version-migrator-operator/0.log" Jun 11 20:20:11.834082 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:20:11.834053 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-8v7zj_373380a2-bd6c-4b56-8c91-e0076d6853d1/discovery/0.log" Jun 11 20:20:11.865028 ip-10-0-137-142 kubenswrapper[2562]: I0611 20:20:11.865003 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59446c6fd7-sh7b5_9525d310-8a99-4e98-8398-4b26851cde18/kube-auth-proxy/0.log"