Jun 11 12:50:25.335041 ip-10-0-137-120 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 11 12:50:25.335053 ip-10-0-137-120 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 11 12:50:25.335060 ip-10-0-137-120 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 11 12:50:25.335213 ip-10-0-137-120 systemd[1]: Failed to start Kubernetes Kubelet. Jun 11 12:50:36.556271 ip-10-0-137-120 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 11 12:50:36.556284 ip-10-0-137-120 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot d3cc445bfa7f43cfbb31530f8ddb5668 -- Jun 11 12:53:20.227586 ip-10-0-137-120 systemd[1]: Starting Kubernetes Kubelet... Jun 11 12:53:20.663738 ip-10-0-137-120 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 12:53:20.663738 ip-10-0-137-120 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 12:53:20.663738 ip-10-0-137-120 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 12:53:20.663738 ip-10-0-137-120 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 12:53:20.663738 ip-10-0-137-120 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 12:53:20.665561 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.665475 2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 12:53:20.669786 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669771 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 12:53:20.669786 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669787 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 12:53:20.669852 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669791 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 12:53:20.669852 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669794 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 12:53:20.669852 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669797 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 12:53:20.669852 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669800 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 12:53:20.669852 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669803 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 12:53:20.669852 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669805 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 12:53:20.669852 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669808 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 12:53:20.669852 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669811 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 12:53:20.669852 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669814 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 12:53:20.669852 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669816 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 12:53:20.669852 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669820 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 12:53:20.669852 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669824 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 12:53:20.669852 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669828 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 12:53:20.669852 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669831 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 12:53:20.669852 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669834 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 12:53:20.669852 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669838 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 12:53:20.669852 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669841 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 12:53:20.669852 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669843 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 12:53:20.669852 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669847 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 12:53:20.670320 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669850 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 12:53:20.670320 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669853 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 11 12:53:20.670320 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669856 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 12:53:20.670320 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669861 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 12:53:20.670320 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669864 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 12:53:20.670320 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669867 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 12:53:20.670320 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669870 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 12:53:20.670320 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669873 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 12:53:20.670320 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669876 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 12:53:20.670320 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669879 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 12:53:20.670320 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669881 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 12:53:20.670320 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669884 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 12:53:20.670320 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669887 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 12:53:20.670320 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669889 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 12:53:20.670320 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669891 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 12:53:20.670320 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669894 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 12:53:20.670320 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669897 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 12:53:20.670320 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669899 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 12:53:20.670320 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669902 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 12:53:20.670320 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669904 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 12:53:20.670796 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669906 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 12:53:20.670796 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669909 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 12:53:20.670796 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669912 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 12:53:20.670796 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669914 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 12:53:20.670796 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669916 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 12:53:20.670796 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669919 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 12:53:20.670796 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669921 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 12:53:20.670796 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669924 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 12:53:20.670796 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669926 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 12:53:20.670796 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669929 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 12:53:20.670796 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669931 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 12:53:20.670796 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669934 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 12:53:20.670796 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669937 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 12:53:20.670796 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669941 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 12:53:20.670796 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669944 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 12:53:20.670796 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669948 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 12:53:20.670796 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669951 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 12:53:20.670796 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669954 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 12:53:20.670796 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669957 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 12:53:20.670796 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669960 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 12:53:20.671335 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669962 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 12:53:20.671335 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669965 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 12:53:20.671335 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669967 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 12:53:20.671335 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669970 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 12:53:20.671335 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669972 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 12:53:20.671335 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669974 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 12:53:20.671335 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669977 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 12:53:20.671335 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669979 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 12:53:20.671335 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669982 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 12:53:20.671335 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669985 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 12:53:20.671335 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669987 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 12:53:20.671335 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669990 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 12:53:20.671335 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669994 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 12:53:20.671335 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669997 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 12:53:20.671335 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.669999 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 12:53:20.671335 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670002 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 12:53:20.671335 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670004 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 12:53:20.671335 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670007 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 12:53:20.671335 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670009 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 12:53:20.671335 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670013 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 12:53:20.671902 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670017 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 12:53:20.671902 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670020 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 12:53:20.671902 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670022 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 12:53:20.671902 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670025 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 12:53:20.671902 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670028 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 12:53:20.671902 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670031 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 12:53:20.671902 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670034 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 12:53:20.671902 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670036 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 12:53:20.671902 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670039 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 12:53:20.671902 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670042 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 12:53:20.671902 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670044 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 12:53:20.671902 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670047 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 12:53:20.671902 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670050 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 12:53:20.671902 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670052 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 12:53:20.671902 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670055 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 12:53:20.671902 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670057 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 12:53:20.671902 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670060 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 12:53:20.671902 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670062 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 12:53:20.671902 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670759 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 12:53:20.671902 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670765 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 12:53:20.672421 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670768 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 12:53:20.672421 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670772 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 12:53:20.672421 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670775 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 12:53:20.672421 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670778 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 12:53:20.672421 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670782 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 12:53:20.672421 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670784 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 12:53:20.672421 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670787 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 12:53:20.672421 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670790 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 12:53:20.672421 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670793 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 11 12:53:20.672421 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670796 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 12:53:20.672421 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670798 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 12:53:20.672421 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670801 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 12:53:20.672421 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670804 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 12:53:20.672421 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670807 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 12:53:20.672421 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670810 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 12:53:20.672421 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670813 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 12:53:20.672421 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670816 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 12:53:20.672421 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670819 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 12:53:20.672421 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670822 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 12:53:20.672421 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670825 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 12:53:20.672916 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670827 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 12:53:20.672916 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670830 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 12:53:20.672916 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670832 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 12:53:20.672916 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670835 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 12:53:20.672916 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670838 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 12:53:20.672916 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670840 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 12:53:20.672916 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670843 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 12:53:20.672916 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670845 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 12:53:20.672916 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670848 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 12:53:20.672916 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670851 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 12:53:20.672916 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670853 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 12:53:20.672916 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670856 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 12:53:20.672916 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670858 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 12:53:20.672916 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670862 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 12:53:20.672916 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670865 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 12:53:20.672916 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670867 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 12:53:20.672916 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670870 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 12:53:20.672916 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670872 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 12:53:20.672916 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670875 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 12:53:20.672916 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670878 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 12:53:20.673417 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670881 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 12:53:20.673417 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670883 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 12:53:20.673417 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670886 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 12:53:20.673417 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670889 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 12:53:20.673417 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670891 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 12:53:20.673417 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670894 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 12:53:20.673417 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670897 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 12:53:20.673417 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670900 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 12:53:20.673417 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670902 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 12:53:20.673417 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670905 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 12:53:20.673417 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670907 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 12:53:20.673417 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670910 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 12:53:20.673417 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670915 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 12:53:20.673417 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670918 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 12:53:20.673417 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670921 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 12:53:20.673417 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670924 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 12:53:20.673417 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670927 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 12:53:20.673417 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670930 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 12:53:20.673417 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670933 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 12:53:20.673922 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670935 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 12:53:20.673922 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670938 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 12:53:20.673922 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670941 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 12:53:20.673922 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670943 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 12:53:20.673922 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670945 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 12:53:20.673922 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670948 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 12:53:20.673922 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670951 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 12:53:20.673922 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670954 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 12:53:20.673922 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670956 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 12:53:20.673922 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670959 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 12:53:20.673922 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670961 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 12:53:20.673922 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670964 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 12:53:20.673922 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670966 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 12:53:20.673922 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670969 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 12:53:20.673922 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670971 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 12:53:20.673922 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670975 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 12:53:20.673922 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670977 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 12:53:20.673922 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670982 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 12:53:20.673922 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670986 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 12:53:20.673922 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670988 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 12:53:20.674424 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670991 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 12:53:20.674424 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670993 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 12:53:20.674424 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670996 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 12:53:20.674424 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.670999 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 12:53:20.674424 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671001 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 12:53:20.674424 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671004 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 12:53:20.674424 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671007 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 12:53:20.674424 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671009 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 12:53:20.674424 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671012 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 12:53:20.674424 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671014 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 12:53:20.674424 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671017 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 12:53:20.674424 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671020 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 12:53:20.674424 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671022 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 12:53:20.674424 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671025 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 12:53:20.674424 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671027 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 12:53:20.674424 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671030 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 12:53:20.674424 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671034 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 12:53:20.674424 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671037 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 12:53:20.674424 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671425 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 12:53:20.674880 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671430 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 12:53:20.674880 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671433 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 12:53:20.674880 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671436 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 12:53:20.674880 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671441 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 12:53:20.674880 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671445 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 12:53:20.674880 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671448 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 12:53:20.674880 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671451 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 12:53:20.674880 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671454 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 12:53:20.674880 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671457 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 12:53:20.674880 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671460 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 12:53:20.674880 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671462 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 12:53:20.674880 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671465 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 11 12:53:20.674880 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671468 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 12:53:20.674880 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671471 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 12:53:20.674880 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671475 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 12:53:20.674880 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671479 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 12:53:20.674880 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671482 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 12:53:20.674880 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671485 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 12:53:20.674880 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671488 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 12:53:20.675358 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671490 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 12:53:20.675358 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671493 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 12:53:20.675358 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671496 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 12:53:20.675358 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671498 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 12:53:20.675358 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671501 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 12:53:20.675358 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671503 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 12:53:20.675358 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671506 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 12:53:20.675358 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671508 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 12:53:20.675358 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671511 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 12:53:20.675358 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671513 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 12:53:20.675358 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671516 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 12:53:20.675358 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671518 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 12:53:20.675358 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671521 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 12:53:20.675358 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671524 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 12:53:20.675358 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671527 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 12:53:20.675358 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671529 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 12:53:20.675358 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671532 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 12:53:20.675358 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671535 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 12:53:20.675358 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671538 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 12:53:20.675358 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671540 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 12:53:20.675845 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671543 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 12:53:20.675845 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671546 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 12:53:20.675845 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671549 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 12:53:20.675845 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671552 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 12:53:20.675845 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671554 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 12:53:20.675845 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671557 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 12:53:20.675845 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671560 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 12:53:20.675845 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671562 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 12:53:20.675845 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671565 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 12:53:20.675845 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671567 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 12:53:20.675845 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671570 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 12:53:20.675845 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671572 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 12:53:20.675845 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671582 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 12:53:20.675845 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671586 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 12:53:20.675845 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671589 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 12:53:20.675845 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671592 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 12:53:20.675845 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671595 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 12:53:20.675845 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671598 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 12:53:20.675845 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671600 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 12:53:20.675845 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671603 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 12:53:20.676356 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671605 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 12:53:20.676356 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671607 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 12:53:20.676356 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671610 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 12:53:20.676356 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671613 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 12:53:20.676356 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671616 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 12:53:20.676356 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671618 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 12:53:20.676356 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671621 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 12:53:20.676356 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671623 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 12:53:20.676356 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671627 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 12:53:20.676356 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671629 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 12:53:20.676356 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671632 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 12:53:20.676356 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671634 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 12:53:20.676356 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671637 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 12:53:20.676356 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671640 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 12:53:20.676356 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671642 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 12:53:20.676356 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671645 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 12:53:20.676356 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671648 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 12:53:20.676356 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671650 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 12:53:20.676356 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671653 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 12:53:20.676830 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671655 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 12:53:20.676830 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671658 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 12:53:20.676830 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671661 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 12:53:20.676830 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671663 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 12:53:20.676830 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671666 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 12:53:20.676830 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671669 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 12:53:20.676830 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671676 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 12:53:20.676830 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671679 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 12:53:20.676830 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671682 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 12:53:20.676830 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671684 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 12:53:20.676830 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671687 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 12:53:20.676830 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671690 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 12:53:20.676830 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671692 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 12:53:20.676830 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671695 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 12:53:20.676830 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671697 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 12:53:20.676830 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671700 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 12:53:20.676830 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671702 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 12:53:20.676830 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671709 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 12:53:20.676830 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671712 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 12:53:20.677359 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.671714 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 12:53:20.677359 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671786 2558 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 12:53:20.677359 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671792 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 12:53:20.677359 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671798 2558 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 12:53:20.677359 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671803 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 12:53:20.677359 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671807 2558 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 12:53:20.677359 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671810 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 12:53:20.677359 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671815 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 12:53:20.677359 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671820 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 12:53:20.677359 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671823 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 12:53:20.677359 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671826 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 12:53:20.677359 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671829 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 12:53:20.677359 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671832 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 12:53:20.677359 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671836 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 12:53:20.677359 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671838 2558 flags.go:64] FLAG: --cgroup-root="" Jun 11 12:53:20.677359 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671841 2558 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 12:53:20.677359 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671844 2558 flags.go:64] FLAG: --client-ca-file="" Jun 11 12:53:20.677359 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671847 2558 flags.go:64] FLAG: --cloud-provider="external" Jun 11 12:53:20.677359 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671849 2558 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 12:53:20.677359 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671859 2558 flags.go:64] FLAG: --cluster-domain="" Jun 11 12:53:20.677359 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671868 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 12:53:20.677359 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671871 2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 12:53:20.677359 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671874 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 12:53:20.677359 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671878 2558 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 12:53:20.677927 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671881 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 12:53:20.677927 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671884 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 12:53:20.677927 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671887 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 12:53:20.677927 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671891 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 12:53:20.677927 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671894 2558 flags.go:64] FLAG: --contention-profiling="false" Jun 11 12:53:20.677927 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671897 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 12:53:20.677927 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671901 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 12:53:20.677927 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671904 2558 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 12:53:20.677927 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671907 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 12:53:20.677927 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671912 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 12:53:20.677927 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671915 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 12:53:20.677927 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671918 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 12:53:20.677927 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671921 2558 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 12:53:20.677927 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671924 2558 flags.go:64] FLAG: --enable-server="true" Jun 11 12:53:20.677927 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671927 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 12:53:20.677927 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671935 2558 flags.go:64] FLAG: --event-burst="100" Jun 11 12:53:20.677927 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671938 2558 flags.go:64] FLAG: --event-qps="50" Jun 11 12:53:20.677927 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671941 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 12:53:20.677927 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671944 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 12:53:20.677927 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671947 2558 flags.go:64] FLAG: --eviction-hard="" Jun 11 12:53:20.677927 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671951 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 12:53:20.677927 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671953 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 12:53:20.677927 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671956 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 12:53:20.677927 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671959 2558 flags.go:64] FLAG: --eviction-soft="" Jun 11 12:53:20.677927 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671962 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 12:53:20.678577 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671965 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 12:53:20.678577 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671968 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 12:53:20.678577 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671971 2558 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 12:53:20.678577 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671974 2558 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 12:53:20.678577 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671984 2558 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 12:53:20.678577 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671987 2558 flags.go:64] FLAG: --feature-gates="" Jun 11 12:53:20.678577 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671991 2558 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 12:53:20.678577 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671994 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 12:53:20.678577 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.671997 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 12:53:20.678577 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672000 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 12:53:20.678577 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672003 2558 flags.go:64] FLAG: --healthz-port="10248" Jun 11 12:53:20.678577 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672006 2558 flags.go:64] FLAG: --help="false" Jun 11 12:53:20.678577 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672009 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-137-120.ec2.internal" Jun 11 12:53:20.678577 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672013 2558 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 12:53:20.678577 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672016 2558 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 12:53:20.678577 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672019 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 12:53:20.678577 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672022 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 12:53:20.678577 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672025 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 12:53:20.678577 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672028 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 12:53:20.678577 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672031 2558 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 12:53:20.678577 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672033 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 12:53:20.678577 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672037 2558 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 12:53:20.678577 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672040 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 12:53:20.679186 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672044 2558 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 12:53:20.679186 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672046 2558 flags.go:64] FLAG: --kube-reserved="" Jun 11 12:53:20.679186 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672049 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 12:53:20.679186 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672052 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 12:53:20.679186 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672066 2558 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 12:53:20.679186 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672069 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 12:53:20.679186 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672072 2558 flags.go:64] FLAG: --lock-file="" Jun 11 12:53:20.679186 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672075 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 12:53:20.679186 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672078 2558 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 12:53:20.679186 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672081 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 12:53:20.679186 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672086 2558 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 12:53:20.679186 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672089 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 12:53:20.679186 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672091 2558 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 12:53:20.679186 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672094 2558 flags.go:64] FLAG: --logging-format="text" Jun 11 12:53:20.679186 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672104 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 12:53:20.679186 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672107 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 12:53:20.679186 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672110 2558 flags.go:64] FLAG: --manifest-url="" Jun 11 12:53:20.679186 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672113 2558 flags.go:64] FLAG: --manifest-url-header="" Jun 11 12:53:20.679186 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672117 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 12:53:20.679186 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672120 2558 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 12:53:20.679186 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672129 2558 flags.go:64] FLAG: --max-pods="110" Jun 11 12:53:20.679186 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672132 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 12:53:20.679186 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672137 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 12:53:20.679186 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672139 2558 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 12:53:20.679186 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672142 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 12:53:20.679843 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672145 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 12:53:20.679843 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672148 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 12:53:20.679843 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672166 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 12:53:20.679843 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672174 2558 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 12:53:20.679843 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672177 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 12:53:20.679843 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672180 2558 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 12:53:20.679843 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672184 2558 flags.go:64] FLAG: --pod-cidr="" Jun 11 12:53:20.679843 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672187 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 12:53:20.679843 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672193 2558 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 12:53:20.679843 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672196 2558 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 12:53:20.679843 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672199 2558 flags.go:64] FLAG: --pods-per-core="0" Jun 11 12:53:20.679843 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672202 2558 flags.go:64] FLAG: --port="10250" Jun 11 12:53:20.679843 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672205 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 12:53:20.679843 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672207 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09a2c5cb707f44ec1" Jun 11 12:53:20.679843 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672211 2558 flags.go:64] FLAG: --qos-reserved="" Jun 11 12:53:20.679843 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672214 2558 flags.go:64] FLAG: --read-only-port="10255" Jun 11 12:53:20.679843 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672217 2558 flags.go:64] FLAG: --register-node="true" Jun 11 12:53:20.679843 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672219 2558 flags.go:64] FLAG: --register-with-taints="" Jun 11 12:53:20.679843 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672223 2558 flags.go:64] FLAG: --registry-burst="10" Jun 11 12:53:20.679843 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672226 2558 flags.go:64] FLAG: --registry-qps="5" Jun 11 12:53:20.679843 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672229 2558 flags.go:64] FLAG: --reserved-cpus="" Jun 11 12:53:20.679843 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672232 2558 flags.go:64] FLAG: --reserved-memory="" Jun 11 12:53:20.679843 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672241 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 12:53:20.679843 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672245 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 12:53:20.679843 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672247 2558 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 12:53:20.680802 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672250 2558 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 12:53:20.680802 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672253 2558 flags.go:64] FLAG: --runonce="false" Jun 11 12:53:20.680802 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672256 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 12:53:20.680802 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672259 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 12:53:20.680802 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672263 2558 flags.go:64] FLAG: --seccomp-default="false" Jun 11 12:53:20.680802 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672266 2558 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 12:53:20.680802 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672269 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 12:53:20.680802 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672272 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 12:53:20.680802 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672275 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 12:53:20.680802 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672278 2558 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 12:53:20.680802 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672281 2558 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 12:53:20.680802 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672283 2558 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 12:53:20.680802 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672286 2558 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 12:53:20.680802 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672289 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 12:53:20.680802 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672293 2558 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 12:53:20.680802 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672296 2558 flags.go:64] FLAG: --system-cgroups="" Jun 11 12:53:20.680802 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672299 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 12:53:20.680802 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672304 2558 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 12:53:20.680802 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672306 2558 flags.go:64] FLAG: --tls-cert-file="" Jun 11 12:53:20.680802 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672309 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 12:53:20.680802 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672316 2558 flags.go:64] FLAG: --tls-min-version="" Jun 11 12:53:20.680802 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672319 2558 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 12:53:20.680802 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672322 2558 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 12:53:20.680802 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672325 2558 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 12:53:20.680802 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672327 2558 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 12:53:20.681611 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672330 2558 flags.go:64] FLAG: --v="2" Jun 11 12:53:20.681611 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672335 2558 flags.go:64] FLAG: --version="false" Jun 11 12:53:20.681611 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672338 2558 flags.go:64] FLAG: --vmodule="" Jun 11 12:53:20.681611 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672342 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 12:53:20.681611 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.672345 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 12:53:20.681611 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672485 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 12:53:20.681611 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672489 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 12:53:20.681611 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672493 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 12:53:20.681611 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672495 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 12:53:20.681611 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672499 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 12:53:20.681611 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672502 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 12:53:20.681611 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672507 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 12:53:20.681611 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672509 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 12:53:20.681611 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672512 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 12:53:20.681611 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672514 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 11 12:53:20.681611 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672517 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 12:53:20.681611 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672519 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 12:53:20.681611 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672522 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 12:53:20.681611 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672524 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 12:53:20.681611 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672526 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 12:53:20.681611 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672529 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 12:53:20.682128 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672533 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 12:53:20.682128 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672542 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 12:53:20.682128 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672544 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 12:53:20.682128 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672547 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 12:53:20.682128 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672551 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 12:53:20.682128 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672555 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 12:53:20.682128 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672558 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 12:53:20.682128 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672561 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 12:53:20.682128 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672564 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 12:53:20.682128 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672567 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 12:53:20.682128 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672570 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 12:53:20.682128 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672573 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 12:53:20.682128 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672576 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 12:53:20.682128 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672578 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 12:53:20.682128 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672581 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 12:53:20.682128 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672584 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 12:53:20.682128 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672586 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 12:53:20.682128 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672595 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 12:53:20.682128 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672598 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 12:53:20.682666 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672601 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 12:53:20.682666 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672604 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 12:53:20.682666 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672606 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 12:53:20.682666 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672610 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 12:53:20.682666 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672613 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 12:53:20.682666 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672616 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 12:53:20.682666 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672618 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 12:53:20.682666 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672621 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 12:53:20.682666 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672624 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 12:53:20.682666 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672626 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 12:53:20.682666 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672629 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 12:53:20.682666 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672632 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 12:53:20.682666 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672634 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 12:53:20.682666 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672640 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 12:53:20.682666 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672642 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 12:53:20.682666 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672645 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 12:53:20.682666 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672647 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 12:53:20.682666 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672650 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 12:53:20.682666 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672653 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 12:53:20.682666 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672655 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 12:53:20.683169 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672658 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 12:53:20.683169 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672661 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 12:53:20.683169 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672663 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 12:53:20.683169 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672666 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 12:53:20.683169 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672668 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 12:53:20.683169 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672671 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 12:53:20.683169 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672673 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 12:53:20.683169 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672676 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 12:53:20.683169 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672678 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 12:53:20.683169 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672681 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 12:53:20.683169 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672684 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 12:53:20.683169 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672692 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 12:53:20.683169 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672694 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 12:53:20.683169 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672697 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 12:53:20.683169 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672700 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 12:53:20.683169 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672703 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 12:53:20.683169 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672707 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 12:53:20.683169 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672710 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 12:53:20.683169 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672714 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 12:53:20.683637 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672717 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 12:53:20.683637 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672719 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 12:53:20.683637 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672722 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 12:53:20.683637 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672724 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 12:53:20.683637 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672727 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 12:53:20.683637 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672729 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 12:53:20.683637 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672734 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 12:53:20.683637 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672736 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 12:53:20.683637 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672739 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 12:53:20.683637 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672741 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 12:53:20.683637 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672744 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 12:53:20.683637 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672746 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 12:53:20.683637 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672749 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 12:53:20.683637 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672751 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 12:53:20.683637 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672754 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 12:53:20.683637 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672757 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 12:53:20.683637 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672759 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 12:53:20.683637 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672762 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 12:53:20.683637 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672764 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 12:53:20.683637 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672767 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 12:53:20.684195 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672769 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 12:53:20.684195 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672772 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 12:53:20.684195 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672774 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 12:53:20.684195 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672777 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 12:53:20.684195 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.672779 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 12:53:20.684195 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.674313 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 12:53:20.684195 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.682850 2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 12:53:20.684195 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.682867 2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 12:53:20.684195 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.682887 2558 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 12:53:20.684195 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.682900 2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 12:53:20.684195 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.682958 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 12:53:20.684195 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.682964 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 12:53:20.684195 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.682968 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 12:53:20.684195 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.682971 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 12:53:20.684195 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.682973 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 12:53:20.684574 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.682976 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 12:53:20.684574 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.682979 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 12:53:20.684574 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.682982 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 12:53:20.684574 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.682985 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 12:53:20.684574 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.682988 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 12:53:20.684574 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.682991 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 12:53:20.684574 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.682993 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 12:53:20.684574 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.682996 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 12:53:20.684574 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.682999 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 12:53:20.684574 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683001 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 12:53:20.684574 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683004 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 12:53:20.684574 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683006 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 12:53:20.684574 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683010 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 12:53:20.684574 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683012 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 12:53:20.684574 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683015 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 12:53:20.684574 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683017 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 12:53:20.684574 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683020 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 11 12:53:20.684574 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683023 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 12:53:20.684574 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683025 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 12:53:20.684574 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683028 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 12:53:20.685065 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683031 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 12:53:20.685065 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683033 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 12:53:20.685065 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683036 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 12:53:20.685065 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683038 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 12:53:20.685065 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683041 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 12:53:20.685065 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683044 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 12:53:20.685065 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683048 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 12:53:20.685065 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683051 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 12:53:20.685065 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683055 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 12:53:20.685065 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683057 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 12:53:20.685065 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683060 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 12:53:20.685065 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683062 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 12:53:20.685065 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683065 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 12:53:20.685065 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683068 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 12:53:20.685065 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683070 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 12:53:20.685065 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683073 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 12:53:20.685065 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683076 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 12:53:20.685065 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683078 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 12:53:20.685065 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683081 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 12:53:20.685065 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683083 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 12:53:20.685695 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683087 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 12:53:20.685695 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683091 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 12:53:20.685695 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683094 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 12:53:20.685695 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683097 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 12:53:20.685695 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683101 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 12:53:20.685695 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683104 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 12:53:20.685695 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683106 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 12:53:20.685695 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683109 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 12:53:20.685695 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683112 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 12:53:20.685695 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683114 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 12:53:20.685695 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683117 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 12:53:20.685695 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683120 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 12:53:20.685695 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683123 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 12:53:20.685695 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683125 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 12:53:20.685695 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683128 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 12:53:20.685695 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683131 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 12:53:20.685695 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683133 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 12:53:20.685695 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683136 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 12:53:20.685695 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683139 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 12:53:20.686171 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683142 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 12:53:20.686171 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683144 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 12:53:20.686171 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683146 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 12:53:20.686171 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683149 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 12:53:20.686171 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683163 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 12:53:20.686171 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683166 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 12:53:20.686171 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683168 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 12:53:20.686171 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683171 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 12:53:20.686171 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683174 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 12:53:20.686171 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683177 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 12:53:20.686171 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683180 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 12:53:20.686171 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683183 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 12:53:20.686171 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683186 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 12:53:20.686171 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683189 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 12:53:20.686171 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683192 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 12:53:20.686171 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683195 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 12:53:20.686171 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683198 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 12:53:20.686171 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683201 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 12:53:20.686171 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683204 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 12:53:20.686171 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683206 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 12:53:20.686663 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683209 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 12:53:20.686663 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683211 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 12:53:20.686663 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683214 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 12:53:20.686663 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683216 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 12:53:20.686663 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683219 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 12:53:20.686663 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683222 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 12:53:20.686663 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683224 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 12:53:20.686663 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683227 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 12:53:20.686663 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683230 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 12:53:20.686663 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683232 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 12:53:20.686663 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683235 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 12:53:20.686663 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683239 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 12:53:20.686663 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683242 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 12:53:20.686663 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683245 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 12:53:20.686663 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683248 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 12:53:20.687025 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.683253 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 12:53:20.687025 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683367 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 12:53:20.687025 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683373 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 12:53:20.687025 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683376 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 12:53:20.687025 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683379 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 12:53:20.687025 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683382 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 12:53:20.687025 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683385 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 12:53:20.687025 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683388 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 12:53:20.687025 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683391 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 12:53:20.687025 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683394 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 12:53:20.687025 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683397 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 12:53:20.687025 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683400 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 12:53:20.687025 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683403 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 12:53:20.687025 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683406 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 12:53:20.687025 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683409 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 12:53:20.687460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683412 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 12:53:20.687460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683414 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 12:53:20.687460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683417 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 12:53:20.687460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683419 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 12:53:20.687460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683422 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 12:53:20.687460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683424 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 12:53:20.687460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683427 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 12:53:20.687460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683429 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 12:53:20.687460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683432 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 12:53:20.687460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683434 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 12:53:20.687460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683437 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 12:53:20.687460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683439 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 12:53:20.687460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683442 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 12:53:20.687460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683444 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 12:53:20.687460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683447 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 12:53:20.687460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683450 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 12:53:20.687460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683452 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 12:53:20.687460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683455 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 12:53:20.687460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683458 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 12:53:20.687460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683460 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 12:53:20.687954 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683463 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 12:53:20.687954 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683466 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 12:53:20.687954 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683468 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 12:53:20.687954 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683471 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 12:53:20.687954 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683474 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 12:53:20.687954 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683476 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 12:53:20.687954 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683479 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 12:53:20.687954 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683481 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 12:53:20.687954 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683484 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 12:53:20.687954 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683487 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 12:53:20.687954 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683489 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 12:53:20.687954 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683493 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 12:53:20.687954 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683496 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 12:53:20.687954 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683498 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 12:53:20.687954 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683501 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 12:53:20.687954 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683503 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 12:53:20.687954 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683506 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 12:53:20.687954 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683509 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 12:53:20.687954 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683511 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 12:53:20.687954 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683514 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 12:53:20.688460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683516 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 12:53:20.688460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683519 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 12:53:20.688460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683521 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 12:53:20.688460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683524 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 12:53:20.688460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683526 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 12:53:20.688460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683529 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 12:53:20.688460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683532 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 12:53:20.688460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683534 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 12:53:20.688460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683537 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 12:53:20.688460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683542 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 12:53:20.688460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683545 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 12:53:20.688460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683547 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 12:53:20.688460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683550 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 12:53:20.688460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683553 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 12:53:20.688460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683555 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 12:53:20.688460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683558 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 12:53:20.688460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683560 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 12:53:20.688460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683563 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 11 12:53:20.688460 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683566 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 12:53:20.688942 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683568 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 12:53:20.688942 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683571 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 12:53:20.688942 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683573 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 12:53:20.688942 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683576 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 12:53:20.688942 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683579 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 12:53:20.688942 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683582 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 12:53:20.688942 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683585 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 12:53:20.688942 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683587 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 12:53:20.688942 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683590 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 12:53:20.688942 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683593 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 12:53:20.688942 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683595 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 12:53:20.688942 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683598 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 12:53:20.688942 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683600 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 12:53:20.688942 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683603 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 12:53:20.688942 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683606 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 12:53:20.688942 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683608 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 12:53:20.688942 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683611 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 12:53:20.688942 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683613 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 12:53:20.688942 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683617 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 12:53:20.689525 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683620 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 12:53:20.689525 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683623 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 12:53:20.689525 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683627 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 12:53:20.689525 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683633 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 12:53:20.689525 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683636 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 12:53:20.689525 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683639 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 12:53:20.689525 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:20.683642 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 12:53:20.689525 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.683648 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 12:53:20.689525 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.683759 2558 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 12:53:20.689525 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.687134 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 12:53:20.689525 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.688541 2558 server.go:1019] "Starting client certificate rotation" Jun 11 12:53:20.689525 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.688644 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 12:53:20.689525 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.688682 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 12:53:20.691017 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.691003 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 12:53:20.692341 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.692321 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 12:53:20.705191 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.705148 2558 log.go:25] "Validated CRI v1 runtime API" Jun 11 12:53:20.708558 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.708543 2558 log.go:25] "Validated CRI v1 image API" Jun 11 12:53:20.710620 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.710597 2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 12:53:20.713740 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.713720 2558 fs.go:135] Filesystem UUIDs: map[48fafa08-d234-4712-be93-f89f42ec4fe5:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 cec7da13-7f43-4c3c-bc6e-28a9347c9453:/dev/nvme0n1p4] Jun 11 12:53:20.713816 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.713745 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 12:53:20.716364 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.716347 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 12:53:20.721435 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.721264 2558 manager.go:216] Machine: {Timestamp:2026-06-11 12:53:20.71848242 +0000 UTC m=+0.365004353 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3124847 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d314dc93ae1e0b90b0f3b560a377c SystemUUID:ec2d314d-c93a-e1e0-b90b-0f3b560a377c BootID:d3cc445b-fa7f-43cf-bb31-530f8ddb5668 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0d:0f:84:14:6d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0d:0f:84:14:6d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:82:24:7b:c0:8a:30 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 12:53:20.721435 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.721420 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 12:53:20.721624 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.721542 2558 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 12:53:20.724564 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.724530 2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 12:53:20.724733 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.724567 2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-120.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 12:53:20.725335 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.725323 2558 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 12:53:20.725396 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.725341 2558 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 12:53:20.725396 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.725352 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 12:53:20.726028 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.726015 2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 12:53:20.726922 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.726910 2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 12:53:20.730301 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.730284 2558 state_mem.go:36] "Initialized new in-memory state store" Jun 11 12:53:20.730458 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.730447 2558 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 12:53:20.730515 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.730493 2558 kubelet.go:486] "Attempting to sync node with API server" Jun 11 12:53:20.730515 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.730509 2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 12:53:20.730609 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.730529 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 12:53:20.730609 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.730545 2558 kubelet.go:398] "Adding apiserver pod source" Jun 11 12:53:20.730609 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.730558 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 12:53:20.730958 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.730944 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 12:53:20.731019 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.730966 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 12:53:20.735117 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.735098 2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 12:53:20.737641 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.737625 2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 12:53:20.737712 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.737656 2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 12:53:20.738711 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.738692 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 12:53:20.738766 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.738714 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 12:53:20.738766 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.738722 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 12:53:20.738766 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.738728 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 12:53:20.738766 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.738738 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 12:53:20.738766 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.738756 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 12:53:20.738766 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.738766 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 12:53:20.738934 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.738772 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 12:53:20.738934 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.738781 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 12:53:20.738934 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.738787 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 12:53:20.738934 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.738799 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 12:53:20.738934 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.738806 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 12:53:20.739450 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:20.739425 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-120.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 12:53:20.739491 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:20.739429 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 12:53:20.739491 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.739474 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 12:53:20.739491 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.739484 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 12:53:20.742676 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.742656 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-78psl" Jun 11 12:53:20.742676 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.742671 2558 server.go:1268] "Started kubelet" Jun 11 12:53:20.742815 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.742785 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 12:53:20.742941 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.742884 2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 12:53:20.743013 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.742967 2558 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 12:53:20.743374 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.743352 2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-120.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 12:53:20.744040 ip-10-0-137-120 systemd[1]: Started Kubernetes Kubelet. Jun 11 12:53:20.745720 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.745706 2558 server.go:310] "Adding debug handlers to kubelet server" Jun 11 12:53:20.747888 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.747871 2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 12:53:20.748236 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.748221 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-78psl" Jun 11 12:53:20.751254 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:20.750366 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-120.ec2.internal.18b807f4d4717501 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-120.ec2.internal,UID:ip-10-0-137-120.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-120.ec2.internal,},FirstTimestamp:2026-06-11 12:53:20.742651137 +0000 UTC m=+0.389173070,LastTimestamp:2026-06-11 12:53:20.742651137 +0000 UTC m=+0.389173070,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-120.ec2.internal,}" Jun 11 12:53:20.752363 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:20.752341 2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 12:53:20.752688 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.752664 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 12:53:20.752773 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.752752 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 12:53:20.753128 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:20.753101 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-120.ec2.internal\" not found" Jun 11 12:53:20.753475 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.753460 2558 factory.go:55] Registering systemd factory Jun 11 12:53:20.753544 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.753479 2558 factory.go:223] Registration of the systemd container factory successfully Jun 11 12:53:20.753607 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.753590 2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 12:53:20.753665 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.753630 2558 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 12:53:20.753665 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.753660 2558 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 12:53:20.753760 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.753749 2558 reconstruct.go:97] "Volume reconstruction finished" Jun 11 12:53:20.753760 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.753759 2558 reconciler.go:29] "Reconciler: start to sync state" Jun 11 12:53:20.753844 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.753806 2558 factory.go:153] Registering CRI-O factory Jun 11 12:53:20.753844 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.753818 2558 factory.go:223] Registration of the crio container factory successfully Jun 11 12:53:20.753927 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.753887 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 12:53:20.753927 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.753913 2558 factory.go:103] Registering Raw factory Jun 11 12:53:20.753927 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.753927 2558 manager.go:1196] Started watching for new ooms in manager Jun 11 12:53:20.754552 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.754537 2558 manager.go:349] Starting recovery of all containers Jun 11 12:53:20.757078 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.757049 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 12:53:20.762022 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:20.761997 2558 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-120.ec2.internal\" not found" node="ip-10-0-137-120.ec2.internal" Jun 11 12:53:20.766979 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.766860 2558 manager.go:354] Recovery completed Jun 11 12:53:20.771075 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.771061 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 12:53:20.773020 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.773003 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-120.ec2.internal" event="NodeHasSufficientMemory" Jun 11 12:53:20.773077 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.773033 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-120.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 12:53:20.773077 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.773045 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-120.ec2.internal" event="NodeHasSufficientPID" Jun 11 12:53:20.773588 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.773575 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 12:53:20.773627 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.773589 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 12:53:20.773627 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.773576 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 12:53:20.773627 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.773610 2558 state_mem.go:36] "Initialized new in-memory state store" Jun 11 12:53:20.774361 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.774336 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-120.ec2.internal" event="NodeHasSufficientMemory" Jun 11 12:53:20.774437 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.774367 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-120.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 12:53:20.774437 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.774379 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-120.ec2.internal" event="NodeHasSufficientPID" Jun 11 12:53:20.774865 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.774851 2558 policy_none.go:49] "None policy: Start" Jun 11 12:53:20.774904 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.774869 2558 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 12:53:20.774904 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.774881 2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 12:53:20.776127 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.776115 2558 policy_none.go:47] "Start" Jun 11 12:53:20.812800 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.812781 2558 manager.go:337] "Starting Device Plugin manager" Jun 11 12:53:20.819131 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:20.812825 2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 12:53:20.819131 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.812838 2558 server.go:87] "Starting device plugin registration server" Jun 11 12:53:20.819131 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.813247 2558 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 12:53:20.819131 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.813259 2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 12:53:20.819131 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.813426 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 12:53:20.819131 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.813532 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 12:53:20.819131 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.813550 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 12:53:20.819131 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:20.814016 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 12:53:20.819131 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:20.814071 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-120.ec2.internal\" not found" Jun 11 12:53:20.819131 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.817059 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 12:53:20.819131 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.818350 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 12:53:20.819131 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.818389 2558 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 12:53:20.819131 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.818409 2558 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 12:53:20.819131 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:20.818446 2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 12:53:20.820456 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.820439 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 12:53:20.913825 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.913710 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 12:53:20.914704 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.914690 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-120.ec2.internal" event="NodeHasSufficientMemory" Jun 11 12:53:20.914769 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.914719 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-120.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 12:53:20.914769 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.914729 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-120.ec2.internal" event="NodeHasSufficientPID" Jun 11 12:53:20.914769 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.914755 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-120.ec2.internal" Jun 11 12:53:20.919102 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.919085 2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-120.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-120.ec2.internal"] Jun 11 12:53:20.919149 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.919144 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 12:53:20.919866 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.919854 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-120.ec2.internal" event="NodeHasSufficientMemory" Jun 11 12:53:20.919921 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.919878 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-120.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 12:53:20.919921 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.919892 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-120.ec2.internal" event="NodeHasSufficientPID" Jun 11 12:53:20.921288 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.921276 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 12:53:20.921422 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.921405 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-120.ec2.internal" Jun 11 12:53:20.921489 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.921446 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 12:53:20.921944 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.921921 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-120.ec2.internal" event="NodeHasSufficientMemory" Jun 11 12:53:20.922035 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.921934 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-120.ec2.internal" event="NodeHasSufficientMemory" Jun 11 12:53:20.922035 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.921966 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-120.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 12:53:20.922035 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.921976 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-120.ec2.internal" event="NodeHasSufficientPID" Jun 11 12:53:20.922035 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.921951 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-120.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 12:53:20.922035 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.922031 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-120.ec2.internal" event="NodeHasSufficientPID" Jun 11 12:53:20.923243 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.923221 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-120.ec2.internal" Jun 11 12:53:20.923243 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.923246 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 12:53:20.923404 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.923296 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-120.ec2.internal" Jun 11 12:53:20.923404 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:20.923318 2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-120.ec2.internal\": node \"ip-10-0-137-120.ec2.internal\" not found" Jun 11 12:53:20.923953 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.923935 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-120.ec2.internal" event="NodeHasSufficientMemory" Jun 11 12:53:20.924034 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.923964 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-120.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 12:53:20.924034 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.923975 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-120.ec2.internal" event="NodeHasSufficientPID" Jun 11 12:53:20.939391 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:20.939367 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-120.ec2.internal\" not found" Jun 11 12:53:20.951023 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:20.951000 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-120.ec2.internal\" not found" node="ip-10-0-137-120.ec2.internal" Jun 11 12:53:20.955172 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.955140 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cd2913b23ada3c3f30f6db57a26e4da-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-120.ec2.internal\" (UID: \"2cd2913b23ada3c3f30f6db57a26e4da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-120.ec2.internal" Jun 11 12:53:20.955276 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.955178 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ff108f13402cbf8ebb304d587916d091-config\") pod \"kube-apiserver-proxy-ip-10-0-137-120.ec2.internal\" (UID: \"ff108f13402cbf8ebb304d587916d091\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-120.ec2.internal" Jun 11 12:53:20.955276 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:20.955197 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2cd2913b23ada3c3f30f6db57a26e4da-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-120.ec2.internal\" (UID: \"2cd2913b23ada3c3f30f6db57a26e4da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-120.ec2.internal" Jun 11 12:53:20.955597 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:20.955584 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-120.ec2.internal\" not found" node="ip-10-0-137-120.ec2.internal" Jun 11 12:53:21.040050 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:21.040008 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-120.ec2.internal\" not found" Jun 11 12:53:21.055374 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:21.055333 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2cd2913b23ada3c3f30f6db57a26e4da-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-120.ec2.internal\" (UID: \"2cd2913b23ada3c3f30f6db57a26e4da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-120.ec2.internal" Jun 11 12:53:21.055488 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:21.055379 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cd2913b23ada3c3f30f6db57a26e4da-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-120.ec2.internal\" (UID: \"2cd2913b23ada3c3f30f6db57a26e4da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-120.ec2.internal" Jun 11 12:53:21.055488 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:21.055398 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ff108f13402cbf8ebb304d587916d091-config\") pod \"kube-apiserver-proxy-ip-10-0-137-120.ec2.internal\" (UID: \"ff108f13402cbf8ebb304d587916d091\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-120.ec2.internal" Jun 11 12:53:21.055488 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:21.055425 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2cd2913b23ada3c3f30f6db57a26e4da-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-120.ec2.internal\" (UID: \"2cd2913b23ada3c3f30f6db57a26e4da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-120.ec2.internal" Jun 11 12:53:21.055488 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:21.055444 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cd2913b23ada3c3f30f6db57a26e4da-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-120.ec2.internal\" (UID: \"2cd2913b23ada3c3f30f6db57a26e4da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-120.ec2.internal" Jun 11 12:53:21.055488 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:21.055425 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ff108f13402cbf8ebb304d587916d091-config\") pod \"kube-apiserver-proxy-ip-10-0-137-120.ec2.internal\" (UID: \"ff108f13402cbf8ebb304d587916d091\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-120.ec2.internal" Jun 11 12:53:21.140529 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:21.140486 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-120.ec2.internal\" not found" Jun 11 12:53:21.241311 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:21.241247 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-120.ec2.internal\" not found" Jun 11 12:53:21.255585 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:21.255566 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-120.ec2.internal" Jun 11 12:53:21.260230 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:21.260213 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-120.ec2.internal" Jun 11 12:53:21.341719 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:21.341673 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-120.ec2.internal\" not found" Jun 11 12:53:21.442216 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:21.442183 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-120.ec2.internal\" not found" Jun 11 12:53:21.542797 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:21.542715 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-120.ec2.internal\" not found" Jun 11 12:53:21.643237 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:21.643206 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-120.ec2.internal\" not found" Jun 11 12:53:21.687754 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:21.687726 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 12:53:21.688206 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:21.687901 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 12:53:21.688206 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:21.687897 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 12:53:21.740559 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:21.740522 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff108f13402cbf8ebb304d587916d091.slice/crio-684f10e0d885f0cc77f990d16d8fc30738b6f1b7e80e53ac58e58ebc01e7113a WatchSource:0}: Error finding container 684f10e0d885f0cc77f990d16d8fc30738b6f1b7e80e53ac58e58ebc01e7113a: Status 404 returned error can't find the container with id 684f10e0d885f0cc77f990d16d8fc30738b6f1b7e80e53ac58e58ebc01e7113a Jun 11 12:53:21.740815 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:21.740792 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cd2913b23ada3c3f30f6db57a26e4da.slice/crio-4e577d6a8ed635abfd6876a9cef5a3acbde7ced32595277bc894d2437d02e599 WatchSource:0}: Error finding container 4e577d6a8ed635abfd6876a9cef5a3acbde7ced32595277bc894d2437d02e599: Status 404 returned error can't find the container with id 4e577d6a8ed635abfd6876a9cef5a3acbde7ced32595277bc894d2437d02e599 Jun 11 12:53:21.743715 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:21.743695 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-120.ec2.internal\" not found" Jun 11 12:53:21.746852 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:21.746835 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 12:53:21.752530 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:21.752490 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 12:48:20 +0000 UTC" deadline="2028-01-26 21:01:02.779536372 +0000 UTC" Jun 11 12:53:21.752530 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:21.752528 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14264h7m41.027010287s" Jun 11 12:53:21.821927 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:21.821808 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-120.ec2.internal" event={"ID":"ff108f13402cbf8ebb304d587916d091","Type":"ContainerStarted","Data":"684f10e0d885f0cc77f990d16d8fc30738b6f1b7e80e53ac58e58ebc01e7113a"} Jun 11 12:53:21.822866 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:21.822844 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-120.ec2.internal" event={"ID":"2cd2913b23ada3c3f30f6db57a26e4da","Type":"ContainerStarted","Data":"4e577d6a8ed635abfd6876a9cef5a3acbde7ced32595277bc894d2437d02e599"} Jun 11 12:53:21.843990 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:21.843966 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-120.ec2.internal\" not found" Jun 11 12:53:21.944544 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:21.944510 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-120.ec2.internal\" not found" Jun 11 12:53:22.045093 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:22.045055 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-120.ec2.internal\" not found" Jun 11 12:53:22.070126 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.070101 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 12:53:22.076403 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.076347 2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 12:53:22.152906 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.152875 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-120.ec2.internal" Jun 11 12:53:22.166473 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.166446 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 12:53:22.167779 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.167576 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-120.ec2.internal" Jun 11 12:53:22.174656 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.174565 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 12:53:22.548440 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.548416 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 12:53:22.731937 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.731904 2558 apiserver.go:52] "Watching apiserver" Jun 11 12:53:22.739547 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.739523 2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 12:53:22.739936 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.739914 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-zzsxs","openshift-multus/multus-additional-cni-plugins-zxx5s","openshift-multus/network-metrics-daemon-jd6lc","openshift-network-diagnostics/network-check-target-gdklg","openshift-network-operator/iptables-alerter-l26j6","kube-system/kube-apiserver-proxy-ip-10-0-137-120.ec2.internal","openshift-dns/node-resolver-hcnkc","openshift-image-registry/node-ca-w7dg4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-120.ec2.internal","openshift-multus/multus-bkdpg","openshift-ovn-kubernetes/ovnkube-node-5njr6","kube-system/global-pull-secret-syncer-dl6mx","kube-system/konnectivity-agent-229ps","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfl2p"] Jun 11 12:53:22.741514 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.741492 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdklg" Jun 11 12:53:22.741620 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:22.741566 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdklg" podUID="91e0efc4-f28a-4e27-8e50-99e6c424f288" Jun 11 12:53:22.742588 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.742570 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfl2p" Jun 11 12:53:22.743685 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.743665 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hcnkc" Jun 11 12:53:22.744940 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.744792 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 12:53:22.744940 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.744897 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jd6lc" Jun 11 12:53:22.745108 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:22.744962 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jd6lc" podUID="5540735c-30f1-4071-8ca5-86c1d43d1315" Jun 11 12:53:22.745108 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.744976 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 12:53:22.745108 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.745003 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jw5x8\"" Jun 11 12:53:22.745279 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.745228 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 12:53:22.746103 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.746086 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 12:53:22.746314 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.746210 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l26j6" Jun 11 12:53:22.746634 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.746592 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 12:53:22.746634 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.746605 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9nd4p\"" Jun 11 12:53:22.747594 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.747575 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.748451 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.748414 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 12:53:22.748927 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.748908 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 12:53:22.749017 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.748990 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fssc6\"" Jun 11 12:53:22.749078 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.749065 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 12:53:22.749390 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.749370 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w7dg4" Jun 11 12:53:22.752570 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.752534 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.753740 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.752924 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.753740 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.753473 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 12:53:22.754599 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.754463 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 12:53:22.754599 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.754538 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rfrhg\"" Jun 11 12:53:22.754766 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.754619 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 12:53:22.754766 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.754738 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-z5znb\"" Jun 11 12:53:22.754972 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.754951 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 12:53:22.755073 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.754987 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 12:53:22.755073 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.755023 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 12:53:22.755199 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.754952 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dl6mx" Jun 11 12:53:22.755255 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:22.755217 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dl6mx" podUID="b3b5dc2f-8831-4790-85e8-9934466019b8" Jun 11 12:53:22.755357 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.755336 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 12:53:22.755508 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.755483 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 12:53:22.755602 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.755487 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 12:53:22.755800 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.755780 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 12:53:22.755931 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.755912 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 12:53:22.756435 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.756418 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-229ps" Jun 11 12:53:22.757093 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.757076 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 12:53:22.757194 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.757173 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 12:53:22.757500 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.757186 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-44sft\"" Jun 11 12:53:22.757500 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.757338 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 12:53:22.757500 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.757438 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xx8tx\"" Jun 11 12:53:22.757661 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.757548 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 12:53:22.757661 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.757614 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 12:53:22.757859 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.757840 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zxx5s" Jun 11 12:53:22.758607 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.758588 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 12:53:22.759534 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.759507 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wnpfg\"" Jun 11 12:53:22.759878 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.759835 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 12:53:22.760064 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.760045 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 12:53:22.760193 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.760177 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 12:53:22.760523 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.760466 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8x9cx\"" Jun 11 12:53:22.763989 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.763920 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-system-cni-dir\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.763989 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.763955 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-multus-cni-dir\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.764126 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.763994 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c2109998-6314-4e3f-9291-97b19146d944-cni-binary-copy\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.764126 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.764013 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-run-ovn\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.764126 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.764029 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-env-overrides\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.764126 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.764082 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b59938c4-f965-43fe-a109-837198e91085-socket-dir\") pod \"aws-ebs-csi-driver-node-rfl2p\" (UID: \"b59938c4-f965-43fe-a109-837198e91085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfl2p" Jun 11 12:53:22.764347 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.764125 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24b518d4-f50f-4930-9675-ee7719d79d73-etc-kubernetes\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.764347 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.764167 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/24b518d4-f50f-4930-9675-ee7719d79d73-host\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.764347 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.764193 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-etc-openvswitch\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.764347 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.764216 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-node-log\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.764347 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.764240 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b59938c4-f965-43fe-a109-837198e91085-registration-dir\") pod \"aws-ebs-csi-driver-node-rfl2p\" (UID: \"b59938c4-f965-43fe-a109-837198e91085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfl2p" Jun 11 12:53:22.764347 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.764264 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhwk7\" (UniqueName: \"kubernetes.io/projected/b59938c4-f965-43fe-a109-837198e91085-kube-api-access-mhwk7\") pod \"aws-ebs-csi-driver-node-rfl2p\" (UID: \"b59938c4-f965-43fe-a109-837198e91085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfl2p" Jun 11 12:53:22.764347 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.764304 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24b518d4-f50f-4930-9675-ee7719d79d73-tmp\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.764347 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.764334 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b10f8cf9-e375-4b40-bd55-c0cb329ce19e-host\") pod \"node-ca-w7dg4\" (UID: \"b10f8cf9-e375-4b40-bd55-c0cb329ce19e\") " pod="openshift-image-registry/node-ca-w7dg4" Jun 11 12:53:22.764732 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.764365 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-run-systemd\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.764732 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.764405 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-host-cni-bin\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.764732 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.764445 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.764732 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.764479 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-ovn-node-metrics-cert\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.764732 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.764508 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/24b518d4-f50f-4930-9675-ee7719d79d73-etc-modprobe-d\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.764732 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.764531 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/24b518d4-f50f-4930-9675-ee7719d79d73-etc-sysctl-conf\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.764732 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.764555 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24b518d4-f50f-4930-9675-ee7719d79d73-sys\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.764732 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.764577 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcn74\" (UniqueName: \"kubernetes.io/projected/24b518d4-f50f-4930-9675-ee7719d79d73-kube-api-access-lcn74\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.764732 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.764612 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb4q5\" (UniqueName: \"kubernetes.io/projected/91e0efc4-f28a-4e27-8e50-99e6c424f288-kube-api-access-hb4q5\") pod \"network-check-target-gdklg\" (UID: \"91e0efc4-f28a-4e27-8e50-99e6c424f288\") " pod="openshift-network-diagnostics/network-check-target-gdklg" Jun 11 12:53:22.764732 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.764634 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f80224ad-14f9-4dd4-a511-cedcad37a73d-host-slash\") pod \"iptables-alerter-l26j6\" (UID: \"f80224ad-14f9-4dd4-a511-cedcad37a73d\") " pod="openshift-network-operator/iptables-alerter-l26j6" Jun 11 12:53:22.764732 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.764659 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-systemd-units\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.764732 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.764677 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-host-run-netns\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.764732 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.764700 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/24b518d4-f50f-4930-9675-ee7719d79d73-etc-sysctl-d\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.764732 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.764728 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24b518d4-f50f-4930-9675-ee7719d79d73-var-lib-kubelet\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.764732 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.764742 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b10f8cf9-e375-4b40-bd55-c0cb329ce19e-serviceca\") pod \"node-ca-w7dg4\" (UID: \"b10f8cf9-e375-4b40-bd55-c0cb329ce19e\") " pod="openshift-image-registry/node-ca-w7dg4" Jun 11 12:53:22.765442 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.764756 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-cnibin\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.765442 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.764790 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-var-lib-openvswitch\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.765442 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.764804 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/24b518d4-f50f-4930-9675-ee7719d79d73-etc-sysconfig\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.765442 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.764819 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9f24\" (UniqueName: \"kubernetes.io/projected/52db0382-33eb-4bbd-8c3a-850757a8b9fb-kube-api-access-t9f24\") pod \"node-resolver-hcnkc\" (UID: \"52db0382-33eb-4bbd-8c3a-850757a8b9fb\") " pod="openshift-dns/node-resolver-hcnkc" Jun 11 12:53:22.765442 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.764834 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzhbg\" (UniqueName: \"kubernetes.io/projected/5540735c-30f1-4071-8ca5-86c1d43d1315-kube-api-access-tzhbg\") pod \"network-metrics-daemon-jd6lc\" (UID: \"5540735c-30f1-4071-8ca5-86c1d43d1315\") " pod="openshift-multus/network-metrics-daemon-jd6lc" Jun 11 12:53:22.765442 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.764870 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-os-release\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.765442 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.764909 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-host-var-lib-cni-bin\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.765442 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.764942 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-host-run-ovn-kubernetes\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.765442 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.764989 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-ovnkube-script-lib\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.765442 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.765026 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b3b5dc2f-8831-4790-85e8-9934466019b8-dbus\") pod \"global-pull-secret-syncer-dl6mx\" (UID: \"b3b5dc2f-8831-4790-85e8-9934466019b8\") " pod="kube-system/global-pull-secret-syncer-dl6mx" Jun 11 12:53:22.765442 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.765067 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-host-var-lib-cni-multus\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.765442 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.765111 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-host-run-multus-certs\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.765442 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.765142 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/24b518d4-f50f-4930-9675-ee7719d79d73-etc-tuned\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.765442 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.765187 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b3b5dc2f-8831-4790-85e8-9934466019b8-original-pull-secret\") pod \"global-pull-secret-syncer-dl6mx\" (UID: \"b3b5dc2f-8831-4790-85e8-9934466019b8\") " pod="kube-system/global-pull-secret-syncer-dl6mx" Jun 11 12:53:22.765442 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.765213 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/52db0382-33eb-4bbd-8c3a-850757a8b9fb-hosts-file\") pod \"node-resolver-hcnkc\" (UID: \"52db0382-33eb-4bbd-8c3a-850757a8b9fb\") " pod="openshift-dns/node-resolver-hcnkc" Jun 11 12:53:22.765442 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.765233 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52db0382-33eb-4bbd-8c3a-850757a8b9fb-tmp-dir\") pod \"node-resolver-hcnkc\" (UID: \"52db0382-33eb-4bbd-8c3a-850757a8b9fb\") " pod="openshift-dns/node-resolver-hcnkc" Jun 11 12:53:22.765442 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.765256 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c2109998-6314-4e3f-9291-97b19146d944-multus-daemon-config\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.766195 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.765280 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-host-cni-netd\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.766195 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.765301 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b59938c4-f965-43fe-a109-837198e91085-device-dir\") pod \"aws-ebs-csi-driver-node-rfl2p\" (UID: \"b59938c4-f965-43fe-a109-837198e91085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfl2p" Jun 11 12:53:22.766195 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.765349 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-hostroot\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.766195 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.765370 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-multus-conf-dir\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.766195 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.765386 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-log-socket\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.766195 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.765410 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/24b518d4-f50f-4930-9675-ee7719d79d73-run\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.766195 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.765431 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-host-run-netns\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.766195 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.765455 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mk76\" (UniqueName: \"kubernetes.io/projected/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-kube-api-access-5mk76\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.766195 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.765478 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/24b518d4-f50f-4930-9675-ee7719d79d73-lib-modules\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.766195 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.765518 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4ld6\" (UniqueName: \"kubernetes.io/projected/f80224ad-14f9-4dd4-a511-cedcad37a73d-kube-api-access-c4ld6\") pod \"iptables-alerter-l26j6\" (UID: \"f80224ad-14f9-4dd4-a511-cedcad37a73d\") " pod="openshift-network-operator/iptables-alerter-l26j6" Jun 11 12:53:22.766195 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.765564 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-host-run-k8s-cni-cncf-io\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.766195 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.765587 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcnmf\" (UniqueName: \"kubernetes.io/projected/c2109998-6314-4e3f-9291-97b19146d944-kube-api-access-gcnmf\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.766195 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.765608 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbdqr\" (UniqueName: \"kubernetes.io/projected/b10f8cf9-e375-4b40-bd55-c0cb329ce19e-kube-api-access-zbdqr\") pod \"node-ca-w7dg4\" (UID: \"b10f8cf9-e375-4b40-bd55-c0cb329ce19e\") " pod="openshift-image-registry/node-ca-w7dg4" Jun 11 12:53:22.766195 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.765628 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5540735c-30f1-4071-8ca5-86c1d43d1315-metrics-certs\") pod \"network-metrics-daemon-jd6lc\" (UID: \"5540735c-30f1-4071-8ca5-86c1d43d1315\") " pod="openshift-multus/network-metrics-daemon-jd6lc" Jun 11 12:53:22.766195 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.765655 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-multus-socket-dir-parent\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.766195 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.765674 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-host-var-lib-kubelet\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.766195 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.765702 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-etc-kubernetes\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.766983 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.765722 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-run-openvswitch\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.766983 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.765751 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-ovnkube-config\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.766983 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.765772 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f80224ad-14f9-4dd4-a511-cedcad37a73d-iptables-alerter-script\") pod \"iptables-alerter-l26j6\" (UID: \"f80224ad-14f9-4dd4-a511-cedcad37a73d\") " pod="openshift-network-operator/iptables-alerter-l26j6" Jun 11 12:53:22.766983 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.765833 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-host-kubelet\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.766983 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.765864 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b59938c4-f965-43fe-a109-837198e91085-sys-fs\") pod \"aws-ebs-csi-driver-node-rfl2p\" (UID: \"b59938c4-f965-43fe-a109-837198e91085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfl2p" Jun 11 12:53:22.766983 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.765895 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b59938c4-f965-43fe-a109-837198e91085-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rfl2p\" (UID: \"b59938c4-f965-43fe-a109-837198e91085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfl2p" Jun 11 12:53:22.766983 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.765927 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/24b518d4-f50f-4930-9675-ee7719d79d73-etc-systemd\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.766983 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.765946 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b3b5dc2f-8831-4790-85e8-9934466019b8-kubelet-config\") pod \"global-pull-secret-syncer-dl6mx\" (UID: \"b3b5dc2f-8831-4790-85e8-9934466019b8\") " pod="kube-system/global-pull-secret-syncer-dl6mx" Jun 11 12:53:22.766983 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.765968 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-host-slash\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.766983 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.765995 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b59938c4-f965-43fe-a109-837198e91085-etc-selinux\") pod \"aws-ebs-csi-driver-node-rfl2p\" (UID: \"b59938c4-f965-43fe-a109-837198e91085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfl2p" Jun 11 12:53:22.766983 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.766548 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 12:53:22.790389 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.790360 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-glhf7" Jun 11 12:53:22.798424 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.798399 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-glhf7" Jun 11 12:53:22.847892 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.847861 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 12:53:22.854308 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.854283 2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 12:53:22.866756 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.866720 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b3b5dc2f-8831-4790-85e8-9934466019b8-dbus\") pod \"global-pull-secret-syncer-dl6mx\" (UID: \"b3b5dc2f-8831-4790-85e8-9934466019b8\") " pod="kube-system/global-pull-secret-syncer-dl6mx" Jun 11 12:53:22.866756 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.866757 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-host-var-lib-cni-multus\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.866990 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.866785 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-host-run-multus-certs\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.866990 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.866809 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/24b518d4-f50f-4930-9675-ee7719d79d73-etc-tuned\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.866990 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.866827 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b3b5dc2f-8831-4790-85e8-9934466019b8-original-pull-secret\") pod \"global-pull-secret-syncer-dl6mx\" (UID: \"b3b5dc2f-8831-4790-85e8-9934466019b8\") " pod="kube-system/global-pull-secret-syncer-dl6mx" Jun 11 12:53:22.866990 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.866841 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/52db0382-33eb-4bbd-8c3a-850757a8b9fb-hosts-file\") pod \"node-resolver-hcnkc\" (UID: \"52db0382-33eb-4bbd-8c3a-850757a8b9fb\") " pod="openshift-dns/node-resolver-hcnkc" Jun 11 12:53:22.866990 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.866856 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52db0382-33eb-4bbd-8c3a-850757a8b9fb-tmp-dir\") pod \"node-resolver-hcnkc\" (UID: \"52db0382-33eb-4bbd-8c3a-850757a8b9fb\") " pod="openshift-dns/node-resolver-hcnkc" Jun 11 12:53:22.866990 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.866878 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c2109998-6314-4e3f-9291-97b19146d944-multus-daemon-config\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.866990 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.866951 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/52db0382-33eb-4bbd-8c3a-850757a8b9fb-hosts-file\") pod \"node-resolver-hcnkc\" (UID: \"52db0382-33eb-4bbd-8c3a-850757a8b9fb\") " pod="openshift-dns/node-resolver-hcnkc" Jun 11 12:53:22.866990 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:22.866962 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 12:53:22.866990 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.866991 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-host-cni-netd\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.867418 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867018 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b59938c4-f965-43fe-a109-837198e91085-device-dir\") pod \"aws-ebs-csi-driver-node-rfl2p\" (UID: \"b59938c4-f965-43fe-a109-837198e91085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfl2p" Jun 11 12:53:22.867418 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:22.867058 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3b5dc2f-8831-4790-85e8-9934466019b8-original-pull-secret podName:b3b5dc2f-8831-4790-85e8-9934466019b8 nodeName:}" failed. No retries permitted until 2026-06-11 12:53:23.367026156 +0000 UTC m=+3.013548079 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b3b5dc2f-8831-4790-85e8-9934466019b8-original-pull-secret") pod "global-pull-secret-syncer-dl6mx" (UID: "b3b5dc2f-8831-4790-85e8-9934466019b8") : object "kube-system"/"original-pull-secret" not registered Jun 11 12:53:22.867418 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867074 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b59938c4-f965-43fe-a109-837198e91085-device-dir\") pod \"aws-ebs-csi-driver-node-rfl2p\" (UID: \"b59938c4-f965-43fe-a109-837198e91085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfl2p" Jun 11 12:53:22.867418 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867084 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-hostroot\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.867418 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867110 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-hostroot\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.867418 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867113 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-multus-conf-dir\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.867418 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867137 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-log-socket\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.867418 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867186 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/24b518d4-f50f-4930-9675-ee7719d79d73-run\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.867418 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867205 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52db0382-33eb-4bbd-8c3a-850757a8b9fb-tmp-dir\") pod \"node-resolver-hcnkc\" (UID: \"52db0382-33eb-4bbd-8c3a-850757a8b9fb\") " pod="openshift-dns/node-resolver-hcnkc" Jun 11 12:53:22.867418 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867213 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/70f746b8-9a69-4b2c-86b5-95632730e3c8-cnibin\") pod \"multus-additional-cni-plugins-zxx5s\" (UID: \"70f746b8-9a69-4b2c-86b5-95632730e3c8\") " pod="openshift-multus/multus-additional-cni-plugins-zxx5s" Jun 11 12:53:22.867418 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867242 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-host-run-netns\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.867418 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867268 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mk76\" (UniqueName: \"kubernetes.io/projected/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-kube-api-access-5mk76\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.867418 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867263 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 12:53:22.867418 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867287 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-host-run-multus-certs\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.867418 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867316 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/24b518d4-f50f-4930-9675-ee7719d79d73-lib-modules\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.867418 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867347 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/70f746b8-9a69-4b2c-86b5-95632730e3c8-system-cni-dir\") pod \"multus-additional-cni-plugins-zxx5s\" (UID: \"70f746b8-9a69-4b2c-86b5-95632730e3c8\") " pod="openshift-multus/multus-additional-cni-plugins-zxx5s" Jun 11 12:53:22.867418 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867354 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-multus-conf-dir\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.868242 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867365 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b3b5dc2f-8831-4790-85e8-9934466019b8-dbus\") pod \"global-pull-secret-syncer-dl6mx\" (UID: \"b3b5dc2f-8831-4790-85e8-9934466019b8\") " pod="kube-system/global-pull-secret-syncer-dl6mx" Jun 11 12:53:22.868242 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867358 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-host-run-netns\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.868242 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867376 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4ld6\" (UniqueName: \"kubernetes.io/projected/f80224ad-14f9-4dd4-a511-cedcad37a73d-kube-api-access-c4ld6\") pod \"iptables-alerter-l26j6\" (UID: \"f80224ad-14f9-4dd4-a511-cedcad37a73d\") " pod="openshift-network-operator/iptables-alerter-l26j6" Jun 11 12:53:22.868242 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867321 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-host-var-lib-cni-multus\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.868242 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867406 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-host-run-k8s-cni-cncf-io\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.868242 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867434 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcnmf\" (UniqueName: \"kubernetes.io/projected/c2109998-6314-4e3f-9291-97b19146d944-kube-api-access-gcnmf\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.868242 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867458 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbdqr\" (UniqueName: \"kubernetes.io/projected/b10f8cf9-e375-4b40-bd55-c0cb329ce19e-kube-api-access-zbdqr\") pod \"node-ca-w7dg4\" (UID: \"b10f8cf9-e375-4b40-bd55-c0cb329ce19e\") " pod="openshift-image-registry/node-ca-w7dg4" Jun 11 12:53:22.868242 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867474 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5540735c-30f1-4071-8ca5-86c1d43d1315-metrics-certs\") pod \"network-metrics-daemon-jd6lc\" (UID: \"5540735c-30f1-4071-8ca5-86c1d43d1315\") " pod="openshift-multus/network-metrics-daemon-jd6lc" Jun 11 12:53:22.868242 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867490 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-multus-socket-dir-parent\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.868242 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867505 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/24b518d4-f50f-4930-9675-ee7719d79d73-lib-modules\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.868242 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867511 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-host-var-lib-kubelet\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.868242 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867409 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/24b518d4-f50f-4930-9675-ee7719d79d73-run\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.868242 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867534 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-etc-kubernetes\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.868242 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867556 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-run-openvswitch\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.868242 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867569 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-host-run-k8s-cni-cncf-io\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.868242 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867581 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-ovnkube-config\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.868242 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867614 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f80224ad-14f9-4dd4-a511-cedcad37a73d-iptables-alerter-script\") pod \"iptables-alerter-l26j6\" (UID: \"f80224ad-14f9-4dd4-a511-cedcad37a73d\") " pod="openshift-network-operator/iptables-alerter-l26j6" Jun 11 12:53:22.868242 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867641 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-host-kubelet\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.869053 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867666 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b59938c4-f965-43fe-a109-837198e91085-sys-fs\") pod \"aws-ebs-csi-driver-node-rfl2p\" (UID: \"b59938c4-f965-43fe-a109-837198e91085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfl2p" Jun 11 12:53:22.869053 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867689 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b59938c4-f965-43fe-a109-837198e91085-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rfl2p\" (UID: \"b59938c4-f965-43fe-a109-837198e91085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfl2p" Jun 11 12:53:22.869053 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867712 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/24b518d4-f50f-4930-9675-ee7719d79d73-etc-systemd\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.869053 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867737 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b3b5dc2f-8831-4790-85e8-9934466019b8-kubelet-config\") pod \"global-pull-secret-syncer-dl6mx\" (UID: \"b3b5dc2f-8831-4790-85e8-9934466019b8\") " pod="kube-system/global-pull-secret-syncer-dl6mx" Jun 11 12:53:22.869053 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867763 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/70f746b8-9a69-4b2c-86b5-95632730e3c8-os-release\") pod \"multus-additional-cni-plugins-zxx5s\" (UID: \"70f746b8-9a69-4b2c-86b5-95632730e3c8\") " pod="openshift-multus/multus-additional-cni-plugins-zxx5s" Jun 11 12:53:22.869053 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867774 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-host-kubelet\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.869053 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867792 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/70f746b8-9a69-4b2c-86b5-95632730e3c8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zxx5s\" (UID: \"70f746b8-9a69-4b2c-86b5-95632730e3c8\") " pod="openshift-multus/multus-additional-cni-plugins-zxx5s" Jun 11 12:53:22.869053 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867819 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-host-slash\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.869053 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867409 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-log-socket\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.869053 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867844 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b59938c4-f965-43fe-a109-837198e91085-etc-selinux\") pod \"aws-ebs-csi-driver-node-rfl2p\" (UID: \"b59938c4-f965-43fe-a109-837198e91085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfl2p" Jun 11 12:53:22.869053 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:22.867855 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:53:22.869053 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867868 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-system-cni-dir\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.869053 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:22.867925 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5540735c-30f1-4071-8ca5-86c1d43d1315-metrics-certs podName:5540735c-30f1-4071-8ca5-86c1d43d1315 nodeName:}" failed. No retries permitted until 2026-06-11 12:53:23.367905641 +0000 UTC m=+3.014427570 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5540735c-30f1-4071-8ca5-86c1d43d1315-metrics-certs") pod "network-metrics-daemon-jd6lc" (UID: "5540735c-30f1-4071-8ca5-86c1d43d1315") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:53:22.869053 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867942 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-host-var-lib-kubelet\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.869053 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867980 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-multus-cni-dir\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.869053 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867983 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-etc-kubernetes\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.869053 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868006 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c2109998-6314-4e3f-9291-97b19146d944-cni-binary-copy\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.869901 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868030 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-run-ovn\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.869901 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868033 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-run-openvswitch\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.869901 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868049 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-ovnkube-config\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.869901 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868053 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-env-overrides\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.869901 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868093 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-multus-cni-dir\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.869901 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868080 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b59938c4-f965-43fe-a109-837198e91085-socket-dir\") pod \"aws-ebs-csi-driver-node-rfl2p\" (UID: \"b59938c4-f965-43fe-a109-837198e91085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfl2p" Jun 11 12:53:22.869901 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868136 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24b518d4-f50f-4930-9675-ee7719d79d73-etc-kubernetes\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.869901 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868147 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-system-cni-dir\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.869901 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.867289 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-host-cni-netd\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.869901 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868178 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/24b518d4-f50f-4930-9675-ee7719d79d73-host\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.869901 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868202 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b59938c4-f965-43fe-a109-837198e91085-sys-fs\") pod \"aws-ebs-csi-driver-node-rfl2p\" (UID: \"b59938c4-f965-43fe-a109-837198e91085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfl2p" Jun 11 12:53:22.869901 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868202 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-etc-openvswitch\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.869901 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868209 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b59938c4-f965-43fe-a109-837198e91085-socket-dir\") pod \"aws-ebs-csi-driver-node-rfl2p\" (UID: \"b59938c4-f965-43fe-a109-837198e91085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfl2p" Jun 11 12:53:22.869901 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868228 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-node-log\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.869901 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868232 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b59938c4-f965-43fe-a109-837198e91085-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rfl2p\" (UID: \"b59938c4-f965-43fe-a109-837198e91085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfl2p" Jun 11 12:53:22.869901 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868260 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/24b518d4-f50f-4930-9675-ee7719d79d73-etc-systemd\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.869901 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868277 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-run-ovn\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.869901 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868285 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24b518d4-f50f-4930-9675-ee7719d79d73-etc-kubernetes\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.870745 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868291 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b3b5dc2f-8831-4790-85e8-9934466019b8-kubelet-config\") pod \"global-pull-secret-syncer-dl6mx\" (UID: \"b3b5dc2f-8831-4790-85e8-9934466019b8\") " pod="kube-system/global-pull-secret-syncer-dl6mx" Jun 11 12:53:22.870745 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868296 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-etc-openvswitch\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.870745 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868328 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b59938c4-f965-43fe-a109-837198e91085-registration-dir\") pod \"aws-ebs-csi-driver-node-rfl2p\" (UID: \"b59938c4-f965-43fe-a109-837198e91085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfl2p" Jun 11 12:53:22.870745 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868336 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-host-slash\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.870745 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868356 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhwk7\" (UniqueName: \"kubernetes.io/projected/b59938c4-f965-43fe-a109-837198e91085-kube-api-access-mhwk7\") pod \"aws-ebs-csi-driver-node-rfl2p\" (UID: \"b59938c4-f965-43fe-a109-837198e91085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfl2p" Jun 11 12:53:22.870745 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868379 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24b518d4-f50f-4930-9675-ee7719d79d73-tmp\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.870745 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868401 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b10f8cf9-e375-4b40-bd55-c0cb329ce19e-host\") pod \"node-ca-w7dg4\" (UID: \"b10f8cf9-e375-4b40-bd55-c0cb329ce19e\") " pod="openshift-image-registry/node-ca-w7dg4" Jun 11 12:53:22.870745 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868449 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f80224ad-14f9-4dd4-a511-cedcad37a73d-iptables-alerter-script\") pod \"iptables-alerter-l26j6\" (UID: \"f80224ad-14f9-4dd4-a511-cedcad37a73d\") " pod="openshift-network-operator/iptables-alerter-l26j6" Jun 11 12:53:22.870745 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868454 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/70f746b8-9a69-4b2c-86b5-95632730e3c8-cni-binary-copy\") pod \"multus-additional-cni-plugins-zxx5s\" (UID: \"70f746b8-9a69-4b2c-86b5-95632730e3c8\") " pod="openshift-multus/multus-additional-cni-plugins-zxx5s" Jun 11 12:53:22.870745 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868478 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-run-systemd\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.870745 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868502 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-host-cni-bin\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.870745 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868509 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-multus-socket-dir-parent\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.870745 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868528 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.870745 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868554 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-ovn-node-metrics-cert\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.870745 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868558 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/24b518d4-f50f-4930-9675-ee7719d79d73-host\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.870745 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868585 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/24b518d4-f50f-4930-9675-ee7719d79d73-etc-modprobe-d\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.870745 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868610 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/24b518d4-f50f-4930-9675-ee7719d79d73-etc-sysctl-conf\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.871480 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868634 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24b518d4-f50f-4930-9675-ee7719d79d73-sys\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.871480 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868659 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcn74\" (UniqueName: \"kubernetes.io/projected/24b518d4-f50f-4930-9675-ee7719d79d73-kube-api-access-lcn74\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.871480 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868686 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb4q5\" (UniqueName: \"kubernetes.io/projected/91e0efc4-f28a-4e27-8e50-99e6c424f288-kube-api-access-hb4q5\") pod \"network-check-target-gdklg\" (UID: \"91e0efc4-f28a-4e27-8e50-99e6c424f288\") " pod="openshift-network-diagnostics/network-check-target-gdklg" Jun 11 12:53:22.871480 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868690 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-env-overrides\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.871480 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868733 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f80224ad-14f9-4dd4-a511-cedcad37a73d-host-slash\") pod \"iptables-alerter-l26j6\" (UID: \"f80224ad-14f9-4dd4-a511-cedcad37a73d\") " pod="openshift-network-operator/iptables-alerter-l26j6" Jun 11 12:53:22.871480 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868743 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c2109998-6314-4e3f-9291-97b19146d944-cni-binary-copy\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.871480 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868758 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-systemd-units\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.871480 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868777 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-node-log\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.871480 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868790 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-host-run-netns\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.871480 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868811 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b10f8cf9-e375-4b40-bd55-c0cb329ce19e-host\") pod \"node-ca-w7dg4\" (UID: \"b10f8cf9-e375-4b40-bd55-c0cb329ce19e\") " pod="openshift-image-registry/node-ca-w7dg4" Jun 11 12:53:22.871480 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868814 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/24b518d4-f50f-4930-9675-ee7719d79d73-etc-sysctl-d\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.871480 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868839 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24b518d4-f50f-4930-9675-ee7719d79d73-var-lib-kubelet\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.871480 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868842 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b59938c4-f965-43fe-a109-837198e91085-etc-selinux\") pod \"aws-ebs-csi-driver-node-rfl2p\" (UID: \"b59938c4-f965-43fe-a109-837198e91085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfl2p" Jun 11 12:53:22.871480 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868861 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b10f8cf9-e375-4b40-bd55-c0cb329ce19e-serviceca\") pod \"node-ca-w7dg4\" (UID: \"b10f8cf9-e375-4b40-bd55-c0cb329ce19e\") " pod="openshift-image-registry/node-ca-w7dg4" Jun 11 12:53:22.871480 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868878 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b59938c4-f965-43fe-a109-837198e91085-registration-dir\") pod \"aws-ebs-csi-driver-node-rfl2p\" (UID: \"b59938c4-f965-43fe-a109-837198e91085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfl2p" Jun 11 12:53:22.871480 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868893 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34-agent-certs\") pod \"konnectivity-agent-229ps\" (UID: \"0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34\") " pod="kube-system/konnectivity-agent-229ps" Jun 11 12:53:22.871480 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868918 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrsd4\" (UniqueName: \"kubernetes.io/projected/70f746b8-9a69-4b2c-86b5-95632730e3c8-kube-api-access-rrsd4\") pod \"multus-additional-cni-plugins-zxx5s\" (UID: \"70f746b8-9a69-4b2c-86b5-95632730e3c8\") " pod="openshift-multus/multus-additional-cni-plugins-zxx5s" Jun 11 12:53:22.872095 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868947 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/24b518d4-f50f-4930-9675-ee7719d79d73-etc-modprobe-d\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.872095 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868952 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-cnibin\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.872095 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.868999 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-var-lib-openvswitch\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.872095 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.869005 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-cnibin\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.872095 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.869063 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f80224ad-14f9-4dd4-a511-cedcad37a73d-host-slash\") pod \"iptables-alerter-l26j6\" (UID: \"f80224ad-14f9-4dd4-a511-cedcad37a73d\") " pod="openshift-network-operator/iptables-alerter-l26j6" Jun 11 12:53:22.872095 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.869067 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24b518d4-f50f-4930-9675-ee7719d79d73-sys\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.872095 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.869100 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/24b518d4-f50f-4930-9675-ee7719d79d73-etc-sysconfig\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.872095 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.869207 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c2109998-6314-4e3f-9291-97b19146d944-multus-daemon-config\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.872095 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.869247 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34-konnectivity-ca\") pod \"konnectivity-agent-229ps\" (UID: \"0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34\") " pod="kube-system/konnectivity-agent-229ps" Jun 11 12:53:22.872095 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.869257 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/24b518d4-f50f-4930-9675-ee7719d79d73-etc-sysconfig\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.872095 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.869211 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-run-systemd\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.872095 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.869284 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/70f746b8-9a69-4b2c-86b5-95632730e3c8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zxx5s\" (UID: \"70f746b8-9a69-4b2c-86b5-95632730e3c8\") " pod="openshift-multus/multus-additional-cni-plugins-zxx5s" Jun 11 12:53:22.872095 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.869286 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-host-cni-bin\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.872095 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.869314 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.872095 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.869317 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/70f746b8-9a69-4b2c-86b5-95632730e3c8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zxx5s\" (UID: \"70f746b8-9a69-4b2c-86b5-95632730e3c8\") " pod="openshift-multus/multus-additional-cni-plugins-zxx5s" Jun 11 12:53:22.872095 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.869352 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-var-lib-openvswitch\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.872095 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.869357 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-host-run-netns\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.872682 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.869400 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9f24\" (UniqueName: \"kubernetes.io/projected/52db0382-33eb-4bbd-8c3a-850757a8b9fb-kube-api-access-t9f24\") pod \"node-resolver-hcnkc\" (UID: \"52db0382-33eb-4bbd-8c3a-850757a8b9fb\") " pod="openshift-dns/node-resolver-hcnkc" Jun 11 12:53:22.872682 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.869412 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-systemd-units\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.872682 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.869426 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzhbg\" (UniqueName: \"kubernetes.io/projected/5540735c-30f1-4071-8ca5-86c1d43d1315-kube-api-access-tzhbg\") pod \"network-metrics-daemon-jd6lc\" (UID: \"5540735c-30f1-4071-8ca5-86c1d43d1315\") " pod="openshift-multus/network-metrics-daemon-jd6lc" Jun 11 12:53:22.872682 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.869449 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-os-release\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.872682 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.869487 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b10f8cf9-e375-4b40-bd55-c0cb329ce19e-serviceca\") pod \"node-ca-w7dg4\" (UID: \"b10f8cf9-e375-4b40-bd55-c0cb329ce19e\") " pod="openshift-image-registry/node-ca-w7dg4" Jun 11 12:53:22.872682 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.869499 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-host-var-lib-cni-bin\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.872682 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.869502 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/24b518d4-f50f-4930-9675-ee7719d79d73-etc-sysctl-d\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.872682 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.869528 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-host-run-ovn-kubernetes\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.872682 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.869545 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24b518d4-f50f-4930-9675-ee7719d79d73-var-lib-kubelet\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.872682 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.869554 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-ovnkube-script-lib\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.872682 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.869630 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-os-release\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.872682 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.869629 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2109998-6314-4e3f-9291-97b19146d944-host-var-lib-cni-bin\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.872682 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.869635 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/24b518d4-f50f-4930-9675-ee7719d79d73-etc-sysctl-conf\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.872682 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.869661 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-host-run-ovn-kubernetes\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.872682 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.870091 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-ovnkube-script-lib\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.872682 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.871406 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24b518d4-f50f-4930-9675-ee7719d79d73-tmp\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.872682 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.871443 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/24b518d4-f50f-4930-9675-ee7719d79d73-etc-tuned\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.872682 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.871566 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-ovn-node-metrics-cert\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.875226 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:22.875203 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 12:53:22.875226 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:22.875228 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 12:53:22.875402 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:22.875242 2558 projected.go:196] Error preparing data for projected volume kube-api-access-hb4q5 for pod openshift-network-diagnostics/network-check-target-gdklg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:53:22.875402 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:22.875304 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91e0efc4-f28a-4e27-8e50-99e6c424f288-kube-api-access-hb4q5 podName:91e0efc4-f28a-4e27-8e50-99e6c424f288 nodeName:}" failed. No retries permitted until 2026-06-11 12:53:23.375288136 +0000 UTC m=+3.021810070 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hb4q5" (UniqueName: "kubernetes.io/projected/91e0efc4-f28a-4e27-8e50-99e6c424f288-kube-api-access-hb4q5") pod "network-check-target-gdklg" (UID: "91e0efc4-f28a-4e27-8e50-99e6c424f288") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:53:22.877143 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.877114 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4ld6\" (UniqueName: \"kubernetes.io/projected/f80224ad-14f9-4dd4-a511-cedcad37a73d-kube-api-access-c4ld6\") pod \"iptables-alerter-l26j6\" (UID: \"f80224ad-14f9-4dd4-a511-cedcad37a73d\") " pod="openshift-network-operator/iptables-alerter-l26j6" Jun 11 12:53:22.877358 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.877335 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcn74\" (UniqueName: \"kubernetes.io/projected/24b518d4-f50f-4930-9675-ee7719d79d73-kube-api-access-lcn74\") pod \"tuned-zzsxs\" (UID: \"24b518d4-f50f-4930-9675-ee7719d79d73\") " pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:22.877552 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.877528 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcnmf\" (UniqueName: \"kubernetes.io/projected/c2109998-6314-4e3f-9291-97b19146d944-kube-api-access-gcnmf\") pod \"multus-bkdpg\" (UID: \"c2109998-6314-4e3f-9291-97b19146d944\") " pod="openshift-multus/multus-bkdpg" Jun 11 12:53:22.878091 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.878073 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9f24\" (UniqueName: \"kubernetes.io/projected/52db0382-33eb-4bbd-8c3a-850757a8b9fb-kube-api-access-t9f24\") pod \"node-resolver-hcnkc\" (UID: \"52db0382-33eb-4bbd-8c3a-850757a8b9fb\") " pod="openshift-dns/node-resolver-hcnkc" Jun 11 12:53:22.878261 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.878239 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhwk7\" (UniqueName: \"kubernetes.io/projected/b59938c4-f965-43fe-a109-837198e91085-kube-api-access-mhwk7\") pod \"aws-ebs-csi-driver-node-rfl2p\" (UID: \"b59938c4-f965-43fe-a109-837198e91085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfl2p" Jun 11 12:53:22.878770 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.878747 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbdqr\" (UniqueName: \"kubernetes.io/projected/b10f8cf9-e375-4b40-bd55-c0cb329ce19e-kube-api-access-zbdqr\") pod \"node-ca-w7dg4\" (UID: \"b10f8cf9-e375-4b40-bd55-c0cb329ce19e\") " pod="openshift-image-registry/node-ca-w7dg4" Jun 11 12:53:22.878879 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.878848 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mk76\" (UniqueName: \"kubernetes.io/projected/a1f8a5ba-4d3e-41bf-931f-ad49b5259328-kube-api-access-5mk76\") pod \"ovnkube-node-5njr6\" (UID: \"a1f8a5ba-4d3e-41bf-931f-ad49b5259328\") " pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:22.880925 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.880903 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzhbg\" (UniqueName: \"kubernetes.io/projected/5540735c-30f1-4071-8ca5-86c1d43d1315-kube-api-access-tzhbg\") pod \"network-metrics-daemon-jd6lc\" (UID: \"5540735c-30f1-4071-8ca5-86c1d43d1315\") " pod="openshift-multus/network-metrics-daemon-jd6lc" Jun 11 12:53:22.969976 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.969939 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/70f746b8-9a69-4b2c-86b5-95632730e3c8-cnibin\") pod \"multus-additional-cni-plugins-zxx5s\" (UID: \"70f746b8-9a69-4b2c-86b5-95632730e3c8\") " pod="openshift-multus/multus-additional-cni-plugins-zxx5s" Jun 11 12:53:22.970180 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.969985 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/70f746b8-9a69-4b2c-86b5-95632730e3c8-system-cni-dir\") pod \"multus-additional-cni-plugins-zxx5s\" (UID: \"70f746b8-9a69-4b2c-86b5-95632730e3c8\") " pod="openshift-multus/multus-additional-cni-plugins-zxx5s" Jun 11 12:53:22.970180 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.970040 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/70f746b8-9a69-4b2c-86b5-95632730e3c8-os-release\") pod \"multus-additional-cni-plugins-zxx5s\" (UID: \"70f746b8-9a69-4b2c-86b5-95632730e3c8\") " pod="openshift-multus/multus-additional-cni-plugins-zxx5s" Jun 11 12:53:22.970180 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.970067 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/70f746b8-9a69-4b2c-86b5-95632730e3c8-system-cni-dir\") pod \"multus-additional-cni-plugins-zxx5s\" (UID: \"70f746b8-9a69-4b2c-86b5-95632730e3c8\") " pod="openshift-multus/multus-additional-cni-plugins-zxx5s" Jun 11 12:53:22.970180 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.970038 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/70f746b8-9a69-4b2c-86b5-95632730e3c8-cnibin\") pod \"multus-additional-cni-plugins-zxx5s\" (UID: \"70f746b8-9a69-4b2c-86b5-95632730e3c8\") " pod="openshift-multus/multus-additional-cni-plugins-zxx5s" Jun 11 12:53:22.970649 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.970067 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/70f746b8-9a69-4b2c-86b5-95632730e3c8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zxx5s\" (UID: \"70f746b8-9a69-4b2c-86b5-95632730e3c8\") " pod="openshift-multus/multus-additional-cni-plugins-zxx5s" Jun 11 12:53:22.970745 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.970697 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/70f746b8-9a69-4b2c-86b5-95632730e3c8-cni-binary-copy\") pod \"multus-additional-cni-plugins-zxx5s\" (UID: \"70f746b8-9a69-4b2c-86b5-95632730e3c8\") " pod="openshift-multus/multus-additional-cni-plugins-zxx5s" Jun 11 12:53:22.970795 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.970761 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34-agent-certs\") pod \"konnectivity-agent-229ps\" (UID: \"0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34\") " pod="kube-system/konnectivity-agent-229ps" Jun 11 12:53:22.970846 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.970795 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrsd4\" (UniqueName: \"kubernetes.io/projected/70f746b8-9a69-4b2c-86b5-95632730e3c8-kube-api-access-rrsd4\") pod \"multus-additional-cni-plugins-zxx5s\" (UID: \"70f746b8-9a69-4b2c-86b5-95632730e3c8\") " pod="openshift-multus/multus-additional-cni-plugins-zxx5s" Jun 11 12:53:22.970846 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.970831 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34-konnectivity-ca\") pod \"konnectivity-agent-229ps\" (UID: \"0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34\") " pod="kube-system/konnectivity-agent-229ps" Jun 11 12:53:22.970946 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.970477 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/70f746b8-9a69-4b2c-86b5-95632730e3c8-os-release\") pod \"multus-additional-cni-plugins-zxx5s\" (UID: \"70f746b8-9a69-4b2c-86b5-95632730e3c8\") " pod="openshift-multus/multus-additional-cni-plugins-zxx5s" Jun 11 12:53:22.970946 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.970867 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/70f746b8-9a69-4b2c-86b5-95632730e3c8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zxx5s\" (UID: \"70f746b8-9a69-4b2c-86b5-95632730e3c8\") " pod="openshift-multus/multus-additional-cni-plugins-zxx5s" Jun 11 12:53:22.971291 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.971103 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/70f746b8-9a69-4b2c-86b5-95632730e3c8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zxx5s\" (UID: \"70f746b8-9a69-4b2c-86b5-95632730e3c8\") " pod="openshift-multus/multus-additional-cni-plugins-zxx5s" Jun 11 12:53:22.971291 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.971240 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/70f746b8-9a69-4b2c-86b5-95632730e3c8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zxx5s\" (UID: \"70f746b8-9a69-4b2c-86b5-95632730e3c8\") " pod="openshift-multus/multus-additional-cni-plugins-zxx5s" Jun 11 12:53:22.973804 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.971669 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/70f746b8-9a69-4b2c-86b5-95632730e3c8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zxx5s\" (UID: \"70f746b8-9a69-4b2c-86b5-95632730e3c8\") " pod="openshift-multus/multus-additional-cni-plugins-zxx5s" Jun 11 12:53:22.973804 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.971764 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/70f746b8-9a69-4b2c-86b5-95632730e3c8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zxx5s\" (UID: \"70f746b8-9a69-4b2c-86b5-95632730e3c8\") " pod="openshift-multus/multus-additional-cni-plugins-zxx5s" Jun 11 12:53:22.973804 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.972040 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/70f746b8-9a69-4b2c-86b5-95632730e3c8-cni-binary-copy\") pod \"multus-additional-cni-plugins-zxx5s\" (UID: \"70f746b8-9a69-4b2c-86b5-95632730e3c8\") " pod="openshift-multus/multus-additional-cni-plugins-zxx5s" Jun 11 12:53:22.973804 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.972254 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34-konnectivity-ca\") pod \"konnectivity-agent-229ps\" (UID: \"0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34\") " pod="kube-system/konnectivity-agent-229ps" Jun 11 12:53:22.975014 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.974972 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34-agent-certs\") pod \"konnectivity-agent-229ps\" (UID: \"0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34\") " pod="kube-system/konnectivity-agent-229ps" Jun 11 12:53:22.979838 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:22.979806 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrsd4\" (UniqueName: \"kubernetes.io/projected/70f746b8-9a69-4b2c-86b5-95632730e3c8-kube-api-access-rrsd4\") pod \"multus-additional-cni-plugins-zxx5s\" (UID: \"70f746b8-9a69-4b2c-86b5-95632730e3c8\") " pod="openshift-multus/multus-additional-cni-plugins-zxx5s" Jun 11 12:53:23.055870 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:23.055788 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfl2p" Jun 11 12:53:23.063188 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:23.063166 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hcnkc" Jun 11 12:53:23.072925 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:23.072905 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l26j6" Jun 11 12:53:23.079514 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:23.079491 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" Jun 11 12:53:23.087174 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:23.087142 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w7dg4" Jun 11 12:53:23.094256 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:23.094236 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:23.101082 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:23.101055 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bkdpg" Jun 11 12:53:23.107478 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:23.107454 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-229ps" Jun 11 12:53:23.113423 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:23.113400 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zxx5s" Jun 11 12:53:23.373452 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:23.373421 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b3b5dc2f-8831-4790-85e8-9934466019b8-original-pull-secret\") pod \"global-pull-secret-syncer-dl6mx\" (UID: \"b3b5dc2f-8831-4790-85e8-9934466019b8\") " pod="kube-system/global-pull-secret-syncer-dl6mx" Jun 11 12:53:23.373627 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:23.373473 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5540735c-30f1-4071-8ca5-86c1d43d1315-metrics-certs\") pod \"network-metrics-daemon-jd6lc\" (UID: \"5540735c-30f1-4071-8ca5-86c1d43d1315\") " pod="openshift-multus/network-metrics-daemon-jd6lc" Jun 11 12:53:23.373627 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:23.373582 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:53:23.373627 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:23.373593 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 12:53:23.373770 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:23.373638 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5540735c-30f1-4071-8ca5-86c1d43d1315-metrics-certs podName:5540735c-30f1-4071-8ca5-86c1d43d1315 nodeName:}" failed. No retries permitted until 2026-06-11 12:53:24.373618462 +0000 UTC m=+4.020140382 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5540735c-30f1-4071-8ca5-86c1d43d1315-metrics-certs") pod "network-metrics-daemon-jd6lc" (UID: "5540735c-30f1-4071-8ca5-86c1d43d1315") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:53:23.373770 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:23.373706 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3b5dc2f-8831-4790-85e8-9934466019b8-original-pull-secret podName:b3b5dc2f-8831-4790-85e8-9934466019b8 nodeName:}" failed. No retries permitted until 2026-06-11 12:53:24.373685899 +0000 UTC m=+4.020207823 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b3b5dc2f-8831-4790-85e8-9934466019b8-original-pull-secret") pod "global-pull-secret-syncer-dl6mx" (UID: "b3b5dc2f-8831-4790-85e8-9934466019b8") : object "kube-system"/"original-pull-secret" not registered Jun 11 12:53:23.474503 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:23.474471 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb4q5\" (UniqueName: \"kubernetes.io/projected/91e0efc4-f28a-4e27-8e50-99e6c424f288-kube-api-access-hb4q5\") pod \"network-check-target-gdklg\" (UID: \"91e0efc4-f28a-4e27-8e50-99e6c424f288\") " pod="openshift-network-diagnostics/network-check-target-gdklg" Jun 11 12:53:23.474682 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:23.474619 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 12:53:23.474682 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:23.474641 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 12:53:23.474682 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:23.474653 2558 projected.go:196] Error preparing data for projected volume kube-api-access-hb4q5 for pod openshift-network-diagnostics/network-check-target-gdklg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:53:23.474819 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:23.474704 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91e0efc4-f28a-4e27-8e50-99e6c424f288-kube-api-access-hb4q5 podName:91e0efc4-f28a-4e27-8e50-99e6c424f288 nodeName:}" failed. No retries permitted until 2026-06-11 12:53:24.474691894 +0000 UTC m=+4.121213814 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hb4q5" (UniqueName: "kubernetes.io/projected/91e0efc4-f28a-4e27-8e50-99e6c424f288-kube-api-access-hb4q5") pod "network-check-target-gdklg" (UID: "91e0efc4-f28a-4e27-8e50-99e6c424f288") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:53:23.593288 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:23.593112 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb59938c4_f965_43fe_a109_837198e91085.slice/crio-81feba512044143c03689e9dc82c8a886cb3bfc6f987fd1d64250023eff9b45d WatchSource:0}: Error finding container 81feba512044143c03689e9dc82c8a886cb3bfc6f987fd1d64250023eff9b45d: Status 404 returned error can't find the container with id 81feba512044143c03689e9dc82c8a886cb3bfc6f987fd1d64250023eff9b45d Jun 11 12:53:23.594588 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:23.594566 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52db0382_33eb_4bbd_8c3a_850757a8b9fb.slice/crio-d41fc49cbcbb106a6fb4bfd89b686d8f623042de7f0f0d79ab46423c27e61ce3 WatchSource:0}: Error finding container d41fc49cbcbb106a6fb4bfd89b686d8f623042de7f0f0d79ab46423c27e61ce3: Status 404 returned error can't find the container with id d41fc49cbcbb106a6fb4bfd89b686d8f623042de7f0f0d79ab46423c27e61ce3 Jun 11 12:53:23.596082 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:23.596053 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b5e8ffb_3e76_44e4_8648_dcbaa4c82d34.slice/crio-30e493939a408449af9e41e865eeb77ec9501e5ca6a1f1fbeea3e26053b1e8aa WatchSource:0}: Error finding container 30e493939a408449af9e41e865eeb77ec9501e5ca6a1f1fbeea3e26053b1e8aa: Status 404 returned error can't find the container with id 30e493939a408449af9e41e865eeb77ec9501e5ca6a1f1fbeea3e26053b1e8aa Jun 11 12:53:23.598409 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:23.598385 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2109998_6314_4e3f_9291_97b19146d944.slice/crio-79e0910ada89cd98863b1d87b237f8ccc90bfb5a52b688f1fef26d4976138389 WatchSource:0}: Error finding container 79e0910ada89cd98863b1d87b237f8ccc90bfb5a52b688f1fef26d4976138389: Status 404 returned error can't find the container with id 79e0910ada89cd98863b1d87b237f8ccc90bfb5a52b688f1fef26d4976138389 Jun 11 12:53:23.599178 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:23.599137 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1f8a5ba_4d3e_41bf_931f_ad49b5259328.slice/crio-186b132654bf7c76c7ca4b653a95aa08932d4dd1a991956d355c3d7efc39472e WatchSource:0}: Error finding container 186b132654bf7c76c7ca4b653a95aa08932d4dd1a991956d355c3d7efc39472e: Status 404 returned error can't find the container with id 186b132654bf7c76c7ca4b653a95aa08932d4dd1a991956d355c3d7efc39472e Jun 11 12:53:23.600541 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:23.600519 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb10f8cf9_e375_4b40_bd55_c0cb329ce19e.slice/crio-9d74e8e20ad3f8de398c38b732f93b6d68471a9b655c17d99c57fc38d7f6827e WatchSource:0}: Error finding container 9d74e8e20ad3f8de398c38b732f93b6d68471a9b655c17d99c57fc38d7f6827e: Status 404 returned error can't find the container with id 9d74e8e20ad3f8de398c38b732f93b6d68471a9b655c17d99c57fc38d7f6827e Jun 11 12:53:23.602214 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:23.602094 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24b518d4_f50f_4930_9675_ee7719d79d73.slice/crio-5da05d326b078c84c1451219beeaf3cd89bbbedd3bd8f7ef23cca8414d769701 WatchSource:0}: Error finding container 5da05d326b078c84c1451219beeaf3cd89bbbedd3bd8f7ef23cca8414d769701: Status 404 returned error can't find the container with id 5da05d326b078c84c1451219beeaf3cd89bbbedd3bd8f7ef23cca8414d769701 Jun 11 12:53:23.602873 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:23.602853 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf80224ad_14f9_4dd4_a511_cedcad37a73d.slice/crio-ddd21c81df7485a0455bee4a36703c46780e9bf9881f29db3ed27471ae779868 WatchSource:0}: Error finding container ddd21c81df7485a0455bee4a36703c46780e9bf9881f29db3ed27471ae779868: Status 404 returned error can't find the container with id ddd21c81df7485a0455bee4a36703c46780e9bf9881f29db3ed27471ae779868 Jun 11 12:53:23.604091 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:23.604067 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70f746b8_9a69_4b2c_86b5_95632730e3c8.slice/crio-46aaca14dd82e3999f30c5219f54a2197b7545fb38f3d1b9b74f8e09829447af WatchSource:0}: Error finding container 46aaca14dd82e3999f30c5219f54a2197b7545fb38f3d1b9b74f8e09829447af: Status 404 returned error can't find the container with id 46aaca14dd82e3999f30c5219f54a2197b7545fb38f3d1b9b74f8e09829447af Jun 11 12:53:23.801187 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:23.800982 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 12:48:22 +0000 UTC" deadline="2028-02-13 17:39:28.33542123 +0000 UTC" Jun 11 12:53:23.801667 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:23.801189 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14692h46m4.534241708s" Jun 11 12:53:23.827800 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:23.827767 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-120.ec2.internal" event={"ID":"ff108f13402cbf8ebb304d587916d091","Type":"ContainerStarted","Data":"bd1e104118dd67a59a3043d0b8a7d9fafd4b4669b70846fc338b16c6ada52243"} Jun 11 12:53:23.828939 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:23.828914 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zxx5s" event={"ID":"70f746b8-9a69-4b2c-86b5-95632730e3c8","Type":"ContainerStarted","Data":"46aaca14dd82e3999f30c5219f54a2197b7545fb38f3d1b9b74f8e09829447af"} Jun 11 12:53:23.830028 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:23.830000 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l26j6" event={"ID":"f80224ad-14f9-4dd4-a511-cedcad37a73d","Type":"ContainerStarted","Data":"ddd21c81df7485a0455bee4a36703c46780e9bf9881f29db3ed27471ae779868"} Jun 11 12:53:23.831040 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:23.831009 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w7dg4" event={"ID":"b10f8cf9-e375-4b40-bd55-c0cb329ce19e","Type":"ContainerStarted","Data":"9d74e8e20ad3f8de398c38b732f93b6d68471a9b655c17d99c57fc38d7f6827e"} Jun 11 12:53:23.832094 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:23.832070 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hcnkc" event={"ID":"52db0382-33eb-4bbd-8c3a-850757a8b9fb","Type":"ContainerStarted","Data":"d41fc49cbcbb106a6fb4bfd89b686d8f623042de7f0f0d79ab46423c27e61ce3"} Jun 11 12:53:23.833067 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:23.833039 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfl2p" event={"ID":"b59938c4-f965-43fe-a109-837198e91085","Type":"ContainerStarted","Data":"81feba512044143c03689e9dc82c8a886cb3bfc6f987fd1d64250023eff9b45d"} Jun 11 12:53:23.833921 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:23.833897 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" event={"ID":"24b518d4-f50f-4930-9675-ee7719d79d73","Type":"ContainerStarted","Data":"5da05d326b078c84c1451219beeaf3cd89bbbedd3bd8f7ef23cca8414d769701"} Jun 11 12:53:23.834961 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:23.834935 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" event={"ID":"a1f8a5ba-4d3e-41bf-931f-ad49b5259328","Type":"ContainerStarted","Data":"186b132654bf7c76c7ca4b653a95aa08932d4dd1a991956d355c3d7efc39472e"} Jun 11 12:53:23.835986 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:23.835940 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bkdpg" event={"ID":"c2109998-6314-4e3f-9291-97b19146d944","Type":"ContainerStarted","Data":"79e0910ada89cd98863b1d87b237f8ccc90bfb5a52b688f1fef26d4976138389"} Jun 11 12:53:23.836905 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:23.836880 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-229ps" event={"ID":"0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34","Type":"ContainerStarted","Data":"30e493939a408449af9e41e865eeb77ec9501e5ca6a1f1fbeea3e26053b1e8aa"} Jun 11 12:53:23.841372 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:23.841336 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-120.ec2.internal" podStartSLOduration=1.841325463 podStartE2EDuration="1.841325463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:53:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:53:23.841067242 +0000 UTC m=+3.487589185" watchObservedRunningTime="2026-06-11 12:53:23.841325463 +0000 UTC m=+3.487847405" Jun 11 12:53:24.383589 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:24.383551 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5540735c-30f1-4071-8ca5-86c1d43d1315-metrics-certs\") pod \"network-metrics-daemon-jd6lc\" (UID: \"5540735c-30f1-4071-8ca5-86c1d43d1315\") " pod="openshift-multus/network-metrics-daemon-jd6lc" Jun 11 12:53:24.383781 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:24.383650 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b3b5dc2f-8831-4790-85e8-9934466019b8-original-pull-secret\") pod \"global-pull-secret-syncer-dl6mx\" (UID: \"b3b5dc2f-8831-4790-85e8-9934466019b8\") " pod="kube-system/global-pull-secret-syncer-dl6mx" Jun 11 12:53:24.383781 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:24.383761 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 12:53:24.383899 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:24.383824 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3b5dc2f-8831-4790-85e8-9934466019b8-original-pull-secret podName:b3b5dc2f-8831-4790-85e8-9934466019b8 nodeName:}" failed. No retries permitted until 2026-06-11 12:53:26.383806956 +0000 UTC m=+6.030328879 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b3b5dc2f-8831-4790-85e8-9934466019b8-original-pull-secret") pod "global-pull-secret-syncer-dl6mx" (UID: "b3b5dc2f-8831-4790-85e8-9934466019b8") : object "kube-system"/"original-pull-secret" not registered Jun 11 12:53:24.383899 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:24.383762 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:53:24.384013 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:24.383954 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5540735c-30f1-4071-8ca5-86c1d43d1315-metrics-certs podName:5540735c-30f1-4071-8ca5-86c1d43d1315 nodeName:}" failed. No retries permitted until 2026-06-11 12:53:26.383908187 +0000 UTC m=+6.030430126 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5540735c-30f1-4071-8ca5-86c1d43d1315-metrics-certs") pod "network-metrics-daemon-jd6lc" (UID: "5540735c-30f1-4071-8ca5-86c1d43d1315") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:53:24.485717 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:24.485114 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb4q5\" (UniqueName: \"kubernetes.io/projected/91e0efc4-f28a-4e27-8e50-99e6c424f288-kube-api-access-hb4q5\") pod \"network-check-target-gdklg\" (UID: \"91e0efc4-f28a-4e27-8e50-99e6c424f288\") " pod="openshift-network-diagnostics/network-check-target-gdklg" Jun 11 12:53:24.485717 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:24.485292 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 12:53:24.485717 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:24.485313 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 12:53:24.485717 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:24.485327 2558 projected.go:196] Error preparing data for projected volume kube-api-access-hb4q5 for pod openshift-network-diagnostics/network-check-target-gdklg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:53:24.485717 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:24.485383 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91e0efc4-f28a-4e27-8e50-99e6c424f288-kube-api-access-hb4q5 podName:91e0efc4-f28a-4e27-8e50-99e6c424f288 nodeName:}" failed. No retries permitted until 2026-06-11 12:53:26.485365455 +0000 UTC m=+6.131887381 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hb4q5" (UniqueName: "kubernetes.io/projected/91e0efc4-f28a-4e27-8e50-99e6c424f288-kube-api-access-hb4q5") pod "network-check-target-gdklg" (UID: "91e0efc4-f28a-4e27-8e50-99e6c424f288") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:53:24.802551 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:24.802319 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 12:48:22 +0000 UTC" deadline="2028-02-13 10:37:22.610614062 +0000 UTC" Jun 11 12:53:24.802551 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:24.802361 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14685h43m57.80825845s" Jun 11 12:53:24.822442 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:24.821540 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dl6mx" Jun 11 12:53:24.822442 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:24.821659 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dl6mx" podUID="b3b5dc2f-8831-4790-85e8-9934466019b8" Jun 11 12:53:24.822442 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:24.822033 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdklg" Jun 11 12:53:24.822442 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:24.822119 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdklg" podUID="91e0efc4-f28a-4e27-8e50-99e6c424f288" Jun 11 12:53:24.822442 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:24.822202 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jd6lc" Jun 11 12:53:24.822442 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:24.822281 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jd6lc" podUID="5540735c-30f1-4071-8ca5-86c1d43d1315" Jun 11 12:53:24.863485 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:24.863389 2558 generic.go:356] "Generic (PLEG): container finished" podID="2cd2913b23ada3c3f30f6db57a26e4da" containerID="ca0ec379969bfac7e029d9c7a2b258ffc77c15716a8bb807e545fdd954dff7e7" exitCode=0 Jun 11 12:53:24.864236 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:24.864206 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-120.ec2.internal" event={"ID":"2cd2913b23ada3c3f30f6db57a26e4da","Type":"ContainerDied","Data":"ca0ec379969bfac7e029d9c7a2b258ffc77c15716a8bb807e545fdd954dff7e7"} Jun 11 12:53:25.924165 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:25.924015 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-120.ec2.internal" event={"ID":"2cd2913b23ada3c3f30f6db57a26e4da","Type":"ContainerStarted","Data":"dc8168f3e71c3730ffee7edaf37aa602e80e95514b1c06d62e2ab12a684ca8a6"} Jun 11 12:53:26.402288 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:26.402245 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b3b5dc2f-8831-4790-85e8-9934466019b8-original-pull-secret\") pod \"global-pull-secret-syncer-dl6mx\" (UID: \"b3b5dc2f-8831-4790-85e8-9934466019b8\") " pod="kube-system/global-pull-secret-syncer-dl6mx" Jun 11 12:53:26.402466 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:26.402304 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5540735c-30f1-4071-8ca5-86c1d43d1315-metrics-certs\") pod \"network-metrics-daemon-jd6lc\" (UID: \"5540735c-30f1-4071-8ca5-86c1d43d1315\") " pod="openshift-multus/network-metrics-daemon-jd6lc" Jun 11 12:53:26.402466 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:26.402409 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 12:53:26.402466 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:26.402451 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:53:26.402632 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:26.402491 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3b5dc2f-8831-4790-85e8-9934466019b8-original-pull-secret podName:b3b5dc2f-8831-4790-85e8-9934466019b8 nodeName:}" failed. No retries permitted until 2026-06-11 12:53:30.402470437 +0000 UTC m=+10.048992360 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b3b5dc2f-8831-4790-85e8-9934466019b8-original-pull-secret") pod "global-pull-secret-syncer-dl6mx" (UID: "b3b5dc2f-8831-4790-85e8-9934466019b8") : object "kube-system"/"original-pull-secret" not registered Jun 11 12:53:26.402632 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:26.402512 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5540735c-30f1-4071-8ca5-86c1d43d1315-metrics-certs podName:5540735c-30f1-4071-8ca5-86c1d43d1315 nodeName:}" failed. No retries permitted until 2026-06-11 12:53:30.402502018 +0000 UTC m=+10.049023943 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5540735c-30f1-4071-8ca5-86c1d43d1315-metrics-certs") pod "network-metrics-daemon-jd6lc" (UID: "5540735c-30f1-4071-8ca5-86c1d43d1315") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:53:26.503676 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:26.503636 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb4q5\" (UniqueName: \"kubernetes.io/projected/91e0efc4-f28a-4e27-8e50-99e6c424f288-kube-api-access-hb4q5\") pod \"network-check-target-gdklg\" (UID: \"91e0efc4-f28a-4e27-8e50-99e6c424f288\") " pod="openshift-network-diagnostics/network-check-target-gdklg" Jun 11 12:53:26.503892 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:26.503871 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 12:53:26.503978 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:26.503900 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 12:53:26.503978 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:26.503914 2558 projected.go:196] Error preparing data for projected volume kube-api-access-hb4q5 for pod openshift-network-diagnostics/network-check-target-gdklg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:53:26.504214 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:26.503984 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91e0efc4-f28a-4e27-8e50-99e6c424f288-kube-api-access-hb4q5 podName:91e0efc4-f28a-4e27-8e50-99e6c424f288 nodeName:}" failed. No retries permitted until 2026-06-11 12:53:30.503954325 +0000 UTC m=+10.150476246 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hb4q5" (UniqueName: "kubernetes.io/projected/91e0efc4-f28a-4e27-8e50-99e6c424f288-kube-api-access-hb4q5") pod "network-check-target-gdklg" (UID: "91e0efc4-f28a-4e27-8e50-99e6c424f288") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:53:26.819698 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:26.819613 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dl6mx" Jun 11 12:53:26.819858 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:26.819620 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdklg" Jun 11 12:53:26.819858 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:26.819754 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jd6lc" Jun 11 12:53:26.819858 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:26.819750 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dl6mx" podUID="b3b5dc2f-8831-4790-85e8-9934466019b8" Jun 11 12:53:26.819858 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:26.819841 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdklg" podUID="91e0efc4-f28a-4e27-8e50-99e6c424f288" Jun 11 12:53:26.819997 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:26.819927 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jd6lc" podUID="5540735c-30f1-4071-8ca5-86c1d43d1315" Jun 11 12:53:28.818997 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:28.818960 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dl6mx" Jun 11 12:53:28.819483 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:28.818961 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdklg" Jun 11 12:53:28.819483 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:28.819273 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdklg" podUID="91e0efc4-f28a-4e27-8e50-99e6c424f288" Jun 11 12:53:28.819483 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:28.819098 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dl6mx" podUID="b3b5dc2f-8831-4790-85e8-9934466019b8" Jun 11 12:53:28.819483 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:28.818960 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jd6lc" Jun 11 12:53:28.819483 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:28.819382 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jd6lc" podUID="5540735c-30f1-4071-8ca5-86c1d43d1315" Jun 11 12:53:30.436639 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:30.436596 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b3b5dc2f-8831-4790-85e8-9934466019b8-original-pull-secret\") pod \"global-pull-secret-syncer-dl6mx\" (UID: \"b3b5dc2f-8831-4790-85e8-9934466019b8\") " pod="kube-system/global-pull-secret-syncer-dl6mx" Jun 11 12:53:30.437103 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:30.436659 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5540735c-30f1-4071-8ca5-86c1d43d1315-metrics-certs\") pod \"network-metrics-daemon-jd6lc\" (UID: \"5540735c-30f1-4071-8ca5-86c1d43d1315\") " pod="openshift-multus/network-metrics-daemon-jd6lc" Jun 11 12:53:30.437103 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:30.436773 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:53:30.437103 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:30.436837 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5540735c-30f1-4071-8ca5-86c1d43d1315-metrics-certs podName:5540735c-30f1-4071-8ca5-86c1d43d1315 nodeName:}" failed. No retries permitted until 2026-06-11 12:53:38.436817192 +0000 UTC m=+18.083339115 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5540735c-30f1-4071-8ca5-86c1d43d1315-metrics-certs") pod "network-metrics-daemon-jd6lc" (UID: "5540735c-30f1-4071-8ca5-86c1d43d1315") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:53:30.437103 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:30.436771 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 12:53:30.437103 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:30.436928 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3b5dc2f-8831-4790-85e8-9934466019b8-original-pull-secret podName:b3b5dc2f-8831-4790-85e8-9934466019b8 nodeName:}" failed. No retries permitted until 2026-06-11 12:53:38.436907686 +0000 UTC m=+18.083429619 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b3b5dc2f-8831-4790-85e8-9934466019b8-original-pull-secret") pod "global-pull-secret-syncer-dl6mx" (UID: "b3b5dc2f-8831-4790-85e8-9934466019b8") : object "kube-system"/"original-pull-secret" not registered Jun 11 12:53:30.538489 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:30.537757 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb4q5\" (UniqueName: \"kubernetes.io/projected/91e0efc4-f28a-4e27-8e50-99e6c424f288-kube-api-access-hb4q5\") pod \"network-check-target-gdklg\" (UID: \"91e0efc4-f28a-4e27-8e50-99e6c424f288\") " pod="openshift-network-diagnostics/network-check-target-gdklg" Jun 11 12:53:30.538489 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:30.537982 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 12:53:30.538489 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:30.538011 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 12:53:30.538489 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:30.538028 2558 projected.go:196] Error preparing data for projected volume kube-api-access-hb4q5 for pod openshift-network-diagnostics/network-check-target-gdklg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:53:30.538489 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:30.538094 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91e0efc4-f28a-4e27-8e50-99e6c424f288-kube-api-access-hb4q5 podName:91e0efc4-f28a-4e27-8e50-99e6c424f288 nodeName:}" failed. No retries permitted until 2026-06-11 12:53:38.538071479 +0000 UTC m=+18.184593403 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hb4q5" (UniqueName: "kubernetes.io/projected/91e0efc4-f28a-4e27-8e50-99e6c424f288-kube-api-access-hb4q5") pod "network-check-target-gdklg" (UID: "91e0efc4-f28a-4e27-8e50-99e6c424f288") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:53:30.820325 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:30.820235 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdklg" Jun 11 12:53:30.820492 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:30.820344 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jd6lc" Jun 11 12:53:30.820492 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:30.820346 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdklg" podUID="91e0efc4-f28a-4e27-8e50-99e6c424f288" Jun 11 12:53:30.820492 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:30.820372 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dl6mx" Jun 11 12:53:30.820492 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:30.820474 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jd6lc" podUID="5540735c-30f1-4071-8ca5-86c1d43d1315" Jun 11 12:53:30.820649 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:30.820587 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dl6mx" podUID="b3b5dc2f-8831-4790-85e8-9934466019b8" Jun 11 12:53:32.818772 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:32.818738 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdklg" Jun 11 12:53:32.819260 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:32.818926 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdklg" podUID="91e0efc4-f28a-4e27-8e50-99e6c424f288" Jun 11 12:53:32.819260 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:32.818989 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jd6lc" Jun 11 12:53:32.819260 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:32.819076 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jd6lc" podUID="5540735c-30f1-4071-8ca5-86c1d43d1315" Jun 11 12:53:32.819405 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:32.819267 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dl6mx" Jun 11 12:53:32.819405 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:32.819380 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dl6mx" podUID="b3b5dc2f-8831-4790-85e8-9934466019b8" Jun 11 12:53:34.818866 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:34.818823 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jd6lc" Jun 11 12:53:34.818866 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:34.818850 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dl6mx" Jun 11 12:53:34.818866 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:34.818823 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdklg" Jun 11 12:53:34.819467 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:34.818958 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dl6mx" podUID="b3b5dc2f-8831-4790-85e8-9934466019b8" Jun 11 12:53:34.819467 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:34.819382 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdklg" podUID="91e0efc4-f28a-4e27-8e50-99e6c424f288" Jun 11 12:53:34.819568 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:34.819469 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jd6lc" podUID="5540735c-30f1-4071-8ca5-86c1d43d1315" Jun 11 12:53:36.819355 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:36.819321 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dl6mx" Jun 11 12:53:36.819355 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:36.819357 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jd6lc" Jun 11 12:53:36.819996 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:36.819322 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdklg" Jun 11 12:53:36.819996 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:36.819453 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dl6mx" podUID="b3b5dc2f-8831-4790-85e8-9934466019b8" Jun 11 12:53:36.819996 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:36.819543 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdklg" podUID="91e0efc4-f28a-4e27-8e50-99e6c424f288" Jun 11 12:53:36.819996 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:36.819634 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jd6lc" podUID="5540735c-30f1-4071-8ca5-86c1d43d1315" Jun 11 12:53:37.950932 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:37.950594 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hcnkc" event={"ID":"52db0382-33eb-4bbd-8c3a-850757a8b9fb","Type":"ContainerStarted","Data":"7b23fc8d6e99b020306bedd8e5352c0b64f5eaca296aa44ae372413aad5ef03e"} Jun 11 12:53:37.952175 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:37.952134 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfl2p" event={"ID":"b59938c4-f965-43fe-a109-837198e91085","Type":"ContainerStarted","Data":"8f3f2a2429833e9c9d29bb229a8f77da8215729c033c9c63133caeb9e65d7e96"} Jun 11 12:53:37.953812 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:37.953541 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" event={"ID":"24b518d4-f50f-4930-9675-ee7719d79d73","Type":"ContainerStarted","Data":"51def9cbf16cc6924f5e771d419083834ca922b57a0b3e736ae54d809651587f"} Jun 11 12:53:37.955225 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:37.955199 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bkdpg" event={"ID":"c2109998-6314-4e3f-9291-97b19146d944","Type":"ContainerStarted","Data":"d0fe1fffbb0efe6ee0adcce6502214bc9ea80c0ec25f6f1fb1a83216daebfb76"} Jun 11 12:53:37.956791 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:37.956758 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-229ps" event={"ID":"0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34","Type":"ContainerStarted","Data":"39d95989db8cdbc429c3dfee6dd59c59f581e2e30fe2eeb893cabca5dcd5eb42"} Jun 11 12:53:37.958769 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:37.958745 2558 generic.go:356] "Generic (PLEG): container finished" podID="70f746b8-9a69-4b2c-86b5-95632730e3c8" containerID="1e13534d283d414a31c77c85cee7cca7b4f6fb1c17edd8a212a38b618c93768f" exitCode=0 Jun 11 12:53:37.958913 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:37.958824 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zxx5s" event={"ID":"70f746b8-9a69-4b2c-86b5-95632730e3c8","Type":"ContainerDied","Data":"1e13534d283d414a31c77c85cee7cca7b4f6fb1c17edd8a212a38b618c93768f"} Jun 11 12:53:37.960342 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:37.960238 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w7dg4" event={"ID":"b10f8cf9-e375-4b40-bd55-c0cb329ce19e","Type":"ContainerStarted","Data":"4555d3971fe55ea84b2d767d595061d33119cf397b89c5c967dddc2a3e6bcb56"} Jun 11 12:53:37.966056 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:37.966018 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hcnkc" podStartSLOduration=3.272142197 podStartE2EDuration="16.966005437s" totalImagesPullingTime="13.69386324s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:53:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:53:37.965760586 +0000 UTC m=+17.612282551" watchObservedRunningTime="2026-06-11 12:53:37.966005437 +0000 UTC m=+17.612527378" Jun 11 12:53:37.966207 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:37.966117 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-120.ec2.internal" podStartSLOduration=15.966111795 podStartE2EDuration="15.966111795s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:53:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:53:25.940739886 +0000 UTC m=+5.587261830" watchObservedRunningTime="2026-06-11 12:53:37.966111795 +0000 UTC m=+17.612633736" Jun 11 12:53:37.982583 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:37.982537 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zzsxs" podStartSLOduration=3.295991463 podStartE2EDuration="16.982524281s" totalImagesPullingTime="13.686532818s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:53:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:53:37.982169295 +0000 UTC m=+17.628691235" watchObservedRunningTime="2026-06-11 12:53:37.982524281 +0000 UTC m=+17.629046224" Jun 11 12:53:38.001313 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:37.999439 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bkdpg" podStartSLOduration=3.150912049 podStartE2EDuration="16.999414028s" totalImagesPullingTime="13.848501979s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:53:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:53:37.99887798 +0000 UTC m=+17.645399926" watchObservedRunningTime="2026-06-11 12:53:37.999414028 +0000 UTC m=+17.645935971" Jun 11 12:53:38.013095 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:38.013052 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-w7dg4" podStartSLOduration=3.3254869559999998 podStartE2EDuration="17.013034767s" totalImagesPullingTime="13.687547811s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:53:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:53:38.012770209 +0000 UTC m=+17.659292154" watchObservedRunningTime="2026-06-11 12:53:38.013034767 +0000 UTC m=+17.659556711" Jun 11 12:53:38.027369 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:38.027321 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-229ps" podStartSLOduration=3.334912606 podStartE2EDuration="17.027307066s" totalImagesPullingTime="13.69239446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:53:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:53:38.02702132 +0000 UTC m=+17.673543263" watchObservedRunningTime="2026-06-11 12:53:38.027307066 +0000 UTC m=+17.673829008" Jun 11 12:53:38.152905 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:38.152867 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:53:38.222581 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:38.222545 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:53:38.495897 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:38.495816 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b3b5dc2f-8831-4790-85e8-9934466019b8-original-pull-secret\") pod \"global-pull-secret-syncer-dl6mx\" (UID: \"b3b5dc2f-8831-4790-85e8-9934466019b8\") " pod="kube-system/global-pull-secret-syncer-dl6mx" Jun 11 12:53:38.495897 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:38.495865 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5540735c-30f1-4071-8ca5-86c1d43d1315-metrics-certs\") pod \"network-metrics-daemon-jd6lc\" (UID: \"5540735c-30f1-4071-8ca5-86c1d43d1315\") " pod="openshift-multus/network-metrics-daemon-jd6lc" Jun 11 12:53:38.496128 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:38.495984 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 12:53:38.496128 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:38.496002 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:53:38.496128 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:38.496051 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3b5dc2f-8831-4790-85e8-9934466019b8-original-pull-secret podName:b3b5dc2f-8831-4790-85e8-9934466019b8 nodeName:}" failed. No retries permitted until 2026-06-11 12:53:54.496031843 +0000 UTC m=+34.142553765 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b3b5dc2f-8831-4790-85e8-9934466019b8-original-pull-secret") pod "global-pull-secret-syncer-dl6mx" (UID: "b3b5dc2f-8831-4790-85e8-9934466019b8") : object "kube-system"/"original-pull-secret" not registered Jun 11 12:53:38.496128 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:38.496067 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5540735c-30f1-4071-8ca5-86c1d43d1315-metrics-certs podName:5540735c-30f1-4071-8ca5-86c1d43d1315 nodeName:}" failed. No retries permitted until 2026-06-11 12:53:54.496060929 +0000 UTC m=+34.142582850 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5540735c-30f1-4071-8ca5-86c1d43d1315-metrics-certs") pod "network-metrics-daemon-jd6lc" (UID: "5540735c-30f1-4071-8ca5-86c1d43d1315") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:53:38.520742 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:38.520709 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:53:38.580212 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:38.580182 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:53:38.596508 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:38.596468 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb4q5\" (UniqueName: \"kubernetes.io/projected/91e0efc4-f28a-4e27-8e50-99e6c424f288-kube-api-access-hb4q5\") pod \"network-check-target-gdklg\" (UID: \"91e0efc4-f28a-4e27-8e50-99e6c424f288\") " pod="openshift-network-diagnostics/network-check-target-gdklg" Jun 11 12:53:38.596659 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:38.596636 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 12:53:38.596659 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:38.596652 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 12:53:38.596733 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:38.596662 2558 projected.go:196] Error preparing data for projected volume kube-api-access-hb4q5 for pod openshift-network-diagnostics/network-check-target-gdklg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:53:38.596733 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:38.596715 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91e0efc4-f28a-4e27-8e50-99e6c424f288-kube-api-access-hb4q5 podName:91e0efc4-f28a-4e27-8e50-99e6c424f288 nodeName:}" failed. No retries permitted until 2026-06-11 12:53:54.596698478 +0000 UTC m=+34.243220411 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hb4q5" (UniqueName: "kubernetes.io/projected/91e0efc4-f28a-4e27-8e50-99e6c424f288-kube-api-access-hb4q5") pod "network-check-target-gdklg" (UID: "91e0efc4-f28a-4e27-8e50-99e6c424f288") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:53:38.818760 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:38.818675 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dl6mx" Jun 11 12:53:38.818909 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:38.818675 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jd6lc" Jun 11 12:53:38.818909 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:38.818806 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dl6mx" podUID="b3b5dc2f-8831-4790-85e8-9934466019b8" Jun 11 12:53:38.818909 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:38.818689 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdklg" Jun 11 12:53:38.819048 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:38.818904 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jd6lc" podUID="5540735c-30f1-4071-8ca5-86c1d43d1315" Jun 11 12:53:38.819048 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:38.819014 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdklg" podUID="91e0efc4-f28a-4e27-8e50-99e6c424f288" Jun 11 12:53:38.964376 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:38.964328 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l26j6" event={"ID":"f80224ad-14f9-4dd4-a511-cedcad37a73d","Type":"ContainerStarted","Data":"73e2c780f7300c1474f09787abac32ed038c7c131b04f78706abbef666894d82"} Jun 11 12:53:38.979954 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:38.979905 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-l26j6" podStartSLOduration=4.288767681 podStartE2EDuration="17.979889012s" totalImagesPullingTime="13.691121331s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:53:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:53:38.979714751 +0000 UTC m=+18.626236694" watchObservedRunningTime="2026-06-11 12:53:38.979889012 +0000 UTC m=+18.626410961" Jun 11 12:53:39.152658 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:39.152625 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:53:39.253686 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:39.253648 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:53:39.320074 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:39.320037 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:53:39.658884 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:39.658844 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:53:39.715085 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:39.715050 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:53:40.819665 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:40.819479 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dl6mx" Jun 11 12:53:40.819665 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:40.819589 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dl6mx" podUID="b3b5dc2f-8831-4790-85e8-9934466019b8" Jun 11 12:53:40.820200 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:40.819680 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdklg" Jun 11 12:53:40.820200 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:40.819773 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdklg" podUID="91e0efc4-f28a-4e27-8e50-99e6c424f288" Jun 11 12:53:40.820200 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:40.819845 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jd6lc" Jun 11 12:53:40.820200 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:40.819941 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jd6lc" podUID="5540735c-30f1-4071-8ca5-86c1d43d1315" Jun 11 12:53:41.699698 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:41.699666 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-229ps" Jun 11 12:53:41.700291 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:41.700267 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-229ps" Jun 11 12:53:41.971001 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:41.970912 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-229ps" Jun 11 12:53:41.971571 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:41.971535 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-229ps" Jun 11 12:53:42.028660 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:42.028628 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:53:42.723083 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:42.722901 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 12:53:42.818678 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:42.818621 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jd6lc" Jun 11 12:53:42.818678 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:42.818653 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dl6mx" Jun 11 12:53:42.818851 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:42.818619 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdklg" Jun 11 12:53:42.818851 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:42.818760 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jd6lc" podUID="5540735c-30f1-4071-8ca5-86c1d43d1315" Jun 11 12:53:42.818948 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:42.818895 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdklg" podUID="91e0efc4-f28a-4e27-8e50-99e6c424f288" Jun 11 12:53:42.819019 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:42.818992 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dl6mx" podUID="b3b5dc2f-8831-4790-85e8-9934466019b8" Jun 11 12:53:42.824028 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:42.823936 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T12:53:42.723080309Z","UUID":"72557788-c07e-41ae-9e86-1d2f377e8673","Handler":null,"Name":"","Endpoint":""} Jun 11 12:53:42.825696 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:42.825653 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 12:53:42.825805 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:42.825705 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 12:53:42.975785 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:42.975743 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfl2p" event={"ID":"b59938c4-f965-43fe-a109-837198e91085","Type":"ContainerStarted","Data":"f81a2a7bd7bee1ae0f8368fd94c3d0769508d53eb13b92106cf29538fadec540"} Jun 11 12:53:42.978757 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:42.978553 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" event={"ID":"a1f8a5ba-4d3e-41bf-931f-ad49b5259328","Type":"ContainerStarted","Data":"c33e517221803a226b8e01eae2dc453fe964c8e832945dd002aedb2c093e88fc"} Jun 11 12:53:42.978855 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:42.978810 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" event={"ID":"a1f8a5ba-4d3e-41bf-931f-ad49b5259328","Type":"ContainerStarted","Data":"4ee2d10df35a7e85ca2e25265f01f4ae36d9aca65cc829154dc097ff6ba7669d"} Jun 11 12:53:42.978891 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:42.978864 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" event={"ID":"a1f8a5ba-4d3e-41bf-931f-ad49b5259328","Type":"ContainerStarted","Data":"7493b7ebe11cf4d2000b32e482f44d515b36d3f14c370224d6283d54c8073f00"} Jun 11 12:53:42.978931 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:42.978918 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" event={"ID":"a1f8a5ba-4d3e-41bf-931f-ad49b5259328","Type":"ContainerStarted","Data":"e86c23b920ceb794fc9631f0a8cc1cedfb207464209aa564c01afd6ea104522a"} Jun 11 12:53:43.985305 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:43.984652 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" event={"ID":"a1f8a5ba-4d3e-41bf-931f-ad49b5259328","Type":"ContainerStarted","Data":"0e4566310f1c446f6898bbe04baf9f14a0061c4ba4f0466d4c609dec6bced0f2"} Jun 11 12:53:43.985305 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:43.984762 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" event={"ID":"a1f8a5ba-4d3e-41bf-931f-ad49b5259328","Type":"ContainerStarted","Data":"93aefd3a84f54a76513ef706fd4a71c6a545c6981dcaa9553a7c827be7a430a4"} Jun 11 12:53:44.818662 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:44.818620 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdklg" Jun 11 12:53:44.818854 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:44.818620 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jd6lc" Jun 11 12:53:44.818854 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:44.818747 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdklg" podUID="91e0efc4-f28a-4e27-8e50-99e6c424f288" Jun 11 12:53:44.818854 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:44.818620 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dl6mx" Jun 11 12:53:44.819019 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:44.818820 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jd6lc" podUID="5540735c-30f1-4071-8ca5-86c1d43d1315" Jun 11 12:53:44.819019 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:44.818920 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dl6mx" podUID="b3b5dc2f-8831-4790-85e8-9934466019b8" Jun 11 12:53:44.989061 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:44.989022 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfl2p" event={"ID":"b59938c4-f965-43fe-a109-837198e91085","Type":"ContainerStarted","Data":"f9e2f300228f97037448b6662d3bb676e22d4305c55daf9c1fd5447379c3fbdf"} Jun 11 12:53:45.008992 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:45.008940 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rfl2p" podStartSLOduration=5.078875261 podStartE2EDuration="25.008922104s" totalImagesPullingTime="19.930046843s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:53:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:53:45.008509464 +0000 UTC m=+24.655031404" watchObservedRunningTime="2026-06-11 12:53:45.008922104 +0000 UTC m=+24.655444047" Jun 11 12:53:46.819673 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:46.819636 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jd6lc" Jun 11 12:53:46.819673 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:46.819677 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dl6mx" Jun 11 12:53:46.820107 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:46.819636 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdklg" Jun 11 12:53:46.820107 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:46.819771 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jd6lc" podUID="5540735c-30f1-4071-8ca5-86c1d43d1315" Jun 11 12:53:46.820107 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:46.819822 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dl6mx" podUID="b3b5dc2f-8831-4790-85e8-9934466019b8" Jun 11 12:53:46.820107 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:46.819922 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdklg" podUID="91e0efc4-f28a-4e27-8e50-99e6c424f288" Jun 11 12:53:46.997033 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:46.996944 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" event={"ID":"a1f8a5ba-4d3e-41bf-931f-ad49b5259328","Type":"ContainerStarted","Data":"da4332193c06818a790d1bbbdc66738f20ae20bdbcb7a6ff3e692646ef052706"} Jun 11 12:53:46.998597 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:46.998569 2558 generic.go:356] "Generic (PLEG): container finished" podID="70f746b8-9a69-4b2c-86b5-95632730e3c8" containerID="ea1da3dd20009f8689dc94a65f1e0b3581e737c3ec3426b89aec501ea54e9844" exitCode=0 Jun 11 12:53:46.998700 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:46.998614 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zxx5s" event={"ID":"70f746b8-9a69-4b2c-86b5-95632730e3c8","Type":"ContainerDied","Data":"ea1da3dd20009f8689dc94a65f1e0b3581e737c3ec3426b89aec501ea54e9844"} Jun 11 12:53:48.818936 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:48.818851 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dl6mx" Jun 11 12:53:48.818936 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:48.818878 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jd6lc" Jun 11 12:53:48.819401 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:48.818851 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdklg" Jun 11 12:53:48.819401 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:48.818973 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dl6mx" podUID="b3b5dc2f-8831-4790-85e8-9934466019b8" Jun 11 12:53:48.819401 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:48.819027 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdklg" podUID="91e0efc4-f28a-4e27-8e50-99e6c424f288" Jun 11 12:53:48.819401 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:48.819144 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jd6lc" podUID="5540735c-30f1-4071-8ca5-86c1d43d1315" Jun 11 12:53:49.006463 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:49.006429 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" event={"ID":"a1f8a5ba-4d3e-41bf-931f-ad49b5259328","Type":"ContainerStarted","Data":"cfb3c079b4891e4177e34bcc3459ec6d75cfaef37ebd6a98846ea5da06b03a4a"} Jun 11 12:53:49.006696 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:49.006671 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:49.008848 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:49.008814 2558 generic.go:356] "Generic (PLEG): container finished" podID="70f746b8-9a69-4b2c-86b5-95632730e3c8" containerID="fc1741d52493e588a19bcfaa97c2fe8fcb3f27da34cde14ff02d6ebb4b89817d" exitCode=0 Jun 11 12:53:49.008941 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:49.008860 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zxx5s" event={"ID":"70f746b8-9a69-4b2c-86b5-95632730e3c8","Type":"ContainerDied","Data":"fc1741d52493e588a19bcfaa97c2fe8fcb3f27da34cde14ff02d6ebb4b89817d"} Jun 11 12:53:49.023266 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:49.023241 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:49.036246 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:49.035872 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" podStartSLOduration=9.047700214 podStartE2EDuration="28.035851455s" totalImagesPullingTime="18.988151241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:53:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:53:49.032977837 +0000 UTC m=+28.679499790" watchObservedRunningTime="2026-06-11 12:53:49.035851455 +0000 UTC m=+28.682373377" Jun 11 12:53:50.011343 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:50.011089 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:50.011694 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:50.011452 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:50.025623 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:50.025595 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:53:50.575262 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:50.575231 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:53:50.675473 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:50.675445 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:53:50.819540 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:50.819514 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdklg" Jun 11 12:53:50.819714 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:50.819604 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdklg" podUID="91e0efc4-f28a-4e27-8e50-99e6c424f288" Jun 11 12:53:50.819714 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:50.819627 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dl6mx" Jun 11 12:53:50.819822 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:50.819729 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dl6mx" podUID="b3b5dc2f-8831-4790-85e8-9934466019b8" Jun 11 12:53:50.819822 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:50.819769 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jd6lc" Jun 11 12:53:50.819933 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:50.819856 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jd6lc" podUID="5540735c-30f1-4071-8ca5-86c1d43d1315" Jun 11 12:53:51.015673 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:51.015636 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gdklg"] Jun 11 12:53:51.016540 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:51.016330 2558 generic.go:356] "Generic (PLEG): container finished" podID="70f746b8-9a69-4b2c-86b5-95632730e3c8" containerID="7cce3289f5f57f9ada33a3f8b83720e925ea821281f2d2aa0f10d53abc5978c3" exitCode=0 Jun 11 12:53:51.016540 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:51.016466 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zxx5s" event={"ID":"70f746b8-9a69-4b2c-86b5-95632730e3c8","Type":"ContainerDied","Data":"7cce3289f5f57f9ada33a3f8b83720e925ea821281f2d2aa0f10d53abc5978c3"} Jun 11 12:53:51.016540 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:51.016516 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jd6lc"] Jun 11 12:53:51.017377 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:51.017306 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dl6mx"] Jun 11 12:53:51.017377 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:51.017333 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdklg" Jun 11 12:53:51.017495 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:51.017439 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdklg" podUID="91e0efc4-f28a-4e27-8e50-99e6c424f288" Jun 11 12:53:51.017495 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:51.017453 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dl6mx" Jun 11 12:53:51.017495 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:51.017446 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jd6lc" Jun 11 12:53:51.017728 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:51.017551 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dl6mx" podUID="b3b5dc2f-8831-4790-85e8-9934466019b8" Jun 11 12:53:51.017728 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:51.017635 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jd6lc" podUID="5540735c-30f1-4071-8ca5-86c1d43d1315" Jun 11 12:53:52.819432 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:52.819397 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdklg" Jun 11 12:53:52.819994 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:52.819438 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jd6lc" Jun 11 12:53:52.819994 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:52.819437 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dl6mx" Jun 11 12:53:52.819994 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:52.819527 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdklg" podUID="91e0efc4-f28a-4e27-8e50-99e6c424f288" Jun 11 12:53:52.819994 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:52.819624 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jd6lc" podUID="5540735c-30f1-4071-8ca5-86c1d43d1315" Jun 11 12:53:52.819994 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:52.819689 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dl6mx" podUID="b3b5dc2f-8831-4790-85e8-9934466019b8" Jun 11 12:53:54.516917 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:54.516716 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5540735c-30f1-4071-8ca5-86c1d43d1315-metrics-certs\") pod \"network-metrics-daemon-jd6lc\" (UID: \"5540735c-30f1-4071-8ca5-86c1d43d1315\") " pod="openshift-multus/network-metrics-daemon-jd6lc" Jun 11 12:53:54.517426 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:54.516972 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b3b5dc2f-8831-4790-85e8-9934466019b8-original-pull-secret\") pod \"global-pull-secret-syncer-dl6mx\" (UID: \"b3b5dc2f-8831-4790-85e8-9934466019b8\") " pod="kube-system/global-pull-secret-syncer-dl6mx" Jun 11 12:53:54.517426 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:54.516879 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:53:54.517426 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:54.517041 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5540735c-30f1-4071-8ca5-86c1d43d1315-metrics-certs podName:5540735c-30f1-4071-8ca5-86c1d43d1315 nodeName:}" failed. No retries permitted until 2026-06-11 12:54:26.517024825 +0000 UTC m=+66.163546746 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5540735c-30f1-4071-8ca5-86c1d43d1315-metrics-certs") pod "network-metrics-daemon-jd6lc" (UID: "5540735c-30f1-4071-8ca5-86c1d43d1315") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 12:53:54.517426 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:54.517061 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 12:53:54.517426 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:54.517111 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3b5dc2f-8831-4790-85e8-9934466019b8-original-pull-secret podName:b3b5dc2f-8831-4790-85e8-9934466019b8 nodeName:}" failed. No retries permitted until 2026-06-11 12:54:26.517099529 +0000 UTC m=+66.163621449 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b3b5dc2f-8831-4790-85e8-9934466019b8-original-pull-secret") pod "global-pull-secret-syncer-dl6mx" (UID: "b3b5dc2f-8831-4790-85e8-9934466019b8") : object "kube-system"/"original-pull-secret" not registered Jun 11 12:53:54.618202 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:54.618168 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb4q5\" (UniqueName: \"kubernetes.io/projected/91e0efc4-f28a-4e27-8e50-99e6c424f288-kube-api-access-hb4q5\") pod \"network-check-target-gdklg\" (UID: \"91e0efc4-f28a-4e27-8e50-99e6c424f288\") " pod="openshift-network-diagnostics/network-check-target-gdklg" Jun 11 12:53:54.618386 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:54.618270 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 12:53:54.618386 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:54.618294 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 12:53:54.618386 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:54.618307 2558 projected.go:196] Error preparing data for projected volume kube-api-access-hb4q5 for pod openshift-network-diagnostics/network-check-target-gdklg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:53:54.618386 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:54.618358 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91e0efc4-f28a-4e27-8e50-99e6c424f288-kube-api-access-hb4q5 podName:91e0efc4-f28a-4e27-8e50-99e6c424f288 nodeName:}" failed. No retries permitted until 2026-06-11 12:54:26.61834462 +0000 UTC m=+66.264866543 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hb4q5" (UniqueName: "kubernetes.io/projected/91e0efc4-f28a-4e27-8e50-99e6c424f288-kube-api-access-hb4q5") pod "network-check-target-gdklg" (UID: "91e0efc4-f28a-4e27-8e50-99e6c424f288") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 12:53:54.819226 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:54.819133 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dl6mx" Jun 11 12:53:54.819412 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:54.819133 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jd6lc" Jun 11 12:53:54.819412 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:54.819275 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dl6mx" podUID="b3b5dc2f-8831-4790-85e8-9934466019b8" Jun 11 12:53:54.819412 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:54.819366 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jd6lc" podUID="5540735c-30f1-4071-8ca5-86c1d43d1315" Jun 11 12:53:54.819412 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:54.819136 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdklg" Jun 11 12:53:54.819567 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:54.819463 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdklg" podUID="91e0efc4-f28a-4e27-8e50-99e6c424f288" Jun 11 12:53:55.195296 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.195262 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-120.ec2.internal" event="NodeReady" Jun 11 12:53:55.195487 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.195387 2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 12:53:55.242846 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.242808 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-w6vpc"] Jun 11 12:53:55.264715 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.264687 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xjmtd"] Jun 11 12:53:55.264885 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.264835 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w6vpc" Jun 11 12:53:55.267601 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.267583 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 12:53:55.267829 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.267813 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 12:53:55.268131 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.268115 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cjs9v\"" Jun 11 12:53:55.287061 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.287037 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w6vpc"] Jun 11 12:53:55.287061 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.287073 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xjmtd"] Jun 11 12:53:55.287241 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.287178 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xjmtd" Jun 11 12:53:55.289620 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.289600 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-s5krz\"" Jun 11 12:53:55.289874 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.289856 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 12:53:55.289975 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.289886 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 12:53:55.289975 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.289898 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 12:53:55.372108 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.372064 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:53:55.424124 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.424090 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b06d4318-3ca7-4101-8f86-d1454c9b82cb-config-volume\") pod \"dns-default-w6vpc\" (UID: \"b06d4318-3ca7-4101-8f86-d1454c9b82cb\") " pod="openshift-dns/dns-default-w6vpc" Jun 11 12:53:55.424289 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.424144 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c9a9482-6765-4d5f-b21b-37c26d9be26d-cert\") pod \"ingress-canary-xjmtd\" (UID: \"8c9a9482-6765-4d5f-b21b-37c26d9be26d\") " pod="openshift-ingress-canary/ingress-canary-xjmtd" Jun 11 12:53:55.424289 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.424185 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b06d4318-3ca7-4101-8f86-d1454c9b82cb-metrics-tls\") pod \"dns-default-w6vpc\" (UID: \"b06d4318-3ca7-4101-8f86-d1454c9b82cb\") " pod="openshift-dns/dns-default-w6vpc" Jun 11 12:53:55.424289 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.424208 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phs8l\" (UniqueName: \"kubernetes.io/projected/b06d4318-3ca7-4101-8f86-d1454c9b82cb-kube-api-access-phs8l\") pod \"dns-default-w6vpc\" (UID: \"b06d4318-3ca7-4101-8f86-d1454c9b82cb\") " pod="openshift-dns/dns-default-w6vpc" Jun 11 12:53:55.424289 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.424269 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b06d4318-3ca7-4101-8f86-d1454c9b82cb-tmp-dir\") pod \"dns-default-w6vpc\" (UID: \"b06d4318-3ca7-4101-8f86-d1454c9b82cb\") " pod="openshift-dns/dns-default-w6vpc" Jun 11 12:53:55.424417 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.424312 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7qmz\" (UniqueName: \"kubernetes.io/projected/8c9a9482-6765-4d5f-b21b-37c26d9be26d-kube-api-access-s7qmz\") pod \"ingress-canary-xjmtd\" (UID: \"8c9a9482-6765-4d5f-b21b-37c26d9be26d\") " pod="openshift-ingress-canary/ingress-canary-xjmtd" Jun 11 12:53:55.471281 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.471257 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:53:55.524863 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.524837 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phs8l\" (UniqueName: \"kubernetes.io/projected/b06d4318-3ca7-4101-8f86-d1454c9b82cb-kube-api-access-phs8l\") pod \"dns-default-w6vpc\" (UID: \"b06d4318-3ca7-4101-8f86-d1454c9b82cb\") " pod="openshift-dns/dns-default-w6vpc" Jun 11 12:53:55.525205 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.524878 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b06d4318-3ca7-4101-8f86-d1454c9b82cb-tmp-dir\") pod \"dns-default-w6vpc\" (UID: \"b06d4318-3ca7-4101-8f86-d1454c9b82cb\") " pod="openshift-dns/dns-default-w6vpc" Jun 11 12:53:55.525205 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.524992 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7qmz\" (UniqueName: \"kubernetes.io/projected/8c9a9482-6765-4d5f-b21b-37c26d9be26d-kube-api-access-s7qmz\") pod \"ingress-canary-xjmtd\" (UID: \"8c9a9482-6765-4d5f-b21b-37c26d9be26d\") " pod="openshift-ingress-canary/ingress-canary-xjmtd" Jun 11 12:53:55.525205 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.525050 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b06d4318-3ca7-4101-8f86-d1454c9b82cb-config-volume\") pod \"dns-default-w6vpc\" (UID: \"b06d4318-3ca7-4101-8f86-d1454c9b82cb\") " pod="openshift-dns/dns-default-w6vpc" Jun 11 12:53:55.525205 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.525099 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c9a9482-6765-4d5f-b21b-37c26d9be26d-cert\") pod \"ingress-canary-xjmtd\" (UID: \"8c9a9482-6765-4d5f-b21b-37c26d9be26d\") " pod="openshift-ingress-canary/ingress-canary-xjmtd" Jun 11 12:53:55.525205 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.525117 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b06d4318-3ca7-4101-8f86-d1454c9b82cb-tmp-dir\") pod \"dns-default-w6vpc\" (UID: \"b06d4318-3ca7-4101-8f86-d1454c9b82cb\") " pod="openshift-dns/dns-default-w6vpc" Jun 11 12:53:55.525205 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.525127 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b06d4318-3ca7-4101-8f86-d1454c9b82cb-metrics-tls\") pod \"dns-default-w6vpc\" (UID: \"b06d4318-3ca7-4101-8f86-d1454c9b82cb\") " pod="openshift-dns/dns-default-w6vpc" Jun 11 12:53:55.525491 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:55.525217 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 12:53:55.525491 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:55.525274 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b06d4318-3ca7-4101-8f86-d1454c9b82cb-metrics-tls podName:b06d4318-3ca7-4101-8f86-d1454c9b82cb nodeName:}" failed. No retries permitted until 2026-06-11 12:53:56.025256507 +0000 UTC m=+35.671778428 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b06d4318-3ca7-4101-8f86-d1454c9b82cb-metrics-tls") pod "dns-default-w6vpc" (UID: "b06d4318-3ca7-4101-8f86-d1454c9b82cb") : secret "dns-default-metrics-tls" not found Jun 11 12:53:55.525596 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.525580 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b06d4318-3ca7-4101-8f86-d1454c9b82cb-config-volume\") pod \"dns-default-w6vpc\" (UID: \"b06d4318-3ca7-4101-8f86-d1454c9b82cb\") " pod="openshift-dns/dns-default-w6vpc" Jun 11 12:53:55.528944 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.528923 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c9a9482-6765-4d5f-b21b-37c26d9be26d-cert\") pod \"ingress-canary-xjmtd\" (UID: \"8c9a9482-6765-4d5f-b21b-37c26d9be26d\") " pod="openshift-ingress-canary/ingress-canary-xjmtd" Jun 11 12:53:55.535746 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.535722 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phs8l\" (UniqueName: \"kubernetes.io/projected/b06d4318-3ca7-4101-8f86-d1454c9b82cb-kube-api-access-phs8l\") pod \"dns-default-w6vpc\" (UID: \"b06d4318-3ca7-4101-8f86-d1454c9b82cb\") " pod="openshift-dns/dns-default-w6vpc" Jun 11 12:53:55.535896 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.535778 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7qmz\" (UniqueName: \"kubernetes.io/projected/8c9a9482-6765-4d5f-b21b-37c26d9be26d-kube-api-access-s7qmz\") pod \"ingress-canary-xjmtd\" (UID: \"8c9a9482-6765-4d5f-b21b-37c26d9be26d\") " pod="openshift-ingress-canary/ingress-canary-xjmtd" Jun 11 12:53:55.595594 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.595560 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xjmtd" Jun 11 12:53:55.622026 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.621982 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:53:55.676105 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.676077 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:53:55.752768 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:55.752738 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xjmtd"] Jun 11 12:53:55.756433 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:53:55.756389 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c9a9482_6765_4d5f_b21b_37c26d9be26d.slice/crio-1a3386330f71e59f08725e890a097d0c83a27a6e92ae655ee45a32a1c01a386d WatchSource:0}: Error finding container 1a3386330f71e59f08725e890a097d0c83a27a6e92ae655ee45a32a1c01a386d: Status 404 returned error can't find the container with id 1a3386330f71e59f08725e890a097d0c83a27a6e92ae655ee45a32a1c01a386d Jun 11 12:53:56.028681 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:56.028597 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b06d4318-3ca7-4101-8f86-d1454c9b82cb-metrics-tls\") pod \"dns-default-w6vpc\" (UID: \"b06d4318-3ca7-4101-8f86-d1454c9b82cb\") " pod="openshift-dns/dns-default-w6vpc" Jun 11 12:53:56.028835 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:56.028758 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 12:53:56.028835 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:56.028825 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b06d4318-3ca7-4101-8f86-d1454c9b82cb-metrics-tls podName:b06d4318-3ca7-4101-8f86-d1454c9b82cb nodeName:}" failed. No retries permitted until 2026-06-11 12:53:57.028809517 +0000 UTC m=+36.675331441 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b06d4318-3ca7-4101-8f86-d1454c9b82cb-metrics-tls") pod "dns-default-w6vpc" (UID: "b06d4318-3ca7-4101-8f86-d1454c9b82cb") : secret "dns-default-metrics-tls" not found Jun 11 12:53:56.036129 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:56.036096 2558 generic.go:356] "Generic (PLEG): container finished" podID="70f746b8-9a69-4b2c-86b5-95632730e3c8" containerID="c189665dae55cb223ba80b7b8a6a45cfefb2b8490e41851645d327154b4d8aa9" exitCode=0 Jun 11 12:53:56.036362 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:56.036182 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zxx5s" event={"ID":"70f746b8-9a69-4b2c-86b5-95632730e3c8","Type":"ContainerDied","Data":"c189665dae55cb223ba80b7b8a6a45cfefb2b8490e41851645d327154b4d8aa9"} Jun 11 12:53:56.037327 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:56.037303 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xjmtd" event={"ID":"8c9a9482-6765-4d5f-b21b-37c26d9be26d","Type":"ContainerStarted","Data":"1a3386330f71e59f08725e890a097d0c83a27a6e92ae655ee45a32a1c01a386d"} Jun 11 12:53:56.819444 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:56.819366 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdklg" Jun 11 12:53:56.819865 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:56.819365 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dl6mx" Jun 11 12:53:56.819865 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:56.819366 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jd6lc" Jun 11 12:53:56.822466 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:56.822448 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 12:53:56.822466 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:56.822458 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 12:53:56.823409 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:56.823383 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 12:53:56.823409 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:56.823393 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2tv44\"" Jun 11 12:53:56.823578 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:56.823455 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zkphv\"" Jun 11 12:53:56.823578 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:56.823369 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 12:53:57.038339 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:57.038303 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b06d4318-3ca7-4101-8f86-d1454c9b82cb-metrics-tls\") pod \"dns-default-w6vpc\" (UID: \"b06d4318-3ca7-4101-8f86-d1454c9b82cb\") " pod="openshift-dns/dns-default-w6vpc" Jun 11 12:53:57.038516 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:57.038476 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 12:53:57.038569 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:57.038556 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b06d4318-3ca7-4101-8f86-d1454c9b82cb-metrics-tls podName:b06d4318-3ca7-4101-8f86-d1454c9b82cb nodeName:}" failed. No retries permitted until 2026-06-11 12:53:59.038533094 +0000 UTC m=+38.685055027 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b06d4318-3ca7-4101-8f86-d1454c9b82cb-metrics-tls") pod "dns-default-w6vpc" (UID: "b06d4318-3ca7-4101-8f86-d1454c9b82cb") : secret "dns-default-metrics-tls" not found Jun 11 12:53:57.043063 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:57.043036 2558 generic.go:356] "Generic (PLEG): container finished" podID="70f746b8-9a69-4b2c-86b5-95632730e3c8" containerID="49eb35c3c20a17d2085c883d741c3b8e3bb061594224f40ad1ea4293178f69a6" exitCode=0 Jun 11 12:53:57.043228 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:57.043105 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zxx5s" event={"ID":"70f746b8-9a69-4b2c-86b5-95632730e3c8","Type":"ContainerDied","Data":"49eb35c3c20a17d2085c883d741c3b8e3bb061594224f40ad1ea4293178f69a6"} Jun 11 12:53:57.051528 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:57.051505 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:53:57.109052 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:57.109014 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:53:58.048781 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:58.048742 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zxx5s" event={"ID":"70f746b8-9a69-4b2c-86b5-95632730e3c8","Type":"ContainerStarted","Data":"3d7983d0ef108a1a242f0fa6d6a0a122c5b011d2f227c135471f01e631f04630"} Jun 11 12:53:58.050072 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:58.050043 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xjmtd" event={"ID":"8c9a9482-6765-4d5f-b21b-37c26d9be26d","Type":"ContainerStarted","Data":"cf5406e34fc20eea9f57d43091020adad1710ff8de6a3fb9dc19a260c90f2bb1"} Jun 11 12:53:58.072418 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:58.072362 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zxx5s" podStartSLOduration=8.164709722 podStartE2EDuration="37.072345635s" totalImagesPullingTime="28.907635913s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:53:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:53:58.070691922 +0000 UTC m=+37.717213865" watchObservedRunningTime="2026-06-11 12:53:58.072345635 +0000 UTC m=+37.718867577" Jun 11 12:53:58.087711 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:58.087655 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xjmtd" podStartSLOduration=1.264758637 podStartE2EDuration="3.087639247s" totalImagesPullingTime="1.82288061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:53:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:53:58.08697409 +0000 UTC m=+37.733496033" watchObservedRunningTime="2026-06-11 12:53:58.087639247 +0000 UTC m=+37.734161167" Jun 11 12:53:58.175872 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:58.175839 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:53:58.275202 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:58.275148 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:53:58.328338 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:58.328226 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:53:59.053247 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:53:59.053218 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b06d4318-3ca7-4101-8f86-d1454c9b82cb-metrics-tls\") pod \"dns-default-w6vpc\" (UID: \"b06d4318-3ca7-4101-8f86-d1454c9b82cb\") " pod="openshift-dns/dns-default-w6vpc" Jun 11 12:53:59.053699 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:59.053398 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 12:53:59.053699 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:53:59.053476 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b06d4318-3ca7-4101-8f86-d1454c9b82cb-metrics-tls podName:b06d4318-3ca7-4101-8f86-d1454c9b82cb nodeName:}" failed. No retries permitted until 2026-06-11 12:54:03.053454003 +0000 UTC m=+42.699975940 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b06d4318-3ca7-4101-8f86-d1454c9b82cb-metrics-tls") pod "dns-default-w6vpc" (UID: "b06d4318-3ca7-4101-8f86-d1454c9b82cb") : secret "dns-default-metrics-tls" not found Jun 11 12:54:02.507591 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:02.507560 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:54:02.565268 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:02.565220 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:54:03.080847 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:03.080810 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b06d4318-3ca7-4101-8f86-d1454c9b82cb-metrics-tls\") pod \"dns-default-w6vpc\" (UID: \"b06d4318-3ca7-4101-8f86-d1454c9b82cb\") " pod="openshift-dns/dns-default-w6vpc" Jun 11 12:54:03.081018 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:54:03.080931 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 12:54:03.081018 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:54:03.080983 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b06d4318-3ca7-4101-8f86-d1454c9b82cb-metrics-tls podName:b06d4318-3ca7-4101-8f86-d1454c9b82cb nodeName:}" failed. No retries permitted until 2026-06-11 12:54:11.080970236 +0000 UTC m=+50.727492157 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b06d4318-3ca7-4101-8f86-d1454c9b82cb-metrics-tls") pod "dns-default-w6vpc" (UID: "b06d4318-3ca7-4101-8f86-d1454c9b82cb") : secret "dns-default-metrics-tls" not found Jun 11 12:54:11.141904 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:11.141866 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b06d4318-3ca7-4101-8f86-d1454c9b82cb-metrics-tls\") pod \"dns-default-w6vpc\" (UID: \"b06d4318-3ca7-4101-8f86-d1454c9b82cb\") " pod="openshift-dns/dns-default-w6vpc" Jun 11 12:54:11.142458 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:54:11.141994 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 12:54:11.142458 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:54:11.142045 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b06d4318-3ca7-4101-8f86-d1454c9b82cb-metrics-tls podName:b06d4318-3ca7-4101-8f86-d1454c9b82cb nodeName:}" failed. No retries permitted until 2026-06-11 12:54:27.142031869 +0000 UTC m=+66.788553790 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b06d4318-3ca7-4101-8f86-d1454c9b82cb-metrics-tls") pod "dns-default-w6vpc" (UID: "b06d4318-3ca7-4101-8f86-d1454c9b82cb") : secret "dns-default-metrics-tls" not found Jun 11 12:54:22.030324 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:22.030295 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5njr6" Jun 11 12:54:22.150781 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:22.150743 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:54:22.250859 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:22.250822 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:54:26.543482 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:26.543440 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5540735c-30f1-4071-8ca5-86c1d43d1315-metrics-certs\") pod \"network-metrics-daemon-jd6lc\" (UID: \"5540735c-30f1-4071-8ca5-86c1d43d1315\") " pod="openshift-multus/network-metrics-daemon-jd6lc" Jun 11 12:54:26.543969 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:26.543507 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b3b5dc2f-8831-4790-85e8-9934466019b8-original-pull-secret\") pod \"global-pull-secret-syncer-dl6mx\" (UID: \"b3b5dc2f-8831-4790-85e8-9934466019b8\") " pod="kube-system/global-pull-secret-syncer-dl6mx" Jun 11 12:54:26.546287 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:26.546267 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 12:54:26.546386 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:26.546368 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 12:54:26.554598 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:54:26.554578 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 12:54:26.554654 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:54:26.554645 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5540735c-30f1-4071-8ca5-86c1d43d1315-metrics-certs podName:5540735c-30f1-4071-8ca5-86c1d43d1315 nodeName:}" failed. No retries permitted until 2026-06-11 12:55:30.554630404 +0000 UTC m=+130.201152323 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5540735c-30f1-4071-8ca5-86c1d43d1315-metrics-certs") pod "network-metrics-daemon-jd6lc" (UID: "5540735c-30f1-4071-8ca5-86c1d43d1315") : secret "metrics-daemon-secret" not found Jun 11 12:54:26.556719 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:26.556696 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b3b5dc2f-8831-4790-85e8-9934466019b8-original-pull-secret\") pod \"global-pull-secret-syncer-dl6mx\" (UID: \"b3b5dc2f-8831-4790-85e8-9934466019b8\") " pod="kube-system/global-pull-secret-syncer-dl6mx" Jun 11 12:54:26.644552 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:26.644515 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb4q5\" (UniqueName: \"kubernetes.io/projected/91e0efc4-f28a-4e27-8e50-99e6c424f288-kube-api-access-hb4q5\") pod \"network-check-target-gdklg\" (UID: \"91e0efc4-f28a-4e27-8e50-99e6c424f288\") " pod="openshift-network-diagnostics/network-check-target-gdklg" Jun 11 12:54:26.647689 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:26.647667 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 12:54:26.657165 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:26.657121 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 12:54:26.667338 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:26.667310 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb4q5\" (UniqueName: \"kubernetes.io/projected/91e0efc4-f28a-4e27-8e50-99e6c424f288-kube-api-access-hb4q5\") pod \"network-check-target-gdklg\" (UID: \"91e0efc4-f28a-4e27-8e50-99e6c424f288\") " pod="openshift-network-diagnostics/network-check-target-gdklg" Jun 11 12:54:26.834326 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:26.834250 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2tv44\"" Jun 11 12:54:26.836085 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:26.836070 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dl6mx" Jun 11 12:54:26.841597 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:26.841579 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdklg" Jun 11 12:54:26.974606 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:26.974576 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gdklg"] Jun 11 12:54:26.977878 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:54:26.977851 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91e0efc4_f28a_4e27_8e50_99e6c424f288.slice/crio-f2a03b20bea7e296044cdde3ef487da2014c629671555f99a5d90b4200c4c1eb WatchSource:0}: Error finding container f2a03b20bea7e296044cdde3ef487da2014c629671555f99a5d90b4200c4c1eb: Status 404 returned error can't find the container with id f2a03b20bea7e296044cdde3ef487da2014c629671555f99a5d90b4200c4c1eb Jun 11 12:54:27.005905 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:27.005874 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dl6mx"] Jun 11 12:54:27.008909 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:54:27.008881 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3b5dc2f_8831_4790_85e8_9934466019b8.slice/crio-2ea8e3f7f2dfda7897620fce19673bf4b78703a52a4df1b8eaba062c23ca5178 WatchSource:0}: Error finding container 2ea8e3f7f2dfda7897620fce19673bf4b78703a52a4df1b8eaba062c23ca5178: Status 404 returned error can't find the container with id 2ea8e3f7f2dfda7897620fce19673bf4b78703a52a4df1b8eaba062c23ca5178 Jun 11 12:54:27.119602 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:27.119570 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gdklg" event={"ID":"91e0efc4-f28a-4e27-8e50-99e6c424f288","Type":"ContainerStarted","Data":"f2a03b20bea7e296044cdde3ef487da2014c629671555f99a5d90b4200c4c1eb"} Jun 11 12:54:27.120585 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:27.120561 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dl6mx" event={"ID":"b3b5dc2f-8831-4790-85e8-9934466019b8","Type":"ContainerStarted","Data":"2ea8e3f7f2dfda7897620fce19673bf4b78703a52a4df1b8eaba062c23ca5178"} Jun 11 12:54:27.149037 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:27.149005 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b06d4318-3ca7-4101-8f86-d1454c9b82cb-metrics-tls\") pod \"dns-default-w6vpc\" (UID: \"b06d4318-3ca7-4101-8f86-d1454c9b82cb\") " pod="openshift-dns/dns-default-w6vpc" Jun 11 12:54:27.149212 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:54:27.149110 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 12:54:27.149212 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:54:27.149180 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b06d4318-3ca7-4101-8f86-d1454c9b82cb-metrics-tls podName:b06d4318-3ca7-4101-8f86-d1454c9b82cb nodeName:}" failed. No retries permitted until 2026-06-11 12:54:59.149145273 +0000 UTC m=+98.795667193 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b06d4318-3ca7-4101-8f86-d1454c9b82cb-metrics-tls") pod "dns-default-w6vpc" (UID: "b06d4318-3ca7-4101-8f86-d1454c9b82cb") : secret "dns-default-metrics-tls" not found Jun 11 12:54:30.130821 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:30.130775 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gdklg" event={"ID":"91e0efc4-f28a-4e27-8e50-99e6c424f288","Type":"ContainerStarted","Data":"0244516ac235ae83bcf7eccedc7c628f760f5abce9df0bfae9258d6f2e3669c1"} Jun 11 12:54:30.131270 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:30.130868 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gdklg" Jun 11 12:54:30.146881 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:30.146822 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gdklg" podStartSLOduration=67.322741823 podStartE2EDuration="1m10.146799621s" totalImagesPullingTime="2.824057798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:53:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:54:30.146043654 +0000 UTC m=+69.792565610" watchObservedRunningTime="2026-06-11 12:54:30.146799621 +0000 UTC m=+69.793321544" Jun 11 12:54:32.137539 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:32.137411 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dl6mx" event={"ID":"b3b5dc2f-8831-4790-85e8-9934466019b8","Type":"ContainerStarted","Data":"6e7be9f0136636e78fdebbea8956b227b4692b1434975eac5e140b75cdc245e1"} Jun 11 12:54:32.153363 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:32.153307 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dl6mx" podStartSLOduration=66.894470595 podStartE2EDuration="1m11.153291282s" totalImagesPullingTime="4.258820687s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:53:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:54:32.152987065 +0000 UTC m=+71.799509008" watchObservedRunningTime="2026-06-11 12:54:32.153291282 +0000 UTC m=+71.799813225" Jun 11 12:54:57.283616 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:57.283580 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759687bbbb-ts74t"] Jun 11 12:54:57.286228 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:57.286209 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759687bbbb-ts74t" Jun 11 12:54:57.288603 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:57.288576 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 12:54:57.289846 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:57.289784 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 12:54:57.289947 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:57.289858 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-vb2h7\"" Jun 11 12:54:57.289947 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:57.289800 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 12:54:57.289947 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:57.289799 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 11 12:54:57.298000 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:57.297971 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759687bbbb-ts74t"] Jun 11 12:54:57.353408 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:57.353368 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhqv4\" (UniqueName: \"kubernetes.io/projected/76e09fd7-9609-406a-ac12-71fbb978d2a5-kube-api-access-bhqv4\") pod \"managed-serviceaccount-addon-agent-759687bbbb-ts74t\" (UID: \"76e09fd7-9609-406a-ac12-71fbb978d2a5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759687bbbb-ts74t" Jun 11 12:54:57.353576 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:57.353435 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/76e09fd7-9609-406a-ac12-71fbb978d2a5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-759687bbbb-ts74t\" (UID: \"76e09fd7-9609-406a-ac12-71fbb978d2a5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759687bbbb-ts74t" Jun 11 12:54:57.454558 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:57.454528 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhqv4\" (UniqueName: \"kubernetes.io/projected/76e09fd7-9609-406a-ac12-71fbb978d2a5-kube-api-access-bhqv4\") pod \"managed-serviceaccount-addon-agent-759687bbbb-ts74t\" (UID: \"76e09fd7-9609-406a-ac12-71fbb978d2a5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759687bbbb-ts74t" Jun 11 12:54:57.454667 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:57.454582 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/76e09fd7-9609-406a-ac12-71fbb978d2a5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-759687bbbb-ts74t\" (UID: \"76e09fd7-9609-406a-ac12-71fbb978d2a5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759687bbbb-ts74t" Jun 11 12:54:57.457056 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:57.457032 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/76e09fd7-9609-406a-ac12-71fbb978d2a5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-759687bbbb-ts74t\" (UID: \"76e09fd7-9609-406a-ac12-71fbb978d2a5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759687bbbb-ts74t" Jun 11 12:54:57.463121 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:57.463097 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhqv4\" (UniqueName: \"kubernetes.io/projected/76e09fd7-9609-406a-ac12-71fbb978d2a5-kube-api-access-bhqv4\") pod \"managed-serviceaccount-addon-agent-759687bbbb-ts74t\" (UID: \"76e09fd7-9609-406a-ac12-71fbb978d2a5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759687bbbb-ts74t" Jun 11 12:54:57.604322 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:57.604291 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759687bbbb-ts74t" Jun 11 12:54:57.723476 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:57.723440 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759687bbbb-ts74t"] Jun 11 12:54:57.727519 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:54:57.727491 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76e09fd7_9609_406a_ac12_71fbb978d2a5.slice/crio-f030820edf2f38f93f8c7fdbc55292da8905b69b2153b4a65af63e011b95f068 WatchSource:0}: Error finding container f030820edf2f38f93f8c7fdbc55292da8905b69b2153b4a65af63e011b95f068: Status 404 returned error can't find the container with id f030820edf2f38f93f8c7fdbc55292da8905b69b2153b4a65af63e011b95f068 Jun 11 12:54:58.195764 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:58.195730 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759687bbbb-ts74t" event={"ID":"76e09fd7-9609-406a-ac12-71fbb978d2a5","Type":"ContainerStarted","Data":"f030820edf2f38f93f8c7fdbc55292da8905b69b2153b4a65af63e011b95f068"} Jun 11 12:54:59.168420 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:54:59.168386 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b06d4318-3ca7-4101-8f86-d1454c9b82cb-metrics-tls\") pod \"dns-default-w6vpc\" (UID: \"b06d4318-3ca7-4101-8f86-d1454c9b82cb\") " pod="openshift-dns/dns-default-w6vpc" Jun 11 12:54:59.168814 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:54:59.168545 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 12:54:59.168814 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:54:59.168619 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b06d4318-3ca7-4101-8f86-d1454c9b82cb-metrics-tls podName:b06d4318-3ca7-4101-8f86-d1454c9b82cb nodeName:}" failed. No retries permitted until 2026-06-11 12:56:03.168596295 +0000 UTC m=+162.815118222 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b06d4318-3ca7-4101-8f86-d1454c9b82cb-metrics-tls") pod "dns-default-w6vpc" (UID: "b06d4318-3ca7-4101-8f86-d1454c9b82cb") : secret "dns-default-metrics-tls" not found Jun 11 12:55:01.136386 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:55:01.136357 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gdklg" Jun 11 12:55:01.205142 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:55:01.205105 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759687bbbb-ts74t" event={"ID":"76e09fd7-9609-406a-ac12-71fbb978d2a5","Type":"ContainerStarted","Data":"4c944a07ebb1fdd6dfa7a20e68290554e776b7317d872b0edf7a87b46b136bb3"} Jun 11 12:55:01.221573 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:55:01.221520 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759687bbbb-ts74t" podStartSLOduration=1.26865944 podStartE2EDuration="4.22150418s" totalImagesPullingTime="2.95284474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:54:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:55:01.220948005 +0000 UTC m=+100.867469968" watchObservedRunningTime="2026-06-11 12:55:01.22150418 +0000 UTC m=+100.868026122" Jun 11 12:55:30.581667 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:55:30.581628 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5540735c-30f1-4071-8ca5-86c1d43d1315-metrics-certs\") pod \"network-metrics-daemon-jd6lc\" (UID: \"5540735c-30f1-4071-8ca5-86c1d43d1315\") " pod="openshift-multus/network-metrics-daemon-jd6lc" Jun 11 12:55:30.582190 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:55:30.581742 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 12:55:30.582190 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:55:30.581803 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5540735c-30f1-4071-8ca5-86c1d43d1315-metrics-certs podName:5540735c-30f1-4071-8ca5-86c1d43d1315 nodeName:}" failed. No retries permitted until 2026-06-11 12:57:32.581788249 +0000 UTC m=+252.228310168 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5540735c-30f1-4071-8ca5-86c1d43d1315-metrics-certs") pod "network-metrics-daemon-jd6lc" (UID: "5540735c-30f1-4071-8ca5-86c1d43d1315") : secret "metrics-daemon-secret" not found Jun 11 12:55:30.767296 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:55:30.767261 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:55:58.273994 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:55:58.273943 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-w6vpc" podUID="b06d4318-3ca7-4101-8f86-d1454c9b82cb" Jun 11 12:55:58.336983 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:55:58.336957 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w6vpc" Jun 11 12:55:59.840906 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:55:59.840864 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-jd6lc" podUID="5540735c-30f1-4071-8ca5-86c1d43d1315" Jun 11 12:56:01.727055 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:01.727026 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:03.209466 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:03.209412 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b06d4318-3ca7-4101-8f86-d1454c9b82cb-metrics-tls\") pod \"dns-default-w6vpc\" (UID: \"b06d4318-3ca7-4101-8f86-d1454c9b82cb\") " pod="openshift-dns/dns-default-w6vpc" Jun 11 12:56:03.209854 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:03.209576 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 12:56:03.209854 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:03.209642 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b06d4318-3ca7-4101-8f86-d1454c9b82cb-metrics-tls podName:b06d4318-3ca7-4101-8f86-d1454c9b82cb nodeName:}" failed. No retries permitted until 2026-06-11 12:58:05.209625651 +0000 UTC m=+284.856147571 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b06d4318-3ca7-4101-8f86-d1454c9b82cb-metrics-tls") pod "dns-default-w6vpc" (UID: "b06d4318-3ca7-4101-8f86-d1454c9b82cb") : secret "dns-default-metrics-tls" not found Jun 11 12:56:12.819541 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:12.819502 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jd6lc" Jun 11 12:56:39.050630 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.050594 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-bccb87fdf-hn668"] Jun 11 12:56:39.052837 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.052817 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-fcf5bd6bf-qv5rz"] Jun 11 12:56:39.052949 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.052937 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-bccb87fdf-hn668" Jun 11 12:56:39.054929 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.054912 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" Jun 11 12:56:39.056356 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.056329 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 11 12:56:39.056456 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.056414 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 11 12:56:39.056538 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.056521 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 11 12:56:39.056659 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.056642 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-cxfrz\"" Jun 11 12:56:39.056755 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.056741 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 12:56:39.056949 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.056935 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 11 12:56:39.057292 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.057277 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 12:56:39.057445 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.057430 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 12:56:39.057521 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.057464 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 12:56:39.057521 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.057484 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lsrj5\"" Jun 11 12:56:39.059893 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.059862 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 12:56:39.064835 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.064818 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 12:56:39.082337 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.082312 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-fcf5bd6bf-qv5rz"] Jun 11 12:56:39.082972 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.082954 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-bccb87fdf-hn668"] Jun 11 12:56:39.151294 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.151260 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/770032ba-df71-4645-8c1f-d845abef1986-registry-tls\") pod \"image-registry-fcf5bd6bf-qv5rz\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" Jun 11 12:56:39.151485 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.151317 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/058a7bf8-5cab-4f2f-9f11-a48e58370f14-stats-auth\") pod \"router-default-bccb87fdf-hn668\" (UID: \"058a7bf8-5cab-4f2f-9f11-a48e58370f14\") " pod="openshift-ingress/router-default-bccb87fdf-hn668" Jun 11 12:56:39.151485 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.151343 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p8z5\" (UniqueName: \"kubernetes.io/projected/770032ba-df71-4645-8c1f-d845abef1986-kube-api-access-9p8z5\") pod \"image-registry-fcf5bd6bf-qv5rz\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" Jun 11 12:56:39.151485 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.151379 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/058a7bf8-5cab-4f2f-9f11-a48e58370f14-default-certificate\") pod \"router-default-bccb87fdf-hn668\" (UID: \"058a7bf8-5cab-4f2f-9f11-a48e58370f14\") " pod="openshift-ingress/router-default-bccb87fdf-hn668" Jun 11 12:56:39.151485 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.151444 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/770032ba-df71-4645-8c1f-d845abef1986-registry-certificates\") pod \"image-registry-fcf5bd6bf-qv5rz\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" Jun 11 12:56:39.151485 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.151464 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/770032ba-df71-4645-8c1f-d845abef1986-trusted-ca\") pod \"image-registry-fcf5bd6bf-qv5rz\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" Jun 11 12:56:39.151714 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.151486 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/770032ba-df71-4645-8c1f-d845abef1986-bound-sa-token\") pod \"image-registry-fcf5bd6bf-qv5rz\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" Jun 11 12:56:39.151714 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.151513 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/058a7bf8-5cab-4f2f-9f11-a48e58370f14-service-ca-bundle\") pod \"router-default-bccb87fdf-hn668\" (UID: \"058a7bf8-5cab-4f2f-9f11-a48e58370f14\") " pod="openshift-ingress/router-default-bccb87fdf-hn668" Jun 11 12:56:39.151714 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.151613 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/058a7bf8-5cab-4f2f-9f11-a48e58370f14-metrics-certs\") pod \"router-default-bccb87fdf-hn668\" (UID: \"058a7bf8-5cab-4f2f-9f11-a48e58370f14\") " pod="openshift-ingress/router-default-bccb87fdf-hn668" Jun 11 12:56:39.151714 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.151640 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6kxf\" (UniqueName: \"kubernetes.io/projected/058a7bf8-5cab-4f2f-9f11-a48e58370f14-kube-api-access-d6kxf\") pod \"router-default-bccb87fdf-hn668\" (UID: \"058a7bf8-5cab-4f2f-9f11-a48e58370f14\") " pod="openshift-ingress/router-default-bccb87fdf-hn668" Jun 11 12:56:39.151714 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.151662 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/770032ba-df71-4645-8c1f-d845abef1986-installation-pull-secrets\") pod \"image-registry-fcf5bd6bf-qv5rz\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" Jun 11 12:56:39.151714 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.151681 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/770032ba-df71-4645-8c1f-d845abef1986-image-registry-private-configuration\") pod \"image-registry-fcf5bd6bf-qv5rz\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" Jun 11 12:56:39.151714 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.151708 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/770032ba-df71-4645-8c1f-d845abef1986-ca-trust-extracted\") pod \"image-registry-fcf5bd6bf-qv5rz\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" Jun 11 12:56:39.165673 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.165637 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-lb8tl"] Jun 11 12:56:39.167625 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.167609 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-l66cp"] Jun 11 12:56:39.167754 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.167738 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-lb8tl" Jun 11 12:56:39.169503 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.169487 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-l66cp" Jun 11 12:56:39.171248 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.171229 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 11 12:56:39.171578 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.171561 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 11 12:56:39.171676 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.171653 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 11 12:56:39.172461 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.172445 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-mft7l\"" Jun 11 12:56:39.175507 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.175388 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 11 12:56:39.175795 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.175777 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 11 12:56:39.175909 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.175887 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 11 12:56:39.176021 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.175904 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 11 12:56:39.176021 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.175996 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 11 12:56:39.176144 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.176040 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-rff7h\"" Jun 11 12:56:39.184197 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.184129 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 11 12:56:39.184717 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.184699 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-lb8tl"] Jun 11 12:56:39.189222 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.189199 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-l66cp"] Jun 11 12:56:39.245521 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.245487 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j9zf5"] Jun 11 12:56:39.247474 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.247457 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j9zf5" Jun 11 12:56:39.250172 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.250139 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-vghnw\"" Jun 11 12:56:39.250293 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.250215 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 12:56:39.250293 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.250212 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 11 12:56:39.250293 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.250245 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 12:56:39.253003 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.252977 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0631981e-3326-46e4-a9e5-962fbdf4ed6a-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-l66cp\" (UID: \"0631981e-3326-46e4-a9e5-962fbdf4ed6a\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-l66cp" Jun 11 12:56:39.253204 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.253185 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5bjk\" (UniqueName: \"kubernetes.io/projected/aa1e7777-83cf-4536-9e9e-dcc68a066c62-kube-api-access-s5bjk\") pod \"cluster-monitoring-operator-74bbf69bbb-j9zf5\" (UID: \"aa1e7777-83cf-4536-9e9e-dcc68a066c62\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j9zf5" Jun 11 12:56:39.253327 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.253311 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/770032ba-df71-4645-8c1f-d845abef1986-trusted-ca\") pod \"image-registry-fcf5bd6bf-qv5rz\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" Jun 11 12:56:39.253436 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.253422 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/20c98c8b-f1fa-4066-8907-1ac8f01bacf5-serving-cert\") pod \"console-operator-668fdbf85c-lb8tl\" (UID: \"20c98c8b-f1fa-4066-8907-1ac8f01bacf5\") " pod="openshift-console-operator/console-operator-668fdbf85c-lb8tl" Jun 11 12:56:39.253538 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.253519 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-898b8\" (UniqueName: \"kubernetes.io/projected/20c98c8b-f1fa-4066-8907-1ac8f01bacf5-kube-api-access-898b8\") pod \"console-operator-668fdbf85c-lb8tl\" (UID: \"20c98c8b-f1fa-4066-8907-1ac8f01bacf5\") " pod="openshift-console-operator/console-operator-668fdbf85c-lb8tl" Jun 11 12:56:39.253627 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.253614 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcmqc\" (UniqueName: \"kubernetes.io/projected/0631981e-3326-46e4-a9e5-962fbdf4ed6a-kube-api-access-qcmqc\") pod \"service-ca-operator-6bc5ff68f5-l66cp\" (UID: \"0631981e-3326-46e4-a9e5-962fbdf4ed6a\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-l66cp" Jun 11 12:56:39.253729 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.253714 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aa1e7777-83cf-4536-9e9e-dcc68a066c62-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-j9zf5\" (UID: \"aa1e7777-83cf-4536-9e9e-dcc68a066c62\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j9zf5" Jun 11 12:56:39.253853 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.253839 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20c98c8b-f1fa-4066-8907-1ac8f01bacf5-trusted-ca\") pod \"console-operator-668fdbf85c-lb8tl\" (UID: \"20c98c8b-f1fa-4066-8907-1ac8f01bacf5\") " pod="openshift-console-operator/console-operator-668fdbf85c-lb8tl" Jun 11 12:56:39.254030 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.254013 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/aa1e7777-83cf-4536-9e9e-dcc68a066c62-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-j9zf5\" (UID: \"aa1e7777-83cf-4536-9e9e-dcc68a066c62\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j9zf5" Jun 11 12:56:39.254216 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.254200 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/770032ba-df71-4645-8c1f-d845abef1986-installation-pull-secrets\") pod \"image-registry-fcf5bd6bf-qv5rz\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" Jun 11 12:56:39.254418 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.253761 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 11 12:56:39.254418 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.254378 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/058a7bf8-5cab-4f2f-9f11-a48e58370f14-stats-auth\") pod \"router-default-bccb87fdf-hn668\" (UID: \"058a7bf8-5cab-4f2f-9f11-a48e58370f14\") " pod="openshift-ingress/router-default-bccb87fdf-hn668" Jun 11 12:56:39.254418 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.254418 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/058a7bf8-5cab-4f2f-9f11-a48e58370f14-default-certificate\") pod \"router-default-bccb87fdf-hn668\" (UID: \"058a7bf8-5cab-4f2f-9f11-a48e58370f14\") " pod="openshift-ingress/router-default-bccb87fdf-hn668" Jun 11 12:56:39.254628 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.254457 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p8z5\" (UniqueName: \"kubernetes.io/projected/770032ba-df71-4645-8c1f-d845abef1986-kube-api-access-9p8z5\") pod \"image-registry-fcf5bd6bf-qv5rz\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" Jun 11 12:56:39.254628 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.254489 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/058a7bf8-5cab-4f2f-9f11-a48e58370f14-service-ca-bundle\") pod \"router-default-bccb87fdf-hn668\" (UID: \"058a7bf8-5cab-4f2f-9f11-a48e58370f14\") " pod="openshift-ingress/router-default-bccb87fdf-hn668" Jun 11 12:56:39.254628 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.254520 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/770032ba-df71-4645-8c1f-d845abef1986-registry-certificates\") pod \"image-registry-fcf5bd6bf-qv5rz\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" Jun 11 12:56:39.254628 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.254543 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/770032ba-df71-4645-8c1f-d845abef1986-bound-sa-token\") pod \"image-registry-fcf5bd6bf-qv5rz\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" Jun 11 12:56:39.254628 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.254571 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/058a7bf8-5cab-4f2f-9f11-a48e58370f14-metrics-certs\") pod \"router-default-bccb87fdf-hn668\" (UID: \"058a7bf8-5cab-4f2f-9f11-a48e58370f14\") " pod="openshift-ingress/router-default-bccb87fdf-hn668" Jun 11 12:56:39.254628 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.254609 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0631981e-3326-46e4-a9e5-962fbdf4ed6a-config\") pod \"service-ca-operator-6bc5ff68f5-l66cp\" (UID: \"0631981e-3326-46e4-a9e5-962fbdf4ed6a\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-l66cp" Jun 11 12:56:39.254940 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.254643 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6kxf\" (UniqueName: \"kubernetes.io/projected/058a7bf8-5cab-4f2f-9f11-a48e58370f14-kube-api-access-d6kxf\") pod \"router-default-bccb87fdf-hn668\" (UID: \"058a7bf8-5cab-4f2f-9f11-a48e58370f14\") " pod="openshift-ingress/router-default-bccb87fdf-hn668" Jun 11 12:56:39.254940 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.254675 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/20c98c8b-f1fa-4066-8907-1ac8f01bacf5-config\") pod \"console-operator-668fdbf85c-lb8tl\" (UID: \"20c98c8b-f1fa-4066-8907-1ac8f01bacf5\") " pod="openshift-console-operator/console-operator-668fdbf85c-lb8tl" Jun 11 12:56:39.254940 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.254703 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/770032ba-df71-4645-8c1f-d845abef1986-image-registry-private-configuration\") pod \"image-registry-fcf5bd6bf-qv5rz\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" Jun 11 12:56:39.254940 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.254731 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/770032ba-df71-4645-8c1f-d845abef1986-ca-trust-extracted\") pod \"image-registry-fcf5bd6bf-qv5rz\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" Jun 11 12:56:39.254940 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.254761 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/770032ba-df71-4645-8c1f-d845abef1986-registry-tls\") pod \"image-registry-fcf5bd6bf-qv5rz\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" Jun 11 12:56:39.254940 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:39.254920 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 12:56:39.255893 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:39.255010 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/058a7bf8-5cab-4f2f-9f11-a48e58370f14-metrics-certs podName:058a7bf8-5cab-4f2f-9f11-a48e58370f14 nodeName:}" failed. No retries permitted until 2026-06-11 12:56:39.754985348 +0000 UTC m=+199.401507273 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/058a7bf8-5cab-4f2f-9f11-a48e58370f14-metrics-certs") pod "router-default-bccb87fdf-hn668" (UID: "058a7bf8-5cab-4f2f-9f11-a48e58370f14") : secret "router-metrics-certs-default" not found Jun 11 12:56:39.255893 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.255549 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/770032ba-df71-4645-8c1f-d845abef1986-ca-trust-extracted\") pod \"image-registry-fcf5bd6bf-qv5rz\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" Jun 11 12:56:39.255893 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:39.255688 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/058a7bf8-5cab-4f2f-9f11-a48e58370f14-service-ca-bundle podName:058a7bf8-5cab-4f2f-9f11-a48e58370f14 nodeName:}" failed. No retries permitted until 2026-06-11 12:56:39.755659235 +0000 UTC m=+199.402181174 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/058a7bf8-5cab-4f2f-9f11-a48e58370f14-service-ca-bundle") pod "router-default-bccb87fdf-hn668" (UID: "058a7bf8-5cab-4f2f-9f11-a48e58370f14") : configmap references non-existent config key: service-ca.crt Jun 11 12:56:39.256131 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:39.255922 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 12:56:39.256131 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:39.255939 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fcf5bd6bf-qv5rz: secret "image-registry-tls" not found Jun 11 12:56:39.256131 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:39.255990 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/770032ba-df71-4645-8c1f-d845abef1986-registry-tls podName:770032ba-df71-4645-8c1f-d845abef1986 nodeName:}" failed. No retries permitted until 2026-06-11 12:56:39.755974264 +0000 UTC m=+199.402496199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/770032ba-df71-4645-8c1f-d845abef1986-registry-tls") pod "image-registry-fcf5bd6bf-qv5rz" (UID: "770032ba-df71-4645-8c1f-d845abef1986") : secret "image-registry-tls" not found Jun 11 12:56:39.256408 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.256375 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/770032ba-df71-4645-8c1f-d845abef1986-registry-certificates\") pod \"image-registry-fcf5bd6bf-qv5rz\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" Jun 11 12:56:39.257569 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.257544 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/058a7bf8-5cab-4f2f-9f11-a48e58370f14-stats-auth\") pod \"router-default-bccb87fdf-hn668\" (UID: \"058a7bf8-5cab-4f2f-9f11-a48e58370f14\") " pod="openshift-ingress/router-default-bccb87fdf-hn668" Jun 11 12:56:39.257569 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.257558 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/770032ba-df71-4645-8c1f-d845abef1986-trusted-ca\") pod \"image-registry-fcf5bd6bf-qv5rz\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" Jun 11 12:56:39.258092 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.258068 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/058a7bf8-5cab-4f2f-9f11-a48e58370f14-default-certificate\") pod \"router-default-bccb87fdf-hn668\" (UID: \"058a7bf8-5cab-4f2f-9f11-a48e58370f14\") " pod="openshift-ingress/router-default-bccb87fdf-hn668" Jun 11 12:56:39.258439 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.258420 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/770032ba-df71-4645-8c1f-d845abef1986-image-registry-private-configuration\") pod \"image-registry-fcf5bd6bf-qv5rz\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" Jun 11 12:56:39.259722 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.259699 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/770032ba-df71-4645-8c1f-d845abef1986-installation-pull-secrets\") pod \"image-registry-fcf5bd6bf-qv5rz\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" Jun 11 12:56:39.260523 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.260502 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j9zf5"] Jun 11 12:56:39.268250 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.268227 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/770032ba-df71-4645-8c1f-d845abef1986-bound-sa-token\") pod \"image-registry-fcf5bd6bf-qv5rz\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" Jun 11 12:56:39.268429 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.268406 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p8z5\" (UniqueName: \"kubernetes.io/projected/770032ba-df71-4645-8c1f-d845abef1986-kube-api-access-9p8z5\") pod \"image-registry-fcf5bd6bf-qv5rz\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" Jun 11 12:56:39.268497 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.268461 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6kxf\" (UniqueName: \"kubernetes.io/projected/058a7bf8-5cab-4f2f-9f11-a48e58370f14-kube-api-access-d6kxf\") pod \"router-default-bccb87fdf-hn668\" (UID: \"058a7bf8-5cab-4f2f-9f11-a48e58370f14\") " pod="openshift-ingress/router-default-bccb87fdf-hn668" Jun 11 12:56:39.287998 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.287973 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:39.355426 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.355384 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0631981e-3326-46e4-a9e5-962fbdf4ed6a-config\") pod \"service-ca-operator-6bc5ff68f5-l66cp\" (UID: \"0631981e-3326-46e4-a9e5-962fbdf4ed6a\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-l66cp" Jun 11 12:56:39.355532 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.355437 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/20c98c8b-f1fa-4066-8907-1ac8f01bacf5-config\") pod \"console-operator-668fdbf85c-lb8tl\" (UID: \"20c98c8b-f1fa-4066-8907-1ac8f01bacf5\") " pod="openshift-console-operator/console-operator-668fdbf85c-lb8tl" Jun 11 12:56:39.355532 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.355471 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0631981e-3326-46e4-a9e5-962fbdf4ed6a-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-l66cp\" (UID: \"0631981e-3326-46e4-a9e5-962fbdf4ed6a\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-l66cp" Jun 11 12:56:39.355532 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.355493 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5bjk\" (UniqueName: \"kubernetes.io/projected/aa1e7777-83cf-4536-9e9e-dcc68a066c62-kube-api-access-s5bjk\") pod \"cluster-monitoring-operator-74bbf69bbb-j9zf5\" (UID: \"aa1e7777-83cf-4536-9e9e-dcc68a066c62\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j9zf5" Jun 11 12:56:39.355532 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.355515 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/20c98c8b-f1fa-4066-8907-1ac8f01bacf5-serving-cert\") pod \"console-operator-668fdbf85c-lb8tl\" (UID: \"20c98c8b-f1fa-4066-8907-1ac8f01bacf5\") " pod="openshift-console-operator/console-operator-668fdbf85c-lb8tl" Jun 11 12:56:39.355769 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.355538 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-898b8\" (UniqueName: \"kubernetes.io/projected/20c98c8b-f1fa-4066-8907-1ac8f01bacf5-kube-api-access-898b8\") pod \"console-operator-668fdbf85c-lb8tl\" (UID: \"20c98c8b-f1fa-4066-8907-1ac8f01bacf5\") " pod="openshift-console-operator/console-operator-668fdbf85c-lb8tl" Jun 11 12:56:39.355769 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.355561 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcmqc\" (UniqueName: \"kubernetes.io/projected/0631981e-3326-46e4-a9e5-962fbdf4ed6a-kube-api-access-qcmqc\") pod \"service-ca-operator-6bc5ff68f5-l66cp\" (UID: \"0631981e-3326-46e4-a9e5-962fbdf4ed6a\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-l66cp" Jun 11 12:56:39.355769 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.355591 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aa1e7777-83cf-4536-9e9e-dcc68a066c62-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-j9zf5\" (UID: \"aa1e7777-83cf-4536-9e9e-dcc68a066c62\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j9zf5" Jun 11 12:56:39.355769 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:39.355664 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 12:56:39.355769 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:39.355752 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa1e7777-83cf-4536-9e9e-dcc68a066c62-cluster-monitoring-operator-tls podName:aa1e7777-83cf-4536-9e9e-dcc68a066c62 nodeName:}" failed. No retries permitted until 2026-06-11 12:56:39.855732494 +0000 UTC m=+199.502254417 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/aa1e7777-83cf-4536-9e9e-dcc68a066c62-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-j9zf5" (UID: "aa1e7777-83cf-4536-9e9e-dcc68a066c62") : secret "cluster-monitoring-operator-tls" not found Jun 11 12:56:39.356018 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.355783 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20c98c8b-f1fa-4066-8907-1ac8f01bacf5-trusted-ca\") pod \"console-operator-668fdbf85c-lb8tl\" (UID: \"20c98c8b-f1fa-4066-8907-1ac8f01bacf5\") " pod="openshift-console-operator/console-operator-668fdbf85c-lb8tl" Jun 11 12:56:39.356018 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.355841 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/aa1e7777-83cf-4536-9e9e-dcc68a066c62-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-j9zf5\" (UID: \"aa1e7777-83cf-4536-9e9e-dcc68a066c62\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j9zf5" Jun 11 12:56:39.356122 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.356083 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0631981e-3326-46e4-a9e5-962fbdf4ed6a-config\") pod \"service-ca-operator-6bc5ff68f5-l66cp\" (UID: \"0631981e-3326-46e4-a9e5-962fbdf4ed6a\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-l66cp" Jun 11 12:56:39.356439 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.356410 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/20c98c8b-f1fa-4066-8907-1ac8f01bacf5-config\") pod \"console-operator-668fdbf85c-lb8tl\" (UID: \"20c98c8b-f1fa-4066-8907-1ac8f01bacf5\") " pod="openshift-console-operator/console-operator-668fdbf85c-lb8tl" Jun 11 12:56:39.356589 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.356572 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/aa1e7777-83cf-4536-9e9e-dcc68a066c62-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-j9zf5\" (UID: \"aa1e7777-83cf-4536-9e9e-dcc68a066c62\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j9zf5" Jun 11 12:56:39.356730 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.356711 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20c98c8b-f1fa-4066-8907-1ac8f01bacf5-trusted-ca\") pod \"console-operator-668fdbf85c-lb8tl\" (UID: \"20c98c8b-f1fa-4066-8907-1ac8f01bacf5\") " pod="openshift-console-operator/console-operator-668fdbf85c-lb8tl" Jun 11 12:56:39.357764 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.357744 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0631981e-3326-46e4-a9e5-962fbdf4ed6a-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-l66cp\" (UID: \"0631981e-3326-46e4-a9e5-962fbdf4ed6a\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-l66cp" Jun 11 12:56:39.358203 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.358187 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/20c98c8b-f1fa-4066-8907-1ac8f01bacf5-serving-cert\") pod \"console-operator-668fdbf85c-lb8tl\" (UID: \"20c98c8b-f1fa-4066-8907-1ac8f01bacf5\") " pod="openshift-console-operator/console-operator-668fdbf85c-lb8tl" Jun 11 12:56:39.364627 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.364599 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcmqc\" (UniqueName: \"kubernetes.io/projected/0631981e-3326-46e4-a9e5-962fbdf4ed6a-kube-api-access-qcmqc\") pod \"service-ca-operator-6bc5ff68f5-l66cp\" (UID: \"0631981e-3326-46e4-a9e5-962fbdf4ed6a\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-l66cp" Jun 11 12:56:39.364802 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.364770 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5bjk\" (UniqueName: \"kubernetes.io/projected/aa1e7777-83cf-4536-9e9e-dcc68a066c62-kube-api-access-s5bjk\") pod \"cluster-monitoring-operator-74bbf69bbb-j9zf5\" (UID: \"aa1e7777-83cf-4536-9e9e-dcc68a066c62\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j9zf5" Jun 11 12:56:39.365130 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.365113 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-898b8\" (UniqueName: \"kubernetes.io/projected/20c98c8b-f1fa-4066-8907-1ac8f01bacf5-kube-api-access-898b8\") pod \"console-operator-668fdbf85c-lb8tl\" (UID: \"20c98c8b-f1fa-4066-8907-1ac8f01bacf5\") " pod="openshift-console-operator/console-operator-668fdbf85c-lb8tl" Jun 11 12:56:39.388544 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.388519 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:39.478459 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.478419 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-lb8tl" Jun 11 12:56:39.485121 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.485105 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-l66cp" Jun 11 12:56:39.489167 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.489134 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:39.607653 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.607578 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-lb8tl"] Jun 11 12:56:39.611900 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:56:39.611867 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20c98c8b_f1fa_4066_8907_1ac8f01bacf5.slice/crio-02908174e2129c0f3f5b8577133b4d20992be8e6aec52cf099409e322fecc6a2 WatchSource:0}: Error finding container 02908174e2129c0f3f5b8577133b4d20992be8e6aec52cf099409e322fecc6a2: Status 404 returned error can't find the container with id 02908174e2129c0f3f5b8577133b4d20992be8e6aec52cf099409e322fecc6a2 Jun 11 12:56:39.621694 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.621665 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-l66cp"] Jun 11 12:56:39.628485 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:56:39.628459 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0631981e_3326_46e4_a9e5_962fbdf4ed6a.slice/crio-f428d38395204e63fcd5db80befd1d780d2298e390389693ce03b0968f2961ad WatchSource:0}: Error finding container f428d38395204e63fcd5db80befd1d780d2298e390389693ce03b0968f2961ad: Status 404 returned error can't find the container with id f428d38395204e63fcd5db80befd1d780d2298e390389693ce03b0968f2961ad Jun 11 12:56:39.759521 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.759484 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/058a7bf8-5cab-4f2f-9f11-a48e58370f14-metrics-certs\") pod \"router-default-bccb87fdf-hn668\" (UID: \"058a7bf8-5cab-4f2f-9f11-a48e58370f14\") " pod="openshift-ingress/router-default-bccb87fdf-hn668" Jun 11 12:56:39.759704 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.759538 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/770032ba-df71-4645-8c1f-d845abef1986-registry-tls\") pod \"image-registry-fcf5bd6bf-qv5rz\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" Jun 11 12:56:39.759704 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.759638 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/058a7bf8-5cab-4f2f-9f11-a48e58370f14-service-ca-bundle\") pod \"router-default-bccb87fdf-hn668\" (UID: \"058a7bf8-5cab-4f2f-9f11-a48e58370f14\") " pod="openshift-ingress/router-default-bccb87fdf-hn668" Jun 11 12:56:39.759704 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:39.759637 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 12:56:39.759704 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:39.759696 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 12:56:39.759914 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:39.759713 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fcf5bd6bf-qv5rz: secret "image-registry-tls" not found Jun 11 12:56:39.759914 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:39.759720 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/058a7bf8-5cab-4f2f-9f11-a48e58370f14-metrics-certs podName:058a7bf8-5cab-4f2f-9f11-a48e58370f14 nodeName:}" failed. No retries permitted until 2026-06-11 12:56:40.759701729 +0000 UTC m=+200.406223650 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/058a7bf8-5cab-4f2f-9f11-a48e58370f14-metrics-certs") pod "router-default-bccb87fdf-hn668" (UID: "058a7bf8-5cab-4f2f-9f11-a48e58370f14") : secret "router-metrics-certs-default" not found Jun 11 12:56:39.759914 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:39.759772 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/770032ba-df71-4645-8c1f-d845abef1986-registry-tls podName:770032ba-df71-4645-8c1f-d845abef1986 nodeName:}" failed. No retries permitted until 2026-06-11 12:56:40.759752238 +0000 UTC m=+200.406274158 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/770032ba-df71-4645-8c1f-d845abef1986-registry-tls") pod "image-registry-fcf5bd6bf-qv5rz" (UID: "770032ba-df71-4645-8c1f-d845abef1986") : secret "image-registry-tls" not found Jun 11 12:56:39.759914 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:39.759786 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/058a7bf8-5cab-4f2f-9f11-a48e58370f14-service-ca-bundle podName:058a7bf8-5cab-4f2f-9f11-a48e58370f14 nodeName:}" failed. No retries permitted until 2026-06-11 12:56:40.75978042 +0000 UTC m=+200.406302339 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/058a7bf8-5cab-4f2f-9f11-a48e58370f14-service-ca-bundle") pod "router-default-bccb87fdf-hn668" (UID: "058a7bf8-5cab-4f2f-9f11-a48e58370f14") : configmap references non-existent config key: service-ca.crt Jun 11 12:56:39.860954 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:39.860859 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aa1e7777-83cf-4536-9e9e-dcc68a066c62-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-j9zf5\" (UID: \"aa1e7777-83cf-4536-9e9e-dcc68a066c62\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j9zf5" Jun 11 12:56:39.861106 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:39.861001 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 12:56:39.861106 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:39.861068 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa1e7777-83cf-4536-9e9e-dcc68a066c62-cluster-monitoring-operator-tls podName:aa1e7777-83cf-4536-9e9e-dcc68a066c62 nodeName:}" failed. No retries permitted until 2026-06-11 12:56:40.861051406 +0000 UTC m=+200.507573331 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/aa1e7777-83cf-4536-9e9e-dcc68a066c62-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-j9zf5" (UID: "aa1e7777-83cf-4536-9e9e-dcc68a066c62") : secret "cluster-monitoring-operator-tls" not found Jun 11 12:56:40.436813 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:40.436746 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-l66cp" event={"ID":"0631981e-3326-46e4-a9e5-962fbdf4ed6a","Type":"ContainerStarted","Data":"f428d38395204e63fcd5db80befd1d780d2298e390389693ce03b0968f2961ad"} Jun 11 12:56:40.438034 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:40.438006 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-lb8tl" event={"ID":"20c98c8b-f1fa-4066-8907-1ac8f01bacf5","Type":"ContainerStarted","Data":"02908174e2129c0f3f5b8577133b4d20992be8e6aec52cf099409e322fecc6a2"} Jun 11 12:56:40.767794 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:40.767695 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/058a7bf8-5cab-4f2f-9f11-a48e58370f14-metrics-certs\") pod \"router-default-bccb87fdf-hn668\" (UID: \"058a7bf8-5cab-4f2f-9f11-a48e58370f14\") " pod="openshift-ingress/router-default-bccb87fdf-hn668" Jun 11 12:56:40.767794 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:40.767767 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/770032ba-df71-4645-8c1f-d845abef1986-registry-tls\") pod \"image-registry-fcf5bd6bf-qv5rz\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" Jun 11 12:56:40.768023 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:40.767864 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 12:56:40.768023 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:40.767880 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/058a7bf8-5cab-4f2f-9f11-a48e58370f14-service-ca-bundle\") pod \"router-default-bccb87fdf-hn668\" (UID: \"058a7bf8-5cab-4f2f-9f11-a48e58370f14\") " pod="openshift-ingress/router-default-bccb87fdf-hn668" Jun 11 12:56:40.768023 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:40.767937 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/058a7bf8-5cab-4f2f-9f11-a48e58370f14-metrics-certs podName:058a7bf8-5cab-4f2f-9f11-a48e58370f14 nodeName:}" failed. No retries permitted until 2026-06-11 12:56:42.767917214 +0000 UTC m=+202.414439150 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/058a7bf8-5cab-4f2f-9f11-a48e58370f14-metrics-certs") pod "router-default-bccb87fdf-hn668" (UID: "058a7bf8-5cab-4f2f-9f11-a48e58370f14") : secret "router-metrics-certs-default" not found Jun 11 12:56:40.768023 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:40.767962 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 12:56:40.768023 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:40.767984 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fcf5bd6bf-qv5rz: secret "image-registry-tls" not found Jun 11 12:56:40.768023 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:40.767997 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/058a7bf8-5cab-4f2f-9f11-a48e58370f14-service-ca-bundle podName:058a7bf8-5cab-4f2f-9f11-a48e58370f14 nodeName:}" failed. No retries permitted until 2026-06-11 12:56:42.767979693 +0000 UTC m=+202.414501618 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/058a7bf8-5cab-4f2f-9f11-a48e58370f14-service-ca-bundle") pod "router-default-bccb87fdf-hn668" (UID: "058a7bf8-5cab-4f2f-9f11-a48e58370f14") : configmap references non-existent config key: service-ca.crt Jun 11 12:56:40.768023 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:40.768029 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/770032ba-df71-4645-8c1f-d845abef1986-registry-tls podName:770032ba-df71-4645-8c1f-d845abef1986 nodeName:}" failed. No retries permitted until 2026-06-11 12:56:42.768015275 +0000 UTC m=+202.414537208 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/770032ba-df71-4645-8c1f-d845abef1986-registry-tls") pod "image-registry-fcf5bd6bf-qv5rz" (UID: "770032ba-df71-4645-8c1f-d845abef1986") : secret "image-registry-tls" not found Jun 11 12:56:40.868880 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:40.868840 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aa1e7777-83cf-4536-9e9e-dcc68a066c62-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-j9zf5\" (UID: \"aa1e7777-83cf-4536-9e9e-dcc68a066c62\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j9zf5" Jun 11 12:56:40.869117 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:40.868981 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 12:56:40.869117 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:40.869064 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa1e7777-83cf-4536-9e9e-dcc68a066c62-cluster-monitoring-operator-tls podName:aa1e7777-83cf-4536-9e9e-dcc68a066c62 nodeName:}" failed. No retries permitted until 2026-06-11 12:56:42.869042445 +0000 UTC m=+202.515564367 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/aa1e7777-83cf-4536-9e9e-dcc68a066c62-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-j9zf5" (UID: "aa1e7777-83cf-4536-9e9e-dcc68a066c62") : secret "cluster-monitoring-operator-tls" not found Jun 11 12:56:41.993882 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:41.993852 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:42.050606 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:42.050574 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:42.449947 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:42.449919 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lb8tl_20c98c8b-f1fa-4066-8907-1ac8f01bacf5/console-operator/0.log" Jun 11 12:56:42.450131 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:42.449956 2558 generic.go:356] "Generic (PLEG): container finished" podID="20c98c8b-f1fa-4066-8907-1ac8f01bacf5" containerID="6780498fd0ab884316488d7d99f9bb4369b5afb08a19bc034f42081561344550" exitCode=255 Jun 11 12:56:42.450131 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:42.449986 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-lb8tl" event={"ID":"20c98c8b-f1fa-4066-8907-1ac8f01bacf5","Type":"ContainerDied","Data":"6780498fd0ab884316488d7d99f9bb4369b5afb08a19bc034f42081561344550"} Jun 11 12:56:42.450321 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:42.450299 2558 scope.go:117] "RemoveContainer" containerID="6780498fd0ab884316488d7d99f9bb4369b5afb08a19bc034f42081561344550" Jun 11 12:56:42.451389 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:42.451370 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-l66cp" event={"ID":"0631981e-3326-46e4-a9e5-962fbdf4ed6a","Type":"ContainerStarted","Data":"6052aaf28299ff59da388bf1935731c226271db9615c1e9dcf1e227c5f20702b"} Jun 11 12:56:42.481344 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:42.481302 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-l66cp" podStartSLOduration=1.3041963619999999 podStartE2EDuration="3.481288355s" totalImagesPullingTime="2.177091993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:56:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:56:42.48033053 +0000 UTC m=+202.126852507" watchObservedRunningTime="2026-06-11 12:56:42.481288355 +0000 UTC m=+202.127810297" Jun 11 12:56:42.672219 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:42.672186 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:42.782700 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:42.782618 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/058a7bf8-5cab-4f2f-9f11-a48e58370f14-service-ca-bundle\") pod \"router-default-bccb87fdf-hn668\" (UID: \"058a7bf8-5cab-4f2f-9f11-a48e58370f14\") " pod="openshift-ingress/router-default-bccb87fdf-hn668" Jun 11 12:56:42.782700 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:42.782652 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/058a7bf8-5cab-4f2f-9f11-a48e58370f14-metrics-certs\") pod \"router-default-bccb87fdf-hn668\" (UID: \"058a7bf8-5cab-4f2f-9f11-a48e58370f14\") " pod="openshift-ingress/router-default-bccb87fdf-hn668" Jun 11 12:56:42.782700 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:42.782681 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/770032ba-df71-4645-8c1f-d845abef1986-registry-tls\") pod \"image-registry-fcf5bd6bf-qv5rz\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" Jun 11 12:56:42.782894 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:42.782761 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 12:56:42.782894 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:42.782781 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/058a7bf8-5cab-4f2f-9f11-a48e58370f14-service-ca-bundle podName:058a7bf8-5cab-4f2f-9f11-a48e58370f14 nodeName:}" failed. No retries permitted until 2026-06-11 12:56:46.78276409 +0000 UTC m=+206.429286011 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/058a7bf8-5cab-4f2f-9f11-a48e58370f14-service-ca-bundle") pod "router-default-bccb87fdf-hn668" (UID: "058a7bf8-5cab-4f2f-9f11-a48e58370f14") : configmap references non-existent config key: service-ca.crt Jun 11 12:56:42.782894 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:42.782798 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 12:56:42.782894 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:42.782808 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fcf5bd6bf-qv5rz: secret "image-registry-tls" not found Jun 11 12:56:42.782894 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:42.782811 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/058a7bf8-5cab-4f2f-9f11-a48e58370f14-metrics-certs podName:058a7bf8-5cab-4f2f-9f11-a48e58370f14 nodeName:}" failed. No retries permitted until 2026-06-11 12:56:46.782799145 +0000 UTC m=+206.429321065 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/058a7bf8-5cab-4f2f-9f11-a48e58370f14-metrics-certs") pod "router-default-bccb87fdf-hn668" (UID: "058a7bf8-5cab-4f2f-9f11-a48e58370f14") : secret "router-metrics-certs-default" not found Jun 11 12:56:42.782894 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:42.782855 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/770032ba-df71-4645-8c1f-d845abef1986-registry-tls podName:770032ba-df71-4645-8c1f-d845abef1986 nodeName:}" failed. No retries permitted until 2026-06-11 12:56:46.782844439 +0000 UTC m=+206.429366361 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/770032ba-df71-4645-8c1f-d845abef1986-registry-tls") pod "image-registry-fcf5bd6bf-qv5rz" (UID: "770032ba-df71-4645-8c1f-d845abef1986") : secret "image-registry-tls" not found Jun 11 12:56:42.883561 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:42.883518 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aa1e7777-83cf-4536-9e9e-dcc68a066c62-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-j9zf5\" (UID: \"aa1e7777-83cf-4536-9e9e-dcc68a066c62\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j9zf5" Jun 11 12:56:42.883727 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:42.883664 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 12:56:42.883781 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:42.883754 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa1e7777-83cf-4536-9e9e-dcc68a066c62-cluster-monitoring-operator-tls podName:aa1e7777-83cf-4536-9e9e-dcc68a066c62 nodeName:}" failed. No retries permitted until 2026-06-11 12:56:46.883739591 +0000 UTC m=+206.530261511 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/aa1e7777-83cf-4536-9e9e-dcc68a066c62-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-j9zf5" (UID: "aa1e7777-83cf-4536-9e9e-dcc68a066c62") : secret "cluster-monitoring-operator-tls" not found Jun 11 12:56:43.127145 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:43.127112 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:43.225139 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:43.225108 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:43.456641 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:43.456567 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lb8tl_20c98c8b-f1fa-4066-8907-1ac8f01bacf5/console-operator/1.log" Jun 11 12:56:43.456998 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:43.456983 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lb8tl_20c98c8b-f1fa-4066-8907-1ac8f01bacf5/console-operator/0.log" Jun 11 12:56:43.457057 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:43.457017 2558 generic.go:356] "Generic (PLEG): container finished" podID="20c98c8b-f1fa-4066-8907-1ac8f01bacf5" containerID="6dad4342b5380de92686f160f98ae285aceadd790d4130926ce2253a494c6ab9" exitCode=255 Jun 11 12:56:43.457121 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:43.457102 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-lb8tl" event={"ID":"20c98c8b-f1fa-4066-8907-1ac8f01bacf5","Type":"ContainerDied","Data":"6dad4342b5380de92686f160f98ae285aceadd790d4130926ce2253a494c6ab9"} Jun 11 12:56:43.457195 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:43.457181 2558 scope.go:117] "RemoveContainer" containerID="6780498fd0ab884316488d7d99f9bb4369b5afb08a19bc034f42081561344550" Jun 11 12:56:43.457393 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:43.457370 2558 scope.go:117] "RemoveContainer" containerID="6dad4342b5380de92686f160f98ae285aceadd790d4130926ce2253a494c6ab9" Jun 11 12:56:43.457593 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:43.457573 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-lb8tl_openshift-console-operator(20c98c8b-f1fa-4066-8907-1ac8f01bacf5)\"" pod="openshift-console-operator/console-operator-668fdbf85c-lb8tl" podUID="20c98c8b-f1fa-4066-8907-1ac8f01bacf5" Jun 11 12:56:43.461390 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:43.461371 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:43.516632 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:43.516600 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:43.591074 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:43.591046 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:43.687276 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:43.687242 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:43.787214 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:43.787130 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:44.462446 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:44.462418 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lb8tl_20c98c8b-f1fa-4066-8907-1ac8f01bacf5/console-operator/1.log" Jun 11 12:56:44.462803 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:44.462731 2558 scope.go:117] "RemoveContainer" containerID="6dad4342b5380de92686f160f98ae285aceadd790d4130926ce2253a494c6ab9" Jun 11 12:56:44.462900 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:44.462881 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-lb8tl_openshift-console-operator(20c98c8b-f1fa-4066-8907-1ac8f01bacf5)\"" pod="openshift-console-operator/console-operator-668fdbf85c-lb8tl" podUID="20c98c8b-f1fa-4066-8907-1ac8f01bacf5" Jun 11 12:56:45.016145 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:45.016113 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:45.072370 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:45.072335 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:45.357211 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:45.357186 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hcnkc_52db0382-33eb-4bbd-8c3a-850757a8b9fb/dns-node-resolver/0.log" Jun 11 12:56:45.913197 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:45.913146 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:46.359406 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:46.359384 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w7dg4_b10f8cf9-e375-4b40-bd55-c0cb329ce19e/node-ca/0.log" Jun 11 12:56:46.818880 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:46.818789 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/058a7bf8-5cab-4f2f-9f11-a48e58370f14-service-ca-bundle\") pod \"router-default-bccb87fdf-hn668\" (UID: \"058a7bf8-5cab-4f2f-9f11-a48e58370f14\") " pod="openshift-ingress/router-default-bccb87fdf-hn668" Jun 11 12:56:46.818880 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:46.818825 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/058a7bf8-5cab-4f2f-9f11-a48e58370f14-metrics-certs\") pod \"router-default-bccb87fdf-hn668\" (UID: \"058a7bf8-5cab-4f2f-9f11-a48e58370f14\") " pod="openshift-ingress/router-default-bccb87fdf-hn668" Jun 11 12:56:46.818880 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:46.818855 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/770032ba-df71-4645-8c1f-d845abef1986-registry-tls\") pod \"image-registry-fcf5bd6bf-qv5rz\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" Jun 11 12:56:46.819133 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:46.818966 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 12:56:46.819133 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:46.818987 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/058a7bf8-5cab-4f2f-9f11-a48e58370f14-service-ca-bundle podName:058a7bf8-5cab-4f2f-9f11-a48e58370f14 nodeName:}" failed. No retries permitted until 2026-06-11 12:56:54.818965755 +0000 UTC m=+214.465487693 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/058a7bf8-5cab-4f2f-9f11-a48e58370f14-service-ca-bundle") pod "router-default-bccb87fdf-hn668" (UID: "058a7bf8-5cab-4f2f-9f11-a48e58370f14") : configmap references non-existent config key: service-ca.crt Jun 11 12:56:46.819133 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:46.818988 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 12:56:46.819133 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:46.819014 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fcf5bd6bf-qv5rz: secret "image-registry-tls" not found Jun 11 12:56:46.819133 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:46.819028 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/058a7bf8-5cab-4f2f-9f11-a48e58370f14-metrics-certs podName:058a7bf8-5cab-4f2f-9f11-a48e58370f14 nodeName:}" failed. No retries permitted until 2026-06-11 12:56:54.81901519 +0000 UTC m=+214.465537109 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/058a7bf8-5cab-4f2f-9f11-a48e58370f14-metrics-certs") pod "router-default-bccb87fdf-hn668" (UID: "058a7bf8-5cab-4f2f-9f11-a48e58370f14") : secret "router-metrics-certs-default" not found Jun 11 12:56:46.819133 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:46.819043 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/770032ba-df71-4645-8c1f-d845abef1986-registry-tls podName:770032ba-df71-4645-8c1f-d845abef1986 nodeName:}" failed. No retries permitted until 2026-06-11 12:56:54.819033952 +0000 UTC m=+214.465555905 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/770032ba-df71-4645-8c1f-d845abef1986-registry-tls") pod "image-registry-fcf5bd6bf-qv5rz" (UID: "770032ba-df71-4645-8c1f-d845abef1986") : secret "image-registry-tls" not found Jun 11 12:56:46.919755 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:46.919711 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aa1e7777-83cf-4536-9e9e-dcc68a066c62-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-j9zf5\" (UID: \"aa1e7777-83cf-4536-9e9e-dcc68a066c62\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j9zf5" Jun 11 12:56:46.920116 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:46.919881 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 12:56:46.920116 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:46.919951 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa1e7777-83cf-4536-9e9e-dcc68a066c62-cluster-monitoring-operator-tls podName:aa1e7777-83cf-4536-9e9e-dcc68a066c62 nodeName:}" failed. No retries permitted until 2026-06-11 12:56:54.919931017 +0000 UTC m=+214.566452940 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/aa1e7777-83cf-4536-9e9e-dcc68a066c62-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-j9zf5" (UID: "aa1e7777-83cf-4536-9e9e-dcc68a066c62") : secret "cluster-monitoring-operator-tls" not found Jun 11 12:56:47.157451 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:47.157426 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xjmtd_8c9a9482-6765-4d5f-b21b-37c26d9be26d/serve-healthcheck-canary/0.log" Jun 11 12:56:48.061003 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:48.060971 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:48.163302 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:48.163268 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:48.269412 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:48.269373 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:48.365532 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:48.365506 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:48.445606 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:48.445575 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:48.954177 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:48.954127 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:49.479209 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:49.479182 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-lb8tl" Jun 11 12:56:49.479577 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:49.479226 2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-lb8tl" Jun 11 12:56:49.479577 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:49.479534 2558 scope.go:117] "RemoveContainer" containerID="6dad4342b5380de92686f160f98ae285aceadd790d4130926ce2253a494c6ab9" Jun 11 12:56:49.479699 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:49.479681 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-lb8tl_openshift-console-operator(20c98c8b-f1fa-4066-8907-1ac8f01bacf5)\"" pod="openshift-console-operator/console-operator-668fdbf85c-lb8tl" podUID="20c98c8b-f1fa-4066-8907-1ac8f01bacf5" Jun 11 12:56:49.516959 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:49.516932 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:49.756965 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:49.756884 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:50.159174 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:50.159131 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:50.350957 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:50.350927 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:50.557765 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:50.557688 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:50.953018 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:50.952988 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:51.362215 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:51.362187 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:51.788446 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:51.788368 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:51.953766 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:51.953737 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:52.159463 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:52.159434 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:52.357574 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:52.357546 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:52.753409 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:52.753375 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:52.957618 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:52.957591 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:53.159449 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:53.159418 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:54.051646 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:54.051614 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:54.351693 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:54.351663 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:54.555921 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:54.555888 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:54.757844 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:54.757755 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:54.882564 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:54.882515 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/770032ba-df71-4645-8c1f-d845abef1986-registry-tls\") pod \"image-registry-fcf5bd6bf-qv5rz\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" Jun 11 12:56:54.882750 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:54.882714 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/058a7bf8-5cab-4f2f-9f11-a48e58370f14-service-ca-bundle\") pod \"router-default-bccb87fdf-hn668\" (UID: \"058a7bf8-5cab-4f2f-9f11-a48e58370f14\") " pod="openshift-ingress/router-default-bccb87fdf-hn668" Jun 11 12:56:54.882750 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:54.882746 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/058a7bf8-5cab-4f2f-9f11-a48e58370f14-metrics-certs\") pod \"router-default-bccb87fdf-hn668\" (UID: \"058a7bf8-5cab-4f2f-9f11-a48e58370f14\") " pod="openshift-ingress/router-default-bccb87fdf-hn668" Jun 11 12:56:54.883349 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:54.883327 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/058a7bf8-5cab-4f2f-9f11-a48e58370f14-service-ca-bundle\") pod \"router-default-bccb87fdf-hn668\" (UID: \"058a7bf8-5cab-4f2f-9f11-a48e58370f14\") " pod="openshift-ingress/router-default-bccb87fdf-hn668" Jun 11 12:56:54.884876 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:54.884855 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/058a7bf8-5cab-4f2f-9f11-a48e58370f14-metrics-certs\") pod \"router-default-bccb87fdf-hn668\" (UID: \"058a7bf8-5cab-4f2f-9f11-a48e58370f14\") " pod="openshift-ingress/router-default-bccb87fdf-hn668" Jun 11 12:56:54.885014 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:54.884996 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/770032ba-df71-4645-8c1f-d845abef1986-registry-tls\") pod \"image-registry-fcf5bd6bf-qv5rz\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" Jun 11 12:56:54.964195 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:54.964142 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-bccb87fdf-hn668" Jun 11 12:56:54.968646 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:54.968629 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" Jun 11 12:56:54.971914 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:54.971891 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:54.983399 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:54.983375 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aa1e7777-83cf-4536-9e9e-dcc68a066c62-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-j9zf5\" (UID: \"aa1e7777-83cf-4536-9e9e-dcc68a066c62\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j9zf5" Jun 11 12:56:54.983552 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:54.983526 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 12:56:54.983660 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:56:54.983609 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa1e7777-83cf-4536-9e9e-dcc68a066c62-cluster-monitoring-operator-tls podName:aa1e7777-83cf-4536-9e9e-dcc68a066c62 nodeName:}" failed. No retries permitted until 2026-06-11 12:57:10.9835869 +0000 UTC m=+230.630108835 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/aa1e7777-83cf-4536-9e9e-dcc68a066c62-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-j9zf5" (UID: "aa1e7777-83cf-4536-9e9e-dcc68a066c62") : secret "cluster-monitoring-operator-tls" not found Jun 11 12:56:55.095232 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:55.095185 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-bccb87fdf-hn668"] Jun 11 12:56:55.097638 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:56:55.097613 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod058a7bf8_5cab_4f2f_9f11_a48e58370f14.slice/crio-9ead8ff3720e2319a7f5410964dca93052b40a9b9a893a38d11d750a20b012d4 WatchSource:0}: Error finding container 9ead8ff3720e2319a7f5410964dca93052b40a9b9a893a38d11d750a20b012d4: Status 404 returned error can't find the container with id 9ead8ff3720e2319a7f5410964dca93052b40a9b9a893a38d11d750a20b012d4 Jun 11 12:56:55.113450 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:55.113427 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-fcf5bd6bf-qv5rz"] Jun 11 12:56:55.128234 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:56:55.128207 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod770032ba_df71_4645_8c1f_d845abef1986.slice/crio-0ce996c8e2d9d98827432900d9e4b913082403be8ab02398618a35a198c968dd WatchSource:0}: Error finding container 0ce996c8e2d9d98827432900d9e4b913082403be8ab02398618a35a198c968dd: Status 404 returned error can't find the container with id 0ce996c8e2d9d98827432900d9e4b913082403be8ab02398618a35a198c968dd Jun 11 12:56:55.159235 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:55.159186 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:55.497698 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:55.497660 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" event={"ID":"770032ba-df71-4645-8c1f-d845abef1986","Type":"ContainerStarted","Data":"24a56c3c68aa0503e8bd136570767506bc5cde44983fe7382267b78754f1092a"} Jun 11 12:56:55.497885 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:55.497752 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" Jun 11 12:56:55.497885 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:55.497773 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" event={"ID":"770032ba-df71-4645-8c1f-d845abef1986","Type":"ContainerStarted","Data":"0ce996c8e2d9d98827432900d9e4b913082403be8ab02398618a35a198c968dd"} Jun 11 12:56:55.499171 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:55.499125 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-bccb87fdf-hn668" event={"ID":"058a7bf8-5cab-4f2f-9f11-a48e58370f14","Type":"ContainerStarted","Data":"b3c4d737883988646f00b76b65608aa95dd893194e678cbe042368dd1945c6a9"} Jun 11 12:56:55.499250 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:55.499190 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-bccb87fdf-hn668" event={"ID":"058a7bf8-5cab-4f2f-9f11-a48e58370f14","Type":"ContainerStarted","Data":"9ead8ff3720e2319a7f5410964dca93052b40a9b9a893a38d11d750a20b012d4"} Jun 11 12:56:55.518285 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:55.518238 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" podStartSLOduration=16.518224848 podStartE2EDuration="16.518224848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:56:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:56:55.517335692 +0000 UTC m=+215.163857634" watchObservedRunningTime="2026-06-11 12:56:55.518224848 +0000 UTC m=+215.164746801" Jun 11 12:56:55.535498 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:55.535439 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-bccb87fdf-hn668" podStartSLOduration=16.535419502 podStartE2EDuration="16.535419502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:56:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:56:55.534558332 +0000 UTC m=+215.181080296" watchObservedRunningTime="2026-06-11 12:56:55.535419502 +0000 UTC m=+215.181941648" Jun 11 12:56:55.955530 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:55.955477 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:55.964556 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:55.964540 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-bccb87fdf-hn668" Jun 11 12:56:55.967052 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:55.967027 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-bccb87fdf-hn668" Jun 11 12:56:56.194795 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:56.194761 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:56.404555 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:56.404525 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:56.502280 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:56.502249 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-bccb87fdf-hn668" Jun 11 12:56:56.503478 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:56.503458 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-bccb87fdf-hn668" Jun 11 12:56:56.755243 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:56.755165 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:56.960294 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:56.960256 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:57.015747 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:57.015661 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:57.356888 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:57.356852 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:58.162775 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:58.162743 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:58.352565 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:58.352536 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:58.551006 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:58.550916 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:56:58.758902 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:56:58.758871 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:01.519622 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:01.519586 2558 generic.go:356] "Generic (PLEG): container finished" podID="76e09fd7-9609-406a-ac12-71fbb978d2a5" containerID="4c944a07ebb1fdd6dfa7a20e68290554e776b7317d872b0edf7a87b46b136bb3" exitCode=255 Jun 11 12:57:01.520065 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:01.519640 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759687bbbb-ts74t" event={"ID":"76e09fd7-9609-406a-ac12-71fbb978d2a5","Type":"ContainerDied","Data":"4c944a07ebb1fdd6dfa7a20e68290554e776b7317d872b0edf7a87b46b136bb3"} Jun 11 12:57:01.525360 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:01.525340 2558 scope.go:117] "RemoveContainer" containerID="4c944a07ebb1fdd6dfa7a20e68290554e776b7317d872b0edf7a87b46b136bb3" Jun 11 12:57:02.524280 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:02.524249 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759687bbbb-ts74t" event={"ID":"76e09fd7-9609-406a-ac12-71fbb978d2a5","Type":"ContainerStarted","Data":"d6f3b5946e2239ecb934964f22ccc281ab6b785de030c233bd020e576a1d57e7"} Jun 11 12:57:02.819173 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:02.819068 2558 scope.go:117] "RemoveContainer" containerID="6dad4342b5380de92686f160f98ae285aceadd790d4130926ce2253a494c6ab9" Jun 11 12:57:03.528929 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:03.528899 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lb8tl_20c98c8b-f1fa-4066-8907-1ac8f01bacf5/console-operator/2.log" Jun 11 12:57:03.529339 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:03.529287 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lb8tl_20c98c8b-f1fa-4066-8907-1ac8f01bacf5/console-operator/1.log" Jun 11 12:57:03.529339 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:03.529317 2558 generic.go:356] "Generic (PLEG): container finished" podID="20c98c8b-f1fa-4066-8907-1ac8f01bacf5" containerID="21e98d267a8756b1cb485cf2bed2464dfc9859a8220b5821037b4b829f2733c9" exitCode=255 Jun 11 12:57:03.529429 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:03.529380 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-lb8tl" event={"ID":"20c98c8b-f1fa-4066-8907-1ac8f01bacf5","Type":"ContainerDied","Data":"21e98d267a8756b1cb485cf2bed2464dfc9859a8220b5821037b4b829f2733c9"} Jun 11 12:57:03.529429 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:03.529425 2558 scope.go:117] "RemoveContainer" containerID="6dad4342b5380de92686f160f98ae285aceadd790d4130926ce2253a494c6ab9" Jun 11 12:57:03.529720 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:03.529700 2558 scope.go:117] "RemoveContainer" containerID="21e98d267a8756b1cb485cf2bed2464dfc9859a8220b5821037b4b829f2733c9" Jun 11 12:57:03.529902 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:57:03.529876 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-lb8tl_openshift-console-operator(20c98c8b-f1fa-4066-8907-1ac8f01bacf5)\"" pod="openshift-console-operator/console-operator-668fdbf85c-lb8tl" podUID="20c98c8b-f1fa-4066-8907-1ac8f01bacf5" Jun 11 12:57:04.533393 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:04.533360 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lb8tl_20c98c8b-f1fa-4066-8907-1ac8f01bacf5/console-operator/2.log" Jun 11 12:57:08.981547 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:08.981514 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bwmrj"] Jun 11 12:57:08.985307 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:08.985291 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bwmrj" Jun 11 12:57:08.989904 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:08.989885 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 12:57:08.990129 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:08.990107 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 12:57:08.990244 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:08.990113 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 12:57:08.990318 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:08.990194 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 12:57:08.991168 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:08.991131 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cw2rk\"" Jun 11 12:57:09.000031 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:09.000008 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bwmrj"] Jun 11 12:57:09.012942 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:09.012919 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-fcf5bd6bf-qv5rz"] Jun 11 12:57:09.082599 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:09.082568 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:09.089666 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:09.089640 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvck6\" (UniqueName: \"kubernetes.io/projected/c04f77fb-af91-4a59-b78e-400b06751a93-kube-api-access-gvck6\") pod \"insights-runtime-extractor-bwmrj\" (UID: \"c04f77fb-af91-4a59-b78e-400b06751a93\") " pod="openshift-insights/insights-runtime-extractor-bwmrj" Jun 11 12:57:09.089803 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:09.089716 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c04f77fb-af91-4a59-b78e-400b06751a93-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bwmrj\" (UID: \"c04f77fb-af91-4a59-b78e-400b06751a93\") " pod="openshift-insights/insights-runtime-extractor-bwmrj" Jun 11 12:57:09.089803 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:09.089749 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c04f77fb-af91-4a59-b78e-400b06751a93-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bwmrj\" (UID: \"c04f77fb-af91-4a59-b78e-400b06751a93\") " pod="openshift-insights/insights-runtime-extractor-bwmrj" Jun 11 12:57:09.089803 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:09.089796 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c04f77fb-af91-4a59-b78e-400b06751a93-crio-socket\") pod \"insights-runtime-extractor-bwmrj\" (UID: \"c04f77fb-af91-4a59-b78e-400b06751a93\") " pod="openshift-insights/insights-runtime-extractor-bwmrj" Jun 11 12:57:09.089899 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:09.089826 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c04f77fb-af91-4a59-b78e-400b06751a93-data-volume\") pod \"insights-runtime-extractor-bwmrj\" (UID: \"c04f77fb-af91-4a59-b78e-400b06751a93\") " pod="openshift-insights/insights-runtime-extractor-bwmrj" Jun 11 12:57:09.175257 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:09.175224 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:09.190838 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:09.190813 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c04f77fb-af91-4a59-b78e-400b06751a93-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bwmrj\" (UID: \"c04f77fb-af91-4a59-b78e-400b06751a93\") " pod="openshift-insights/insights-runtime-extractor-bwmrj" Jun 11 12:57:09.190925 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:09.190841 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c04f77fb-af91-4a59-b78e-400b06751a93-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bwmrj\" (UID: \"c04f77fb-af91-4a59-b78e-400b06751a93\") " pod="openshift-insights/insights-runtime-extractor-bwmrj" Jun 11 12:57:09.190925 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:09.190867 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c04f77fb-af91-4a59-b78e-400b06751a93-crio-socket\") pod \"insights-runtime-extractor-bwmrj\" (UID: \"c04f77fb-af91-4a59-b78e-400b06751a93\") " pod="openshift-insights/insights-runtime-extractor-bwmrj" Jun 11 12:57:09.191077 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:09.191066 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c04f77fb-af91-4a59-b78e-400b06751a93-crio-socket\") pod \"insights-runtime-extractor-bwmrj\" (UID: \"c04f77fb-af91-4a59-b78e-400b06751a93\") " pod="openshift-insights/insights-runtime-extractor-bwmrj" Jun 11 12:57:09.191122 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:09.191092 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c04f77fb-af91-4a59-b78e-400b06751a93-data-volume\") pod \"insights-runtime-extractor-bwmrj\" (UID: \"c04f77fb-af91-4a59-b78e-400b06751a93\") " pod="openshift-insights/insights-runtime-extractor-bwmrj" Jun 11 12:57:09.191174 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:09.191138 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvck6\" (UniqueName: \"kubernetes.io/projected/c04f77fb-af91-4a59-b78e-400b06751a93-kube-api-access-gvck6\") pod \"insights-runtime-extractor-bwmrj\" (UID: \"c04f77fb-af91-4a59-b78e-400b06751a93\") " pod="openshift-insights/insights-runtime-extractor-bwmrj" Jun 11 12:57:09.191416 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:09.191391 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c04f77fb-af91-4a59-b78e-400b06751a93-data-volume\") pod \"insights-runtime-extractor-bwmrj\" (UID: \"c04f77fb-af91-4a59-b78e-400b06751a93\") " pod="openshift-insights/insights-runtime-extractor-bwmrj" Jun 11 12:57:09.191527 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:09.191508 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c04f77fb-af91-4a59-b78e-400b06751a93-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bwmrj\" (UID: \"c04f77fb-af91-4a59-b78e-400b06751a93\") " pod="openshift-insights/insights-runtime-extractor-bwmrj" Jun 11 12:57:09.193135 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:09.193113 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c04f77fb-af91-4a59-b78e-400b06751a93-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bwmrj\" (UID: \"c04f77fb-af91-4a59-b78e-400b06751a93\") " pod="openshift-insights/insights-runtime-extractor-bwmrj" Jun 11 12:57:09.202039 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:09.202014 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvck6\" (UniqueName: \"kubernetes.io/projected/c04f77fb-af91-4a59-b78e-400b06751a93-kube-api-access-gvck6\") pod \"insights-runtime-extractor-bwmrj\" (UID: \"c04f77fb-af91-4a59-b78e-400b06751a93\") " pod="openshift-insights/insights-runtime-extractor-bwmrj" Jun 11 12:57:09.278356 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:09.278249 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:09.294324 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:09.294301 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bwmrj" Jun 11 12:57:09.419504 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:09.419399 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bwmrj"] Jun 11 12:57:09.421979 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:57:09.421947 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc04f77fb_af91_4a59_b78e_400b06751a93.slice/crio-bf1a0b622e5328bee695c6543b3d5cbeca683f0f76d96e45e138ea186a498a31 WatchSource:0}: Error finding container bf1a0b622e5328bee695c6543b3d5cbeca683f0f76d96e45e138ea186a498a31: Status 404 returned error can't find the container with id bf1a0b622e5328bee695c6543b3d5cbeca683f0f76d96e45e138ea186a498a31 Jun 11 12:57:09.478845 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:09.478821 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-lb8tl" Jun 11 12:57:09.478948 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:09.478874 2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-lb8tl" Jun 11 12:57:09.479232 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:09.479198 2558 scope.go:117] "RemoveContainer" containerID="21e98d267a8756b1cb485cf2bed2464dfc9859a8220b5821037b4b829f2733c9" Jun 11 12:57:09.479383 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:57:09.479366 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-lb8tl_openshift-console-operator(20c98c8b-f1fa-4066-8907-1ac8f01bacf5)\"" pod="openshift-console-operator/console-operator-668fdbf85c-lb8tl" podUID="20c98c8b-f1fa-4066-8907-1ac8f01bacf5" Jun 11 12:57:09.553409 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:09.553315 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bwmrj" event={"ID":"c04f77fb-af91-4a59-b78e-400b06751a93","Type":"ContainerStarted","Data":"4196a58f173e8ca73604ec470cdf22eb933f6137585c77abd770d48829a98e87"} Jun 11 12:57:09.553409 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:09.553403 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bwmrj" event={"ID":"c04f77fb-af91-4a59-b78e-400b06751a93","Type":"ContainerStarted","Data":"bf1a0b622e5328bee695c6543b3d5cbeca683f0f76d96e45e138ea186a498a31"} Jun 11 12:57:10.558050 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:10.558008 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bwmrj" event={"ID":"c04f77fb-af91-4a59-b78e-400b06751a93","Type":"ContainerStarted","Data":"6a90455238d9502aa38e0c8a2de28953235dcbc4f9639bddee3b83ebe8b8ac11"} Jun 11 12:57:11.006312 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:11.006280 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aa1e7777-83cf-4536-9e9e-dcc68a066c62-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-j9zf5\" (UID: \"aa1e7777-83cf-4536-9e9e-dcc68a066c62\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j9zf5" Jun 11 12:57:11.009134 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:11.009105 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aa1e7777-83cf-4536-9e9e-dcc68a066c62-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-j9zf5\" (UID: \"aa1e7777-83cf-4536-9e9e-dcc68a066c62\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j9zf5" Jun 11 12:57:11.076235 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:11.076202 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j9zf5" Jun 11 12:57:11.217865 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:11.217834 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j9zf5"] Jun 11 12:57:11.699530 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:57:11.699499 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa1e7777_83cf_4536_9e9e_dcc68a066c62.slice/crio-da961fd1698d013697d7e87060b621ef71fb7ea24a46f10a02c7e70b9782b29f WatchSource:0}: Error finding container da961fd1698d013697d7e87060b621ef71fb7ea24a46f10a02c7e70b9782b29f: Status 404 returned error can't find the container with id da961fd1698d013697d7e87060b621ef71fb7ea24a46f10a02c7e70b9782b29f Jun 11 12:57:12.566705 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:12.566663 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bwmrj" event={"ID":"c04f77fb-af91-4a59-b78e-400b06751a93","Type":"ContainerStarted","Data":"dcb9da4d6c9aaeb37b6c314744efeba8ca67726fcdb62b414d2c1c849c647e9b"} Jun 11 12:57:12.567621 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:12.567598 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j9zf5" event={"ID":"aa1e7777-83cf-4536-9e9e-dcc68a066c62","Type":"ContainerStarted","Data":"da961fd1698d013697d7e87060b621ef71fb7ea24a46f10a02c7e70b9782b29f"} Jun 11 12:57:12.585068 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:12.585026 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bwmrj" podStartSLOduration=2.380939584 podStartE2EDuration="4.585011814s" totalImagesPullingTime="2.20407223s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 12:57:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:57:12.583947905 +0000 UTC m=+232.230469848" watchObservedRunningTime="2026-06-11 12:57:12.585011814 +0000 UTC m=+232.231533734" Jun 11 12:57:13.572648 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:13.572606 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j9zf5" event={"ID":"aa1e7777-83cf-4536-9e9e-dcc68a066c62","Type":"ContainerStarted","Data":"39fd42f212136f119847da3a70f3bea03e51dce58200481481957e55d688a97c"} Jun 11 12:57:13.589300 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:13.589210 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-j9zf5" podStartSLOduration=32.95740759 podStartE2EDuration="34.589193668s" totalImagesPullingTime="1.631786078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:56:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:57:13.588844438 +0000 UTC m=+233.235366379" watchObservedRunningTime="2026-06-11 12:57:13.589193668 +0000 UTC m=+233.235715610" Jun 11 12:57:13.632145 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:13.632116 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:13.734973 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:13.734942 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:13.808486 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:13.808453 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:14.156908 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:14.156874 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:14.257526 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:14.257496 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:14.316042 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:14.316014 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:16.102683 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:16.102646 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:16.174467 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:16.174435 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:16.832215 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:16.832184 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:16.867026 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:16.866994 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-j27sv"] Jun 11 12:57:16.869295 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:16.869279 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-j27sv" Jun 11 12:57:16.873508 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:16.873486 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 11 12:57:16.873631 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:16.873542 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-5g2xq\"" Jun 11 12:57:16.874725 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:16.874708 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 11 12:57:16.874797 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:16.874739 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 12:57:16.880340 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:16.880319 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-j27sv"] Jun 11 12:57:16.951230 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:16.951198 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:16.955427 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:16.955408 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42412644-77a4-4534-b14f-249659d5428d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-j27sv\" (UID: \"42412644-77a4-4534-b14f-249659d5428d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-j27sv" Jun 11 12:57:16.955503 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:16.955457 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s64fg\" (UniqueName: \"kubernetes.io/projected/42412644-77a4-4534-b14f-249659d5428d-kube-api-access-s64fg\") pod \"prometheus-operator-7f7d445d84-j27sv\" (UID: \"42412644-77a4-4534-b14f-249659d5428d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-j27sv" Jun 11 12:57:16.955560 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:16.955541 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/42412644-77a4-4534-b14f-249659d5428d-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-j27sv\" (UID: \"42412644-77a4-4534-b14f-249659d5428d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-j27sv" Jun 11 12:57:16.955622 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:16.955604 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42412644-77a4-4534-b14f-249659d5428d-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-j27sv\" (UID: \"42412644-77a4-4534-b14f-249659d5428d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-j27sv" Jun 11 12:57:17.056932 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:17.056894 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42412644-77a4-4534-b14f-249659d5428d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-j27sv\" (UID: \"42412644-77a4-4534-b14f-249659d5428d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-j27sv" Jun 11 12:57:17.057108 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:17.056957 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s64fg\" (UniqueName: \"kubernetes.io/projected/42412644-77a4-4534-b14f-249659d5428d-kube-api-access-s64fg\") pod \"prometheus-operator-7f7d445d84-j27sv\" (UID: \"42412644-77a4-4534-b14f-249659d5428d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-j27sv" Jun 11 12:57:17.057108 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:17.057025 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/42412644-77a4-4534-b14f-249659d5428d-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-j27sv\" (UID: \"42412644-77a4-4534-b14f-249659d5428d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-j27sv" Jun 11 12:57:17.057245 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:57:17.057166 2558 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 11 12:57:17.057245 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:17.057180 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42412644-77a4-4534-b14f-249659d5428d-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-j27sv\" (UID: \"42412644-77a4-4534-b14f-249659d5428d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-j27sv" Jun 11 12:57:17.057245 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:57:17.057218 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42412644-77a4-4534-b14f-249659d5428d-prometheus-operator-tls podName:42412644-77a4-4534-b14f-249659d5428d nodeName:}" failed. No retries permitted until 2026-06-11 12:57:17.557206069 +0000 UTC m=+237.203727989 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/42412644-77a4-4534-b14f-249659d5428d-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-j27sv" (UID: "42412644-77a4-4534-b14f-249659d5428d") : secret "prometheus-operator-tls" not found Jun 11 12:57:17.057764 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:17.057746 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42412644-77a4-4534-b14f-249659d5428d-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-j27sv\" (UID: \"42412644-77a4-4534-b14f-249659d5428d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-j27sv" Jun 11 12:57:17.059420 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:17.059398 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42412644-77a4-4534-b14f-249659d5428d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-j27sv\" (UID: \"42412644-77a4-4534-b14f-249659d5428d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-j27sv" Jun 11 12:57:17.066807 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:17.066785 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s64fg\" (UniqueName: \"kubernetes.io/projected/42412644-77a4-4534-b14f-249659d5428d-kube-api-access-s64fg\") pod \"prometheus-operator-7f7d445d84-j27sv\" (UID: \"42412644-77a4-4534-b14f-249659d5428d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-j27sv" Jun 11 12:57:17.128207 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:17.128173 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:17.561018 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:17.560919 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/42412644-77a4-4534-b14f-249659d5428d-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-j27sv\" (UID: \"42412644-77a4-4534-b14f-249659d5428d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-j27sv" Jun 11 12:57:17.563321 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:17.563300 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/42412644-77a4-4534-b14f-249659d5428d-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-j27sv\" (UID: \"42412644-77a4-4534-b14f-249659d5428d\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-j27sv" Jun 11 12:57:17.778036 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:17.777984 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-j27sv" Jun 11 12:57:17.898691 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:17.898662 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-j27sv"] Jun 11 12:57:17.901569 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:57:17.901540 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42412644_77a4_4534_b14f_249659d5428d.slice/crio-8ba6e474127d971b5cb3b81da75ddab75fcc47771e483aaad358ccb66aa7c733 WatchSource:0}: Error finding container 8ba6e474127d971b5cb3b81da75ddab75fcc47771e483aaad358ccb66aa7c733: Status 404 returned error can't find the container with id 8ba6e474127d971b5cb3b81da75ddab75fcc47771e483aaad358ccb66aa7c733 Jun 11 12:57:18.590928 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:18.590886 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-j27sv" event={"ID":"42412644-77a4-4534-b14f-249659d5428d","Type":"ContainerStarted","Data":"8ba6e474127d971b5cb3b81da75ddab75fcc47771e483aaad358ccb66aa7c733"} Jun 11 12:57:19.019060 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:19.019021 2558 patch_prober.go:28] interesting pod/image-registry-fcf5bd6bf-qv5rz container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 12:57:19.019267 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:19.019087 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" podUID="770032ba-df71-4645-8c1f-d845abef1986" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 12:57:19.595943 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:19.595908 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-j27sv" event={"ID":"42412644-77a4-4534-b14f-249659d5428d","Type":"ContainerStarted","Data":"1b03d76b1ace8396f4d0a7625697d65add1f86b41f56490993a87bdfc58fcfa9"} Jun 11 12:57:19.596385 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:19.595972 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-j27sv" event={"ID":"42412644-77a4-4534-b14f-249659d5428d","Type":"ContainerStarted","Data":"2a8ddf93ba2daae95f076f906a008f5d95003ba6bcb191d5bccb10d07a8530dd"} Jun 11 12:57:19.614777 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:19.614730 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-j27sv" podStartSLOduration=2.129107371 podStartE2EDuration="3.614713625s" totalImagesPullingTime="1.485606254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:57:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:57:19.612964964 +0000 UTC m=+239.259486907" watchObservedRunningTime="2026-06-11 12:57:19.614713625 +0000 UTC m=+239.261235567" Jun 11 12:57:19.621458 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:19.621429 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:20.965399 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:20.965368 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:21.161974 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.161945 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:21.223709 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.223617 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2m2wk"] Jun 11 12:57:21.227656 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.227630 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2m2wk" Jun 11 12:57:21.230019 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.229997 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 12:57:21.230216 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.230020 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tjj7q\"" Jun 11 12:57:21.230308 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.230292 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 12:57:21.230361 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.230335 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 12:57:21.254691 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.254657 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:21.325296 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.325261 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:21.391557 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.391510 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8d31c2e-6c0b-4193-a3c3-959435fea56b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2m2wk\" (UID: \"f8d31c2e-6c0b-4193-a3c3-959435fea56b\") " pod="openshift-monitoring/node-exporter-2m2wk" Jun 11 12:57:21.391557 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.391549 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwfqn\" (UniqueName: \"kubernetes.io/projected/f8d31c2e-6c0b-4193-a3c3-959435fea56b-kube-api-access-kwfqn\") pod \"node-exporter-2m2wk\" (UID: \"f8d31c2e-6c0b-4193-a3c3-959435fea56b\") " pod="openshift-monitoring/node-exporter-2m2wk" Jun 11 12:57:21.391794 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.391573 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f8d31c2e-6c0b-4193-a3c3-959435fea56b-node-exporter-textfile\") pod \"node-exporter-2m2wk\" (UID: \"f8d31c2e-6c0b-4193-a3c3-959435fea56b\") " pod="openshift-monitoring/node-exporter-2m2wk" Jun 11 12:57:21.391794 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.391589 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f8d31c2e-6c0b-4193-a3c3-959435fea56b-node-exporter-accelerators-collector-config\") pod \"node-exporter-2m2wk\" (UID: \"f8d31c2e-6c0b-4193-a3c3-959435fea56b\") " pod="openshift-monitoring/node-exporter-2m2wk" Jun 11 12:57:21.391794 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.391682 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f8d31c2e-6c0b-4193-a3c3-959435fea56b-node-exporter-tls\") pod \"node-exporter-2m2wk\" (UID: \"f8d31c2e-6c0b-4193-a3c3-959435fea56b\") " pod="openshift-monitoring/node-exporter-2m2wk" Jun 11 12:57:21.391794 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.391700 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f8d31c2e-6c0b-4193-a3c3-959435fea56b-root\") pod \"node-exporter-2m2wk\" (UID: \"f8d31c2e-6c0b-4193-a3c3-959435fea56b\") " pod="openshift-monitoring/node-exporter-2m2wk" Jun 11 12:57:21.391794 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.391717 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f8d31c2e-6c0b-4193-a3c3-959435fea56b-node-exporter-wtmp\") pod \"node-exporter-2m2wk\" (UID: \"f8d31c2e-6c0b-4193-a3c3-959435fea56b\") " pod="openshift-monitoring/node-exporter-2m2wk" Jun 11 12:57:21.391794 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.391766 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8d31c2e-6c0b-4193-a3c3-959435fea56b-sys\") pod \"node-exporter-2m2wk\" (UID: \"f8d31c2e-6c0b-4193-a3c3-959435fea56b\") " pod="openshift-monitoring/node-exporter-2m2wk" Jun 11 12:57:21.391986 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.391808 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8d31c2e-6c0b-4193-a3c3-959435fea56b-metrics-client-ca\") pod \"node-exporter-2m2wk\" (UID: \"f8d31c2e-6c0b-4193-a3c3-959435fea56b\") " pod="openshift-monitoring/node-exporter-2m2wk" Jun 11 12:57:21.432090 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.432062 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:21.492505 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.492416 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f8d31c2e-6c0b-4193-a3c3-959435fea56b-node-exporter-tls\") pod \"node-exporter-2m2wk\" (UID: \"f8d31c2e-6c0b-4193-a3c3-959435fea56b\") " pod="openshift-monitoring/node-exporter-2m2wk" Jun 11 12:57:21.492505 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.492452 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f8d31c2e-6c0b-4193-a3c3-959435fea56b-root\") pod \"node-exporter-2m2wk\" (UID: \"f8d31c2e-6c0b-4193-a3c3-959435fea56b\") " pod="openshift-monitoring/node-exporter-2m2wk" Jun 11 12:57:21.492505 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.492470 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f8d31c2e-6c0b-4193-a3c3-959435fea56b-node-exporter-wtmp\") pod \"node-exporter-2m2wk\" (UID: \"f8d31c2e-6c0b-4193-a3c3-959435fea56b\") " pod="openshift-monitoring/node-exporter-2m2wk" Jun 11 12:57:21.492719 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.492518 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f8d31c2e-6c0b-4193-a3c3-959435fea56b-root\") pod \"node-exporter-2m2wk\" (UID: \"f8d31c2e-6c0b-4193-a3c3-959435fea56b\") " pod="openshift-monitoring/node-exporter-2m2wk" Jun 11 12:57:21.492719 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.492543 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8d31c2e-6c0b-4193-a3c3-959435fea56b-sys\") pod \"node-exporter-2m2wk\" (UID: \"f8d31c2e-6c0b-4193-a3c3-959435fea56b\") " pod="openshift-monitoring/node-exporter-2m2wk" Jun 11 12:57:21.492719 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.492558 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8d31c2e-6c0b-4193-a3c3-959435fea56b-metrics-client-ca\") pod \"node-exporter-2m2wk\" (UID: \"f8d31c2e-6c0b-4193-a3c3-959435fea56b\") " pod="openshift-monitoring/node-exporter-2m2wk" Jun 11 12:57:21.492719 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.492621 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8d31c2e-6c0b-4193-a3c3-959435fea56b-sys\") pod \"node-exporter-2m2wk\" (UID: \"f8d31c2e-6c0b-4193-a3c3-959435fea56b\") " pod="openshift-monitoring/node-exporter-2m2wk" Jun 11 12:57:21.492719 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.492626 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8d31c2e-6c0b-4193-a3c3-959435fea56b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2m2wk\" (UID: \"f8d31c2e-6c0b-4193-a3c3-959435fea56b\") " pod="openshift-monitoring/node-exporter-2m2wk" Jun 11 12:57:21.492719 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.492665 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f8d31c2e-6c0b-4193-a3c3-959435fea56b-node-exporter-wtmp\") pod \"node-exporter-2m2wk\" (UID: \"f8d31c2e-6c0b-4193-a3c3-959435fea56b\") " pod="openshift-monitoring/node-exporter-2m2wk" Jun 11 12:57:21.492719 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.492692 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwfqn\" (UniqueName: \"kubernetes.io/projected/f8d31c2e-6c0b-4193-a3c3-959435fea56b-kube-api-access-kwfqn\") pod \"node-exporter-2m2wk\" (UID: \"f8d31c2e-6c0b-4193-a3c3-959435fea56b\") " pod="openshift-monitoring/node-exporter-2m2wk" Jun 11 12:57:21.493031 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.492728 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f8d31c2e-6c0b-4193-a3c3-959435fea56b-node-exporter-textfile\") pod \"node-exporter-2m2wk\" (UID: \"f8d31c2e-6c0b-4193-a3c3-959435fea56b\") " pod="openshift-monitoring/node-exporter-2m2wk" Jun 11 12:57:21.493031 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.492756 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f8d31c2e-6c0b-4193-a3c3-959435fea56b-node-exporter-accelerators-collector-config\") pod \"node-exporter-2m2wk\" (UID: \"f8d31c2e-6c0b-4193-a3c3-959435fea56b\") " pod="openshift-monitoring/node-exporter-2m2wk" Jun 11 12:57:21.493122 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.493044 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f8d31c2e-6c0b-4193-a3c3-959435fea56b-node-exporter-textfile\") pod \"node-exporter-2m2wk\" (UID: \"f8d31c2e-6c0b-4193-a3c3-959435fea56b\") " pod="openshift-monitoring/node-exporter-2m2wk" Jun 11 12:57:21.493283 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.493267 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8d31c2e-6c0b-4193-a3c3-959435fea56b-metrics-client-ca\") pod \"node-exporter-2m2wk\" (UID: \"f8d31c2e-6c0b-4193-a3c3-959435fea56b\") " pod="openshift-monitoring/node-exporter-2m2wk" Jun 11 12:57:21.493368 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.493346 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f8d31c2e-6c0b-4193-a3c3-959435fea56b-node-exporter-accelerators-collector-config\") pod \"node-exporter-2m2wk\" (UID: \"f8d31c2e-6c0b-4193-a3c3-959435fea56b\") " pod="openshift-monitoring/node-exporter-2m2wk" Jun 11 12:57:21.494850 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.494826 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f8d31c2e-6c0b-4193-a3c3-959435fea56b-node-exporter-tls\") pod \"node-exporter-2m2wk\" (UID: \"f8d31c2e-6c0b-4193-a3c3-959435fea56b\") " pod="openshift-monitoring/node-exporter-2m2wk" Jun 11 12:57:21.494955 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.494887 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8d31c2e-6c0b-4193-a3c3-959435fea56b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2m2wk\" (UID: \"f8d31c2e-6c0b-4193-a3c3-959435fea56b\") " pod="openshift-monitoring/node-exporter-2m2wk" Jun 11 12:57:21.501895 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.501876 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwfqn\" (UniqueName: \"kubernetes.io/projected/f8d31c2e-6c0b-4193-a3c3-959435fea56b-kube-api-access-kwfqn\") pod \"node-exporter-2m2wk\" (UID: \"f8d31c2e-6c0b-4193-a3c3-959435fea56b\") " pod="openshift-monitoring/node-exporter-2m2wk" Jun 11 12:57:21.537032 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.537006 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2m2wk" Jun 11 12:57:21.550216 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:57:21.549501 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8d31c2e_6c0b_4193_a3c3_959435fea56b.slice/crio-c36e9fe75dc1a36e6a52c385f81d639b9b38d81d0eb31a82efe2ce7d90e26427 WatchSource:0}: Error finding container c36e9fe75dc1a36e6a52c385f81d639b9b38d81d0eb31a82efe2ce7d90e26427: Status 404 returned error can't find the container with id c36e9fe75dc1a36e6a52c385f81d639b9b38d81d0eb31a82efe2ce7d90e26427 Jun 11 12:57:21.587318 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.587290 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:21.603913 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.603888 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2m2wk" event={"ID":"f8d31c2e-6c0b-4193-a3c3-959435fea56b","Type":"ContainerStarted","Data":"c36e9fe75dc1a36e6a52c385f81d639b9b38d81d0eb31a82efe2ce7d90e26427"} Jun 11 12:57:21.684318 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.684281 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:21.819644 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.819569 2558 scope.go:117] "RemoveContainer" containerID="21e98d267a8756b1cb485cf2bed2464dfc9859a8220b5821037b4b829f2733c9" Jun 11 12:57:21.819817 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:57:21.819716 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-lb8tl_openshift-console-operator(20c98c8b-f1fa-4066-8907-1ac8f01bacf5)\"" pod="openshift-console-operator/console-operator-668fdbf85c-lb8tl" podUID="20c98c8b-f1fa-4066-8907-1ac8f01bacf5" Jun 11 12:57:21.896916 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:21.896888 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:22.230875 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:22.230839 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:22.331821 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:22.331778 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:22.533570 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:22.533519 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:22.609698 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:22.609660 2558 generic.go:356] "Generic (PLEG): container finished" podID="f8d31c2e-6c0b-4193-a3c3-959435fea56b" containerID="9cd3cbcb372ee2863e0662eede71b72937d19b0e0c66c832321c5445ad7a00a1" exitCode=0 Jun 11 12:57:22.609894 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:22.609747 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2m2wk" event={"ID":"f8d31c2e-6c0b-4193-a3c3-959435fea56b","Type":"ContainerDied","Data":"9cd3cbcb372ee2863e0662eede71b72937d19b0e0c66c832321c5445ad7a00a1"} Jun 11 12:57:23.615545 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:23.615509 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2m2wk" event={"ID":"f8d31c2e-6c0b-4193-a3c3-959435fea56b","Type":"ContainerStarted","Data":"7155ddc89aca13f5d45b0a849bb595055741f31f1619ba4886f5abc83a759e8a"} Jun 11 12:57:23.615995 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:23.615566 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2m2wk" event={"ID":"f8d31c2e-6c0b-4193-a3c3-959435fea56b","Type":"ContainerStarted","Data":"b0523691c735e9c7de35f633cf8c03448c04b6a434dc929e1adc83220846e111"} Jun 11 12:57:23.635596 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:23.635547 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2m2wk" podStartSLOduration=1.767612863 podStartE2EDuration="2.635532218s" totalImagesPullingTime="798.06332ms" totalInitContainerRuntime="69.856035ms" isStatefulPod=true podCreationTimestamp="2026-06-11 12:57:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:57:23.634688996 +0000 UTC m=+243.281210937" watchObservedRunningTime="2026-06-11 12:57:23.635532218 +0000 UTC m=+243.282054159" Jun 11 12:57:24.200443 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:24.200407 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:24.294711 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:24.294677 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:24.360871 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:24.360837 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:25.314185 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:25.314136 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:25.626030 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:25.625998 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-f7c4fbc7f-992fg"] Jun 11 12:57:25.628595 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:25.628579 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-f7c4fbc7f-992fg" Jun 11 12:57:25.632259 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:25.632232 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 11 12:57:25.632259 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:25.632244 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 12:57:25.633442 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:25.633423 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-5ftgz\"" Jun 11 12:57:25.633501 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:25.633488 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 11 12:57:25.633598 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:25.633582 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 11 12:57:25.633732 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:25.633716 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-et3m8ndck09a5\"" Jun 11 12:57:25.640110 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:25.640082 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-f7c4fbc7f-992fg"] Jun 11 12:57:25.731043 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:25.731004 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2c38901-dc6a-4f6f-810d-ebb448a80f50-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f7c4fbc7f-992fg\" (UID: \"b2c38901-dc6a-4f6f-810d-ebb448a80f50\") " pod="openshift-monitoring/metrics-server-f7c4fbc7f-992fg" Jun 11 12:57:25.731250 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:25.731071 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b2c38901-dc6a-4f6f-810d-ebb448a80f50-metrics-server-audit-profiles\") pod \"metrics-server-f7c4fbc7f-992fg\" (UID: \"b2c38901-dc6a-4f6f-810d-ebb448a80f50\") " pod="openshift-monitoring/metrics-server-f7c4fbc7f-992fg" Jun 11 12:57:25.731250 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:25.731124 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8wg2\" (UniqueName: \"kubernetes.io/projected/b2c38901-dc6a-4f6f-810d-ebb448a80f50-kube-api-access-n8wg2\") pod \"metrics-server-f7c4fbc7f-992fg\" (UID: \"b2c38901-dc6a-4f6f-810d-ebb448a80f50\") " pod="openshift-monitoring/metrics-server-f7c4fbc7f-992fg" Jun 11 12:57:25.731250 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:25.731191 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b2c38901-dc6a-4f6f-810d-ebb448a80f50-client-ca-bundle\") pod \"metrics-server-f7c4fbc7f-992fg\" (UID: \"b2c38901-dc6a-4f6f-810d-ebb448a80f50\") " pod="openshift-monitoring/metrics-server-f7c4fbc7f-992fg" Jun 11 12:57:25.731250 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:25.731218 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b2c38901-dc6a-4f6f-810d-ebb448a80f50-secret-metrics-server-tls\") pod \"metrics-server-f7c4fbc7f-992fg\" (UID: \"b2c38901-dc6a-4f6f-810d-ebb448a80f50\") " pod="openshift-monitoring/metrics-server-f7c4fbc7f-992fg" Jun 11 12:57:25.731416 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:25.731260 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b2c38901-dc6a-4f6f-810d-ebb448a80f50-audit-log\") pod \"metrics-server-f7c4fbc7f-992fg\" (UID: \"b2c38901-dc6a-4f6f-810d-ebb448a80f50\") " pod="openshift-monitoring/metrics-server-f7c4fbc7f-992fg" Jun 11 12:57:25.731416 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:25.731283 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b2c38901-dc6a-4f6f-810d-ebb448a80f50-secret-metrics-server-client-certs\") pod \"metrics-server-f7c4fbc7f-992fg\" (UID: \"b2c38901-dc6a-4f6f-810d-ebb448a80f50\") " pod="openshift-monitoring/metrics-server-f7c4fbc7f-992fg" Jun 11 12:57:25.832666 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:25.832631 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b2c38901-dc6a-4f6f-810d-ebb448a80f50-metrics-server-audit-profiles\") pod \"metrics-server-f7c4fbc7f-992fg\" (UID: \"b2c38901-dc6a-4f6f-810d-ebb448a80f50\") " pod="openshift-monitoring/metrics-server-f7c4fbc7f-992fg" Jun 11 12:57:25.832819 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:25.832672 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8wg2\" (UniqueName: \"kubernetes.io/projected/b2c38901-dc6a-4f6f-810d-ebb448a80f50-kube-api-access-n8wg2\") pod \"metrics-server-f7c4fbc7f-992fg\" (UID: \"b2c38901-dc6a-4f6f-810d-ebb448a80f50\") " pod="openshift-monitoring/metrics-server-f7c4fbc7f-992fg" Jun 11 12:57:25.832819 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:25.832699 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b2c38901-dc6a-4f6f-810d-ebb448a80f50-client-ca-bundle\") pod \"metrics-server-f7c4fbc7f-992fg\" (UID: \"b2c38901-dc6a-4f6f-810d-ebb448a80f50\") " pod="openshift-monitoring/metrics-server-f7c4fbc7f-992fg" Jun 11 12:57:25.832819 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:25.832810 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b2c38901-dc6a-4f6f-810d-ebb448a80f50-secret-metrics-server-tls\") pod \"metrics-server-f7c4fbc7f-992fg\" (UID: \"b2c38901-dc6a-4f6f-810d-ebb448a80f50\") " pod="openshift-monitoring/metrics-server-f7c4fbc7f-992fg" Jun 11 12:57:25.832977 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:25.832849 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b2c38901-dc6a-4f6f-810d-ebb448a80f50-audit-log\") pod \"metrics-server-f7c4fbc7f-992fg\" (UID: \"b2c38901-dc6a-4f6f-810d-ebb448a80f50\") " pod="openshift-monitoring/metrics-server-f7c4fbc7f-992fg" Jun 11 12:57:25.832977 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:25.832887 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b2c38901-dc6a-4f6f-810d-ebb448a80f50-secret-metrics-server-client-certs\") pod \"metrics-server-f7c4fbc7f-992fg\" (UID: \"b2c38901-dc6a-4f6f-810d-ebb448a80f50\") " pod="openshift-monitoring/metrics-server-f7c4fbc7f-992fg" Jun 11 12:57:25.832977 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:25.832944 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2c38901-dc6a-4f6f-810d-ebb448a80f50-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f7c4fbc7f-992fg\" (UID: \"b2c38901-dc6a-4f6f-810d-ebb448a80f50\") " pod="openshift-monitoring/metrics-server-f7c4fbc7f-992fg" Jun 11 12:57:25.833408 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:25.833383 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b2c38901-dc6a-4f6f-810d-ebb448a80f50-audit-log\") pod \"metrics-server-f7c4fbc7f-992fg\" (UID: \"b2c38901-dc6a-4f6f-810d-ebb448a80f50\") " pod="openshift-monitoring/metrics-server-f7c4fbc7f-992fg" Jun 11 12:57:25.833681 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:25.833660 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2c38901-dc6a-4f6f-810d-ebb448a80f50-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f7c4fbc7f-992fg\" (UID: \"b2c38901-dc6a-4f6f-810d-ebb448a80f50\") " pod="openshift-monitoring/metrics-server-f7c4fbc7f-992fg" Jun 11 12:57:25.833743 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:25.833734 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b2c38901-dc6a-4f6f-810d-ebb448a80f50-metrics-server-audit-profiles\") pod \"metrics-server-f7c4fbc7f-992fg\" (UID: \"b2c38901-dc6a-4f6f-810d-ebb448a80f50\") " pod="openshift-monitoring/metrics-server-f7c4fbc7f-992fg" Jun 11 12:57:25.835271 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:25.835244 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b2c38901-dc6a-4f6f-810d-ebb448a80f50-secret-metrics-server-tls\") pod \"metrics-server-f7c4fbc7f-992fg\" (UID: \"b2c38901-dc6a-4f6f-810d-ebb448a80f50\") " pod="openshift-monitoring/metrics-server-f7c4fbc7f-992fg" Jun 11 12:57:25.835585 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:25.835568 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b2c38901-dc6a-4f6f-810d-ebb448a80f50-secret-metrics-server-client-certs\") pod \"metrics-server-f7c4fbc7f-992fg\" (UID: \"b2c38901-dc6a-4f6f-810d-ebb448a80f50\") " pod="openshift-monitoring/metrics-server-f7c4fbc7f-992fg" Jun 11 12:57:25.835678 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:25.835660 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b2c38901-dc6a-4f6f-810d-ebb448a80f50-client-ca-bundle\") pod \"metrics-server-f7c4fbc7f-992fg\" (UID: \"b2c38901-dc6a-4f6f-810d-ebb448a80f50\") " pod="openshift-monitoring/metrics-server-f7c4fbc7f-992fg" Jun 11 12:57:25.842560 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:25.842538 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8wg2\" (UniqueName: \"kubernetes.io/projected/b2c38901-dc6a-4f6f-810d-ebb448a80f50-kube-api-access-n8wg2\") pod \"metrics-server-f7c4fbc7f-992fg\" (UID: \"b2c38901-dc6a-4f6f-810d-ebb448a80f50\") " pod="openshift-monitoring/metrics-server-f7c4fbc7f-992fg" Jun 11 12:57:25.938100 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:25.938026 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-f7c4fbc7f-992fg" Jun 11 12:57:25.989008 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:25.988975 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:25.992105 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:25.992078 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-787h4"] Jun 11 12:57:25.996572 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:25.996553 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-787h4" Jun 11 12:57:26.000669 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.000642 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 11 12:57:26.001023 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.001004 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-6z9n7\"" Jun 11 12:57:26.007717 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.005299 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-787h4"] Jun 11 12:57:26.080771 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.080733 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-f7c4fbc7f-992fg"] Jun 11 12:57:26.083780 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:57:26.083750 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2c38901_dc6a_4f6f_810d_ebb448a80f50.slice/crio-95c98cb0c641ae93239cce4e66ea4d1d331f0ebb06cc645fd9f65eaa90241451 WatchSource:0}: Error finding container 95c98cb0c641ae93239cce4e66ea4d1d331f0ebb06cc645fd9f65eaa90241451: Status 404 returned error can't find the container with id 95c98cb0c641ae93239cce4e66ea4d1d331f0ebb06cc645fd9f65eaa90241451 Jun 11 12:57:26.135997 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.135962 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnbj4\" (UniqueName: \"kubernetes.io/projected/f26dcba0-eac9-44e3-8f3b-7712e8a96b60-kube-api-access-pnbj4\") pod \"monitoring-plugin-76b68cc874-787h4\" (UID: \"f26dcba0-eac9-44e3-8f3b-7712e8a96b60\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-787h4" Jun 11 12:57:26.135997 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.136000 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f26dcba0-eac9-44e3-8f3b-7712e8a96b60-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-787h4\" (UID: \"f26dcba0-eac9-44e3-8f3b-7712e8a96b60\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-787h4" Jun 11 12:57:26.143292 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.143241 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:26.208384 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.208306 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:26.236429 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.236398 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnbj4\" (UniqueName: \"kubernetes.io/projected/f26dcba0-eac9-44e3-8f3b-7712e8a96b60-kube-api-access-pnbj4\") pod \"monitoring-plugin-76b68cc874-787h4\" (UID: \"f26dcba0-eac9-44e3-8f3b-7712e8a96b60\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-787h4" Jun 11 12:57:26.236622 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.236442 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f26dcba0-eac9-44e3-8f3b-7712e8a96b60-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-787h4\" (UID: \"f26dcba0-eac9-44e3-8f3b-7712e8a96b60\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-787h4" Jun 11 12:57:26.238821 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.238801 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f26dcba0-eac9-44e3-8f3b-7712e8a96b60-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-787h4\" (UID: \"f26dcba0-eac9-44e3-8f3b-7712e8a96b60\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-787h4" Jun 11 12:57:26.245516 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.245498 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnbj4\" (UniqueName: \"kubernetes.io/projected/f26dcba0-eac9-44e3-8f3b-7712e8a96b60-kube-api-access-pnbj4\") pod \"monitoring-plugin-76b68cc874-787h4\" (UID: \"f26dcba0-eac9-44e3-8f3b-7712e8a96b60\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-787h4" Jun 11 12:57:26.276203 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.276172 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:26.309174 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.309102 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-787h4" Jun 11 12:57:26.441985 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.441962 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-787h4"] Jun 11 12:57:26.444104 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:57:26.444077 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf26dcba0_eac9_44e3_8f3b_7712e8a96b60.slice/crio-d4bba6be5353aca7a3881c549e9bf1f6c339bef17e5fa3bad07329acede20f41 WatchSource:0}: Error finding container d4bba6be5353aca7a3881c549e9bf1f6c339bef17e5fa3bad07329acede20f41: Status 404 returned error can't find the container with id d4bba6be5353aca7a3881c549e9bf1f6c339bef17e5fa3bad07329acede20f41 Jun 11 12:57:26.460098 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.460040 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-57747d55bd-5w9dp"] Jun 11 12:57:26.462912 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.462893 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-57747d55bd-5w9dp" Jun 11 12:57:26.468504 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.468478 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 11 12:57:26.468696 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.468634 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 11 12:57:26.468913 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.468744 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 11 12:57:26.468913 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.468866 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 11 12:57:26.469129 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.469109 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-vn2qh\"" Jun 11 12:57:26.469820 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.469803 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 11 12:57:26.475705 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.475688 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 11 12:57:26.483049 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.483026 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-57747d55bd-5w9dp"] Jun 11 12:57:26.632051 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.632009 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-f7c4fbc7f-992fg" event={"ID":"b2c38901-dc6a-4f6f-810d-ebb448a80f50","Type":"ContainerStarted","Data":"95c98cb0c641ae93239cce4e66ea4d1d331f0ebb06cc645fd9f65eaa90241451"} Jun 11 12:57:26.633409 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.633373 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-787h4" event={"ID":"f26dcba0-eac9-44e3-8f3b-7712e8a96b60","Type":"ContainerStarted","Data":"d4bba6be5353aca7a3881c549e9bf1f6c339bef17e5fa3bad07329acede20f41"} Jun 11 12:57:26.640764 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.640736 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45918f10-dcf7-4753-924d-f4a43c9906e3-metrics-client-ca\") pod \"telemeter-client-57747d55bd-5w9dp\" (UID: \"45918f10-dcf7-4753-924d-f4a43c9906e3\") " pod="openshift-monitoring/telemeter-client-57747d55bd-5w9dp" Jun 11 12:57:26.640887 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.640780 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45918f10-dcf7-4753-924d-f4a43c9906e3-serving-certs-ca-bundle\") pod \"telemeter-client-57747d55bd-5w9dp\" (UID: \"45918f10-dcf7-4753-924d-f4a43c9906e3\") " pod="openshift-monitoring/telemeter-client-57747d55bd-5w9dp" Jun 11 12:57:26.640887 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.640822 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/45918f10-dcf7-4753-924d-f4a43c9906e3-federate-client-tls\") pod \"telemeter-client-57747d55bd-5w9dp\" (UID: \"45918f10-dcf7-4753-924d-f4a43c9906e3\") " pod="openshift-monitoring/telemeter-client-57747d55bd-5w9dp" Jun 11 12:57:26.640887 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.640845 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45918f10-dcf7-4753-924d-f4a43c9906e3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-57747d55bd-5w9dp\" (UID: \"45918f10-dcf7-4753-924d-f4a43c9906e3\") " pod="openshift-monitoring/telemeter-client-57747d55bd-5w9dp" Jun 11 12:57:26.640887 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.640879 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/45918f10-dcf7-4753-924d-f4a43c9906e3-secret-telemeter-client\") pod \"telemeter-client-57747d55bd-5w9dp\" (UID: \"45918f10-dcf7-4753-924d-f4a43c9906e3\") " pod="openshift-monitoring/telemeter-client-57747d55bd-5w9dp" Jun 11 12:57:26.641098 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.640949 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/45918f10-dcf7-4753-924d-f4a43c9906e3-telemeter-client-tls\") pod \"telemeter-client-57747d55bd-5w9dp\" (UID: \"45918f10-dcf7-4753-924d-f4a43c9906e3\") " pod="openshift-monitoring/telemeter-client-57747d55bd-5w9dp" Jun 11 12:57:26.641098 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.640975 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/45918f10-dcf7-4753-924d-f4a43c9906e3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-57747d55bd-5w9dp\" (UID: \"45918f10-dcf7-4753-924d-f4a43c9906e3\") " pod="openshift-monitoring/telemeter-client-57747d55bd-5w9dp" Jun 11 12:57:26.641098 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.641018 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcmdp\" (UniqueName: \"kubernetes.io/projected/45918f10-dcf7-4753-924d-f4a43c9906e3-kube-api-access-bcmdp\") pod \"telemeter-client-57747d55bd-5w9dp\" (UID: \"45918f10-dcf7-4753-924d-f4a43c9906e3\") " pod="openshift-monitoring/telemeter-client-57747d55bd-5w9dp" Jun 11 12:57:26.741684 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.741602 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/45918f10-dcf7-4753-924d-f4a43c9906e3-telemeter-client-tls\") pod \"telemeter-client-57747d55bd-5w9dp\" (UID: \"45918f10-dcf7-4753-924d-f4a43c9906e3\") " pod="openshift-monitoring/telemeter-client-57747d55bd-5w9dp" Jun 11 12:57:26.741684 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.741654 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/45918f10-dcf7-4753-924d-f4a43c9906e3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-57747d55bd-5w9dp\" (UID: \"45918f10-dcf7-4753-924d-f4a43c9906e3\") " pod="openshift-monitoring/telemeter-client-57747d55bd-5w9dp" Jun 11 12:57:26.741913 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.741703 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcmdp\" (UniqueName: \"kubernetes.io/projected/45918f10-dcf7-4753-924d-f4a43c9906e3-kube-api-access-bcmdp\") pod \"telemeter-client-57747d55bd-5w9dp\" (UID: \"45918f10-dcf7-4753-924d-f4a43c9906e3\") " pod="openshift-monitoring/telemeter-client-57747d55bd-5w9dp" Jun 11 12:57:26.741913 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.741761 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45918f10-dcf7-4753-924d-f4a43c9906e3-metrics-client-ca\") pod \"telemeter-client-57747d55bd-5w9dp\" (UID: \"45918f10-dcf7-4753-924d-f4a43c9906e3\") " pod="openshift-monitoring/telemeter-client-57747d55bd-5w9dp" Jun 11 12:57:26.741913 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.741795 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45918f10-dcf7-4753-924d-f4a43c9906e3-serving-certs-ca-bundle\") pod \"telemeter-client-57747d55bd-5w9dp\" (UID: \"45918f10-dcf7-4753-924d-f4a43c9906e3\") " pod="openshift-monitoring/telemeter-client-57747d55bd-5w9dp" Jun 11 12:57:26.741913 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.741838 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/45918f10-dcf7-4753-924d-f4a43c9906e3-federate-client-tls\") pod \"telemeter-client-57747d55bd-5w9dp\" (UID: \"45918f10-dcf7-4753-924d-f4a43c9906e3\") " pod="openshift-monitoring/telemeter-client-57747d55bd-5w9dp" Jun 11 12:57:26.741913 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.741864 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45918f10-dcf7-4753-924d-f4a43c9906e3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-57747d55bd-5w9dp\" (UID: \"45918f10-dcf7-4753-924d-f4a43c9906e3\") " pod="openshift-monitoring/telemeter-client-57747d55bd-5w9dp" Jun 11 12:57:26.741913 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.741891 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/45918f10-dcf7-4753-924d-f4a43c9906e3-secret-telemeter-client\") pod \"telemeter-client-57747d55bd-5w9dp\" (UID: \"45918f10-dcf7-4753-924d-f4a43c9906e3\") " pod="openshift-monitoring/telemeter-client-57747d55bd-5w9dp" Jun 11 12:57:26.742772 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.742741 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45918f10-dcf7-4753-924d-f4a43c9906e3-serving-certs-ca-bundle\") pod \"telemeter-client-57747d55bd-5w9dp\" (UID: \"45918f10-dcf7-4753-924d-f4a43c9906e3\") " pod="openshift-monitoring/telemeter-client-57747d55bd-5w9dp" Jun 11 12:57:26.742902 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.742778 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45918f10-dcf7-4753-924d-f4a43c9906e3-metrics-client-ca\") pod \"telemeter-client-57747d55bd-5w9dp\" (UID: \"45918f10-dcf7-4753-924d-f4a43c9906e3\") " pod="openshift-monitoring/telemeter-client-57747d55bd-5w9dp" Jun 11 12:57:26.742962 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.742939 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45918f10-dcf7-4753-924d-f4a43c9906e3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-57747d55bd-5w9dp\" (UID: \"45918f10-dcf7-4753-924d-f4a43c9906e3\") " pod="openshift-monitoring/telemeter-client-57747d55bd-5w9dp" Jun 11 12:57:26.744662 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.744640 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/45918f10-dcf7-4753-924d-f4a43c9906e3-telemeter-client-tls\") pod \"telemeter-client-57747d55bd-5w9dp\" (UID: \"45918f10-dcf7-4753-924d-f4a43c9906e3\") " pod="openshift-monitoring/telemeter-client-57747d55bd-5w9dp" Jun 11 12:57:26.744776 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.744703 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/45918f10-dcf7-4753-924d-f4a43c9906e3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-57747d55bd-5w9dp\" (UID: \"45918f10-dcf7-4753-924d-f4a43c9906e3\") " pod="openshift-monitoring/telemeter-client-57747d55bd-5w9dp" Jun 11 12:57:26.744848 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.744828 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/45918f10-dcf7-4753-924d-f4a43c9906e3-secret-telemeter-client\") pod \"telemeter-client-57747d55bd-5w9dp\" (UID: \"45918f10-dcf7-4753-924d-f4a43c9906e3\") " pod="openshift-monitoring/telemeter-client-57747d55bd-5w9dp" Jun 11 12:57:26.744848 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.744843 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/45918f10-dcf7-4753-924d-f4a43c9906e3-federate-client-tls\") pod \"telemeter-client-57747d55bd-5w9dp\" (UID: \"45918f10-dcf7-4753-924d-f4a43c9906e3\") " pod="openshift-monitoring/telemeter-client-57747d55bd-5w9dp" Jun 11 12:57:26.750812 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.750791 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcmdp\" (UniqueName: \"kubernetes.io/projected/45918f10-dcf7-4753-924d-f4a43c9906e3-kube-api-access-bcmdp\") pod \"telemeter-client-57747d55bd-5w9dp\" (UID: \"45918f10-dcf7-4753-924d-f4a43c9906e3\") " pod="openshift-monitoring/telemeter-client-57747d55bd-5w9dp" Jun 11 12:57:26.771784 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.771753 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-57747d55bd-5w9dp" Jun 11 12:57:26.928316 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:26.928273 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-57747d55bd-5w9dp"] Jun 11 12:57:26.932005 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:57:26.931965 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45918f10_dcf7_4753_924d_f4a43c9906e3.slice/crio-c5c2a95207278f14b36b75db4bb28c10a30380a9e804d6391a9c124b6224ad8e WatchSource:0}: Error finding container c5c2a95207278f14b36b75db4bb28c10a30380a9e804d6391a9c124b6224ad8e: Status 404 returned error can't find the container with id c5c2a95207278f14b36b75db4bb28c10a30380a9e804d6391a9c124b6224ad8e Jun 11 12:57:27.484694 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:27.484646 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:27.638292 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:27.638244 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-57747d55bd-5w9dp" event={"ID":"45918f10-dcf7-4753-924d-f4a43c9906e3","Type":"ContainerStarted","Data":"c5c2a95207278f14b36b75db4bb28c10a30380a9e804d6391a9c124b6224ad8e"} Jun 11 12:57:28.644610 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:28.644575 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-787h4" event={"ID":"f26dcba0-eac9-44e3-8f3b-7712e8a96b60","Type":"ContainerStarted","Data":"9c4ce0ce202c435401e6b079ba05da42c28d9f691112397bfb16611aaa19c189"} Jun 11 12:57:28.645072 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:28.644756 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-787h4" Jun 11 12:57:28.646514 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:28.646485 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-f7c4fbc7f-992fg" event={"ID":"b2c38901-dc6a-4f6f-810d-ebb448a80f50","Type":"ContainerStarted","Data":"a1eac5da751178d60b947e1e14aea3e547c75bfcc3c6b336d47a094d41909914"} Jun 11 12:57:28.650002 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:28.649979 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-787h4" Jun 11 12:57:28.660744 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:28.660700 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-787h4" podStartSLOduration=1.9890237160000002 podStartE2EDuration="3.660685986s" totalImagesPullingTime="1.67166227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:57:28.659187992 +0000 UTC m=+248.305709941" watchObservedRunningTime="2026-06-11 12:57:28.660685986 +0000 UTC m=+248.307207927" Jun 11 12:57:28.691098 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:28.691037 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-f7c4fbc7f-992fg" podStartSLOduration=2.118315336 podStartE2EDuration="3.691014148s" totalImagesPullingTime="1.572698812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:57:28.674965548 +0000 UTC m=+248.321487513" watchObservedRunningTime="2026-06-11 12:57:28.691014148 +0000 UTC m=+248.337536091" Jun 11 12:57:29.018056 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:29.017963 2558 patch_prober.go:28] interesting pod/image-registry-fcf5bd6bf-qv5rz container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 12:57:29.018056 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:29.018031 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" podUID="770032ba-df71-4645-8c1f-d845abef1986" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 12:57:29.652287 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:29.652248 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-57747d55bd-5w9dp" event={"ID":"45918f10-dcf7-4753-924d-f4a43c9906e3","Type":"ContainerStarted","Data":"d64859f98093c9cd294209e5eb8361dd66c936a9c3090484e1508dded6ed01fc"} Jun 11 12:57:30.658052 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:30.658016 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-57747d55bd-5w9dp" event={"ID":"45918f10-dcf7-4753-924d-f4a43c9906e3","Type":"ContainerStarted","Data":"d930fd4e61e58a902297c5496d2634350b036b4336d98bebc8d5d5347b478bc6"} Jun 11 12:57:30.658534 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:30.658074 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-57747d55bd-5w9dp" event={"ID":"45918f10-dcf7-4753-924d-f4a43c9906e3","Type":"ContainerStarted","Data":"91f8a2f501e176d862c739d8e0daed7d6969feaa927a8f01f38b6bb9f9d53cda"} Jun 11 12:57:30.683616 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:30.683545 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-57747d55bd-5w9dp" podStartSLOduration=1.553932689 podStartE2EDuration="4.683525573s" totalImagesPullingTime="3.129592884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:57:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:57:30.681230158 +0000 UTC m=+250.327752101" watchObservedRunningTime="2026-06-11 12:57:30.683525573 +0000 UTC m=+250.330047516" Jun 11 12:57:32.599582 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:32.599490 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5540735c-30f1-4071-8ca5-86c1d43d1315-metrics-certs\") pod \"network-metrics-daemon-jd6lc\" (UID: \"5540735c-30f1-4071-8ca5-86c1d43d1315\") " pod="openshift-multus/network-metrics-daemon-jd6lc" Jun 11 12:57:32.601721 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:32.601695 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5540735c-30f1-4071-8ca5-86c1d43d1315-metrics-certs\") pod \"network-metrics-daemon-jd6lc\" (UID: \"5540735c-30f1-4071-8ca5-86c1d43d1315\") " pod="openshift-multus/network-metrics-daemon-jd6lc" Jun 11 12:57:32.623174 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:32.623128 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zkphv\"" Jun 11 12:57:32.631331 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:32.631292 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jd6lc" Jun 11 12:57:32.762705 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:32.762667 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jd6lc"] Jun 11 12:57:32.764699 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:57:32.764673 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5540735c_30f1_4071_8ca5_86c1d43d1315.slice/crio-94a9a27921b55352f3709847c2a5a029baadb2faa92827e645341259aa3a85c2 WatchSource:0}: Error finding container 94a9a27921b55352f3709847c2a5a029baadb2faa92827e645341259aa3a85c2: Status 404 returned error can't find the container with id 94a9a27921b55352f3709847c2a5a029baadb2faa92827e645341259aa3a85c2 Jun 11 12:57:32.819326 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:32.819298 2558 scope.go:117] "RemoveContainer" containerID="21e98d267a8756b1cb485cf2bed2464dfc9859a8220b5821037b4b829f2733c9" Jun 11 12:57:33.631289 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:33.631250 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-nnwsj"] Jun 11 12:57:33.634483 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:33.634458 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-nnwsj" Jun 11 12:57:33.637213 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:33.637141 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 12:57:33.637339 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:33.637231 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 12:57:33.637339 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:33.637228 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-kb8nw\"" Jun 11 12:57:33.645473 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:33.645451 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-nnwsj"] Jun 11 12:57:33.645901 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:33.645872 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:33.670947 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:33.670908 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jd6lc" event={"ID":"5540735c-30f1-4071-8ca5-86c1d43d1315","Type":"ContainerStarted","Data":"94a9a27921b55352f3709847c2a5a029baadb2faa92827e645341259aa3a85c2"} Jun 11 12:57:33.672644 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:33.672626 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lb8tl_20c98c8b-f1fa-4066-8907-1ac8f01bacf5/console-operator/2.log" Jun 11 12:57:33.672741 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:33.672718 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-lb8tl" event={"ID":"20c98c8b-f1fa-4066-8907-1ac8f01bacf5","Type":"ContainerStarted","Data":"52f950c3aab3877c0dd7a5d8f450c88dd05bb42e9b198464e09d8f18f89ebfcb"} Jun 11 12:57:33.673005 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:33.672971 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-lb8tl" Jun 11 12:57:33.678090 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:33.678066 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-lb8tl" Jun 11 12:57:33.691467 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:33.691421 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-lb8tl" podStartSLOduration=52.497013485 podStartE2EDuration="54.691407133s" totalImagesPullingTime="2.194393648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:56:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:57:33.689947394 +0000 UTC m=+253.336469341" watchObservedRunningTime="2026-06-11 12:57:33.691407133 +0000 UTC m=+253.337929075" Jun 11 12:57:33.703338 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:33.703311 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:33.709770 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:33.709740 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhptf\" (UniqueName: \"kubernetes.io/projected/1bac29f4-0707-4acc-9354-16589cded12e-kube-api-access-rhptf\") pod \"downloads-6657875f97-nnwsj\" (UID: \"1bac29f4-0707-4acc-9354-16589cded12e\") " pod="openshift-console/downloads-6657875f97-nnwsj" Jun 11 12:57:33.757937 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:33.757909 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:33.810303 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:33.810271 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhptf\" (UniqueName: \"kubernetes.io/projected/1bac29f4-0707-4acc-9354-16589cded12e-kube-api-access-rhptf\") pod \"downloads-6657875f97-nnwsj\" (UID: \"1bac29f4-0707-4acc-9354-16589cded12e\") " pod="openshift-console/downloads-6657875f97-nnwsj" Jun 11 12:57:33.819610 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:33.819585 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhptf\" (UniqueName: \"kubernetes.io/projected/1bac29f4-0707-4acc-9354-16589cded12e-kube-api-access-rhptf\") pod \"downloads-6657875f97-nnwsj\" (UID: \"1bac29f4-0707-4acc-9354-16589cded12e\") " pod="openshift-console/downloads-6657875f97-nnwsj" Jun 11 12:57:33.945530 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:33.945438 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-nnwsj" Jun 11 12:57:33.946725 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:33.946697 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:34.038029 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.037953 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" podUID="770032ba-df71-4645-8c1f-d845abef1986" containerName="registry" containerID="cri-o://24a56c3c68aa0503e8bd136570767506bc5cde44983fe7382267b78754f1092a" gracePeriod=30 Jun 11 12:57:34.073691 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.073659 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-nnwsj"] Jun 11 12:57:34.094993 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:57:34.094963 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bac29f4_0707_4acc_9354_16589cded12e.slice/crio-bba55df512e759a60ead23525fb3a4a8521d5ba1d1ca465633912ad098143046 WatchSource:0}: Error finding container bba55df512e759a60ead23525fb3a4a8521d5ba1d1ca465633912ad098143046: Status 404 returned error can't find the container with id bba55df512e759a60ead23525fb3a4a8521d5ba1d1ca465633912ad098143046 Jun 11 12:57:34.115337 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.115311 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:34.217224 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.217196 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:34.269672 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.269648 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" Jun 11 12:57:34.319056 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.319023 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/770032ba-df71-4645-8c1f-d845abef1986-installation-pull-secrets\") pod \"770032ba-df71-4645-8c1f-d845abef1986\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " Jun 11 12:57:34.319056 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.319063 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/770032ba-df71-4645-8c1f-d845abef1986-trusted-ca\") pod \"770032ba-df71-4645-8c1f-d845abef1986\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " Jun 11 12:57:34.319330 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.319089 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9p8z5\" (UniqueName: \"kubernetes.io/projected/770032ba-df71-4645-8c1f-d845abef1986-kube-api-access-9p8z5\") pod \"770032ba-df71-4645-8c1f-d845abef1986\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " Jun 11 12:57:34.319330 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.319121 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/770032ba-df71-4645-8c1f-d845abef1986-ca-trust-extracted\") pod \"770032ba-df71-4645-8c1f-d845abef1986\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " Jun 11 12:57:34.319330 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.319218 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/770032ba-df71-4645-8c1f-d845abef1986-bound-sa-token\") pod \"770032ba-df71-4645-8c1f-d845abef1986\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " Jun 11 12:57:34.319330 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.319248 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/770032ba-df71-4645-8c1f-d845abef1986-image-registry-private-configuration\") pod \"770032ba-df71-4645-8c1f-d845abef1986\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " Jun 11 12:57:34.319330 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.319276 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/770032ba-df71-4645-8c1f-d845abef1986-registry-certificates\") pod \"770032ba-df71-4645-8c1f-d845abef1986\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " Jun 11 12:57:34.319330 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.319302 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/770032ba-df71-4645-8c1f-d845abef1986-registry-tls\") pod \"770032ba-df71-4645-8c1f-d845abef1986\" (UID: \"770032ba-df71-4645-8c1f-d845abef1986\") " Jun 11 12:57:34.319687 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.319628 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/770032ba-df71-4645-8c1f-d845abef1986-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "770032ba-df71-4645-8c1f-d845abef1986" (UID: "770032ba-df71-4645-8c1f-d845abef1986"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 12:57:34.320122 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.320091 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/770032ba-df71-4645-8c1f-d845abef1986-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "770032ba-df71-4645-8c1f-d845abef1986" (UID: "770032ba-df71-4645-8c1f-d845abef1986"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 12:57:34.321542 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.321515 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/770032ba-df71-4645-8c1f-d845abef1986-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "770032ba-df71-4645-8c1f-d845abef1986" (UID: "770032ba-df71-4645-8c1f-d845abef1986"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 12:57:34.321646 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.321588 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/770032ba-df71-4645-8c1f-d845abef1986-kube-api-access-9p8z5" (OuterVolumeSpecName: "kube-api-access-9p8z5") pod "770032ba-df71-4645-8c1f-d845abef1986" (UID: "770032ba-df71-4645-8c1f-d845abef1986"). InnerVolumeSpecName "kube-api-access-9p8z5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 12:57:34.321813 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.321785 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/770032ba-df71-4645-8c1f-d845abef1986-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "770032ba-df71-4645-8c1f-d845abef1986" (UID: "770032ba-df71-4645-8c1f-d845abef1986"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 12:57:34.321885 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.321861 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/770032ba-df71-4645-8c1f-d845abef1986-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "770032ba-df71-4645-8c1f-d845abef1986" (UID: "770032ba-df71-4645-8c1f-d845abef1986"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 12:57:34.321928 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.321895 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/770032ba-df71-4645-8c1f-d845abef1986-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "770032ba-df71-4645-8c1f-d845abef1986" (UID: "770032ba-df71-4645-8c1f-d845abef1986"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 12:57:34.327801 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.327774 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/770032ba-df71-4645-8c1f-d845abef1986-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "770032ba-df71-4645-8c1f-d845abef1986" (UID: "770032ba-df71-4645-8c1f-d845abef1986"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 12:57:34.420620 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.420581 2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/770032ba-df71-4645-8c1f-d845abef1986-bound-sa-token\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 12:57:34.420620 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.420614 2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/770032ba-df71-4645-8c1f-d845abef1986-image-registry-private-configuration\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 12:57:34.420620 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.420626 2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/770032ba-df71-4645-8c1f-d845abef1986-registry-certificates\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 12:57:34.420847 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.420638 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/770032ba-df71-4645-8c1f-d845abef1986-registry-tls\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 12:57:34.420847 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.420650 2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/770032ba-df71-4645-8c1f-d845abef1986-installation-pull-secrets\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 12:57:34.420847 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.420660 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/770032ba-df71-4645-8c1f-d845abef1986-trusted-ca\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 12:57:34.420847 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.420672 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9p8z5\" (UniqueName: \"kubernetes.io/projected/770032ba-df71-4645-8c1f-d845abef1986-kube-api-access-9p8z5\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 12:57:34.420847 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.420684 2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/770032ba-df71-4645-8c1f-d845abef1986-ca-trust-extracted\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 12:57:34.680167 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.680095 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jd6lc" event={"ID":"5540735c-30f1-4071-8ca5-86c1d43d1315","Type":"ContainerStarted","Data":"d543b1cae053b6dff4c320d49e41f5a64d2197d4d193a7ce964b434fa86037bc"} Jun 11 12:57:34.680575 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.680232 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jd6lc" event={"ID":"5540735c-30f1-4071-8ca5-86c1d43d1315","Type":"ContainerStarted","Data":"0fe04b5c36fa117f14b13c21e72412a21c6e5a2324442dc13db18326bd3e2607"} Jun 11 12:57:34.681293 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.681270 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-nnwsj" event={"ID":"1bac29f4-0707-4acc-9354-16589cded12e","Type":"ContainerStarted","Data":"bba55df512e759a60ead23525fb3a4a8521d5ba1d1ca465633912ad098143046"} Jun 11 12:57:34.682391 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.682368 2558 generic.go:356] "Generic (PLEG): container finished" podID="770032ba-df71-4645-8c1f-d845abef1986" containerID="24a56c3c68aa0503e8bd136570767506bc5cde44983fe7382267b78754f1092a" exitCode=0 Jun 11 12:57:34.682460 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.682409 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" Jun 11 12:57:34.682460 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.682449 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" event={"ID":"770032ba-df71-4645-8c1f-d845abef1986","Type":"ContainerDied","Data":"24a56c3c68aa0503e8bd136570767506bc5cde44983fe7382267b78754f1092a"} Jun 11 12:57:34.682543 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.682495 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fcf5bd6bf-qv5rz" event={"ID":"770032ba-df71-4645-8c1f-d845abef1986","Type":"ContainerDied","Data":"0ce996c8e2d9d98827432900d9e4b913082403be8ab02398618a35a198c968dd"} Jun 11 12:57:34.682543 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.682521 2558 scope.go:117] "RemoveContainer" containerID="24a56c3c68aa0503e8bd136570767506bc5cde44983fe7382267b78754f1092a" Jun 11 12:57:34.692138 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.692116 2558 scope.go:117] "RemoveContainer" containerID="24a56c3c68aa0503e8bd136570767506bc5cde44983fe7382267b78754f1092a" Jun 11 12:57:34.692492 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:57:34.692458 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24a56c3c68aa0503e8bd136570767506bc5cde44983fe7382267b78754f1092a\": container with ID starting with 24a56c3c68aa0503e8bd136570767506bc5cde44983fe7382267b78754f1092a not found: ID does not exist" containerID="24a56c3c68aa0503e8bd136570767506bc5cde44983fe7382267b78754f1092a" Jun 11 12:57:34.692563 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.692491 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24a56c3c68aa0503e8bd136570767506bc5cde44983fe7382267b78754f1092a"} err="failed to get container status \"24a56c3c68aa0503e8bd136570767506bc5cde44983fe7382267b78754f1092a\": rpc error: code = NotFound desc = could not find container \"24a56c3c68aa0503e8bd136570767506bc5cde44983fe7382267b78754f1092a\": container with ID starting with 24a56c3c68aa0503e8bd136570767506bc5cde44983fe7382267b78754f1092a not found: ID does not exist" Jun 11 12:57:34.701533 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.701486 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jd6lc" podStartSLOduration=252.788113357 podStartE2EDuration="4m13.701469215s" totalImagesPullingTime="913.355858ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:53:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:57:34.700930041 +0000 UTC m=+254.347451984" watchObservedRunningTime="2026-06-11 12:57:34.701469215 +0000 UTC m=+254.347991156" Jun 11 12:57:34.716849 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.716819 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-fcf5bd6bf-qv5rz"] Jun 11 12:57:34.720308 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.720272 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-fcf5bd6bf-qv5rz"] Jun 11 12:57:34.720423 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.720346 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:34.777557 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.777525 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:34.824137 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.824101 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="770032ba-df71-4645-8c1f-d845abef1986" path="/var/lib/kubelet/pods/770032ba-df71-4645-8c1f-d845abef1986/volumes" Jun 11 12:57:34.878364 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.878329 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:34.978403 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:34.978318 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:35.078795 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:35.078759 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:35.326473 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:35.326390 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:35.519167 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:35.519127 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:35.777944 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:35.777905 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:37.544672 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:37.544634 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:39.148970 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:39.148914 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:39.204979 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:39.204945 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:44.944845 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:44.944779 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:45.938194 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:45.938161 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-f7c4fbc7f-992fg" Jun 11 12:57:45.938380 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:45.938264 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-f7c4fbc7f-992fg" Jun 11 12:57:47.766757 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:47.766678 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:47.872457 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:47.872408 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:50.752782 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:50.752754 2558 generic.go:356] "Generic (PLEG): container finished" podID="0631981e-3326-46e4-a9e5-962fbdf4ed6a" containerID="6052aaf28299ff59da388bf1935731c226271db9615c1e9dcf1e227c5f20702b" exitCode=0 Jun 11 12:57:50.753079 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:50.752818 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-l66cp" event={"ID":"0631981e-3326-46e4-a9e5-962fbdf4ed6a","Type":"ContainerDied","Data":"6052aaf28299ff59da388bf1935731c226271db9615c1e9dcf1e227c5f20702b"} Jun 11 12:57:50.753169 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:50.753134 2558 scope.go:117] "RemoveContainer" containerID="6052aaf28299ff59da388bf1935731c226271db9615c1e9dcf1e227c5f20702b" Jun 11 12:57:51.754565 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:51.754521 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:51.766865 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:51.766829 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-nnwsj" event={"ID":"1bac29f4-0707-4acc-9354-16589cded12e","Type":"ContainerStarted","Data":"89ec6ef7a68b891df968765054f9cfbb518809eaabb0ce2863e2a34044066dfc"} Jun 11 12:57:51.767926 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:51.767868 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-nnwsj" Jun 11 12:57:51.770910 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:51.770885 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-l66cp" event={"ID":"0631981e-3326-46e4-a9e5-962fbdf4ed6a","Type":"ContainerStarted","Data":"d78b591d8fb12c4c92f2a00659e9f949b8da2053c069242dd38094a7ace7e766"} Jun 11 12:57:51.783457 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:51.783432 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-nnwsj" Jun 11 12:57:51.785595 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:51.785547 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-nnwsj" podStartSLOduration=2.200842481 podStartE2EDuration="18.785534038s" totalImagesPullingTime="16.584691557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:57:51.784196486 +0000 UTC m=+271.430718429" watchObservedRunningTime="2026-06-11 12:57:51.785534038 +0000 UTC m=+271.432055990" Jun 11 12:57:52.685570 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:52.685535 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:54.153602 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:54.153565 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:54.253365 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:54.253331 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:54.935396 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:54.935363 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fb8578f5b-fc4vn"] Jun 11 12:57:54.935725 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:54.935704 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="770032ba-df71-4645-8c1f-d845abef1986" containerName="registry" Jun 11 12:57:54.935725 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:54.935721 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="770032ba-df71-4645-8c1f-d845abef1986" containerName="registry" Jun 11 12:57:54.935895 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:54.935766 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="770032ba-df71-4645-8c1f-d845abef1986" containerName="registry" Jun 11 12:57:54.964572 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:54.964541 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fb8578f5b-fc4vn"] Jun 11 12:57:54.964724 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:54.964655 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb8578f5b-fc4vn" Jun 11 12:57:54.967642 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:54.967617 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hr4xm\"" Jun 11 12:57:54.967776 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:54.967679 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 12:57:54.968090 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:54.968074 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 12:57:54.968661 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:54.968630 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 12:57:54.968661 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:54.968657 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 12:57:54.968887 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:54.968863 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 12:57:54.973135 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:54.973100 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 12:57:55.107891 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:55.107852 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-console-oauth-config\") pod \"console-fb8578f5b-fc4vn\" (UID: \"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86\") " pod="openshift-console/console-fb8578f5b-fc4vn" Jun 11 12:57:55.108093 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:55.107907 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-console-config\") pod \"console-fb8578f5b-fc4vn\" (UID: \"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86\") " pod="openshift-console/console-fb8578f5b-fc4vn" Jun 11 12:57:55.108093 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:55.108006 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-console-serving-cert\") pod \"console-fb8578f5b-fc4vn\" (UID: \"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86\") " pod="openshift-console/console-fb8578f5b-fc4vn" Jun 11 12:57:55.108093 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:55.108052 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-service-ca\") pod \"console-fb8578f5b-fc4vn\" (UID: \"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86\") " pod="openshift-console/console-fb8578f5b-fc4vn" Jun 11 12:57:55.108294 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:55.108096 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn85q\" (UniqueName: \"kubernetes.io/projected/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-kube-api-access-qn85q\") pod \"console-fb8578f5b-fc4vn\" (UID: \"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86\") " pod="openshift-console/console-fb8578f5b-fc4vn" Jun 11 12:57:55.108294 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:55.108141 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-trusted-ca-bundle\") pod \"console-fb8578f5b-fc4vn\" (UID: \"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86\") " pod="openshift-console/console-fb8578f5b-fc4vn" Jun 11 12:57:55.108294 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:55.108199 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-oauth-serving-cert\") pod \"console-fb8578f5b-fc4vn\" (UID: \"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86\") " pod="openshift-console/console-fb8578f5b-fc4vn" Jun 11 12:57:55.209137 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:55.209061 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-service-ca\") pod \"console-fb8578f5b-fc4vn\" (UID: \"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86\") " pod="openshift-console/console-fb8578f5b-fc4vn" Jun 11 12:57:55.209137 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:55.209116 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn85q\" (UniqueName: \"kubernetes.io/projected/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-kube-api-access-qn85q\") pod \"console-fb8578f5b-fc4vn\" (UID: \"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86\") " pod="openshift-console/console-fb8578f5b-fc4vn" Jun 11 12:57:55.209655 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:55.209194 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-trusted-ca-bundle\") pod \"console-fb8578f5b-fc4vn\" (UID: \"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86\") " pod="openshift-console/console-fb8578f5b-fc4vn" Jun 11 12:57:55.209655 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:55.209243 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-oauth-serving-cert\") pod \"console-fb8578f5b-fc4vn\" (UID: \"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86\") " pod="openshift-console/console-fb8578f5b-fc4vn" Jun 11 12:57:55.209655 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:55.209284 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-console-oauth-config\") pod \"console-fb8578f5b-fc4vn\" (UID: \"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86\") " pod="openshift-console/console-fb8578f5b-fc4vn" Jun 11 12:57:55.209655 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:55.209330 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-console-config\") pod \"console-fb8578f5b-fc4vn\" (UID: \"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86\") " pod="openshift-console/console-fb8578f5b-fc4vn" Jun 11 12:57:55.209655 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:55.209366 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-console-serving-cert\") pod \"console-fb8578f5b-fc4vn\" (UID: \"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86\") " pod="openshift-console/console-fb8578f5b-fc4vn" Jun 11 12:57:55.209929 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:55.209898 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-service-ca\") pod \"console-fb8578f5b-fc4vn\" (UID: \"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86\") " pod="openshift-console/console-fb8578f5b-fc4vn" Jun 11 12:57:55.210331 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:55.210252 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-console-config\") pod \"console-fb8578f5b-fc4vn\" (UID: \"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86\") " pod="openshift-console/console-fb8578f5b-fc4vn" Jun 11 12:57:55.210331 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:55.210289 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-oauth-serving-cert\") pod \"console-fb8578f5b-fc4vn\" (UID: \"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86\") " pod="openshift-console/console-fb8578f5b-fc4vn" Jun 11 12:57:55.210513 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:55.210383 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-trusted-ca-bundle\") pod \"console-fb8578f5b-fc4vn\" (UID: \"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86\") " pod="openshift-console/console-fb8578f5b-fc4vn" Jun 11 12:57:55.212259 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:55.212235 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-console-oauth-config\") pod \"console-fb8578f5b-fc4vn\" (UID: \"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86\") " pod="openshift-console/console-fb8578f5b-fc4vn" Jun 11 12:57:55.212384 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:55.212360 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-console-serving-cert\") pod \"console-fb8578f5b-fc4vn\" (UID: \"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86\") " pod="openshift-console/console-fb8578f5b-fc4vn" Jun 11 12:57:55.218521 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:55.218498 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn85q\" (UniqueName: \"kubernetes.io/projected/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-kube-api-access-qn85q\") pod \"console-fb8578f5b-fc4vn\" (UID: \"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86\") " pod="openshift-console/console-fb8578f5b-fc4vn" Jun 11 12:57:55.276221 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:55.276184 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb8578f5b-fc4vn" Jun 11 12:57:55.315778 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:55.315718 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:55.382794 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:55.382753 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:55.452864 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:55.452830 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fb8578f5b-fc4vn"] Jun 11 12:57:55.455606 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:57:55.455574 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ec388b0_0821_49d2_8d4e_d64b2d9aaa86.slice/crio-534c514819d1953ae973581d95da0ccf6ae29cbb927758bc83afb05db84f9ba9 WatchSource:0}: Error finding container 534c514819d1953ae973581d95da0ccf6ae29cbb927758bc83afb05db84f9ba9: Status 404 returned error can't find the container with id 534c514819d1953ae973581d95da0ccf6ae29cbb927758bc83afb05db84f9ba9 Jun 11 12:57:55.789482 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:55.789405 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb8578f5b-fc4vn" event={"ID":"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86","Type":"ContainerStarted","Data":"534c514819d1953ae973581d95da0ccf6ae29cbb927758bc83afb05db84f9ba9"} Jun 11 12:57:56.342912 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:56.342872 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:56.406749 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:56.406711 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:56.514371 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:56.514287 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:56.574898 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:56.574864 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:59.557976 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:59.557895 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:59.620305 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:59.620272 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:59.809821 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:59.809740 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:57:59.813168 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:59.813129 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb8578f5b-fc4vn" event={"ID":"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86","Type":"ContainerStarted","Data":"178867b02ff780f4fd9e108d749137e06abc9956962677eb52dd8b655e51efda"} Jun 11 12:57:59.835027 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:59.834969 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fb8578f5b-fc4vn" podStartSLOduration=2.099744771 podStartE2EDuration="5.834953841s" totalImagesPullingTime="3.73520907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:57:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:57:59.833341177 +0000 UTC m=+279.479863148" watchObservedRunningTime="2026-06-11 12:57:59.834953841 +0000 UTC m=+279.481475783" Jun 11 12:57:59.910540 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:57:59.910513 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:58:00.167110 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:00.167076 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:58:00.268648 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:00.268615 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:58:01.337671 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:58:01.337627 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-w6vpc" podUID="b06d4318-3ca7-4101-8f86-d1454c9b82cb" Jun 11 12:58:01.819552 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:01.819520 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w6vpc" Jun 11 12:58:02.350913 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:02.350876 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:58:03.764420 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:03.764388 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:58:03.866118 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:03.866085 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:58:05.276827 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:05.276791 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fb8578f5b-fc4vn" Jun 11 12:58:05.277327 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:05.276857 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-fb8578f5b-fc4vn" Jun 11 12:58:05.281768 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:05.281746 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-fb8578f5b-fc4vn" Jun 11 12:58:05.296956 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:05.296926 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b06d4318-3ca7-4101-8f86-d1454c9b82cb-metrics-tls\") pod \"dns-default-w6vpc\" (UID: \"b06d4318-3ca7-4101-8f86-d1454c9b82cb\") " pod="openshift-dns/dns-default-w6vpc" Jun 11 12:58:05.299311 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:05.299287 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b06d4318-3ca7-4101-8f86-d1454c9b82cb-metrics-tls\") pod \"dns-default-w6vpc\" (UID: \"b06d4318-3ca7-4101-8f86-d1454c9b82cb\") " pod="openshift-dns/dns-default-w6vpc" Jun 11 12:58:05.422905 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:05.422873 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cjs9v\"" Jun 11 12:58:05.430232 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:05.430206 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w6vpc" Jun 11 12:58:05.582365 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:05.582340 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w6vpc"] Jun 11 12:58:05.584950 ip-10-0-137-120 kubenswrapper[2558]: W0611 12:58:05.584918 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb06d4318_3ca7_4101_8f86_d1454c9b82cb.slice/crio-3c198d8b89fcc1fa69e1492f8ef0e85cb4a884f25d0d80ab721712a4a96344f0 WatchSource:0}: Error finding container 3c198d8b89fcc1fa69e1492f8ef0e85cb4a884f25d0d80ab721712a4a96344f0: Status 404 returned error can't find the container with id 3c198d8b89fcc1fa69e1492f8ef0e85cb4a884f25d0d80ab721712a4a96344f0 Jun 11 12:58:05.836067 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:05.835979 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w6vpc" event={"ID":"b06d4318-3ca7-4101-8f86-d1454c9b82cb","Type":"ContainerStarted","Data":"3c198d8b89fcc1fa69e1492f8ef0e85cb4a884f25d0d80ab721712a4a96344f0"} Jun 11 12:58:05.839890 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:05.839866 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-fb8578f5b-fc4vn" Jun 11 12:58:05.944718 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:05.944687 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-f7c4fbc7f-992fg" Jun 11 12:58:05.949286 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:05.949258 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-f7c4fbc7f-992fg" Jun 11 12:58:06.560025 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:06.559992 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:58:06.663885 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:06.663790 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:58:07.358933 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:07.358897 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:58:07.851638 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:07.851601 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w6vpc" event={"ID":"b06d4318-3ca7-4101-8f86-d1454c9b82cb","Type":"ContainerStarted","Data":"99e64e589d13a44dca1a9bb548edcd00238b8f92263e2236ea743d5fffa562ea"} Jun 11 12:58:07.851987 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:07.851681 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w6vpc" event={"ID":"b06d4318-3ca7-4101-8f86-d1454c9b82cb","Type":"ContainerStarted","Data":"562b8359539e5a27083840e174011481487b8978e67911b93803610827da6043"} Jun 11 12:58:07.851987 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:07.851727 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-w6vpc" Jun 11 12:58:07.871566 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:07.871471 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-w6vpc" podStartSLOduration=250.92353547 podStartE2EDuration="4m12.871458407s" totalImagesPullingTime="1.947922937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 12:53:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 12:58:07.870275505 +0000 UTC m=+287.516797459" watchObservedRunningTime="2026-06-11 12:58:07.871458407 +0000 UTC m=+287.517980349" Jun 11 12:58:08.307057 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:08.306963 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:58:08.405745 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:08.405681 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:58:09.020719 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:09.020683 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bccb87fdf-hn668_058a7bf8-5cab-4f2f-9f11-a48e58370f14/router/0.log" Jun 11 12:58:09.253318 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:09.253281 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:58:09.332514 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:09.332403 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:58:09.379741 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:09.379715 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xjmtd_8c9a9482-6765-4d5f-b21b-37c26d9be26d/serve-healthcheck-canary/0.log" Jun 11 12:58:16.232448 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:16.232394 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:58:16.347531 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:16.347502 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:58:16.451452 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:16.451415 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:58:17.858322 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:17.858288 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-w6vpc" Jun 11 12:58:20.769075 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:20.769049 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lb8tl_20c98c8b-f1fa-4066-8907-1ac8f01bacf5/console-operator/2.log" Jun 11 12:58:20.769498 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:20.769442 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lb8tl_20c98c8b-f1fa-4066-8907-1ac8f01bacf5/console-operator/2.log" Jun 11 12:58:20.789050 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:20.789025 2558 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 12:58:24.158205 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:24.158166 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:58:24.217980 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:24.217930 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:58:26.994708 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:26.994672 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:58:27.095874 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:27.095838 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:58:37.359392 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:37.359357 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:58:37.455609 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:37.455567 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:58:37.562249 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:37.562199 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:58:37.634572 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:37.634471 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:58:37.892640 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:37.892546 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:58:38.692509 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:38.692479 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:58:38.763462 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:38.763427 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:58:39.162610 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:39.162576 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:58:39.237243 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:39.237206 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:58:45.245251 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:45.245205 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:58:45.300998 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:45.300967 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:58:48.564452 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:48.564414 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fb8578f5b-fc4vn"] Jun 11 12:58:48.665898 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:48.665854 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:58:48.761346 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:48.761312 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:58:48.819048 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:48.818965 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:58:54.244698 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:54.244664 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:58:54.339359 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:58:54.339324 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:59:13.585056 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:59:13.584964 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-fb8578f5b-fc4vn" podUID="4ec388b0-0821-49d2-8d4e-d64b2d9aaa86" containerName="console" containerID="cri-o://178867b02ff780f4fd9e108d749137e06abc9956962677eb52dd8b655e51efda" gracePeriod=15 Jun 11 12:59:13.828451 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:59:13.828427 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb8578f5b-fc4vn" Jun 11 12:59:13.953355 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:59:13.953326 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-console-config\") pod \"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86\" (UID: \"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86\") " Jun 11 12:59:13.953513 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:59:13.953366 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-console-serving-cert\") pod \"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86\" (UID: \"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86\") " Jun 11 12:59:13.953513 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:59:13.953391 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-trusted-ca-bundle\") pod \"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86\" (UID: \"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86\") " Jun 11 12:59:13.953513 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:59:13.953436 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-service-ca\") pod \"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86\" (UID: \"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86\") " Jun 11 12:59:13.953513 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:59:13.953465 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-console-oauth-config\") pod \"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86\" (UID: \"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86\") " Jun 11 12:59:13.953513 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:59:13.953484 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qn85q\" (UniqueName: \"kubernetes.io/projected/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-kube-api-access-qn85q\") pod \"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86\" (UID: \"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86\") " Jun 11 12:59:13.953773 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:59:13.953514 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-oauth-serving-cert\") pod \"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86\" (UID: \"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86\") " Jun 11 12:59:13.953773 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:59:13.953693 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-console-config" (OuterVolumeSpecName: "console-config") pod "4ec388b0-0821-49d2-8d4e-d64b2d9aaa86" (UID: "4ec388b0-0821-49d2-8d4e-d64b2d9aaa86"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 12:59:13.953911 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:59:13.953883 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4ec388b0-0821-49d2-8d4e-d64b2d9aaa86" (UID: "4ec388b0-0821-49d2-8d4e-d64b2d9aaa86"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 12:59:13.953979 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:59:13.953956 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-service-ca" (OuterVolumeSpecName: "service-ca") pod "4ec388b0-0821-49d2-8d4e-d64b2d9aaa86" (UID: "4ec388b0-0821-49d2-8d4e-d64b2d9aaa86"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 12:59:13.954026 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:59:13.953998 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4ec388b0-0821-49d2-8d4e-d64b2d9aaa86" (UID: "4ec388b0-0821-49d2-8d4e-d64b2d9aaa86"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 12:59:13.955644 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:59:13.955621 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4ec388b0-0821-49d2-8d4e-d64b2d9aaa86" (UID: "4ec388b0-0821-49d2-8d4e-d64b2d9aaa86"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 12:59:13.956086 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:59:13.956064 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4ec388b0-0821-49d2-8d4e-d64b2d9aaa86" (UID: "4ec388b0-0821-49d2-8d4e-d64b2d9aaa86"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 12:59:13.956086 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:59:13.956072 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-kube-api-access-qn85q" (OuterVolumeSpecName: "kube-api-access-qn85q") pod "4ec388b0-0821-49d2-8d4e-d64b2d9aaa86" (UID: "4ec388b0-0821-49d2-8d4e-d64b2d9aaa86"). InnerVolumeSpecName "kube-api-access-qn85q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 12:59:14.054476 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:59:14.054442 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-console-config\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 12:59:14.054476 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:59:14.054470 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-console-serving-cert\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 12:59:14.054476 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:59:14.054481 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-trusted-ca-bundle\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 12:59:14.054761 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:59:14.054489 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-service-ca\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 12:59:14.054761 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:59:14.054497 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-console-oauth-config\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 12:59:14.054761 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:59:14.054506 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qn85q\" (UniqueName: \"kubernetes.io/projected/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-kube-api-access-qn85q\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 12:59:14.054761 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:59:14.054517 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86-oauth-serving-cert\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 12:59:14.099964 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:59:14.099929 2558 generic.go:356] "Generic (PLEG): container finished" podID="4ec388b0-0821-49d2-8d4e-d64b2d9aaa86" containerID="178867b02ff780f4fd9e108d749137e06abc9956962677eb52dd8b655e51efda" exitCode=0 Jun 11 12:59:14.100125 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:59:14.099970 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb8578f5b-fc4vn" Jun 11 12:59:14.100125 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:59:14.099983 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb8578f5b-fc4vn" event={"ID":"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86","Type":"ContainerDied","Data":"178867b02ff780f4fd9e108d749137e06abc9956962677eb52dd8b655e51efda"} Jun 11 12:59:14.100125 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:59:14.100027 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb8578f5b-fc4vn" event={"ID":"4ec388b0-0821-49d2-8d4e-d64b2d9aaa86","Type":"ContainerDied","Data":"534c514819d1953ae973581d95da0ccf6ae29cbb927758bc83afb05db84f9ba9"} Jun 11 12:59:14.100125 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:59:14.100050 2558 scope.go:117] "RemoveContainer" containerID="178867b02ff780f4fd9e108d749137e06abc9956962677eb52dd8b655e51efda" Jun 11 12:59:14.108510 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:59:14.108491 2558 scope.go:117] "RemoveContainer" containerID="178867b02ff780f4fd9e108d749137e06abc9956962677eb52dd8b655e51efda" Jun 11 12:59:14.108739 ip-10-0-137-120 kubenswrapper[2558]: E0611 12:59:14.108720 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"178867b02ff780f4fd9e108d749137e06abc9956962677eb52dd8b655e51efda\": container with ID starting with 178867b02ff780f4fd9e108d749137e06abc9956962677eb52dd8b655e51efda not found: ID does not exist" containerID="178867b02ff780f4fd9e108d749137e06abc9956962677eb52dd8b655e51efda" Jun 11 12:59:14.108792 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:59:14.108747 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"178867b02ff780f4fd9e108d749137e06abc9956962677eb52dd8b655e51efda"} err="failed to get container status \"178867b02ff780f4fd9e108d749137e06abc9956962677eb52dd8b655e51efda\": rpc error: code = NotFound desc = could not find container \"178867b02ff780f4fd9e108d749137e06abc9956962677eb52dd8b655e51efda\": container with ID starting with 178867b02ff780f4fd9e108d749137e06abc9956962677eb52dd8b655e51efda not found: ID does not exist" Jun 11 12:59:14.120394 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:59:14.120368 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fb8578f5b-fc4vn"] Jun 11 12:59:14.124388 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:59:14.124369 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-fb8578f5b-fc4vn"] Jun 11 12:59:14.557520 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:59:14.557488 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:59:14.823716 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:59:14.823645 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ec388b0-0821-49d2-8d4e-d64b2d9aaa86" path="/var/lib/kubelet/pods/4ec388b0-0821-49d2-8d4e-d64b2d9aaa86/volumes" Jun 11 12:59:39.238235 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:59:39.238187 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 12:59:39.309093 ip-10-0-137-120 kubenswrapper[2558]: I0611 12:59:39.309061 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:00:08.493688 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:08.493654 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:00:08.612030 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:08.611995 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:00:09.439517 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:09.439483 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dww94k"] Jun 11 13:00:09.439835 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:09.439817 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ec388b0-0821-49d2-8d4e-d64b2d9aaa86" containerName="console" Jun 11 13:00:09.439835 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:09.439835 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ec388b0-0821-49d2-8d4e-d64b2d9aaa86" containerName="console" Jun 11 13:00:09.439971 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:09.439903 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ec388b0-0821-49d2-8d4e-d64b2d9aaa86" containerName="console" Jun 11 13:00:09.442240 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:09.442225 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dww94k" Jun 11 13:00:09.445889 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:09.445864 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 13:00:09.445990 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:09.445869 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 13:00:09.446915 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:09.446900 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r44s6\"" Jun 11 13:00:09.453825 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:09.453799 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dww94k"] Jun 11 13:00:09.561146 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:09.561102 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfnj8\" (UniqueName: \"kubernetes.io/projected/3d498088-44be-4e09-83ec-d62968ca003a-kube-api-access-lfnj8\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dww94k\" (UID: \"3d498088-44be-4e09-83ec-d62968ca003a\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dww94k" Jun 11 13:00:09.561564 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:09.561193 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d498088-44be-4e09-83ec-d62968ca003a-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dww94k\" (UID: \"3d498088-44be-4e09-83ec-d62968ca003a\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dww94k" Jun 11 13:00:09.561564 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:09.561231 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d498088-44be-4e09-83ec-d62968ca003a-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dww94k\" (UID: \"3d498088-44be-4e09-83ec-d62968ca003a\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dww94k" Jun 11 13:00:09.662282 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:09.662241 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfnj8\" (UniqueName: \"kubernetes.io/projected/3d498088-44be-4e09-83ec-d62968ca003a-kube-api-access-lfnj8\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dww94k\" (UID: \"3d498088-44be-4e09-83ec-d62968ca003a\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dww94k" Jun 11 13:00:09.662476 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:09.662299 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d498088-44be-4e09-83ec-d62968ca003a-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dww94k\" (UID: \"3d498088-44be-4e09-83ec-d62968ca003a\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dww94k" Jun 11 13:00:09.662476 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:09.662336 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d498088-44be-4e09-83ec-d62968ca003a-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dww94k\" (UID: \"3d498088-44be-4e09-83ec-d62968ca003a\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dww94k" Jun 11 13:00:09.662705 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:09.662682 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d498088-44be-4e09-83ec-d62968ca003a-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dww94k\" (UID: \"3d498088-44be-4e09-83ec-d62968ca003a\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dww94k" Jun 11 13:00:09.662773 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:09.662722 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d498088-44be-4e09-83ec-d62968ca003a-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dww94k\" (UID: \"3d498088-44be-4e09-83ec-d62968ca003a\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dww94k" Jun 11 13:00:09.671328 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:09.671302 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfnj8\" (UniqueName: \"kubernetes.io/projected/3d498088-44be-4e09-83ec-d62968ca003a-kube-api-access-lfnj8\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dww94k\" (UID: \"3d498088-44be-4e09-83ec-d62968ca003a\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dww94k" Jun 11 13:00:09.751096 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:09.751007 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dww94k" Jun 11 13:00:09.879434 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:09.879404 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dww94k"] Jun 11 13:00:09.882357 ip-10-0-137-120 kubenswrapper[2558]: W0611 13:00:09.882330 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d498088_44be_4e09_83ec_d62968ca003a.slice/crio-e1040d9fd2339f63c0adf6993b333cc2668afe86d721ec3c0d5c5dd0e30066cf WatchSource:0}: Error finding container e1040d9fd2339f63c0adf6993b333cc2668afe86d721ec3c0d5c5dd0e30066cf: Status 404 returned error can't find the container with id e1040d9fd2339f63c0adf6993b333cc2668afe86d721ec3c0d5c5dd0e30066cf Jun 11 13:00:09.884230 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:09.884213 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 13:00:10.300299 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:10.300257 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dww94k" event={"ID":"3d498088-44be-4e09-83ec-d62968ca003a","Type":"ContainerStarted","Data":"e1040d9fd2339f63c0adf6993b333cc2668afe86d721ec3c0d5c5dd0e30066cf"} Jun 11 13:00:15.322888 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:15.322849 2558 generic.go:356] "Generic (PLEG): container finished" podID="3d498088-44be-4e09-83ec-d62968ca003a" containerID="5cf404c77ce7642639e225bfbe2b5bf07b3fdf542b361a15a03a8e6fa91e5b37" exitCode=0 Jun 11 13:00:15.323358 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:15.322908 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dww94k" event={"ID":"3d498088-44be-4e09-83ec-d62968ca003a","Type":"ContainerDied","Data":"5cf404c77ce7642639e225bfbe2b5bf07b3fdf542b361a15a03a8e6fa91e5b37"} Jun 11 13:00:17.332568 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:17.332531 2558 generic.go:356] "Generic (PLEG): container finished" podID="3d498088-44be-4e09-83ec-d62968ca003a" containerID="f97e3b20f1b33342f6124fdd9d9c179fd03134e2ebfc1bd63373f18bee9eaf30" exitCode=0 Jun 11 13:00:17.332972 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:17.332591 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dww94k" event={"ID":"3d498088-44be-4e09-83ec-d62968ca003a","Type":"ContainerDied","Data":"f97e3b20f1b33342f6124fdd9d9c179fd03134e2ebfc1bd63373f18bee9eaf30"} Jun 11 13:00:26.371504 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:26.371467 2558 generic.go:356] "Generic (PLEG): container finished" podID="3d498088-44be-4e09-83ec-d62968ca003a" containerID="cd89f74fdb3227acb5dbf64c06ade67a50283c0da5637bd838f530f0f8866a7a" exitCode=0 Jun 11 13:00:26.371889 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:26.371535 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dww94k" event={"ID":"3d498088-44be-4e09-83ec-d62968ca003a","Type":"ContainerDied","Data":"cd89f74fdb3227acb5dbf64c06ade67a50283c0da5637bd838f530f0f8866a7a"} Jun 11 13:00:27.497462 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:27.497432 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dww94k" Jun 11 13:00:27.620551 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:27.620511 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d498088-44be-4e09-83ec-d62968ca003a-util\") pod \"3d498088-44be-4e09-83ec-d62968ca003a\" (UID: \"3d498088-44be-4e09-83ec-d62968ca003a\") " Jun 11 13:00:27.620551 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:27.620553 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfnj8\" (UniqueName: \"kubernetes.io/projected/3d498088-44be-4e09-83ec-d62968ca003a-kube-api-access-lfnj8\") pod \"3d498088-44be-4e09-83ec-d62968ca003a\" (UID: \"3d498088-44be-4e09-83ec-d62968ca003a\") " Jun 11 13:00:27.620800 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:27.620587 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d498088-44be-4e09-83ec-d62968ca003a-bundle\") pod \"3d498088-44be-4e09-83ec-d62968ca003a\" (UID: \"3d498088-44be-4e09-83ec-d62968ca003a\") " Jun 11 13:00:27.621296 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:27.621268 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d498088-44be-4e09-83ec-d62968ca003a-bundle" (OuterVolumeSpecName: "bundle") pod "3d498088-44be-4e09-83ec-d62968ca003a" (UID: "3d498088-44be-4e09-83ec-d62968ca003a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:00:27.622993 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:27.622969 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d498088-44be-4e09-83ec-d62968ca003a-kube-api-access-lfnj8" (OuterVolumeSpecName: "kube-api-access-lfnj8") pod "3d498088-44be-4e09-83ec-d62968ca003a" (UID: "3d498088-44be-4e09-83ec-d62968ca003a"). InnerVolumeSpecName "kube-api-access-lfnj8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:00:27.624406 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:27.624386 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d498088-44be-4e09-83ec-d62968ca003a-util" (OuterVolumeSpecName: "util") pod "3d498088-44be-4e09-83ec-d62968ca003a" (UID: "3d498088-44be-4e09-83ec-d62968ca003a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:00:27.721323 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:27.721290 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d498088-44be-4e09-83ec-d62968ca003a-util\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:00:27.721323 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:27.721318 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfnj8\" (UniqueName: \"kubernetes.io/projected/3d498088-44be-4e09-83ec-d62968ca003a-kube-api-access-lfnj8\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:00:27.721323 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:27.721328 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d498088-44be-4e09-83ec-d62968ca003a-bundle\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:00:28.380969 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:28.380935 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dww94k" event={"ID":"3d498088-44be-4e09-83ec-d62968ca003a","Type":"ContainerDied","Data":"e1040d9fd2339f63c0adf6993b333cc2668afe86d721ec3c0d5c5dd0e30066cf"} Jun 11 13:00:28.380969 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:28.380965 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dww94k" Jun 11 13:00:28.381192 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:28.380984 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e1040d9fd2339f63c0adf6993b333cc2668afe86d721ec3c0d5c5dd0e30066cf" Jun 11 13:00:30.611832 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:30.611798 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:00:32.046656 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:32.046560 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:00:32.517532 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:32.517499 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xs44n"] Jun 11 13:00:32.517798 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:32.517785 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d498088-44be-4e09-83ec-d62968ca003a" containerName="pull" Jun 11 13:00:32.517860 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:32.517800 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d498088-44be-4e09-83ec-d62968ca003a" containerName="pull" Jun 11 13:00:32.517860 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:32.517815 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d498088-44be-4e09-83ec-d62968ca003a" containerName="extract" Jun 11 13:00:32.517860 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:32.517820 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d498088-44be-4e09-83ec-d62968ca003a" containerName="extract" Jun 11 13:00:32.517860 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:32.517832 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d498088-44be-4e09-83ec-d62968ca003a" containerName="util" Jun 11 13:00:32.517860 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:32.517837 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d498088-44be-4e09-83ec-d62968ca003a" containerName="util" Jun 11 13:00:32.518032 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:32.517892 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d498088-44be-4e09-83ec-d62968ca003a" containerName="extract" Jun 11 13:00:32.531579 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:32.531550 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xs44n" Jun 11 13:00:32.533023 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:32.532996 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xs44n"] Jun 11 13:00:32.534180 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:32.534139 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 11 13:00:32.534333 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:32.534315 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 11 13:00:32.534423 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:32.534361 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-59nrz\"" Jun 11 13:00:32.666147 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:32.666102 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w29v\" (UniqueName: \"kubernetes.io/projected/1cd26e83-e1c6-4679-a434-3e81de69a5c8-kube-api-access-6w29v\") pod \"cert-manager-operator-controller-manager-57757f7cfc-xs44n\" (UID: \"1cd26e83-e1c6-4679-a434-3e81de69a5c8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xs44n" Jun 11 13:00:32.666343 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:32.666218 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1cd26e83-e1c6-4679-a434-3e81de69a5c8-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-xs44n\" (UID: \"1cd26e83-e1c6-4679-a434-3e81de69a5c8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xs44n" Jun 11 13:00:32.767308 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:32.767268 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w29v\" (UniqueName: \"kubernetes.io/projected/1cd26e83-e1c6-4679-a434-3e81de69a5c8-kube-api-access-6w29v\") pod \"cert-manager-operator-controller-manager-57757f7cfc-xs44n\" (UID: \"1cd26e83-e1c6-4679-a434-3e81de69a5c8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xs44n" Jun 11 13:00:32.767472 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:32.767335 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1cd26e83-e1c6-4679-a434-3e81de69a5c8-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-xs44n\" (UID: \"1cd26e83-e1c6-4679-a434-3e81de69a5c8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xs44n" Jun 11 13:00:32.767713 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:32.767655 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1cd26e83-e1c6-4679-a434-3e81de69a5c8-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-xs44n\" (UID: \"1cd26e83-e1c6-4679-a434-3e81de69a5c8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xs44n" Jun 11 13:00:32.778946 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:32.778919 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w29v\" (UniqueName: \"kubernetes.io/projected/1cd26e83-e1c6-4679-a434-3e81de69a5c8-kube-api-access-6w29v\") pod \"cert-manager-operator-controller-manager-57757f7cfc-xs44n\" (UID: \"1cd26e83-e1c6-4679-a434-3e81de69a5c8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xs44n" Jun 11 13:00:32.841336 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:32.841304 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xs44n" Jun 11 13:00:32.991116 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:32.991092 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xs44n"] Jun 11 13:00:32.993110 ip-10-0-137-120 kubenswrapper[2558]: W0611 13:00:32.993082 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cd26e83_e1c6_4679_a434_3e81de69a5c8.slice/crio-4e6e926c3e4cf023c31b02febb9a45c06b796759cad658743369c39fb1f03d5d WatchSource:0}: Error finding container 4e6e926c3e4cf023c31b02febb9a45c06b796759cad658743369c39fb1f03d5d: Status 404 returned error can't find the container with id 4e6e926c3e4cf023c31b02febb9a45c06b796759cad658743369c39fb1f03d5d Jun 11 13:00:33.399238 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:33.399207 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xs44n" event={"ID":"1cd26e83-e1c6-4679-a434-3e81de69a5c8","Type":"ContainerStarted","Data":"4e6e926c3e4cf023c31b02febb9a45c06b796759cad658743369c39fb1f03d5d"} Jun 11 13:00:34.230641 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:34.230605 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:00:34.331622 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:34.331584 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:00:35.409661 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:35.409617 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xs44n" event={"ID":"1cd26e83-e1c6-4679-a434-3e81de69a5c8","Type":"ContainerStarted","Data":"f14d45c147148f2fbeb8ab0a0415c93cb5fddcdac2961b5c00ef29f20e2aa745"} Jun 11 13:00:35.432064 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:35.432007 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xs44n" podStartSLOduration=1.532302475 podStartE2EDuration="3.431991629s" totalImagesPullingTime="1.899689154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:00:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:00:35.430372752 +0000 UTC m=+435.076894707" watchObservedRunningTime="2026-06-11 13:00:35.431991629 +0000 UTC m=+435.078513570" Jun 11 13:00:35.707877 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:35.707787 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:00:35.822311 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:35.822278 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:00:35.932505 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:35.932469 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:00:37.248822 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:37.248786 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dk5n"] Jun 11 13:00:37.269923 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:37.269889 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dk5n"] Jun 11 13:00:37.270070 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:37.270020 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dk5n" Jun 11 13:00:37.272904 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:37.272879 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 13:00:37.273036 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:37.272888 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 13:00:37.273036 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:37.272935 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r44s6\"" Jun 11 13:00:37.301527 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:37.301494 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rxfr\" (UniqueName: \"kubernetes.io/projected/9786d85e-6b39-4efc-9ad6-5f44333195c4-kube-api-access-8rxfr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dk5n\" (UID: \"9786d85e-6b39-4efc-9ad6-5f44333195c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dk5n" Jun 11 13:00:37.301711 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:37.301581 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9786d85e-6b39-4efc-9ad6-5f44333195c4-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dk5n\" (UID: \"9786d85e-6b39-4efc-9ad6-5f44333195c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dk5n" Jun 11 13:00:37.301711 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:37.301623 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9786d85e-6b39-4efc-9ad6-5f44333195c4-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dk5n\" (UID: \"9786d85e-6b39-4efc-9ad6-5f44333195c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dk5n" Jun 11 13:00:37.402748 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:37.402714 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9786d85e-6b39-4efc-9ad6-5f44333195c4-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dk5n\" (UID: \"9786d85e-6b39-4efc-9ad6-5f44333195c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dk5n" Jun 11 13:00:37.402748 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:37.402762 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rxfr\" (UniqueName: \"kubernetes.io/projected/9786d85e-6b39-4efc-9ad6-5f44333195c4-kube-api-access-8rxfr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dk5n\" (UID: \"9786d85e-6b39-4efc-9ad6-5f44333195c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dk5n" Jun 11 13:00:37.402951 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:37.402806 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9786d85e-6b39-4efc-9ad6-5f44333195c4-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dk5n\" (UID: \"9786d85e-6b39-4efc-9ad6-5f44333195c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dk5n" Jun 11 13:00:37.403119 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:37.403101 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9786d85e-6b39-4efc-9ad6-5f44333195c4-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dk5n\" (UID: \"9786d85e-6b39-4efc-9ad6-5f44333195c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dk5n" Jun 11 13:00:37.403176 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:37.403130 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9786d85e-6b39-4efc-9ad6-5f44333195c4-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dk5n\" (UID: \"9786d85e-6b39-4efc-9ad6-5f44333195c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dk5n" Jun 11 13:00:37.413014 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:37.412988 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rxfr\" (UniqueName: \"kubernetes.io/projected/9786d85e-6b39-4efc-9ad6-5f44333195c4-kube-api-access-8rxfr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dk5n\" (UID: \"9786d85e-6b39-4efc-9ad6-5f44333195c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dk5n" Jun 11 13:00:37.580009 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:37.579919 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dk5n" Jun 11 13:00:37.706774 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:37.706749 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dk5n"] Jun 11 13:00:37.709410 ip-10-0-137-120 kubenswrapper[2558]: W0611 13:00:37.709376 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9786d85e_6b39_4efc_9ad6_5f44333195c4.slice/crio-3ac72abc6a93f5f226374d94d35bc7c07cf8ae8c9d2c000b6de43e9608a6d6f4 WatchSource:0}: Error finding container 3ac72abc6a93f5f226374d94d35bc7c07cf8ae8c9d2c000b6de43e9608a6d6f4: Status 404 returned error can't find the container with id 3ac72abc6a93f5f226374d94d35bc7c07cf8ae8c9d2c000b6de43e9608a6d6f4 Jun 11 13:00:38.423084 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:38.423054 2558 generic.go:356] "Generic (PLEG): container finished" podID="9786d85e-6b39-4efc-9ad6-5f44333195c4" containerID="93035e1bd67642c449ae2625a29af9303320b8b714e14d5630ba93e51494d91d" exitCode=0 Jun 11 13:00:38.423455 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:38.423144 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dk5n" event={"ID":"9786d85e-6b39-4efc-9ad6-5f44333195c4","Type":"ContainerDied","Data":"93035e1bd67642c449ae2625a29af9303320b8b714e14d5630ba93e51494d91d"} Jun 11 13:00:38.423455 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:38.423250 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dk5n" event={"ID":"9786d85e-6b39-4efc-9ad6-5f44333195c4","Type":"ContainerStarted","Data":"3ac72abc6a93f5f226374d94d35bc7c07cf8ae8c9d2c000b6de43e9608a6d6f4"} Jun 11 13:00:39.174339 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:39.174301 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:00:39.561382 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:39.561307 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:00:41.437739 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:41.437646 2558 generic.go:356] "Generic (PLEG): container finished" podID="9786d85e-6b39-4efc-9ad6-5f44333195c4" containerID="6811cee61f44fc5f099c2c67130dcd49e27f1c2735862cbb8d34a7546d4cf282" exitCode=0 Jun 11 13:00:41.438133 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:41.437736 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dk5n" event={"ID":"9786d85e-6b39-4efc-9ad6-5f44333195c4","Type":"ContainerDied","Data":"6811cee61f44fc5f099c2c67130dcd49e27f1c2735862cbb8d34a7546d4cf282"} Jun 11 13:00:41.621536 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:41.621506 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:00:41.682482 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:41.682448 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:00:42.443350 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:42.443308 2558 generic.go:356] "Generic (PLEG): container finished" podID="9786d85e-6b39-4efc-9ad6-5f44333195c4" containerID="6e22187373fd499256da5a298e4f06b134050a0d9b6983fc68f6758a672f37bb" exitCode=0 Jun 11 13:00:42.443748 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:42.443388 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dk5n" event={"ID":"9786d85e-6b39-4efc-9ad6-5f44333195c4","Type":"ContainerDied","Data":"6e22187373fd499256da5a298e4f06b134050a0d9b6983fc68f6758a672f37bb"} Jun 11 13:00:43.161083 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:43.161048 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-78qm9"] Jun 11 13:00:43.163100 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:43.163083 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-78qm9" Jun 11 13:00:43.165564 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:43.165542 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-v2p4s\"" Jun 11 13:00:43.165667 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:43.165595 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 13:00:43.166718 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:43.166700 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 13:00:43.172498 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:43.172477 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-78qm9"] Jun 11 13:00:43.248393 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:43.248354 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c2d9084-75cc-48ea-bc63-8039bcfc3faf-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-78qm9\" (UID: \"2c2d9084-75cc-48ea-bc63-8039bcfc3faf\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-78qm9" Jun 11 13:00:43.248574 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:43.248414 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9bkw\" (UniqueName: \"kubernetes.io/projected/2c2d9084-75cc-48ea-bc63-8039bcfc3faf-kube-api-access-t9bkw\") pod \"cert-manager-cainjector-5d99449ffd-78qm9\" (UID: \"2c2d9084-75cc-48ea-bc63-8039bcfc3faf\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-78qm9" Jun 11 13:00:43.349267 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:43.349228 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c2d9084-75cc-48ea-bc63-8039bcfc3faf-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-78qm9\" (UID: \"2c2d9084-75cc-48ea-bc63-8039bcfc3faf\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-78qm9" Jun 11 13:00:43.349430 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:43.349296 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9bkw\" (UniqueName: \"kubernetes.io/projected/2c2d9084-75cc-48ea-bc63-8039bcfc3faf-kube-api-access-t9bkw\") pod \"cert-manager-cainjector-5d99449ffd-78qm9\" (UID: \"2c2d9084-75cc-48ea-bc63-8039bcfc3faf\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-78qm9" Jun 11 13:00:43.358478 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:43.358451 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c2d9084-75cc-48ea-bc63-8039bcfc3faf-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-78qm9\" (UID: \"2c2d9084-75cc-48ea-bc63-8039bcfc3faf\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-78qm9" Jun 11 13:00:43.358620 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:43.358517 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9bkw\" (UniqueName: \"kubernetes.io/projected/2c2d9084-75cc-48ea-bc63-8039bcfc3faf-kube-api-access-t9bkw\") pod \"cert-manager-cainjector-5d99449ffd-78qm9\" (UID: \"2c2d9084-75cc-48ea-bc63-8039bcfc3faf\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-78qm9" Jun 11 13:00:43.472687 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:43.472653 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-78qm9" Jun 11 13:00:43.578730 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:43.578706 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dk5n" Jun 11 13:00:43.613120 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:43.613075 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-78qm9"] Jun 11 13:00:43.615794 ip-10-0-137-120 kubenswrapper[2558]: W0611 13:00:43.615766 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c2d9084_75cc_48ea_bc63_8039bcfc3faf.slice/crio-15d4eb4fa4b4dcbfa0915e14c340305627a4672ee334b0d154b33ecbfd274aef WatchSource:0}: Error finding container 15d4eb4fa4b4dcbfa0915e14c340305627a4672ee334b0d154b33ecbfd274aef: Status 404 returned error can't find the container with id 15d4eb4fa4b4dcbfa0915e14c340305627a4672ee334b0d154b33ecbfd274aef Jun 11 13:00:43.651952 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:43.651907 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rxfr\" (UniqueName: \"kubernetes.io/projected/9786d85e-6b39-4efc-9ad6-5f44333195c4-kube-api-access-8rxfr\") pod \"9786d85e-6b39-4efc-9ad6-5f44333195c4\" (UID: \"9786d85e-6b39-4efc-9ad6-5f44333195c4\") " Jun 11 13:00:43.652143 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:43.651985 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9786d85e-6b39-4efc-9ad6-5f44333195c4-util\") pod \"9786d85e-6b39-4efc-9ad6-5f44333195c4\" (UID: \"9786d85e-6b39-4efc-9ad6-5f44333195c4\") " Jun 11 13:00:43.652143 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:43.652020 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9786d85e-6b39-4efc-9ad6-5f44333195c4-bundle\") pod \"9786d85e-6b39-4efc-9ad6-5f44333195c4\" (UID: \"9786d85e-6b39-4efc-9ad6-5f44333195c4\") " Jun 11 13:00:43.652555 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:43.652530 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9786d85e-6b39-4efc-9ad6-5f44333195c4-bundle" (OuterVolumeSpecName: "bundle") pod "9786d85e-6b39-4efc-9ad6-5f44333195c4" (UID: "9786d85e-6b39-4efc-9ad6-5f44333195c4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:00:43.654064 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:43.654040 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9786d85e-6b39-4efc-9ad6-5f44333195c4-kube-api-access-8rxfr" (OuterVolumeSpecName: "kube-api-access-8rxfr") pod "9786d85e-6b39-4efc-9ad6-5f44333195c4" (UID: "9786d85e-6b39-4efc-9ad6-5f44333195c4"). InnerVolumeSpecName "kube-api-access-8rxfr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:00:43.656598 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:43.656563 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9786d85e-6b39-4efc-9ad6-5f44333195c4-util" (OuterVolumeSpecName: "util") pod "9786d85e-6b39-4efc-9ad6-5f44333195c4" (UID: "9786d85e-6b39-4efc-9ad6-5f44333195c4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:00:43.753525 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:43.753437 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9786d85e-6b39-4efc-9ad6-5f44333195c4-util\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:00:43.753525 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:43.753465 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9786d85e-6b39-4efc-9ad6-5f44333195c4-bundle\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:00:43.753525 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:43.753475 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rxfr\" (UniqueName: \"kubernetes.io/projected/9786d85e-6b39-4efc-9ad6-5f44333195c4-kube-api-access-8rxfr\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:00:44.453810 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:44.453780 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dk5n" Jun 11 13:00:44.453810 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:44.453784 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7dk5n" event={"ID":"9786d85e-6b39-4efc-9ad6-5f44333195c4","Type":"ContainerDied","Data":"3ac72abc6a93f5f226374d94d35bc7c07cf8ae8c9d2c000b6de43e9608a6d6f4"} Jun 11 13:00:44.454006 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:44.453827 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3ac72abc6a93f5f226374d94d35bc7c07cf8ae8c9d2c000b6de43e9608a6d6f4" Jun 11 13:00:44.455018 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:44.454992 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-78qm9" event={"ID":"2c2d9084-75cc-48ea-bc63-8039bcfc3faf","Type":"ContainerStarted","Data":"15d4eb4fa4b4dcbfa0915e14c340305627a4672ee334b0d154b33ecbfd274aef"} Jun 11 13:00:47.379702 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:47.379666 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:00:48.479957 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:48.479868 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-78qm9" event={"ID":"2c2d9084-75cc-48ea-bc63-8039bcfc3faf","Type":"ContainerStarted","Data":"22119713301ac9a473527e3916e07753d13de8c82ce80d38a71972fc750ce6b3"} Jun 11 13:00:48.495243 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:48.495191 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-78qm9" podStartSLOduration=0.943710909 podStartE2EDuration="5.495173292s" totalImagesPullingTime="4.551462383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:00:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:00:48.495140991 +0000 UTC m=+448.141662934" watchObservedRunningTime="2026-06-11 13:00:48.495173292 +0000 UTC m=+448.141695239" Jun 11 13:00:48.832627 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:48.832539 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:00:48.887394 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:48.887362 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:00:50.030765 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:50.030737 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:00:50.127932 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:50.127891 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:00:56.756877 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:56.756829 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:00:56.858072 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:56.858041 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:00:58.325624 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:58.325587 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnjmcj"] Jun 11 13:00:58.326001 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:58.325859 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9786d85e-6b39-4efc-9ad6-5f44333195c4" containerName="util" Jun 11 13:00:58.326001 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:58.325870 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9786d85e-6b39-4efc-9ad6-5f44333195c4" containerName="util" Jun 11 13:00:58.326001 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:58.325880 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9786d85e-6b39-4efc-9ad6-5f44333195c4" containerName="pull" Jun 11 13:00:58.326001 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:58.325885 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9786d85e-6b39-4efc-9ad6-5f44333195c4" containerName="pull" Jun 11 13:00:58.326001 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:58.325902 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9786d85e-6b39-4efc-9ad6-5f44333195c4" containerName="extract" Jun 11 13:00:58.326001 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:58.325908 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9786d85e-6b39-4efc-9ad6-5f44333195c4" containerName="extract" Jun 11 13:00:58.326001 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:58.325951 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9786d85e-6b39-4efc-9ad6-5f44333195c4" containerName="extract" Jun 11 13:00:58.328940 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:58.328923 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnjmcj" Jun 11 13:00:58.331639 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:58.331610 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 13:00:58.331759 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:58.331655 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 13:00:58.332589 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:58.332572 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r44s6\"" Jun 11 13:00:58.337654 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:58.337624 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnjmcj"] Jun 11 13:00:58.379426 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:58.379389 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c578a62b-b74f-4bbf-85b2-2e866d7be208-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnjmcj\" (UID: \"c578a62b-b74f-4bbf-85b2-2e866d7be208\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnjmcj" Jun 11 13:00:58.379590 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:58.379447 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbhgx\" (UniqueName: \"kubernetes.io/projected/c578a62b-b74f-4bbf-85b2-2e866d7be208-kube-api-access-mbhgx\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnjmcj\" (UID: \"c578a62b-b74f-4bbf-85b2-2e866d7be208\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnjmcj" Jun 11 13:00:58.379590 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:58.379557 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c578a62b-b74f-4bbf-85b2-2e866d7be208-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnjmcj\" (UID: \"c578a62b-b74f-4bbf-85b2-2e866d7be208\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnjmcj" Jun 11 13:00:58.480488 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:58.480450 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c578a62b-b74f-4bbf-85b2-2e866d7be208-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnjmcj\" (UID: \"c578a62b-b74f-4bbf-85b2-2e866d7be208\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnjmcj" Jun 11 13:00:58.480658 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:58.480502 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbhgx\" (UniqueName: \"kubernetes.io/projected/c578a62b-b74f-4bbf-85b2-2e866d7be208-kube-api-access-mbhgx\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnjmcj\" (UID: \"c578a62b-b74f-4bbf-85b2-2e866d7be208\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnjmcj" Jun 11 13:00:58.480658 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:58.480544 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c578a62b-b74f-4bbf-85b2-2e866d7be208-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnjmcj\" (UID: \"c578a62b-b74f-4bbf-85b2-2e866d7be208\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnjmcj" Jun 11 13:00:58.480922 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:58.480908 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c578a62b-b74f-4bbf-85b2-2e866d7be208-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnjmcj\" (UID: \"c578a62b-b74f-4bbf-85b2-2e866d7be208\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnjmcj" Jun 11 13:00:58.480996 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:58.480979 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c578a62b-b74f-4bbf-85b2-2e866d7be208-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnjmcj\" (UID: \"c578a62b-b74f-4bbf-85b2-2e866d7be208\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnjmcj" Jun 11 13:00:58.490966 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:58.490926 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbhgx\" (UniqueName: \"kubernetes.io/projected/c578a62b-b74f-4bbf-85b2-2e866d7be208-kube-api-access-mbhgx\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnjmcj\" (UID: \"c578a62b-b74f-4bbf-85b2-2e866d7be208\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnjmcj" Jun 11 13:00:58.529137 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:58.529100 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:00:58.638327 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:58.638290 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnjmcj" Jun 11 13:00:58.775640 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:58.775599 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnjmcj"] Jun 11 13:00:58.778849 ip-10-0-137-120 kubenswrapper[2558]: W0611 13:00:58.778816 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc578a62b_b74f_4bbf_85b2_2e866d7be208.slice/crio-f87b3eedba25bc90ec2df53b421bedfbb42e312bf5d3f7f6790708e77ef96094 WatchSource:0}: Error finding container f87b3eedba25bc90ec2df53b421bedfbb42e312bf5d3f7f6790708e77ef96094: Status 404 returned error can't find the container with id f87b3eedba25bc90ec2df53b421bedfbb42e312bf5d3f7f6790708e77ef96094 Jun 11 13:00:59.527018 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:59.526983 2558 generic.go:356] "Generic (PLEG): container finished" podID="c578a62b-b74f-4bbf-85b2-2e866d7be208" containerID="b55059b58b6bb53f202f74c28eef5219d01b9806a4acbe74214c5ab045c09541" exitCode=0 Jun 11 13:00:59.527383 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:59.527024 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnjmcj" event={"ID":"c578a62b-b74f-4bbf-85b2-2e866d7be208","Type":"ContainerDied","Data":"b55059b58b6bb53f202f74c28eef5219d01b9806a4acbe74214c5ab045c09541"} Jun 11 13:00:59.527383 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:00:59.527060 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnjmcj" event={"ID":"c578a62b-b74f-4bbf-85b2-2e866d7be208","Type":"ContainerStarted","Data":"f87b3eedba25bc90ec2df53b421bedfbb42e312bf5d3f7f6790708e77ef96094"} Jun 11 13:01:00.533222 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:00.533193 2558 generic.go:356] "Generic (PLEG): container finished" podID="c578a62b-b74f-4bbf-85b2-2e866d7be208" containerID="7033ead17ebb8dbc40d4e03aec4d5a68fd1a328f0e57e07220a0926f45da1824" exitCode=0 Jun 11 13:01:00.533584 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:00.533231 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnjmcj" event={"ID":"c578a62b-b74f-4bbf-85b2-2e866d7be208","Type":"ContainerDied","Data":"7033ead17ebb8dbc40d4e03aec4d5a68fd1a328f0e57e07220a0926f45da1824"} Jun 11 13:01:01.252429 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:01.252396 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:01.538977 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:01.538889 2558 generic.go:356] "Generic (PLEG): container finished" podID="c578a62b-b74f-4bbf-85b2-2e866d7be208" containerID="cc9b7f820c7d8b321f65a141de83ec7884a2217fcaf6f222a822c324cab3dc56" exitCode=0 Jun 11 13:01:01.539352 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:01.538974 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnjmcj" event={"ID":"c578a62b-b74f-4bbf-85b2-2e866d7be208","Type":"ContainerDied","Data":"cc9b7f820c7d8b321f65a141de83ec7884a2217fcaf6f222a822c324cab3dc56"} Jun 11 13:01:02.662235 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:02.662212 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnjmcj" Jun 11 13:01:02.721102 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:02.721064 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c578a62b-b74f-4bbf-85b2-2e866d7be208-bundle\") pod \"c578a62b-b74f-4bbf-85b2-2e866d7be208\" (UID: \"c578a62b-b74f-4bbf-85b2-2e866d7be208\") " Jun 11 13:01:02.721263 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:02.721180 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c578a62b-b74f-4bbf-85b2-2e866d7be208-util\") pod \"c578a62b-b74f-4bbf-85b2-2e866d7be208\" (UID: \"c578a62b-b74f-4bbf-85b2-2e866d7be208\") " Jun 11 13:01:02.721263 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:02.721218 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbhgx\" (UniqueName: \"kubernetes.io/projected/c578a62b-b74f-4bbf-85b2-2e866d7be208-kube-api-access-mbhgx\") pod \"c578a62b-b74f-4bbf-85b2-2e866d7be208\" (UID: \"c578a62b-b74f-4bbf-85b2-2e866d7be208\") " Jun 11 13:01:02.721788 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:02.721754 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c578a62b-b74f-4bbf-85b2-2e866d7be208-bundle" (OuterVolumeSpecName: "bundle") pod "c578a62b-b74f-4bbf-85b2-2e866d7be208" (UID: "c578a62b-b74f-4bbf-85b2-2e866d7be208"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:01:02.723378 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:02.723347 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c578a62b-b74f-4bbf-85b2-2e866d7be208-kube-api-access-mbhgx" (OuterVolumeSpecName: "kube-api-access-mbhgx") pod "c578a62b-b74f-4bbf-85b2-2e866d7be208" (UID: "c578a62b-b74f-4bbf-85b2-2e866d7be208"). InnerVolumeSpecName "kube-api-access-mbhgx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:01:02.726605 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:02.726572 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c578a62b-b74f-4bbf-85b2-2e866d7be208-util" (OuterVolumeSpecName: "util") pod "c578a62b-b74f-4bbf-85b2-2e866d7be208" (UID: "c578a62b-b74f-4bbf-85b2-2e866d7be208"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:01:02.821877 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:02.821786 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c578a62b-b74f-4bbf-85b2-2e866d7be208-bundle\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:01:02.821877 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:02.821818 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c578a62b-b74f-4bbf-85b2-2e866d7be208-util\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:01:02.821877 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:02.821831 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbhgx\" (UniqueName: \"kubernetes.io/projected/c578a62b-b74f-4bbf-85b2-2e866d7be208-kube-api-access-mbhgx\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:01:03.549520 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:03.549486 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnjmcj" event={"ID":"c578a62b-b74f-4bbf-85b2-2e866d7be208","Type":"ContainerDied","Data":"f87b3eedba25bc90ec2df53b421bedfbb42e312bf5d3f7f6790708e77ef96094"} Jun 11 13:01:03.549520 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:03.549505 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnjmcj" Jun 11 13:01:03.549723 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:03.549531 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f87b3eedba25bc90ec2df53b421bedfbb42e312bf5d3f7f6790708e77ef96094" Jun 11 13:01:14.246617 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:14.246569 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:14.339960 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:14.339928 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:14.842501 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:14.842473 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:15.131118 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.131074 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:15.235292 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.235260 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:15.262711 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.262674 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-p4dk5"] Jun 11 13:01:15.263187 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.263142 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c578a62b-b74f-4bbf-85b2-2e866d7be208" containerName="pull" Jun 11 13:01:15.263187 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.263178 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c578a62b-b74f-4bbf-85b2-2e866d7be208" containerName="pull" Jun 11 13:01:15.263307 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.263193 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c578a62b-b74f-4bbf-85b2-2e866d7be208" containerName="extract" Jun 11 13:01:15.263307 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.263202 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c578a62b-b74f-4bbf-85b2-2e866d7be208" containerName="extract" Jun 11 13:01:15.263307 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.263227 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c578a62b-b74f-4bbf-85b2-2e866d7be208" containerName="util" Jun 11 13:01:15.263307 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.263236 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c578a62b-b74f-4bbf-85b2-2e866d7be208" containerName="util" Jun 11 13:01:15.263307 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.263306 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c578a62b-b74f-4bbf-85b2-2e866d7be208" containerName="extract" Jun 11 13:01:15.268869 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.268845 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-p4dk5" Jun 11 13:01:15.271435 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.271408 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 13:01:15.271562 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.271455 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 13:01:15.271993 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.271960 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 13:01:15.271993 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.271969 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6fdmw\"" Jun 11 13:01:15.272148 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.272059 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 13:01:15.281293 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.281270 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-p4dk5"] Jun 11 13:01:15.413868 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.413789 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:15.427036 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.427003 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/18f34f4a-233b-45b1-8b35-4d5c7778dc3e-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fb67dbd4-p4dk5\" (UID: \"18f34f4a-233b-45b1-8b35-4d5c7778dc3e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-p4dk5" Jun 11 13:01:15.427228 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.427047 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18f34f4a-233b-45b1-8b35-4d5c7778dc3e-tmp\") pod \"opendatahub-operator-controller-manager-7fb67dbd4-p4dk5\" (UID: \"18f34f4a-233b-45b1-8b35-4d5c7778dc3e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-p4dk5" Jun 11 13:01:15.427228 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.427065 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gqz8\" (UniqueName: \"kubernetes.io/projected/18f34f4a-233b-45b1-8b35-4d5c7778dc3e-kube-api-access-6gqz8\") pod \"opendatahub-operator-controller-manager-7fb67dbd4-p4dk5\" (UID: \"18f34f4a-233b-45b1-8b35-4d5c7778dc3e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-p4dk5" Jun 11 13:01:15.427228 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.427086 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/18f34f4a-233b-45b1-8b35-4d5c7778dc3e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fb67dbd4-p4dk5\" (UID: \"18f34f4a-233b-45b1-8b35-4d5c7778dc3e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-p4dk5" Jun 11 13:01:15.427374 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.427231 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/18f34f4a-233b-45b1-8b35-4d5c7778dc3e-manifests\") pod \"opendatahub-operator-controller-manager-7fb67dbd4-p4dk5\" (UID: \"18f34f4a-233b-45b1-8b35-4d5c7778dc3e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-p4dk5" Jun 11 13:01:15.519353 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.519312 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:15.528621 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.528596 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/18f34f4a-233b-45b1-8b35-4d5c7778dc3e-manifests\") pod \"opendatahub-operator-controller-manager-7fb67dbd4-p4dk5\" (UID: \"18f34f4a-233b-45b1-8b35-4d5c7778dc3e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-p4dk5" Jun 11 13:01:15.528708 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.528641 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/18f34f4a-233b-45b1-8b35-4d5c7778dc3e-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fb67dbd4-p4dk5\" (UID: \"18f34f4a-233b-45b1-8b35-4d5c7778dc3e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-p4dk5" Jun 11 13:01:15.528708 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.528675 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18f34f4a-233b-45b1-8b35-4d5c7778dc3e-tmp\") pod \"opendatahub-operator-controller-manager-7fb67dbd4-p4dk5\" (UID: \"18f34f4a-233b-45b1-8b35-4d5c7778dc3e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-p4dk5" Jun 11 13:01:15.528708 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.528698 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gqz8\" (UniqueName: \"kubernetes.io/projected/18f34f4a-233b-45b1-8b35-4d5c7778dc3e-kube-api-access-6gqz8\") pod \"opendatahub-operator-controller-manager-7fb67dbd4-p4dk5\" (UID: \"18f34f4a-233b-45b1-8b35-4d5c7778dc3e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-p4dk5" Jun 11 13:01:15.528809 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.528726 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/18f34f4a-233b-45b1-8b35-4d5c7778dc3e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fb67dbd4-p4dk5\" (UID: \"18f34f4a-233b-45b1-8b35-4d5c7778dc3e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-p4dk5" Jun 11 13:01:15.529078 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.529054 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/18f34f4a-233b-45b1-8b35-4d5c7778dc3e-manifests\") pod \"opendatahub-operator-controller-manager-7fb67dbd4-p4dk5\" (UID: \"18f34f4a-233b-45b1-8b35-4d5c7778dc3e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-p4dk5" Jun 11 13:01:15.530998 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.530977 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18f34f4a-233b-45b1-8b35-4d5c7778dc3e-tmp\") pod \"opendatahub-operator-controller-manager-7fb67dbd4-p4dk5\" (UID: \"18f34f4a-233b-45b1-8b35-4d5c7778dc3e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-p4dk5" Jun 11 13:01:15.531326 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.531308 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/18f34f4a-233b-45b1-8b35-4d5c7778dc3e-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fb67dbd4-p4dk5\" (UID: \"18f34f4a-233b-45b1-8b35-4d5c7778dc3e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-p4dk5" Jun 11 13:01:15.531392 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.531336 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/18f34f4a-233b-45b1-8b35-4d5c7778dc3e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fb67dbd4-p4dk5\" (UID: \"18f34f4a-233b-45b1-8b35-4d5c7778dc3e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-p4dk5" Jun 11 13:01:15.537018 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.536991 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gqz8\" (UniqueName: \"kubernetes.io/projected/18f34f4a-233b-45b1-8b35-4d5c7778dc3e-kube-api-access-6gqz8\") pod \"opendatahub-operator-controller-manager-7fb67dbd4-p4dk5\" (UID: \"18f34f4a-233b-45b1-8b35-4d5c7778dc3e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-p4dk5" Jun 11 13:01:15.579035 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.578994 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-p4dk5" Jun 11 13:01:15.613993 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.613959 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:15.717200 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.717175 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-p4dk5"] Jun 11 13:01:15.719538 ip-10-0-137-120 kubenswrapper[2558]: W0611 13:01:15.719508 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18f34f4a_233b_45b1_8b35_4d5c7778dc3e.slice/crio-ec1eefd5e1fe299807afa9509f9694c8958f5473188635e0ba039f1ad13c1bbd WatchSource:0}: Error finding container ec1eefd5e1fe299807afa9509f9694c8958f5473188635e0ba039f1ad13c1bbd: Status 404 returned error can't find the container with id ec1eefd5e1fe299807afa9509f9694c8958f5473188635e0ba039f1ad13c1bbd Jun 11 13:01:15.722742 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.722713 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:15.826287 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.826254 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:15.928752 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:15.928715 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:16.026421 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:16.026339 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:16.610869 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:16.610834 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-p4dk5" event={"ID":"18f34f4a-233b-45b1-8b35-4d5c7778dc3e","Type":"ContainerStarted","Data":"ec1eefd5e1fe299807afa9509f9694c8958f5473188635e0ba039f1ad13c1bbd"} Jun 11 13:01:19.628430 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:19.628393 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-p4dk5" event={"ID":"18f34f4a-233b-45b1-8b35-4d5c7778dc3e","Type":"ContainerStarted","Data":"ddbdd179b7bae5a856dfa8807c003fab872ce1aa1865e4e20fefd62df4d75571"} Jun 11 13:01:20.074183 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:20.074134 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:20.168080 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:20.168043 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:20.633782 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:20.633746 2558 generic.go:356] "Generic (PLEG): container finished" podID="18f34f4a-233b-45b1-8b35-4d5c7778dc3e" containerID="ddbdd179b7bae5a856dfa8807c003fab872ce1aa1865e4e20fefd62df4d75571" exitCode=0 Jun 11 13:01:20.634242 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:20.633830 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-p4dk5" event={"ID":"18f34f4a-233b-45b1-8b35-4d5c7778dc3e","Type":"ContainerDied","Data":"ddbdd179b7bae5a856dfa8807c003fab872ce1aa1865e4e20fefd62df4d75571"} Jun 11 13:01:21.640547 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:21.640509 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-p4dk5" event={"ID":"18f34f4a-233b-45b1-8b35-4d5c7778dc3e","Type":"ContainerStarted","Data":"466f2da2fc10f0872819e26c27f39a2816b13b030ecbe30a9d021fd6273c2ff7"} Jun 11 13:01:21.640967 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:21.640669 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-p4dk5" Jun 11 13:01:24.697301 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:24.697265 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:24.801131 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:24.801101 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:26.664349 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:26.664317 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:28.556659 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:28.556620 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:28.621696 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:28.621664 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:32.647428 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:32.647391 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-p4dk5" Jun 11 13:01:32.673909 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:32.673855 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7fb67dbd4-p4dk5" podStartSLOduration=12.917824353 podStartE2EDuration="17.673836724s" totalImagesPullingTime="3.838991713s" totalInitContainerRuntime="917.020658ms" isStatefulPod=false podCreationTimestamp="2026-06-11 13:01:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:01:21.697217055 +0000 UTC m=+481.343739001" watchObservedRunningTime="2026-06-11 13:01:32.673836724 +0000 UTC m=+492.320358665" Jun 11 13:01:35.847454 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:35.847414 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:36.056622 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:36.056589 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:36.612868 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:36.612830 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-cs2gf"] Jun 11 13:01:36.616540 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:36.616518 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-cs2gf" Jun 11 13:01:36.618988 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:36.618961 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 11 13:01:36.619129 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:36.619074 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-r5zp2\"" Jun 11 13:01:36.632055 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:36.632028 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-cs2gf"] Jun 11 13:01:36.659544 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:36.659514 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:36.704978 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:36.704938 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18559f15-3ab2-43e0-90ed-954267dd0d0d-cert\") pod \"odh-model-controller-6dc94f689f-cs2gf\" (UID: \"18559f15-3ab2-43e0-90ed-954267dd0d0d\") " pod="opendatahub/odh-model-controller-6dc94f689f-cs2gf" Jun 11 13:01:36.705134 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:36.704982 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn97b\" (UniqueName: \"kubernetes.io/projected/18559f15-3ab2-43e0-90ed-954267dd0d0d-kube-api-access-xn97b\") pod \"odh-model-controller-6dc94f689f-cs2gf\" (UID: \"18559f15-3ab2-43e0-90ed-954267dd0d0d\") " pod="opendatahub/odh-model-controller-6dc94f689f-cs2gf" Jun 11 13:01:36.755470 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:36.755432 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:36.805861 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:36.805829 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18559f15-3ab2-43e0-90ed-954267dd0d0d-cert\") pod \"odh-model-controller-6dc94f689f-cs2gf\" (UID: \"18559f15-3ab2-43e0-90ed-954267dd0d0d\") " pod="opendatahub/odh-model-controller-6dc94f689f-cs2gf" Jun 11 13:01:36.806016 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:36.805873 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn97b\" (UniqueName: \"kubernetes.io/projected/18559f15-3ab2-43e0-90ed-954267dd0d0d-kube-api-access-xn97b\") pod \"odh-model-controller-6dc94f689f-cs2gf\" (UID: \"18559f15-3ab2-43e0-90ed-954267dd0d0d\") " pod="opendatahub/odh-model-controller-6dc94f689f-cs2gf" Jun 11 13:01:36.806016 ip-10-0-137-120 kubenswrapper[2558]: E0611 13:01:36.805977 2558 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 11 13:01:36.806147 ip-10-0-137-120 kubenswrapper[2558]: E0611 13:01:36.806054 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18559f15-3ab2-43e0-90ed-954267dd0d0d-cert podName:18559f15-3ab2-43e0-90ed-954267dd0d0d nodeName:}" failed. No retries permitted until 2026-06-11 13:01:37.306036982 +0000 UTC m=+496.952558903 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/18559f15-3ab2-43e0-90ed-954267dd0d0d-cert") pod "odh-model-controller-6dc94f689f-cs2gf" (UID: "18559f15-3ab2-43e0-90ed-954267dd0d0d") : secret "odh-model-controller-webhook-cert" not found Jun 11 13:01:36.817082 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:36.817056 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn97b\" (UniqueName: \"kubernetes.io/projected/18559f15-3ab2-43e0-90ed-954267dd0d0d-kube-api-access-xn97b\") pod \"odh-model-controller-6dc94f689f-cs2gf\" (UID: \"18559f15-3ab2-43e0-90ed-954267dd0d0d\") " pod="opendatahub/odh-model-controller-6dc94f689f-cs2gf" Jun 11 13:01:36.854508 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:36.854477 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:37.144380 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:37.144349 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:37.311259 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:37.311226 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18559f15-3ab2-43e0-90ed-954267dd0d0d-cert\") pod \"odh-model-controller-6dc94f689f-cs2gf\" (UID: \"18559f15-3ab2-43e0-90ed-954267dd0d0d\") " pod="opendatahub/odh-model-controller-6dc94f689f-cs2gf" Jun 11 13:01:37.313730 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:37.313705 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18559f15-3ab2-43e0-90ed-954267dd0d0d-cert\") pod \"odh-model-controller-6dc94f689f-cs2gf\" (UID: \"18559f15-3ab2-43e0-90ed-954267dd0d0d\") " pod="opendatahub/odh-model-controller-6dc94f689f-cs2gf" Jun 11 13:01:37.323417 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:37.323387 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-mkwq7"] Jun 11 13:01:37.325821 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:37.325806 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-mkwq7" Jun 11 13:01:37.328434 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:37.328408 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 11 13:01:37.340262 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:37.340239 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-mkwq7"] Jun 11 13:01:37.355139 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:37.355094 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:37.412056 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:37.411976 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9336f330-5089-4b43-a89c-6de50995f06c-tls-certs\") pod \"model-serving-api-5dd488fc48-mkwq7\" (UID: \"9336f330-5089-4b43-a89c-6de50995f06c\") " pod="opendatahub/model-serving-api-5dd488fc48-mkwq7" Jun 11 13:01:37.412056 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:37.412012 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t7pz\" (UniqueName: \"kubernetes.io/projected/9336f330-5089-4b43-a89c-6de50995f06c-kube-api-access-4t7pz\") pod \"model-serving-api-5dd488fc48-mkwq7\" (UID: \"9336f330-5089-4b43-a89c-6de50995f06c\") " pod="opendatahub/model-serving-api-5dd488fc48-mkwq7" Jun 11 13:01:37.513512 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:37.513473 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9336f330-5089-4b43-a89c-6de50995f06c-tls-certs\") pod \"model-serving-api-5dd488fc48-mkwq7\" (UID: \"9336f330-5089-4b43-a89c-6de50995f06c\") " pod="opendatahub/model-serving-api-5dd488fc48-mkwq7" Jun 11 13:01:37.513512 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:37.513514 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t7pz\" (UniqueName: \"kubernetes.io/projected/9336f330-5089-4b43-a89c-6de50995f06c-kube-api-access-4t7pz\") pod \"model-serving-api-5dd488fc48-mkwq7\" (UID: \"9336f330-5089-4b43-a89c-6de50995f06c\") " pod="opendatahub/model-serving-api-5dd488fc48-mkwq7" Jun 11 13:01:37.515933 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:37.515904 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9336f330-5089-4b43-a89c-6de50995f06c-tls-certs\") pod \"model-serving-api-5dd488fc48-mkwq7\" (UID: \"9336f330-5089-4b43-a89c-6de50995f06c\") " pod="opendatahub/model-serving-api-5dd488fc48-mkwq7" Jun 11 13:01:37.522428 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:37.522402 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t7pz\" (UniqueName: \"kubernetes.io/projected/9336f330-5089-4b43-a89c-6de50995f06c-kube-api-access-4t7pz\") pod \"model-serving-api-5dd488fc48-mkwq7\" (UID: \"9336f330-5089-4b43-a89c-6de50995f06c\") " pod="opendatahub/model-serving-api-5dd488fc48-mkwq7" Jun 11 13:01:37.527068 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:37.527042 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-cs2gf" Jun 11 13:01:37.540760 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:37.540731 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:37.636634 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:37.636598 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-mkwq7" Jun 11 13:01:37.667101 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:37.667070 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-cs2gf"] Jun 11 13:01:37.725882 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:37.725816 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-cs2gf" event={"ID":"18559f15-3ab2-43e0-90ed-954267dd0d0d","Type":"ContainerStarted","Data":"16547617f87f79a37ab60cefcd0050964d4cb24468420f370d3c504a3e42d061"} Jun 11 13:01:37.796211 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:37.796146 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-mkwq7"] Jun 11 13:01:37.799487 ip-10-0-137-120 kubenswrapper[2558]: W0611 13:01:37.799450 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9336f330_5089_4b43_a89c_6de50995f06c.slice/crio-59aa58b4692beecf67d60abb6c8c88b1ad5084fd1e9f0e5a9a66755bc9830763 WatchSource:0}: Error finding container 59aa58b4692beecf67d60abb6c8c88b1ad5084fd1e9f0e5a9a66755bc9830763: Status 404 returned error can't find the container with id 59aa58b4692beecf67d60abb6c8c88b1ad5084fd1e9f0e5a9a66755bc9830763 Jun 11 13:01:38.736480 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:38.736430 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-mkwq7" event={"ID":"9336f330-5089-4b43-a89c-6de50995f06c","Type":"ContainerStarted","Data":"59aa58b4692beecf67d60abb6c8c88b1ad5084fd1e9f0e5a9a66755bc9830763"} Jun 11 13:01:41.886295 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:41.886263 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:41.971544 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:41.971495 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068828n"] Jun 11 13:01:41.975265 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:41.975242 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068828n" Jun 11 13:01:41.977912 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:41.977890 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 13:01:41.978311 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:41.978293 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 13:01:41.979148 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:41.979046 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r44s6\"" Jun 11 13:01:41.983899 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:41.983873 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068828n"] Jun 11 13:01:41.987345 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:41.984790 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:42.031409 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.031374 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-bb48c64d9-mpgkw"] Jun 11 13:01:42.033932 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.033912 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-bb48c64d9-mpgkw" Jun 11 13:01:42.036491 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.036445 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 13:01:42.036604 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.036453 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-fzfjj\"" Jun 11 13:01:42.036604 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.036541 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 13:01:42.047752 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.047725 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-bb48c64d9-mpgkw"] Jun 11 13:01:42.058050 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.058018 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca12573d-162c-4e37-a57c-c1defe94e29a-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068828n\" (UID: \"ca12573d-162c-4e37-a57c-c1defe94e29a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068828n" Jun 11 13:01:42.058178 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.058063 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca12573d-162c-4e37-a57c-c1defe94e29a-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068828n\" (UID: \"ca12573d-162c-4e37-a57c-c1defe94e29a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068828n" Jun 11 13:01:42.058240 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.058193 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpdjm\" (UniqueName: \"kubernetes.io/projected/ca12573d-162c-4e37-a57c-c1defe94e29a-kube-api-access-jpdjm\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068828n\" (UID: \"ca12573d-162c-4e37-a57c-c1defe94e29a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068828n" Jun 11 13:01:42.159771 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.159668 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpdjm\" (UniqueName: \"kubernetes.io/projected/ca12573d-162c-4e37-a57c-c1defe94e29a-kube-api-access-jpdjm\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068828n\" (UID: \"ca12573d-162c-4e37-a57c-c1defe94e29a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068828n" Jun 11 13:01:42.159952 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.159771 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca12573d-162c-4e37-a57c-c1defe94e29a-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068828n\" (UID: \"ca12573d-162c-4e37-a57c-c1defe94e29a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068828n" Jun 11 13:01:42.159952 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.159817 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca12573d-162c-4e37-a57c-c1defe94e29a-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068828n\" (UID: \"ca12573d-162c-4e37-a57c-c1defe94e29a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068828n" Jun 11 13:01:42.159952 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.159872 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fd1c0e7-a6f4-4876-9e1f-791af54f8b75-tls-certs\") pod \"kube-auth-proxy-bb48c64d9-mpgkw\" (UID: \"1fd1c0e7-a6f4-4876-9e1f-791af54f8b75\") " pod="openshift-ingress/kube-auth-proxy-bb48c64d9-mpgkw" Jun 11 13:01:42.159952 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.159898 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh2lf\" (UniqueName: \"kubernetes.io/projected/1fd1c0e7-a6f4-4876-9e1f-791af54f8b75-kube-api-access-lh2lf\") pod \"kube-auth-proxy-bb48c64d9-mpgkw\" (UID: \"1fd1c0e7-a6f4-4876-9e1f-791af54f8b75\") " pod="openshift-ingress/kube-auth-proxy-bb48c64d9-mpgkw" Jun 11 13:01:42.159952 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.159936 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1fd1c0e7-a6f4-4876-9e1f-791af54f8b75-tmp\") pod \"kube-auth-proxy-bb48c64d9-mpgkw\" (UID: \"1fd1c0e7-a6f4-4876-9e1f-791af54f8b75\") " pod="openshift-ingress/kube-auth-proxy-bb48c64d9-mpgkw" Jun 11 13:01:42.160350 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.160322 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca12573d-162c-4e37-a57c-c1defe94e29a-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068828n\" (UID: \"ca12573d-162c-4e37-a57c-c1defe94e29a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068828n" Jun 11 13:01:42.160416 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.160334 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca12573d-162c-4e37-a57c-c1defe94e29a-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068828n\" (UID: \"ca12573d-162c-4e37-a57c-c1defe94e29a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068828n" Jun 11 13:01:42.168501 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.168470 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpdjm\" (UniqueName: \"kubernetes.io/projected/ca12573d-162c-4e37-a57c-c1defe94e29a-kube-api-access-jpdjm\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068828n\" (UID: \"ca12573d-162c-4e37-a57c-c1defe94e29a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068828n" Jun 11 13:01:42.260997 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.260962 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fd1c0e7-a6f4-4876-9e1f-791af54f8b75-tls-certs\") pod \"kube-auth-proxy-bb48c64d9-mpgkw\" (UID: \"1fd1c0e7-a6f4-4876-9e1f-791af54f8b75\") " pod="openshift-ingress/kube-auth-proxy-bb48c64d9-mpgkw" Jun 11 13:01:42.260997 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.261006 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh2lf\" (UniqueName: \"kubernetes.io/projected/1fd1c0e7-a6f4-4876-9e1f-791af54f8b75-kube-api-access-lh2lf\") pod \"kube-auth-proxy-bb48c64d9-mpgkw\" (UID: \"1fd1c0e7-a6f4-4876-9e1f-791af54f8b75\") " pod="openshift-ingress/kube-auth-proxy-bb48c64d9-mpgkw" Jun 11 13:01:42.261310 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.261042 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1fd1c0e7-a6f4-4876-9e1f-791af54f8b75-tmp\") pod \"kube-auth-proxy-bb48c64d9-mpgkw\" (UID: \"1fd1c0e7-a6f4-4876-9e1f-791af54f8b75\") " pod="openshift-ingress/kube-auth-proxy-bb48c64d9-mpgkw" Jun 11 13:01:42.261310 ip-10-0-137-120 kubenswrapper[2558]: E0611 13:01:42.261077 2558 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 11 13:01:42.261310 ip-10-0-137-120 kubenswrapper[2558]: E0611 13:01:42.261165 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fd1c0e7-a6f4-4876-9e1f-791af54f8b75-tls-certs podName:1fd1c0e7-a6f4-4876-9e1f-791af54f8b75 nodeName:}" failed. No retries permitted until 2026-06-11 13:01:42.761128022 +0000 UTC m=+502.407649960 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/1fd1c0e7-a6f4-4876-9e1f-791af54f8b75-tls-certs") pod "kube-auth-proxy-bb48c64d9-mpgkw" (UID: "1fd1c0e7-a6f4-4876-9e1f-791af54f8b75") : secret "kube-auth-proxy-tls" not found Jun 11 13:01:42.263603 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.263577 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1fd1c0e7-a6f4-4876-9e1f-791af54f8b75-tmp\") pod \"kube-auth-proxy-bb48c64d9-mpgkw\" (UID: \"1fd1c0e7-a6f4-4876-9e1f-791af54f8b75\") " pod="openshift-ingress/kube-auth-proxy-bb48c64d9-mpgkw" Jun 11 13:01:42.270557 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.270533 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh2lf\" (UniqueName: \"kubernetes.io/projected/1fd1c0e7-a6f4-4876-9e1f-791af54f8b75-kube-api-access-lh2lf\") pod \"kube-auth-proxy-bb48c64d9-mpgkw\" (UID: \"1fd1c0e7-a6f4-4876-9e1f-791af54f8b75\") " pod="openshift-ingress/kube-auth-proxy-bb48c64d9-mpgkw" Jun 11 13:01:42.288258 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.288228 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068828n" Jun 11 13:01:42.416793 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.416715 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:42.424987 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.424960 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068828n"] Jun 11 13:01:42.427518 ip-10-0-137-120 kubenswrapper[2558]: W0611 13:01:42.427493 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca12573d_162c_4e37_a57c_c1defe94e29a.slice/crio-da880cbbffc3238d7b936b2301d15ad54aac19eae6ceb39a3764dd6394c4840b WatchSource:0}: Error finding container da880cbbffc3238d7b936b2301d15ad54aac19eae6ceb39a3764dd6394c4840b: Status 404 returned error can't find the container with id da880cbbffc3238d7b936b2301d15ad54aac19eae6ceb39a3764dd6394c4840b Jun 11 13:01:42.760601 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.760509 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-cs2gf" event={"ID":"18559f15-3ab2-43e0-90ed-954267dd0d0d","Type":"ContainerStarted","Data":"b7eb336cf68ff416e510d2ada4fdb7ab2cab55e441cd385ab4d35a91568b1607"} Jun 11 13:01:42.760767 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.760649 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-cs2gf" Jun 11 13:01:42.762255 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.762222 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-mkwq7" event={"ID":"9336f330-5089-4b43-a89c-6de50995f06c","Type":"ContainerStarted","Data":"366e7f2b0bed71d53889304bc79d52abb016f91e2e96e59aa8c4c1d9c6f7442c"} Jun 11 13:01:42.762395 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.762279 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-mkwq7" Jun 11 13:01:42.763821 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.763797 2558 generic.go:356] "Generic (PLEG): container finished" podID="ca12573d-162c-4e37-a57c-c1defe94e29a" containerID="316026c0a017d3f0ac8e3fb94d6cd8e7bcf2205bb3f5cabdaa86d46f1a7731ea" exitCode=0 Jun 11 13:01:42.763938 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.763835 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068828n" event={"ID":"ca12573d-162c-4e37-a57c-c1defe94e29a","Type":"ContainerDied","Data":"316026c0a017d3f0ac8e3fb94d6cd8e7bcf2205bb3f5cabdaa86d46f1a7731ea"} Jun 11 13:01:42.763938 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.763876 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068828n" event={"ID":"ca12573d-162c-4e37-a57c-c1defe94e29a","Type":"ContainerStarted","Data":"da880cbbffc3238d7b936b2301d15ad54aac19eae6ceb39a3764dd6394c4840b"} Jun 11 13:01:42.764716 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.764655 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fd1c0e7-a6f4-4876-9e1f-791af54f8b75-tls-certs\") pod \"kube-auth-proxy-bb48c64d9-mpgkw\" (UID: \"1fd1c0e7-a6f4-4876-9e1f-791af54f8b75\") " pod="openshift-ingress/kube-auth-proxy-bb48c64d9-mpgkw" Jun 11 13:01:42.767211 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.767194 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fd1c0e7-a6f4-4876-9e1f-791af54f8b75-tls-certs\") pod \"kube-auth-proxy-bb48c64d9-mpgkw\" (UID: \"1fd1c0e7-a6f4-4876-9e1f-791af54f8b75\") " pod="openshift-ingress/kube-auth-proxy-bb48c64d9-mpgkw" Jun 11 13:01:42.779275 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.779208 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-cs2gf" podStartSLOduration=2.550246178 podStartE2EDuration="6.779190661s" totalImagesPullingTime="4.228944483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:01:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:01:42.777560417 +0000 UTC m=+502.424082358" watchObservedRunningTime="2026-06-11 13:01:42.779190661 +0000 UTC m=+502.425712605" Jun 11 13:01:42.794241 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.794193 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-mkwq7" podStartSLOduration=1.6838688529999999 podStartE2EDuration="5.794180538s" totalImagesPullingTime="4.110311685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:01:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:01:42.79376723 +0000 UTC m=+502.440289176" watchObservedRunningTime="2026-06-11 13:01:42.794180538 +0000 UTC m=+502.440702472" Jun 11 13:01:42.945381 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:42.945339 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-bb48c64d9-mpgkw" Jun 11 13:01:43.085932 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:43.085896 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-bb48c64d9-mpgkw"] Jun 11 13:01:43.089410 ip-10-0-137-120 kubenswrapper[2558]: W0611 13:01:43.089375 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fd1c0e7_a6f4_4876_9e1f_791af54f8b75.slice/crio-9b74c9ca8c808b490668b87d56215620724175134f15db3887cc60f0b3c49053 WatchSource:0}: Error finding container 9b74c9ca8c808b490668b87d56215620724175134f15db3887cc60f0b3c49053: Status 404 returned error can't find the container with id 9b74c9ca8c808b490668b87d56215620724175134f15db3887cc60f0b3c49053 Jun 11 13:01:43.769200 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:43.769164 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-bb48c64d9-mpgkw" event={"ID":"1fd1c0e7-a6f4-4876-9e1f-791af54f8b75","Type":"ContainerStarted","Data":"9b74c9ca8c808b490668b87d56215620724175134f15db3887cc60f0b3c49053"} Jun 11 13:01:43.770793 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:43.770764 2558 generic.go:356] "Generic (PLEG): container finished" podID="ca12573d-162c-4e37-a57c-c1defe94e29a" containerID="3cc94b8a2bfd35a99a8d1593002fc09944712a1ebbd77f67a36f0e4b506cd73f" exitCode=0 Jun 11 13:01:43.770943 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:43.770855 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068828n" event={"ID":"ca12573d-162c-4e37-a57c-c1defe94e29a","Type":"ContainerDied","Data":"3cc94b8a2bfd35a99a8d1593002fc09944712a1ebbd77f67a36f0e4b506cd73f"} Jun 11 13:01:44.779698 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:44.779662 2558 generic.go:356] "Generic (PLEG): container finished" podID="ca12573d-162c-4e37-a57c-c1defe94e29a" containerID="824ea3752774d23968227f83ae3cb7977a745658d3a7e754dfaad77a5fbb3af0" exitCode=0 Jun 11 13:01:44.780146 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:44.779752 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068828n" event={"ID":"ca12573d-162c-4e37-a57c-c1defe94e29a","Type":"ContainerDied","Data":"824ea3752774d23968227f83ae3cb7977a745658d3a7e754dfaad77a5fbb3af0"} Jun 11 13:01:46.071042 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:46.071019 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068828n" Jun 11 13:01:46.195321 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:46.195283 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca12573d-162c-4e37-a57c-c1defe94e29a-bundle\") pod \"ca12573d-162c-4e37-a57c-c1defe94e29a\" (UID: \"ca12573d-162c-4e37-a57c-c1defe94e29a\") " Jun 11 13:01:46.195321 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:46.195328 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jpdjm\" (UniqueName: \"kubernetes.io/projected/ca12573d-162c-4e37-a57c-c1defe94e29a-kube-api-access-jpdjm\") pod \"ca12573d-162c-4e37-a57c-c1defe94e29a\" (UID: \"ca12573d-162c-4e37-a57c-c1defe94e29a\") " Jun 11 13:01:46.195573 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:46.195356 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca12573d-162c-4e37-a57c-c1defe94e29a-util\") pod \"ca12573d-162c-4e37-a57c-c1defe94e29a\" (UID: \"ca12573d-162c-4e37-a57c-c1defe94e29a\") " Jun 11 13:01:46.196472 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:46.196443 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca12573d-162c-4e37-a57c-c1defe94e29a-bundle" (OuterVolumeSpecName: "bundle") pod "ca12573d-162c-4e37-a57c-c1defe94e29a" (UID: "ca12573d-162c-4e37-a57c-c1defe94e29a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:01:46.197467 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:46.197434 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca12573d-162c-4e37-a57c-c1defe94e29a-kube-api-access-jpdjm" (OuterVolumeSpecName: "kube-api-access-jpdjm") pod "ca12573d-162c-4e37-a57c-c1defe94e29a" (UID: "ca12573d-162c-4e37-a57c-c1defe94e29a"). InnerVolumeSpecName "kube-api-access-jpdjm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:01:46.202539 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:46.202495 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca12573d-162c-4e37-a57c-c1defe94e29a-util" (OuterVolumeSpecName: "util") pod "ca12573d-162c-4e37-a57c-c1defe94e29a" (UID: "ca12573d-162c-4e37-a57c-c1defe94e29a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:01:46.296726 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:46.296687 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca12573d-162c-4e37-a57c-c1defe94e29a-bundle\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:01:46.296726 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:46.296717 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpdjm\" (UniqueName: \"kubernetes.io/projected/ca12573d-162c-4e37-a57c-c1defe94e29a-kube-api-access-jpdjm\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:01:46.296726 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:46.296727 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca12573d-162c-4e37-a57c-c1defe94e29a-util\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:01:46.790362 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:46.790330 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068828n" Jun 11 13:01:46.790545 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:46.790362 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068828n" event={"ID":"ca12573d-162c-4e37-a57c-c1defe94e29a","Type":"ContainerDied","Data":"da880cbbffc3238d7b936b2301d15ad54aac19eae6ceb39a3764dd6394c4840b"} Jun 11 13:01:46.790545 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:46.790406 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da880cbbffc3238d7b936b2301d15ad54aac19eae6ceb39a3764dd6394c4840b" Jun 11 13:01:46.791880 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:46.791860 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-bb48c64d9-mpgkw" event={"ID":"1fd1c0e7-a6f4-4876-9e1f-791af54f8b75","Type":"ContainerStarted","Data":"d4584363a1a26de94c8352e6be7e8f1fc4f7c3246e974dea77c108552e9f15a4"} Jun 11 13:01:46.819005 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:46.818958 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-bb48c64d9-mpgkw" podStartSLOduration=1.814836342 podStartE2EDuration="4.818943335s" totalImagesPullingTime="3.004106993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:01:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:01:46.817530068 +0000 UTC m=+506.464052011" watchObservedRunningTime="2026-06-11 13:01:46.818943335 +0000 UTC m=+506.465465326" Jun 11 13:01:47.518785 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:47.518753 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:47.624018 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:47.623986 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-n722s"] Jun 11 13:01:47.624327 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:47.624312 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca12573d-162c-4e37-a57c-c1defe94e29a" containerName="util" Jun 11 13:01:47.624378 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:47.624329 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca12573d-162c-4e37-a57c-c1defe94e29a" containerName="util" Jun 11 13:01:47.624378 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:47.624337 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca12573d-162c-4e37-a57c-c1defe94e29a" containerName="pull" Jun 11 13:01:47.624378 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:47.624342 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca12573d-162c-4e37-a57c-c1defe94e29a" containerName="pull" Jun 11 13:01:47.624378 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:47.624355 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca12573d-162c-4e37-a57c-c1defe94e29a" containerName="extract" Jun 11 13:01:47.624378 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:47.624360 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca12573d-162c-4e37-a57c-c1defe94e29a" containerName="extract" Jun 11 13:01:47.624537 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:47.624416 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca12573d-162c-4e37-a57c-c1defe94e29a" containerName="extract" Jun 11 13:01:47.626716 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:47.626696 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-pg2q9"] Jun 11 13:01:47.626850 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:47.626830 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-n722s" Jun 11 13:01:47.629202 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:47.629183 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pg2q9" Jun 11 13:01:47.629791 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:47.629773 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-n7pdf\"" Jun 11 13:01:47.631435 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:47.631404 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 11 13:01:47.631976 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:47.631958 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-h6kt7\"" Jun 11 13:01:47.632244 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:47.632181 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 11 13:01:47.638556 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:47.638534 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-pg2q9"] Jun 11 13:01:47.646645 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:47.646621 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-n722s"] Jun 11 13:01:47.654568 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:47.654539 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:47.707640 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:47.707608 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv9x9\" (UniqueName: \"kubernetes.io/projected/507d46a3-33db-45da-b480-7d779a38181f-kube-api-access-pv9x9\") pod \"kserve-controller-manager-69fc866d76-n722s\" (UID: \"507d46a3-33db-45da-b480-7d779a38181f\") " pod="opendatahub/kserve-controller-manager-69fc866d76-n722s" Jun 11 13:01:47.707819 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:47.707648 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgsxg\" (UniqueName: \"kubernetes.io/projected/fc57507e-35cf-4278-a645-12d53519f8c8-kube-api-access-kgsxg\") pod \"llmisvc-controller-manager-864bfd7bc9-pg2q9\" (UID: \"fc57507e-35cf-4278-a645-12d53519f8c8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pg2q9" Jun 11 13:01:47.707819 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:47.707742 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc57507e-35cf-4278-a645-12d53519f8c8-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-pg2q9\" (UID: \"fc57507e-35cf-4278-a645-12d53519f8c8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pg2q9" Jun 11 13:01:47.707819 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:47.707794 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/507d46a3-33db-45da-b480-7d779a38181f-cert\") pod \"kserve-controller-manager-69fc866d76-n722s\" (UID: \"507d46a3-33db-45da-b480-7d779a38181f\") " pod="opendatahub/kserve-controller-manager-69fc866d76-n722s" Jun 11 13:01:47.782213 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:47.782131 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:47.808501 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:47.808469 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgsxg\" (UniqueName: \"kubernetes.io/projected/fc57507e-35cf-4278-a645-12d53519f8c8-kube-api-access-kgsxg\") pod \"llmisvc-controller-manager-864bfd7bc9-pg2q9\" (UID: \"fc57507e-35cf-4278-a645-12d53519f8c8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pg2q9" Jun 11 13:01:47.808693 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:47.808530 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc57507e-35cf-4278-a645-12d53519f8c8-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-pg2q9\" (UID: \"fc57507e-35cf-4278-a645-12d53519f8c8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pg2q9" Jun 11 13:01:47.808693 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:47.808564 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/507d46a3-33db-45da-b480-7d779a38181f-cert\") pod \"kserve-controller-manager-69fc866d76-n722s\" (UID: \"507d46a3-33db-45da-b480-7d779a38181f\") " pod="opendatahub/kserve-controller-manager-69fc866d76-n722s" Jun 11 13:01:47.808693 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:47.808588 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv9x9\" (UniqueName: \"kubernetes.io/projected/507d46a3-33db-45da-b480-7d779a38181f-kube-api-access-pv9x9\") pod \"kserve-controller-manager-69fc866d76-n722s\" (UID: \"507d46a3-33db-45da-b480-7d779a38181f\") " pod="opendatahub/kserve-controller-manager-69fc866d76-n722s" Jun 11 13:01:47.808851 ip-10-0-137-120 kubenswrapper[2558]: E0611 13:01:47.808712 2558 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 11 13:01:47.808851 ip-10-0-137-120 kubenswrapper[2558]: E0611 13:01:47.808773 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/507d46a3-33db-45da-b480-7d779a38181f-cert podName:507d46a3-33db-45da-b480-7d779a38181f nodeName:}" failed. No retries permitted until 2026-06-11 13:01:48.308757191 +0000 UTC m=+507.955279112 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/507d46a3-33db-45da-b480-7d779a38181f-cert") pod "kserve-controller-manager-69fc866d76-n722s" (UID: "507d46a3-33db-45da-b480-7d779a38181f") : secret "kserve-webhook-server-cert" not found Jun 11 13:01:47.811149 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:47.811123 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc57507e-35cf-4278-a645-12d53519f8c8-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-pg2q9\" (UID: \"fc57507e-35cf-4278-a645-12d53519f8c8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pg2q9" Jun 11 13:01:47.820483 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:47.820457 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgsxg\" (UniqueName: \"kubernetes.io/projected/fc57507e-35cf-4278-a645-12d53519f8c8-kube-api-access-kgsxg\") pod \"llmisvc-controller-manager-864bfd7bc9-pg2q9\" (UID: \"fc57507e-35cf-4278-a645-12d53519f8c8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pg2q9" Jun 11 13:01:47.820604 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:47.820528 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv9x9\" (UniqueName: \"kubernetes.io/projected/507d46a3-33db-45da-b480-7d779a38181f-kube-api-access-pv9x9\") pod \"kserve-controller-manager-69fc866d76-n722s\" (UID: \"507d46a3-33db-45da-b480-7d779a38181f\") " pod="opendatahub/kserve-controller-manager-69fc866d76-n722s" Jun 11 13:01:47.901342 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:47.901311 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:47.946581 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:47.946551 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pg2q9" Jun 11 13:01:48.091298 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:48.091271 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-pg2q9"] Jun 11 13:01:48.092678 ip-10-0-137-120 kubenswrapper[2558]: W0611 13:01:48.092647 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfc57507e_35cf_4278_a645_12d53519f8c8.slice/crio-116b9f5c60bc653611b3a08e97a6eecb2e7d5c8537c96d50bf7031296682c12e WatchSource:0}: Error finding container 116b9f5c60bc653611b3a08e97a6eecb2e7d5c8537c96d50bf7031296682c12e: Status 404 returned error can't find the container with id 116b9f5c60bc653611b3a08e97a6eecb2e7d5c8537c96d50bf7031296682c12e Jun 11 13:01:48.312702 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:48.312665 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/507d46a3-33db-45da-b480-7d779a38181f-cert\") pod \"kserve-controller-manager-69fc866d76-n722s\" (UID: \"507d46a3-33db-45da-b480-7d779a38181f\") " pod="opendatahub/kserve-controller-manager-69fc866d76-n722s" Jun 11 13:01:48.315657 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:48.315622 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/507d46a3-33db-45da-b480-7d779a38181f-cert\") pod \"kserve-controller-manager-69fc866d76-n722s\" (UID: \"507d46a3-33db-45da-b480-7d779a38181f\") " pod="opendatahub/kserve-controller-manager-69fc866d76-n722s" Jun 11 13:01:48.538621 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:48.538585 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-n722s" Jun 11 13:01:48.729108 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:48.729083 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-n722s"] Jun 11 13:01:48.730419 ip-10-0-137-120 kubenswrapper[2558]: W0611 13:01:48.730394 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod507d46a3_33db_45da_b480_7d779a38181f.slice/crio-91c8b2af7e865fe6b816f094f35050ea7ef5cbeb743221b979e1a4da6cdc9a99 WatchSource:0}: Error finding container 91c8b2af7e865fe6b816f094f35050ea7ef5cbeb743221b979e1a4da6cdc9a99: Status 404 returned error can't find the container with id 91c8b2af7e865fe6b816f094f35050ea7ef5cbeb743221b979e1a4da6cdc9a99 Jun 11 13:01:48.802583 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:48.802494 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-n722s" event={"ID":"507d46a3-33db-45da-b480-7d779a38181f","Type":"ContainerStarted","Data":"91c8b2af7e865fe6b816f094f35050ea7ef5cbeb743221b979e1a4da6cdc9a99"} Jun 11 13:01:48.803854 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:48.803819 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pg2q9" event={"ID":"fc57507e-35cf-4278-a645-12d53519f8c8","Type":"ContainerStarted","Data":"116b9f5c60bc653611b3a08e97a6eecb2e7d5c8537c96d50bf7031296682c12e"} Jun 11 13:01:48.871433 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:48.871401 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:48.970057 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:48.970026 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:52.825108 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:52.825066 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pg2q9" event={"ID":"fc57507e-35cf-4278-a645-12d53519f8c8","Type":"ContainerStarted","Data":"6ba16f2641715aed48b04f0f7ea4fe85025033f50d61cf610a44776075e83df6"} Jun 11 13:01:52.826303 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:52.826278 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-n722s" event={"ID":"507d46a3-33db-45da-b480-7d779a38181f","Type":"ContainerStarted","Data":"5f4ca44f21a765ede4ef2bf982defccfc1ef18537720e69a84255e983f98fce8"} Jun 11 13:01:52.826398 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:52.826331 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-n722s" Jun 11 13:01:52.843449 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:52.843396 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pg2q9" podStartSLOduration=1.88216795 podStartE2EDuration="5.843378502s" totalImagesPullingTime="3.961210552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:01:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:01:52.842588844 +0000 UTC m=+512.489110797" watchObservedRunningTime="2026-06-11 13:01:52.843378502 +0000 UTC m=+512.489900445" Jun 11 13:01:52.860927 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:52.860876 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-n722s" podStartSLOduration=2.533100102 podStartE2EDuration="5.860859022s" totalImagesPullingTime="3.32775892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:01:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:01:52.860673118 +0000 UTC m=+512.507195059" watchObservedRunningTime="2026-06-11 13:01:52.860859022 +0000 UTC m=+512.507380975" Jun 11 13:01:53.773530 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:53.773498 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-cs2gf" Jun 11 13:01:53.775409 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:53.775385 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-mkwq7" Jun 11 13:01:53.831142 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:53.831111 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pg2q9" Jun 11 13:01:54.838438 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:54.838402 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:55.012045 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:55.012006 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:56.064713 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:56.064678 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a58m2n"] Jun 11 13:01:56.067091 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:56.067075 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a58m2n" Jun 11 13:01:56.072432 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:56.072400 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 13:01:56.072574 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:56.072447 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 13:01:56.074274 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:56.074251 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r44s6\"" Jun 11 13:01:56.097028 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:56.097001 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a58m2n"] Jun 11 13:01:56.127163 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:56.127133 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:56.186126 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:56.186095 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gglf4\" (UniqueName: \"kubernetes.io/projected/7d5e03dd-23da-4e04-83af-28b7e2b1eeb2-kube-api-access-gglf4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a58m2n\" (UID: \"7d5e03dd-23da-4e04-83af-28b7e2b1eeb2\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a58m2n" Jun 11 13:01:56.186353 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:56.186141 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d5e03dd-23da-4e04-83af-28b7e2b1eeb2-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a58m2n\" (UID: \"7d5e03dd-23da-4e04-83af-28b7e2b1eeb2\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a58m2n" Jun 11 13:01:56.186353 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:56.186275 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d5e03dd-23da-4e04-83af-28b7e2b1eeb2-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a58m2n\" (UID: \"7d5e03dd-23da-4e04-83af-28b7e2b1eeb2\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a58m2n" Jun 11 13:01:56.270437 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:56.270405 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:56.287595 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:56.287558 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d5e03dd-23da-4e04-83af-28b7e2b1eeb2-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a58m2n\" (UID: \"7d5e03dd-23da-4e04-83af-28b7e2b1eeb2\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a58m2n" Jun 11 13:01:56.287706 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:56.287686 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gglf4\" (UniqueName: \"kubernetes.io/projected/7d5e03dd-23da-4e04-83af-28b7e2b1eeb2-kube-api-access-gglf4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a58m2n\" (UID: \"7d5e03dd-23da-4e04-83af-28b7e2b1eeb2\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a58m2n" Jun 11 13:01:56.287849 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:56.287815 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d5e03dd-23da-4e04-83af-28b7e2b1eeb2-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a58m2n\" (UID: \"7d5e03dd-23da-4e04-83af-28b7e2b1eeb2\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a58m2n" Jun 11 13:01:56.288132 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:56.287979 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d5e03dd-23da-4e04-83af-28b7e2b1eeb2-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a58m2n\" (UID: \"7d5e03dd-23da-4e04-83af-28b7e2b1eeb2\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a58m2n" Jun 11 13:01:56.288273 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:56.288244 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d5e03dd-23da-4e04-83af-28b7e2b1eeb2-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a58m2n\" (UID: \"7d5e03dd-23da-4e04-83af-28b7e2b1eeb2\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a58m2n" Jun 11 13:01:56.304028 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:56.303998 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gglf4\" (UniqueName: \"kubernetes.io/projected/7d5e03dd-23da-4e04-83af-28b7e2b1eeb2-kube-api-access-gglf4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a58m2n\" (UID: \"7d5e03dd-23da-4e04-83af-28b7e2b1eeb2\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a58m2n" Jun 11 13:01:56.376848 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:56.376814 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a58m2n" Jun 11 13:01:56.551013 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:56.550960 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a58m2n"] Jun 11 13:01:56.553662 ip-10-0-137-120 kubenswrapper[2558]: W0611 13:01:56.553632 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d5e03dd_23da_4e04_83af_28b7e2b1eeb2.slice/crio-9521dfd025789b9a72f20aa585f405996f1978e5b4ffc3faa5abd7e4f44c018d WatchSource:0}: Error finding container 9521dfd025789b9a72f20aa585f405996f1978e5b4ffc3faa5abd7e4f44c018d: Status 404 returned error can't find the container with id 9521dfd025789b9a72f20aa585f405996f1978e5b4ffc3faa5abd7e4f44c018d Jun 11 13:01:56.573579 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:56.569563 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:56.743673 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:56.743634 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:56.848211 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:56.848180 2558 generic.go:356] "Generic (PLEG): container finished" podID="7d5e03dd-23da-4e04-83af-28b7e2b1eeb2" containerID="662b2c02445f6b426903d81bb6ee9147f351380d0da55911e902a6a3c60d1344" exitCode=0 Jun 11 13:01:56.848386 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:56.848243 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a58m2n" event={"ID":"7d5e03dd-23da-4e04-83af-28b7e2b1eeb2","Type":"ContainerDied","Data":"662b2c02445f6b426903d81bb6ee9147f351380d0da55911e902a6a3c60d1344"} Jun 11 13:01:56.848386 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:56.848284 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a58m2n" event={"ID":"7d5e03dd-23da-4e04-83af-28b7e2b1eeb2","Type":"ContainerStarted","Data":"9521dfd025789b9a72f20aa585f405996f1978e5b4ffc3faa5abd7e4f44c018d"} Jun 11 13:01:57.140382 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:57.140345 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:57.511704 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:57.511629 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-8gwhb"] Jun 11 13:01:57.514103 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:57.514087 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-8gwhb" Jun 11 13:01:57.521167 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:57.521132 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 11 13:01:57.521273 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:57.521252 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-27rf5\"" Jun 11 13:01:57.521273 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:57.521263 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 11 13:01:57.528875 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:57.528850 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-8gwhb"] Jun 11 13:01:57.600083 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:57.600048 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxsfb\" (UniqueName: \"kubernetes.io/projected/bd4caf5b-4ca9-400c-ab74-d056840b3247-kube-api-access-lxsfb\") pod \"servicemesh-operator3-57f65f65fb-8gwhb\" (UID: \"bd4caf5b-4ca9-400c-ab74-d056840b3247\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-8gwhb" Jun 11 13:01:57.600261 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:57.600173 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/bd4caf5b-4ca9-400c-ab74-d056840b3247-operator-config\") pod \"servicemesh-operator3-57f65f65fb-8gwhb\" (UID: \"bd4caf5b-4ca9-400c-ab74-d056840b3247\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-8gwhb" Jun 11 13:01:57.701244 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:57.701210 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/bd4caf5b-4ca9-400c-ab74-d056840b3247-operator-config\") pod \"servicemesh-operator3-57f65f65fb-8gwhb\" (UID: \"bd4caf5b-4ca9-400c-ab74-d056840b3247\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-8gwhb" Jun 11 13:01:57.701463 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:57.701282 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxsfb\" (UniqueName: \"kubernetes.io/projected/bd4caf5b-4ca9-400c-ab74-d056840b3247-kube-api-access-lxsfb\") pod \"servicemesh-operator3-57f65f65fb-8gwhb\" (UID: \"bd4caf5b-4ca9-400c-ab74-d056840b3247\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-8gwhb" Jun 11 13:01:57.703694 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:57.703668 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/bd4caf5b-4ca9-400c-ab74-d056840b3247-operator-config\") pod \"servicemesh-operator3-57f65f65fb-8gwhb\" (UID: \"bd4caf5b-4ca9-400c-ab74-d056840b3247\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-8gwhb" Jun 11 13:01:57.720743 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:57.720718 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxsfb\" (UniqueName: \"kubernetes.io/projected/bd4caf5b-4ca9-400c-ab74-d056840b3247-kube-api-access-lxsfb\") pod \"servicemesh-operator3-57f65f65fb-8gwhb\" (UID: \"bd4caf5b-4ca9-400c-ab74-d056840b3247\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-8gwhb" Jun 11 13:01:57.823763 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:57.823673 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-8gwhb" Jun 11 13:01:57.976304 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:57.976279 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-8gwhb"] Jun 11 13:01:57.979023 ip-10-0-137-120 kubenswrapper[2558]: W0611 13:01:57.978997 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd4caf5b_4ca9_400c_ab74_d056840b3247.slice/crio-dfc78e4b00cd06c34eae2f7249ecf20c37debcc68154a107306862f5e23b68d6 WatchSource:0}: Error finding container dfc78e4b00cd06c34eae2f7249ecf20c37debcc68154a107306862f5e23b68d6: Status 404 returned error can't find the container with id dfc78e4b00cd06c34eae2f7249ecf20c37debcc68154a107306862f5e23b68d6 Jun 11 13:01:58.426790 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:58.426759 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7cf4859678-4sfmk"] Jun 11 13:01:58.429952 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:58.429934 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7cf4859678-4sfmk" Jun 11 13:01:58.435349 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:58.435325 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 13:01:58.435460 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:58.435436 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vnp8c\"" Jun 11 13:01:58.449656 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:58.449629 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7cf4859678-4sfmk"] Jun 11 13:01:58.484337 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:58.484302 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:01:58.507682 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:58.507642 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/081f5bed-9db1-4ff9-9d7e-c7298404be81-redirect-config\") pod \"dashboard-redirect-7cf4859678-4sfmk\" (UID: \"081f5bed-9db1-4ff9-9d7e-c7298404be81\") " pod="opendatahub/dashboard-redirect-7cf4859678-4sfmk" Jun 11 13:01:58.507682 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:58.507675 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql6cv\" (UniqueName: \"kubernetes.io/projected/081f5bed-9db1-4ff9-9d7e-c7298404be81-kube-api-access-ql6cv\") pod \"dashboard-redirect-7cf4859678-4sfmk\" (UID: \"081f5bed-9db1-4ff9-9d7e-c7298404be81\") " pod="opendatahub/dashboard-redirect-7cf4859678-4sfmk" Jun 11 13:01:58.609130 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:58.609094 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/081f5bed-9db1-4ff9-9d7e-c7298404be81-redirect-config\") pod \"dashboard-redirect-7cf4859678-4sfmk\" (UID: \"081f5bed-9db1-4ff9-9d7e-c7298404be81\") " pod="opendatahub/dashboard-redirect-7cf4859678-4sfmk" Jun 11 13:01:58.609318 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:58.609136 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql6cv\" (UniqueName: \"kubernetes.io/projected/081f5bed-9db1-4ff9-9d7e-c7298404be81-kube-api-access-ql6cv\") pod \"dashboard-redirect-7cf4859678-4sfmk\" (UID: \"081f5bed-9db1-4ff9-9d7e-c7298404be81\") " pod="opendatahub/dashboard-redirect-7cf4859678-4sfmk" Jun 11 13:01:58.609826 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:58.609804 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/081f5bed-9db1-4ff9-9d7e-c7298404be81-redirect-config\") pod \"dashboard-redirect-7cf4859678-4sfmk\" (UID: \"081f5bed-9db1-4ff9-9d7e-c7298404be81\") " pod="opendatahub/dashboard-redirect-7cf4859678-4sfmk" Jun 11 13:01:58.632960 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:58.632922 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql6cv\" (UniqueName: \"kubernetes.io/projected/081f5bed-9db1-4ff9-9d7e-c7298404be81-kube-api-access-ql6cv\") pod \"dashboard-redirect-7cf4859678-4sfmk\" (UID: \"081f5bed-9db1-4ff9-9d7e-c7298404be81\") " pod="opendatahub/dashboard-redirect-7cf4859678-4sfmk" Jun 11 13:01:58.740731 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:58.740640 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7cf4859678-4sfmk" Jun 11 13:01:58.861119 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:58.861086 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-8gwhb" event={"ID":"bd4caf5b-4ca9-400c-ab74-d056840b3247","Type":"ContainerStarted","Data":"dfc78e4b00cd06c34eae2f7249ecf20c37debcc68154a107306862f5e23b68d6"} Jun 11 13:01:58.863220 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:58.863186 2558 generic.go:356] "Generic (PLEG): container finished" podID="7d5e03dd-23da-4e04-83af-28b7e2b1eeb2" containerID="77cc654b413a0a21587fe9d57c1d1a324cd032fdc2146cb3bd97a9d0b7226381" exitCode=0 Jun 11 13:01:58.863331 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:58.863237 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a58m2n" event={"ID":"7d5e03dd-23da-4e04-83af-28b7e2b1eeb2","Type":"ContainerDied","Data":"77cc654b413a0a21587fe9d57c1d1a324cd032fdc2146cb3bd97a9d0b7226381"} Jun 11 13:01:58.896813 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:58.896790 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7cf4859678-4sfmk"] Jun 11 13:01:58.899251 ip-10-0-137-120 kubenswrapper[2558]: W0611 13:01:58.899223 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod081f5bed_9db1_4ff9_9d7e_c7298404be81.slice/crio-1009f242d3b611bf781116ff148a2feeafa8a4fded1bd13e8e51ced2d4a1f49c WatchSource:0}: Error finding container 1009f242d3b611bf781116ff148a2feeafa8a4fded1bd13e8e51ced2d4a1f49c: Status 404 returned error can't find the container with id 1009f242d3b611bf781116ff148a2feeafa8a4fded1bd13e8e51ced2d4a1f49c Jun 11 13:01:59.876988 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:59.876932 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7cf4859678-4sfmk" event={"ID":"081f5bed-9db1-4ff9-9d7e-c7298404be81","Type":"ContainerStarted","Data":"1009f242d3b611bf781116ff148a2feeafa8a4fded1bd13e8e51ced2d4a1f49c"} Jun 11 13:01:59.879844 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:59.879804 2558 generic.go:356] "Generic (PLEG): container finished" podID="7d5e03dd-23da-4e04-83af-28b7e2b1eeb2" containerID="6aebca5d9b801fb338503185e7b478546702d2171f9079eb4fd3b49e55b2d7a3" exitCode=0 Jun 11 13:01:59.880016 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:01:59.879904 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a58m2n" event={"ID":"7d5e03dd-23da-4e04-83af-28b7e2b1eeb2","Type":"ContainerDied","Data":"6aebca5d9b801fb338503185e7b478546702d2171f9079eb4fd3b49e55b2d7a3"} Jun 11 13:02:01.084493 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:01.082774 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a58m2n" Jun 11 13:02:01.232667 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:01.232578 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d5e03dd-23da-4e04-83af-28b7e2b1eeb2-bundle\") pod \"7d5e03dd-23da-4e04-83af-28b7e2b1eeb2\" (UID: \"7d5e03dd-23da-4e04-83af-28b7e2b1eeb2\") " Jun 11 13:02:01.232667 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:01.232647 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d5e03dd-23da-4e04-83af-28b7e2b1eeb2-util\") pod \"7d5e03dd-23da-4e04-83af-28b7e2b1eeb2\" (UID: \"7d5e03dd-23da-4e04-83af-28b7e2b1eeb2\") " Jun 11 13:02:01.232921 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:01.232696 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gglf4\" (UniqueName: \"kubernetes.io/projected/7d5e03dd-23da-4e04-83af-28b7e2b1eeb2-kube-api-access-gglf4\") pod \"7d5e03dd-23da-4e04-83af-28b7e2b1eeb2\" (UID: \"7d5e03dd-23da-4e04-83af-28b7e2b1eeb2\") " Jun 11 13:02:01.235360 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:01.234050 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d5e03dd-23da-4e04-83af-28b7e2b1eeb2-bundle" (OuterVolumeSpecName: "bundle") pod "7d5e03dd-23da-4e04-83af-28b7e2b1eeb2" (UID: "7d5e03dd-23da-4e04-83af-28b7e2b1eeb2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:02:01.241405 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:01.241368 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d5e03dd-23da-4e04-83af-28b7e2b1eeb2-util" (OuterVolumeSpecName: "util") pod "7d5e03dd-23da-4e04-83af-28b7e2b1eeb2" (UID: "7d5e03dd-23da-4e04-83af-28b7e2b1eeb2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:02:01.245199 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:01.245112 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d5e03dd-23da-4e04-83af-28b7e2b1eeb2-kube-api-access-gglf4" (OuterVolumeSpecName: "kube-api-access-gglf4") pod "7d5e03dd-23da-4e04-83af-28b7e2b1eeb2" (UID: "7d5e03dd-23da-4e04-83af-28b7e2b1eeb2"). InnerVolumeSpecName "kube-api-access-gglf4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:02:01.333660 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:01.333627 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d5e03dd-23da-4e04-83af-28b7e2b1eeb2-bundle\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:02:01.333660 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:01.333662 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d5e03dd-23da-4e04-83af-28b7e2b1eeb2-util\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:02:01.333900 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:01.333677 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gglf4\" (UniqueName: \"kubernetes.io/projected/7d5e03dd-23da-4e04-83af-28b7e2b1eeb2-kube-api-access-gglf4\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:02:01.895572 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:01.895314 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-8gwhb" event={"ID":"bd4caf5b-4ca9-400c-ab74-d056840b3247","Type":"ContainerStarted","Data":"d304f26d7a0d0f09a1d55a906de54b281fef30ba8ebdd7cfcfc1d754fa8b00ad"} Jun 11 13:02:01.895572 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:01.895379 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-8gwhb" Jun 11 13:02:01.897853 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:01.897825 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a58m2n" event={"ID":"7d5e03dd-23da-4e04-83af-28b7e2b1eeb2","Type":"ContainerDied","Data":"9521dfd025789b9a72f20aa585f405996f1978e5b4ffc3faa5abd7e4f44c018d"} Jun 11 13:02:01.897853 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:01.897846 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a58m2n" Jun 11 13:02:01.898023 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:01.897873 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9521dfd025789b9a72f20aa585f405996f1978e5b4ffc3faa5abd7e4f44c018d" Jun 11 13:02:01.916298 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:01.916246 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-8gwhb" podStartSLOduration=2.076109281 podStartE2EDuration="4.916226821s" totalImagesPullingTime="2.84011754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:01:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:02:01.915596576 +0000 UTC m=+521.562118521" watchObservedRunningTime="2026-06-11 13:02:01.916226821 +0000 UTC m=+521.562748765" Jun 11 13:02:05.929376 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:05.929338 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7cf4859678-4sfmk" event={"ID":"081f5bed-9db1-4ff9-9d7e-c7298404be81","Type":"ContainerStarted","Data":"b8db4afa81e8a732a2b28121122ca7a71e374f6fe523b7ceee44e3b9fb087cd3"} Jun 11 13:02:05.947336 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:05.947288 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7cf4859678-4sfmk" podStartSLOduration=1.921881414 podStartE2EDuration="7.947273355s" totalImagesPullingTime="6.025391941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:01:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:02:05.94523087 +0000 UTC m=+525.591752835" watchObservedRunningTime="2026-06-11 13:02:05.947273355 +0000 UTC m=+525.593795323" Jun 11 13:02:07.698619 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:07.698586 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:02:07.802030 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:07.801989 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:02:10.651603 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.651570 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-5xd8n"] Jun 11 13:02:10.651996 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.651906 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d5e03dd-23da-4e04-83af-28b7e2b1eeb2" containerName="util" Jun 11 13:02:10.651996 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.651917 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d5e03dd-23da-4e04-83af-28b7e2b1eeb2" containerName="util" Jun 11 13:02:10.651996 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.651935 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d5e03dd-23da-4e04-83af-28b7e2b1eeb2" containerName="extract" Jun 11 13:02:10.651996 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.651941 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d5e03dd-23da-4e04-83af-28b7e2b1eeb2" containerName="extract" Jun 11 13:02:10.651996 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.651955 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d5e03dd-23da-4e04-83af-28b7e2b1eeb2" containerName="pull" Jun 11 13:02:10.651996 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.651961 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d5e03dd-23da-4e04-83af-28b7e2b1eeb2" containerName="pull" Jun 11 13:02:10.652300 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.652016 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d5e03dd-23da-4e04-83af-28b7e2b1eeb2" containerName="extract" Jun 11 13:02:10.656441 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.656416 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5xd8n" Jun 11 13:02:10.657837 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.657808 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:02:10.660266 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.660243 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 11 13:02:10.660373 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.660243 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 11 13:02:10.660373 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.660315 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-5pj2h\"" Jun 11 13:02:10.660373 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.660337 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 11 13:02:10.660373 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.660337 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 13:02:10.670350 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.670323 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-5xd8n"] Jun 11 13:02:10.787450 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.787414 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:02:10.820695 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.820661 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e97f92ed-82b1-4b39-9a4f-b7f315fe66c1-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-5xd8n\" (UID: \"e97f92ed-82b1-4b39-9a4f-b7f315fe66c1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5xd8n" Jun 11 13:02:10.820888 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.820719 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e97f92ed-82b1-4b39-9a4f-b7f315fe66c1-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-5xd8n\" (UID: \"e97f92ed-82b1-4b39-9a4f-b7f315fe66c1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5xd8n" Jun 11 13:02:10.820888 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.820786 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e97f92ed-82b1-4b39-9a4f-b7f315fe66c1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-5xd8n\" (UID: \"e97f92ed-82b1-4b39-9a4f-b7f315fe66c1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5xd8n" Jun 11 13:02:10.820888 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.820844 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e97f92ed-82b1-4b39-9a4f-b7f315fe66c1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-5xd8n\" (UID: \"e97f92ed-82b1-4b39-9a4f-b7f315fe66c1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5xd8n" Jun 11 13:02:10.820888 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.820874 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz4gd\" (UniqueName: \"kubernetes.io/projected/e97f92ed-82b1-4b39-9a4f-b7f315fe66c1-kube-api-access-lz4gd\") pod \"istiod-openshift-gateway-75c67f8887-5xd8n\" (UID: \"e97f92ed-82b1-4b39-9a4f-b7f315fe66c1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5xd8n" Jun 11 13:02:10.821066 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.820906 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e97f92ed-82b1-4b39-9a4f-b7f315fe66c1-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-5xd8n\" (UID: \"e97f92ed-82b1-4b39-9a4f-b7f315fe66c1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5xd8n" Jun 11 13:02:10.821066 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.820954 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e97f92ed-82b1-4b39-9a4f-b7f315fe66c1-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-5xd8n\" (UID: \"e97f92ed-82b1-4b39-9a4f-b7f315fe66c1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5xd8n" Jun 11 13:02:10.921898 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.921802 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e97f92ed-82b1-4b39-9a4f-b7f315fe66c1-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-5xd8n\" (UID: \"e97f92ed-82b1-4b39-9a4f-b7f315fe66c1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5xd8n" Jun 11 13:02:10.921898 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.921850 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e97f92ed-82b1-4b39-9a4f-b7f315fe66c1-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-5xd8n\" (UID: \"e97f92ed-82b1-4b39-9a4f-b7f315fe66c1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5xd8n" Jun 11 13:02:10.922080 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.921948 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e97f92ed-82b1-4b39-9a4f-b7f315fe66c1-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-5xd8n\" (UID: \"e97f92ed-82b1-4b39-9a4f-b7f315fe66c1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5xd8n" Jun 11 13:02:10.922080 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.921980 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e97f92ed-82b1-4b39-9a4f-b7f315fe66c1-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-5xd8n\" (UID: \"e97f92ed-82b1-4b39-9a4f-b7f315fe66c1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5xd8n" Jun 11 13:02:10.922080 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.922015 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e97f92ed-82b1-4b39-9a4f-b7f315fe66c1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-5xd8n\" (UID: \"e97f92ed-82b1-4b39-9a4f-b7f315fe66c1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5xd8n" Jun 11 13:02:10.922080 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.922047 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e97f92ed-82b1-4b39-9a4f-b7f315fe66c1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-5xd8n\" (UID: \"e97f92ed-82b1-4b39-9a4f-b7f315fe66c1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5xd8n" Jun 11 13:02:10.922080 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.922073 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz4gd\" (UniqueName: \"kubernetes.io/projected/e97f92ed-82b1-4b39-9a4f-b7f315fe66c1-kube-api-access-lz4gd\") pod \"istiod-openshift-gateway-75c67f8887-5xd8n\" (UID: \"e97f92ed-82b1-4b39-9a4f-b7f315fe66c1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5xd8n" Jun 11 13:02:10.922848 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.922818 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e97f92ed-82b1-4b39-9a4f-b7f315fe66c1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-5xd8n\" (UID: \"e97f92ed-82b1-4b39-9a4f-b7f315fe66c1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5xd8n" Jun 11 13:02:10.924784 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.924753 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e97f92ed-82b1-4b39-9a4f-b7f315fe66c1-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-5xd8n\" (UID: \"e97f92ed-82b1-4b39-9a4f-b7f315fe66c1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5xd8n" Jun 11 13:02:10.924988 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.924961 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e97f92ed-82b1-4b39-9a4f-b7f315fe66c1-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-5xd8n\" (UID: \"e97f92ed-82b1-4b39-9a4f-b7f315fe66c1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5xd8n" Jun 11 13:02:10.925076 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.925035 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e97f92ed-82b1-4b39-9a4f-b7f315fe66c1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-5xd8n\" (UID: \"e97f92ed-82b1-4b39-9a4f-b7f315fe66c1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5xd8n" Jun 11 13:02:10.925264 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.925240 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e97f92ed-82b1-4b39-9a4f-b7f315fe66c1-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-5xd8n\" (UID: \"e97f92ed-82b1-4b39-9a4f-b7f315fe66c1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5xd8n" Jun 11 13:02:10.931469 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.931433 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e97f92ed-82b1-4b39-9a4f-b7f315fe66c1-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-5xd8n\" (UID: \"e97f92ed-82b1-4b39-9a4f-b7f315fe66c1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5xd8n" Jun 11 13:02:10.931469 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.931445 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz4gd\" (UniqueName: \"kubernetes.io/projected/e97f92ed-82b1-4b39-9a4f-b7f315fe66c1-kube-api-access-lz4gd\") pod \"istiod-openshift-gateway-75c67f8887-5xd8n\" (UID: \"e97f92ed-82b1-4b39-9a4f-b7f315fe66c1\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5xd8n" Jun 11 13:02:10.968019 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:10.967984 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5xd8n" Jun 11 13:02:11.118066 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:11.118041 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-5xd8n"] Jun 11 13:02:11.120784 ip-10-0-137-120 kubenswrapper[2558]: W0611 13:02:11.120748 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode97f92ed_82b1_4b39_9a4f_b7f315fe66c1.slice/crio-5a7b89807c9eeb8d4a792b9fc21ffabd19a6db4eefab902390698b2347b3beaf WatchSource:0}: Error finding container 5a7b89807c9eeb8d4a792b9fc21ffabd19a6db4eefab902390698b2347b3beaf: Status 404 returned error can't find the container with id 5a7b89807c9eeb8d4a792b9fc21ffabd19a6db4eefab902390698b2347b3beaf Jun 11 13:02:11.130634 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:11.130591 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:02:11.960218 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:11.960180 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5xd8n" event={"ID":"e97f92ed-82b1-4b39-9a4f-b7f315fe66c1","Type":"ContainerStarted","Data":"5a7b89807c9eeb8d4a792b9fc21ffabd19a6db4eefab902390698b2347b3beaf"} Jun 11 13:02:12.906562 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:12.906525 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-8gwhb" Jun 11 13:02:13.913909 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:13.913865 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 13:02:13.914240 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:13.913957 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 13:02:14.866383 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:14.866350 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:02:14.969460 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:14.969414 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:02:14.979699 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:14.979666 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5xd8n" event={"ID":"e97f92ed-82b1-4b39-9a4f-b7f315fe66c1","Type":"ContainerStarted","Data":"6e9c9b22d3b765c9a89a4626627e83dc410fcd2c072ae87288a6b58fbcc968ef"} Jun 11 13:02:14.979940 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:14.979924 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5xd8n" Jun 11 13:02:15.010649 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:15.010580 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5xd8n" podStartSLOduration=2.219892367 podStartE2EDuration="5.01055816s" totalImagesPullingTime="2.790665793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:02:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:02:15.007523819 +0000 UTC m=+534.654045763" watchObservedRunningTime="2026-06-11 13:02:15.01055816 +0000 UTC m=+534.657080102" Jun 11 13:02:15.068733 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:15.068700 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:02:15.167524 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:15.167419 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:02:15.237450 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:15.237396 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:02:15.339473 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:15.339439 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:02:15.987710 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:15.987678 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5xd8n" Jun 11 13:02:16.254737 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:16.254643 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:02:23.836732 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:23.836702 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-n722s" Jun 11 13:02:24.839623 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:24.839595 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pg2q9" Jun 11 13:02:37.376588 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:37.376544 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:02:37.477864 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:37.477829 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:02:37.551832 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:37.551794 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:02:38.305740 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:38.305709 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:02:38.505172 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:38.505103 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:02:55.422969 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:55.422931 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598k97j"] Jun 11 13:02:55.448208 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:55.448175 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598k97j"] Jun 11 13:02:55.448366 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:55.448276 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598k97j" Jun 11 13:02:55.451357 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:55.451331 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-t6b8c\"" Jun 11 13:02:55.451507 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:55.451400 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 13:02:55.451507 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:55.451408 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 13:02:55.614442 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:55.614405 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh4d2\" (UniqueName: \"kubernetes.io/projected/f1627eef-ae1c-4873-958c-5317afed5572-kube-api-access-xh4d2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598k97j\" (UID: \"f1627eef-ae1c-4873-958c-5317afed5572\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598k97j" Jun 11 13:02:55.614442 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:55.614443 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1627eef-ae1c-4873-958c-5317afed5572-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598k97j\" (UID: \"f1627eef-ae1c-4873-958c-5317afed5572\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598k97j" Jun 11 13:02:55.614649 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:55.614476 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1627eef-ae1c-4873-958c-5317afed5572-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598k97j\" (UID: \"f1627eef-ae1c-4873-958c-5317afed5572\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598k97j" Jun 11 13:02:55.715506 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:55.715413 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh4d2\" (UniqueName: \"kubernetes.io/projected/f1627eef-ae1c-4873-958c-5317afed5572-kube-api-access-xh4d2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598k97j\" (UID: \"f1627eef-ae1c-4873-958c-5317afed5572\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598k97j" Jun 11 13:02:55.715506 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:55.715454 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1627eef-ae1c-4873-958c-5317afed5572-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598k97j\" (UID: \"f1627eef-ae1c-4873-958c-5317afed5572\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598k97j" Jun 11 13:02:55.715506 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:55.715483 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1627eef-ae1c-4873-958c-5317afed5572-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598k97j\" (UID: \"f1627eef-ae1c-4873-958c-5317afed5572\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598k97j" Jun 11 13:02:55.715859 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:55.715841 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1627eef-ae1c-4873-958c-5317afed5572-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598k97j\" (UID: \"f1627eef-ae1c-4873-958c-5317afed5572\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598k97j" Jun 11 13:02:55.715933 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:55.715917 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1627eef-ae1c-4873-958c-5317afed5572-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598k97j\" (UID: \"f1627eef-ae1c-4873-958c-5317afed5572\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598k97j" Jun 11 13:02:55.723846 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:55.723813 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh4d2\" (UniqueName: \"kubernetes.io/projected/f1627eef-ae1c-4873-958c-5317afed5572-kube-api-access-xh4d2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598k97j\" (UID: \"f1627eef-ae1c-4873-958c-5317afed5572\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598k97j" Jun 11 13:02:55.757424 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:55.757388 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598k97j" Jun 11 13:02:55.818707 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:55.818674 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12ftld"] Jun 11 13:02:55.822983 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:55.822714 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12ftld" Jun 11 13:02:55.830722 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:55.830687 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12ftld"] Jun 11 13:02:55.900148 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:55.900118 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598k97j"] Jun 11 13:02:55.901525 ip-10-0-137-120 kubenswrapper[2558]: W0611 13:02:55.901493 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1627eef_ae1c_4873_958c_5317afed5572.slice/crio-6bbe3f97dafb47df8e387243d5bc53fbff4cae3a5ce770c69a424000b75437c3 WatchSource:0}: Error finding container 6bbe3f97dafb47df8e387243d5bc53fbff4cae3a5ce770c69a424000b75437c3: Status 404 returned error can't find the container with id 6bbe3f97dafb47df8e387243d5bc53fbff4cae3a5ce770c69a424000b75437c3 Jun 11 13:02:55.917434 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:55.917409 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bda59a98-d0ac-4a05-add9-acbf09836217-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12ftld\" (UID: \"bda59a98-d0ac-4a05-add9-acbf09836217\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12ftld" Jun 11 13:02:55.917526 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:55.917447 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bda59a98-d0ac-4a05-add9-acbf09836217-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12ftld\" (UID: \"bda59a98-d0ac-4a05-add9-acbf09836217\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12ftld" Jun 11 13:02:55.917526 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:55.917501 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q26t8\" (UniqueName: \"kubernetes.io/projected/bda59a98-d0ac-4a05-add9-acbf09836217-kube-api-access-q26t8\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12ftld\" (UID: \"bda59a98-d0ac-4a05-add9-acbf09836217\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12ftld" Jun 11 13:02:56.018923 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.018895 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bda59a98-d0ac-4a05-add9-acbf09836217-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12ftld\" (UID: \"bda59a98-d0ac-4a05-add9-acbf09836217\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12ftld" Jun 11 13:02:56.019035 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.018936 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bda59a98-d0ac-4a05-add9-acbf09836217-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12ftld\" (UID: \"bda59a98-d0ac-4a05-add9-acbf09836217\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12ftld" Jun 11 13:02:56.019035 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.018991 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q26t8\" (UniqueName: \"kubernetes.io/projected/bda59a98-d0ac-4a05-add9-acbf09836217-kube-api-access-q26t8\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12ftld\" (UID: \"bda59a98-d0ac-4a05-add9-acbf09836217\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12ftld" Jun 11 13:02:56.019286 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.019267 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bda59a98-d0ac-4a05-add9-acbf09836217-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12ftld\" (UID: \"bda59a98-d0ac-4a05-add9-acbf09836217\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12ftld" Jun 11 13:02:56.019331 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.019316 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bda59a98-d0ac-4a05-add9-acbf09836217-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12ftld\" (UID: \"bda59a98-d0ac-4a05-add9-acbf09836217\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12ftld" Jun 11 13:02:56.027288 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.027265 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q26t8\" (UniqueName: \"kubernetes.io/projected/bda59a98-d0ac-4a05-add9-acbf09836217-kube-api-access-q26t8\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12ftld\" (UID: \"bda59a98-d0ac-4a05-add9-acbf09836217\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12ftld" Jun 11 13:02:56.134575 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.134541 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12ftld" Jun 11 13:02:56.196457 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.196423 2558 generic.go:356] "Generic (PLEG): container finished" podID="f1627eef-ae1c-4873-958c-5317afed5572" containerID="fdee3472cda8a1da0b0654fbf4f940732ccea590fe7840f83a26f8be2a1a8c90" exitCode=0 Jun 11 13:02:56.196627 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.196522 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598k97j" event={"ID":"f1627eef-ae1c-4873-958c-5317afed5572","Type":"ContainerDied","Data":"fdee3472cda8a1da0b0654fbf4f940732ccea590fe7840f83a26f8be2a1a8c90"} Jun 11 13:02:56.196627 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.196584 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598k97j" event={"ID":"f1627eef-ae1c-4873-958c-5317afed5572","Type":"ContainerStarted","Data":"6bbe3f97dafb47df8e387243d5bc53fbff4cae3a5ce770c69a424000b75437c3"} Jun 11 13:02:56.219832 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.219742 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ngn47"] Jun 11 13:02:56.224446 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.224420 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ngn47" Jun 11 13:02:56.231921 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.231857 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ngn47"] Jun 11 13:02:56.278860 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.278834 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12ftld"] Jun 11 13:02:56.280408 ip-10-0-137-120 kubenswrapper[2558]: W0611 13:02:56.280384 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbda59a98_d0ac_4a05_add9_acbf09836217.slice/crio-548eae157b00e28b1cf394a808a6252aad1babffb28d449fe6473c4c2ece82da WatchSource:0}: Error finding container 548eae157b00e28b1cf394a808a6252aad1babffb28d449fe6473c4c2ece82da: Status 404 returned error can't find the container with id 548eae157b00e28b1cf394a808a6252aad1babffb28d449fe6473c4c2ece82da Jun 11 13:02:56.322125 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.322093 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56b21d34-cc8b-4859-b9ff-cb90d7edb795-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ngn47\" (UID: \"56b21d34-cc8b-4859-b9ff-cb90d7edb795\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ngn47" Jun 11 13:02:56.322272 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.322135 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56b21d34-cc8b-4859-b9ff-cb90d7edb795-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ngn47\" (UID: \"56b21d34-cc8b-4859-b9ff-cb90d7edb795\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ngn47" Jun 11 13:02:56.322272 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.322232 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7vvz\" (UniqueName: \"kubernetes.io/projected/56b21d34-cc8b-4859-b9ff-cb90d7edb795-kube-api-access-q7vvz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ngn47\" (UID: \"56b21d34-cc8b-4859-b9ff-cb90d7edb795\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ngn47" Jun 11 13:02:56.423419 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.423387 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7vvz\" (UniqueName: \"kubernetes.io/projected/56b21d34-cc8b-4859-b9ff-cb90d7edb795-kube-api-access-q7vvz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ngn47\" (UID: \"56b21d34-cc8b-4859-b9ff-cb90d7edb795\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ngn47" Jun 11 13:02:56.423849 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.423446 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56b21d34-cc8b-4859-b9ff-cb90d7edb795-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ngn47\" (UID: \"56b21d34-cc8b-4859-b9ff-cb90d7edb795\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ngn47" Jun 11 13:02:56.423849 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.423565 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56b21d34-cc8b-4859-b9ff-cb90d7edb795-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ngn47\" (UID: \"56b21d34-cc8b-4859-b9ff-cb90d7edb795\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ngn47" Jun 11 13:02:56.423849 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.423766 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56b21d34-cc8b-4859-b9ff-cb90d7edb795-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ngn47\" (UID: \"56b21d34-cc8b-4859-b9ff-cb90d7edb795\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ngn47" Jun 11 13:02:56.423976 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.423913 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56b21d34-cc8b-4859-b9ff-cb90d7edb795-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ngn47\" (UID: \"56b21d34-cc8b-4859-b9ff-cb90d7edb795\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ngn47" Jun 11 13:02:56.433087 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.433061 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7vvz\" (UniqueName: \"kubernetes.io/projected/56b21d34-cc8b-4859-b9ff-cb90d7edb795-kube-api-access-q7vvz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ngn47\" (UID: \"56b21d34-cc8b-4859-b9ff-cb90d7edb795\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ngn47" Jun 11 13:02:56.537282 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.537190 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ngn47" Jun 11 13:02:56.627844 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.627805 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt"] Jun 11 13:02:56.633220 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.633189 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt" Jun 11 13:02:56.641301 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.641271 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt"] Jun 11 13:02:56.675438 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.675414 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ngn47"] Jun 11 13:02:56.676815 ip-10-0-137-120 kubenswrapper[2558]: W0611 13:02:56.676788 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56b21d34_cc8b_4859_b9ff_cb90d7edb795.slice/crio-1b0c821a7aa8126dbd2a2c2d73114947b5b7f52456be26951c2c00bcfdb728d5 WatchSource:0}: Error finding container 1b0c821a7aa8126dbd2a2c2d73114947b5b7f52456be26951c2c00bcfdb728d5: Status 404 returned error can't find the container with id 1b0c821a7aa8126dbd2a2c2d73114947b5b7f52456be26951c2c00bcfdb728d5 Jun 11 13:02:56.726067 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.726016 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hb6b\" (UniqueName: \"kubernetes.io/projected/3f97c524-7191-47b6-b71d-63eb7a2f556f-kube-api-access-9hb6b\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt\" (UID: \"3f97c524-7191-47b6-b71d-63eb7a2f556f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt" Jun 11 13:02:56.726217 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.726193 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f97c524-7191-47b6-b71d-63eb7a2f556f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt\" (UID: \"3f97c524-7191-47b6-b71d-63eb7a2f556f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt" Jun 11 13:02:56.726346 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.726255 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f97c524-7191-47b6-b71d-63eb7a2f556f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt\" (UID: \"3f97c524-7191-47b6-b71d-63eb7a2f556f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt" Jun 11 13:02:56.826753 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.826665 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hb6b\" (UniqueName: \"kubernetes.io/projected/3f97c524-7191-47b6-b71d-63eb7a2f556f-kube-api-access-9hb6b\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt\" (UID: \"3f97c524-7191-47b6-b71d-63eb7a2f556f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt" Jun 11 13:02:56.826753 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.826725 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f97c524-7191-47b6-b71d-63eb7a2f556f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt\" (UID: \"3f97c524-7191-47b6-b71d-63eb7a2f556f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt" Jun 11 13:02:56.826753 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.826751 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f97c524-7191-47b6-b71d-63eb7a2f556f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt\" (UID: \"3f97c524-7191-47b6-b71d-63eb7a2f556f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt" Jun 11 13:02:56.827083 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.827063 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f97c524-7191-47b6-b71d-63eb7a2f556f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt\" (UID: \"3f97c524-7191-47b6-b71d-63eb7a2f556f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt" Jun 11 13:02:56.827166 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.827099 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f97c524-7191-47b6-b71d-63eb7a2f556f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt\" (UID: \"3f97c524-7191-47b6-b71d-63eb7a2f556f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt" Jun 11 13:02:56.837106 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.837065 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hb6b\" (UniqueName: \"kubernetes.io/projected/3f97c524-7191-47b6-b71d-63eb7a2f556f-kube-api-access-9hb6b\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt\" (UID: \"3f97c524-7191-47b6-b71d-63eb7a2f556f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt" Jun 11 13:02:56.947054 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:56.947018 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt" Jun 11 13:02:57.110120 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:57.110094 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt"] Jun 11 13:02:57.124975 ip-10-0-137-120 kubenswrapper[2558]: W0611 13:02:57.124945 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f97c524_7191_47b6_b71d_63eb7a2f556f.slice/crio-5e44235982d3be75fd95a9b4726d00cf7ed344d04570a7836c57302dbbaeb1fa WatchSource:0}: Error finding container 5e44235982d3be75fd95a9b4726d00cf7ed344d04570a7836c57302dbbaeb1fa: Status 404 returned error can't find the container with id 5e44235982d3be75fd95a9b4726d00cf7ed344d04570a7836c57302dbbaeb1fa Jun 11 13:02:57.204135 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:57.204096 2558 generic.go:356] "Generic (PLEG): container finished" podID="56b21d34-cc8b-4859-b9ff-cb90d7edb795" containerID="15cdf44e4eeed27142bdc8f4337653a0b97572ead8b01664263c14f3d4708b6e" exitCode=0 Jun 11 13:02:57.204312 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:57.204141 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ngn47" event={"ID":"56b21d34-cc8b-4859-b9ff-cb90d7edb795","Type":"ContainerDied","Data":"15cdf44e4eeed27142bdc8f4337653a0b97572ead8b01664263c14f3d4708b6e"} Jun 11 13:02:57.204312 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:57.204231 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ngn47" event={"ID":"56b21d34-cc8b-4859-b9ff-cb90d7edb795","Type":"ContainerStarted","Data":"1b0c821a7aa8126dbd2a2c2d73114947b5b7f52456be26951c2c00bcfdb728d5"} Jun 11 13:02:57.206299 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:57.206276 2558 generic.go:356] "Generic (PLEG): container finished" podID="f1627eef-ae1c-4873-958c-5317afed5572" containerID="730c0fb61b3573e7d3039eecb7a942b94286cff4005e96d9d51a03f5712ca5f2" exitCode=0 Jun 11 13:02:57.206415 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:57.206351 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598k97j" event={"ID":"f1627eef-ae1c-4873-958c-5317afed5572","Type":"ContainerDied","Data":"730c0fb61b3573e7d3039eecb7a942b94286cff4005e96d9d51a03f5712ca5f2"} Jun 11 13:02:57.208388 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:57.208179 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt" event={"ID":"3f97c524-7191-47b6-b71d-63eb7a2f556f","Type":"ContainerStarted","Data":"e9998413c719ec8125a338835032c294e60fcb056266a7dc76c476e9a9e4996c"} Jun 11 13:02:57.208388 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:57.208225 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt" event={"ID":"3f97c524-7191-47b6-b71d-63eb7a2f556f","Type":"ContainerStarted","Data":"5e44235982d3be75fd95a9b4726d00cf7ed344d04570a7836c57302dbbaeb1fa"} Jun 11 13:02:57.209719 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:57.209698 2558 generic.go:356] "Generic (PLEG): container finished" podID="bda59a98-d0ac-4a05-add9-acbf09836217" containerID="f819fd78455547487b73f66738fa9b12b73f03b7ede730b33960dab3d51bdb2f" exitCode=0 Jun 11 13:02:57.209833 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:57.209748 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12ftld" event={"ID":"bda59a98-d0ac-4a05-add9-acbf09836217","Type":"ContainerDied","Data":"f819fd78455547487b73f66738fa9b12b73f03b7ede730b33960dab3d51bdb2f"} Jun 11 13:02:57.209833 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:57.209787 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12ftld" event={"ID":"bda59a98-d0ac-4a05-add9-acbf09836217","Type":"ContainerStarted","Data":"548eae157b00e28b1cf394a808a6252aad1babffb28d449fe6473c4c2ece82da"} Jun 11 13:02:57.458004 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:57.457970 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:02:58.218422 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:58.218390 2558 generic.go:356] "Generic (PLEG): container finished" podID="56b21d34-cc8b-4859-b9ff-cb90d7edb795" containerID="e7ef066cbd4479c785ec530f49bd3ff08573f24ea739ae642d4efcfc62bab428" exitCode=0 Jun 11 13:02:58.218594 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:58.218482 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ngn47" event={"ID":"56b21d34-cc8b-4859-b9ff-cb90d7edb795","Type":"ContainerDied","Data":"e7ef066cbd4479c785ec530f49bd3ff08573f24ea739ae642d4efcfc62bab428"} Jun 11 13:02:58.220693 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:58.220669 2558 generic.go:356] "Generic (PLEG): container finished" podID="f1627eef-ae1c-4873-958c-5317afed5572" containerID="bd00903c80e03a7c0b7848463e844ec4621d2b3f551f0e4d1d10926d972e4e26" exitCode=0 Jun 11 13:02:58.220784 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:58.220745 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598k97j" event={"ID":"f1627eef-ae1c-4873-958c-5317afed5572","Type":"ContainerDied","Data":"bd00903c80e03a7c0b7848463e844ec4621d2b3f551f0e4d1d10926d972e4e26"} Jun 11 13:02:58.222174 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:58.222139 2558 generic.go:356] "Generic (PLEG): container finished" podID="3f97c524-7191-47b6-b71d-63eb7a2f556f" containerID="e9998413c719ec8125a338835032c294e60fcb056266a7dc76c476e9a9e4996c" exitCode=0 Jun 11 13:02:58.222270 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:58.222186 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt" event={"ID":"3f97c524-7191-47b6-b71d-63eb7a2f556f","Type":"ContainerDied","Data":"e9998413c719ec8125a338835032c294e60fcb056266a7dc76c476e9a9e4996c"} Jun 11 13:02:58.224462 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:58.224442 2558 generic.go:356] "Generic (PLEG): container finished" podID="bda59a98-d0ac-4a05-add9-acbf09836217" containerID="104b57865cd0a222d6ce86e79e119b3e49fd9e15d52d96eb08f865da0c4c3e72" exitCode=0 Jun 11 13:02:58.224548 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:58.224497 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12ftld" event={"ID":"bda59a98-d0ac-4a05-add9-acbf09836217","Type":"ContainerDied","Data":"104b57865cd0a222d6ce86e79e119b3e49fd9e15d52d96eb08f865da0c4c3e72"} Jun 11 13:02:59.231367 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:59.231285 2558 generic.go:356] "Generic (PLEG): container finished" podID="56b21d34-cc8b-4859-b9ff-cb90d7edb795" containerID="ac5872a1d10baa02000ff049a16e94c5b6411b988845d468a7a56d03b58c3c75" exitCode=0 Jun 11 13:02:59.231367 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:59.231363 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ngn47" event={"ID":"56b21d34-cc8b-4859-b9ff-cb90d7edb795","Type":"ContainerDied","Data":"ac5872a1d10baa02000ff049a16e94c5b6411b988845d468a7a56d03b58c3c75"} Jun 11 13:02:59.233106 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:59.233085 2558 generic.go:356] "Generic (PLEG): container finished" podID="3f97c524-7191-47b6-b71d-63eb7a2f556f" containerID="3617ce78cedbdf3402dd69c7d8c38c81497bea6e6bcd5e1f0af8621b5f284e43" exitCode=0 Jun 11 13:02:59.233246 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:59.233173 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt" event={"ID":"3f97c524-7191-47b6-b71d-63eb7a2f556f","Type":"ContainerDied","Data":"3617ce78cedbdf3402dd69c7d8c38c81497bea6e6bcd5e1f0af8621b5f284e43"} Jun 11 13:02:59.235278 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:59.235254 2558 generic.go:356] "Generic (PLEG): container finished" podID="bda59a98-d0ac-4a05-add9-acbf09836217" containerID="710b83cf9886f570729ae0a4848210360a5729870ec2c8e7759af56fc17c1c88" exitCode=0 Jun 11 13:02:59.235362 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:59.235343 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12ftld" event={"ID":"bda59a98-d0ac-4a05-add9-acbf09836217","Type":"ContainerDied","Data":"710b83cf9886f570729ae0a4848210360a5729870ec2c8e7759af56fc17c1c88"} Jun 11 13:02:59.375622 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:59.375589 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598k97j" Jun 11 13:02:59.551570 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:59.551469 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1627eef-ae1c-4873-958c-5317afed5572-util\") pod \"f1627eef-ae1c-4873-958c-5317afed5572\" (UID: \"f1627eef-ae1c-4873-958c-5317afed5572\") " Jun 11 13:02:59.551570 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:59.551553 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1627eef-ae1c-4873-958c-5317afed5572-bundle\") pod \"f1627eef-ae1c-4873-958c-5317afed5572\" (UID: \"f1627eef-ae1c-4873-958c-5317afed5572\") " Jun 11 13:02:59.551809 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:59.551581 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xh4d2\" (UniqueName: \"kubernetes.io/projected/f1627eef-ae1c-4873-958c-5317afed5572-kube-api-access-xh4d2\") pod \"f1627eef-ae1c-4873-958c-5317afed5572\" (UID: \"f1627eef-ae1c-4873-958c-5317afed5572\") " Jun 11 13:02:59.551989 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:59.551964 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1627eef-ae1c-4873-958c-5317afed5572-bundle" (OuterVolumeSpecName: "bundle") pod "f1627eef-ae1c-4873-958c-5317afed5572" (UID: "f1627eef-ae1c-4873-958c-5317afed5572"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:02:59.553865 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:59.553833 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1627eef-ae1c-4873-958c-5317afed5572-kube-api-access-xh4d2" (OuterVolumeSpecName: "kube-api-access-xh4d2") pod "f1627eef-ae1c-4873-958c-5317afed5572" (UID: "f1627eef-ae1c-4873-958c-5317afed5572"). InnerVolumeSpecName "kube-api-access-xh4d2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:02:59.556979 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:59.556953 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1627eef-ae1c-4873-958c-5317afed5572-util" (OuterVolumeSpecName: "util") pod "f1627eef-ae1c-4873-958c-5317afed5572" (UID: "f1627eef-ae1c-4873-958c-5317afed5572"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:02:59.652315 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:59.652276 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1627eef-ae1c-4873-958c-5317afed5572-bundle\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:02:59.652315 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:59.652309 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xh4d2\" (UniqueName: \"kubernetes.io/projected/f1627eef-ae1c-4873-958c-5317afed5572-kube-api-access-xh4d2\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:02:59.652315 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:02:59.652322 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1627eef-ae1c-4873-958c-5317afed5572-util\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:03:00.243808 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:00.243772 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598k97j" event={"ID":"f1627eef-ae1c-4873-958c-5317afed5572","Type":"ContainerDied","Data":"6bbe3f97dafb47df8e387243d5bc53fbff4cae3a5ce770c69a424000b75437c3"} Jun 11 13:03:00.244230 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:00.243825 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6bbe3f97dafb47df8e387243d5bc53fbff4cae3a5ce770c69a424000b75437c3" Jun 11 13:03:00.244230 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:00.243781 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598k97j" Jun 11 13:03:00.245844 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:00.245821 2558 generic.go:356] "Generic (PLEG): container finished" podID="3f97c524-7191-47b6-b71d-63eb7a2f556f" containerID="481bb8d0f8b6f5794beabaae4759fe5b842bcebacab5f1820701134aca231807" exitCode=0 Jun 11 13:03:00.245967 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:00.245906 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt" event={"ID":"3f97c524-7191-47b6-b71d-63eb7a2f556f","Type":"ContainerDied","Data":"481bb8d0f8b6f5794beabaae4759fe5b842bcebacab5f1820701134aca231807"} Jun 11 13:03:00.399975 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:00.399950 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ngn47" Jun 11 13:03:00.402668 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:00.402646 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12ftld" Jun 11 13:03:00.459072 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:00.459041 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q26t8\" (UniqueName: \"kubernetes.io/projected/bda59a98-d0ac-4a05-add9-acbf09836217-kube-api-access-q26t8\") pod \"bda59a98-d0ac-4a05-add9-acbf09836217\" (UID: \"bda59a98-d0ac-4a05-add9-acbf09836217\") " Jun 11 13:03:00.459241 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:00.459082 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bda59a98-d0ac-4a05-add9-acbf09836217-bundle\") pod \"bda59a98-d0ac-4a05-add9-acbf09836217\" (UID: \"bda59a98-d0ac-4a05-add9-acbf09836217\") " Jun 11 13:03:00.459241 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:00.459138 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7vvz\" (UniqueName: \"kubernetes.io/projected/56b21d34-cc8b-4859-b9ff-cb90d7edb795-kube-api-access-q7vvz\") pod \"56b21d34-cc8b-4859-b9ff-cb90d7edb795\" (UID: \"56b21d34-cc8b-4859-b9ff-cb90d7edb795\") " Jun 11 13:03:00.459241 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:00.459195 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bda59a98-d0ac-4a05-add9-acbf09836217-util\") pod \"bda59a98-d0ac-4a05-add9-acbf09836217\" (UID: \"bda59a98-d0ac-4a05-add9-acbf09836217\") " Jun 11 13:03:00.459241 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:00.459227 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56b21d34-cc8b-4859-b9ff-cb90d7edb795-util\") pod \"56b21d34-cc8b-4859-b9ff-cb90d7edb795\" (UID: \"56b21d34-cc8b-4859-b9ff-cb90d7edb795\") " Jun 11 13:03:00.459433 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:00.459258 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56b21d34-cc8b-4859-b9ff-cb90d7edb795-bundle\") pod \"56b21d34-cc8b-4859-b9ff-cb90d7edb795\" (UID: \"56b21d34-cc8b-4859-b9ff-cb90d7edb795\") " Jun 11 13:03:00.459852 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:00.459794 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bda59a98-d0ac-4a05-add9-acbf09836217-bundle" (OuterVolumeSpecName: "bundle") pod "bda59a98-d0ac-4a05-add9-acbf09836217" (UID: "bda59a98-d0ac-4a05-add9-acbf09836217"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:03:00.460061 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:00.460035 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56b21d34-cc8b-4859-b9ff-cb90d7edb795-bundle" (OuterVolumeSpecName: "bundle") pod "56b21d34-cc8b-4859-b9ff-cb90d7edb795" (UID: "56b21d34-cc8b-4859-b9ff-cb90d7edb795"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:03:00.461679 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:00.461654 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56b21d34-cc8b-4859-b9ff-cb90d7edb795-kube-api-access-q7vvz" (OuterVolumeSpecName: "kube-api-access-q7vvz") pod "56b21d34-cc8b-4859-b9ff-cb90d7edb795" (UID: "56b21d34-cc8b-4859-b9ff-cb90d7edb795"). InnerVolumeSpecName "kube-api-access-q7vvz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:03:00.461766 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:00.461723 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bda59a98-d0ac-4a05-add9-acbf09836217-kube-api-access-q26t8" (OuterVolumeSpecName: "kube-api-access-q26t8") pod "bda59a98-d0ac-4a05-add9-acbf09836217" (UID: "bda59a98-d0ac-4a05-add9-acbf09836217"). InnerVolumeSpecName "kube-api-access-q26t8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:03:00.465778 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:00.465747 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56b21d34-cc8b-4859-b9ff-cb90d7edb795-util" (OuterVolumeSpecName: "util") pod "56b21d34-cc8b-4859-b9ff-cb90d7edb795" (UID: "56b21d34-cc8b-4859-b9ff-cb90d7edb795"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:03:00.466012 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:00.465991 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bda59a98-d0ac-4a05-add9-acbf09836217-util" (OuterVolumeSpecName: "util") pod "bda59a98-d0ac-4a05-add9-acbf09836217" (UID: "bda59a98-d0ac-4a05-add9-acbf09836217"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:03:00.560385 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:00.560292 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7vvz\" (UniqueName: \"kubernetes.io/projected/56b21d34-cc8b-4859-b9ff-cb90d7edb795-kube-api-access-q7vvz\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:03:00.560385 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:00.560325 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bda59a98-d0ac-4a05-add9-acbf09836217-util\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:03:00.560385 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:00.560334 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56b21d34-cc8b-4859-b9ff-cb90d7edb795-util\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:03:00.560385 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:00.560341 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56b21d34-cc8b-4859-b9ff-cb90d7edb795-bundle\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:03:00.560385 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:00.560349 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q26t8\" (UniqueName: \"kubernetes.io/projected/bda59a98-d0ac-4a05-add9-acbf09836217-kube-api-access-q26t8\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:03:00.560385 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:00.560358 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bda59a98-d0ac-4a05-add9-acbf09836217-bundle\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:03:01.253677 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:01.253646 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ngn47" Jun 11 13:03:01.253677 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:01.253670 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ngn47" event={"ID":"56b21d34-cc8b-4859-b9ff-cb90d7edb795","Type":"ContainerDied","Data":"1b0c821a7aa8126dbd2a2c2d73114947b5b7f52456be26951c2c00bcfdb728d5"} Jun 11 13:03:01.254140 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:01.253714 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b0c821a7aa8126dbd2a2c2d73114947b5b7f52456be26951c2c00bcfdb728d5" Jun 11 13:03:01.255807 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:01.255783 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12ftld" Jun 11 13:03:01.255987 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:01.255809 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12ftld" event={"ID":"bda59a98-d0ac-4a05-add9-acbf09836217","Type":"ContainerDied","Data":"548eae157b00e28b1cf394a808a6252aad1babffb28d449fe6473c4c2ece82da"} Jun 11 13:03:01.255987 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:01.255857 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="548eae157b00e28b1cf394a808a6252aad1babffb28d449fe6473c4c2ece82da" Jun 11 13:03:01.385401 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:01.385369 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt" Jun 11 13:03:01.468079 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:01.468041 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f97c524-7191-47b6-b71d-63eb7a2f556f-util\") pod \"3f97c524-7191-47b6-b71d-63eb7a2f556f\" (UID: \"3f97c524-7191-47b6-b71d-63eb7a2f556f\") " Jun 11 13:03:01.473487 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:01.473461 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f97c524-7191-47b6-b71d-63eb7a2f556f-util" (OuterVolumeSpecName: "util") pod "3f97c524-7191-47b6-b71d-63eb7a2f556f" (UID: "3f97c524-7191-47b6-b71d-63eb7a2f556f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:03:01.568940 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:01.568852 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hb6b\" (UniqueName: \"kubernetes.io/projected/3f97c524-7191-47b6-b71d-63eb7a2f556f-kube-api-access-9hb6b\") pod \"3f97c524-7191-47b6-b71d-63eb7a2f556f\" (UID: \"3f97c524-7191-47b6-b71d-63eb7a2f556f\") " Jun 11 13:03:01.569081 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:01.568957 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f97c524-7191-47b6-b71d-63eb7a2f556f-bundle\") pod \"3f97c524-7191-47b6-b71d-63eb7a2f556f\" (UID: \"3f97c524-7191-47b6-b71d-63eb7a2f556f\") " Jun 11 13:03:01.569120 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:01.569084 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f97c524-7191-47b6-b71d-63eb7a2f556f-util\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:03:01.569506 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:01.569470 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f97c524-7191-47b6-b71d-63eb7a2f556f-bundle" (OuterVolumeSpecName: "bundle") pod "3f97c524-7191-47b6-b71d-63eb7a2f556f" (UID: "3f97c524-7191-47b6-b71d-63eb7a2f556f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:03:01.570862 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:01.570844 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f97c524-7191-47b6-b71d-63eb7a2f556f-kube-api-access-9hb6b" (OuterVolumeSpecName: "kube-api-access-9hb6b") pod "3f97c524-7191-47b6-b71d-63eb7a2f556f" (UID: "3f97c524-7191-47b6-b71d-63eb7a2f556f"). InnerVolumeSpecName "kube-api-access-9hb6b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:03:01.670139 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:01.670096 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f97c524-7191-47b6-b71d-63eb7a2f556f-bundle\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:03:01.670139 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:01.670128 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hb6b\" (UniqueName: \"kubernetes.io/projected/3f97c524-7191-47b6-b71d-63eb7a2f556f-kube-api-access-9hb6b\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:03:02.263638 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.263614 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt" Jun 11 13:03:02.263638 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.263625 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt" event={"ID":"3f97c524-7191-47b6-b71d-63eb7a2f556f","Type":"ContainerDied","Data":"5e44235982d3be75fd95a9b4726d00cf7ed344d04570a7836c57302dbbaeb1fa"} Jun 11 13:03:02.264318 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.263668 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e44235982d3be75fd95a9b4726d00cf7ed344d04570a7836c57302dbbaeb1fa" Jun 11 13:03:02.879148 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.879112 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74f49d7c8d-vm6g5"] Jun 11 13:03:02.879466 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.879452 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f97c524-7191-47b6-b71d-63eb7a2f556f" containerName="pull" Jun 11 13:03:02.879513 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.879467 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f97c524-7191-47b6-b71d-63eb7a2f556f" containerName="pull" Jun 11 13:03:02.879513 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.879477 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1627eef-ae1c-4873-958c-5317afed5572" containerName="util" Jun 11 13:03:02.879513 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.879482 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1627eef-ae1c-4873-958c-5317afed5572" containerName="util" Jun 11 13:03:02.879513 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.879490 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1627eef-ae1c-4873-958c-5317afed5572" containerName="pull" Jun 11 13:03:02.879513 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.879496 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1627eef-ae1c-4873-958c-5317afed5572" containerName="pull" Jun 11 13:03:02.879513 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.879502 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f97c524-7191-47b6-b71d-63eb7a2f556f" containerName="util" Jun 11 13:03:02.879513 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.879507 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f97c524-7191-47b6-b71d-63eb7a2f556f" containerName="util" Jun 11 13:03:02.879719 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.879517 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1627eef-ae1c-4873-958c-5317afed5572" containerName="extract" Jun 11 13:03:02.879719 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.879522 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1627eef-ae1c-4873-958c-5317afed5572" containerName="extract" Jun 11 13:03:02.879719 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.879528 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56b21d34-cc8b-4859-b9ff-cb90d7edb795" containerName="pull" Jun 11 13:03:02.879719 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.879533 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="56b21d34-cc8b-4859-b9ff-cb90d7edb795" containerName="pull" Jun 11 13:03:02.879719 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.879539 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bda59a98-d0ac-4a05-add9-acbf09836217" containerName="pull" Jun 11 13:03:02.879719 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.879544 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bda59a98-d0ac-4a05-add9-acbf09836217" containerName="pull" Jun 11 13:03:02.879719 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.879549 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f97c524-7191-47b6-b71d-63eb7a2f556f" containerName="extract" Jun 11 13:03:02.879719 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.879554 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f97c524-7191-47b6-b71d-63eb7a2f556f" containerName="extract" Jun 11 13:03:02.879719 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.879560 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56b21d34-cc8b-4859-b9ff-cb90d7edb795" containerName="extract" Jun 11 13:03:02.879719 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.879565 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="56b21d34-cc8b-4859-b9ff-cb90d7edb795" containerName="extract" Jun 11 13:03:02.879719 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.879573 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56b21d34-cc8b-4859-b9ff-cb90d7edb795" containerName="util" Jun 11 13:03:02.879719 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.879578 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="56b21d34-cc8b-4859-b9ff-cb90d7edb795" containerName="util" Jun 11 13:03:02.879719 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.879588 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bda59a98-d0ac-4a05-add9-acbf09836217" containerName="extract" Jun 11 13:03:02.879719 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.879593 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bda59a98-d0ac-4a05-add9-acbf09836217" containerName="extract" Jun 11 13:03:02.879719 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.879603 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bda59a98-d0ac-4a05-add9-acbf09836217" containerName="util" Jun 11 13:03:02.879719 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.879608 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bda59a98-d0ac-4a05-add9-acbf09836217" containerName="util" Jun 11 13:03:02.879719 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.879660 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="56b21d34-cc8b-4859-b9ff-cb90d7edb795" containerName="extract" Jun 11 13:03:02.879719 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.879667 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="bda59a98-d0ac-4a05-add9-acbf09836217" containerName="extract" Jun 11 13:03:02.879719 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.879675 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f97c524-7191-47b6-b71d-63eb7a2f556f" containerName="extract" Jun 11 13:03:02.879719 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.879684 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1627eef-ae1c-4873-958c-5317afed5572" containerName="extract" Jun 11 13:03:02.885238 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.885212 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74f49d7c8d-vm6g5" Jun 11 13:03:02.888103 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.888075 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 13:03:02.888234 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.888105 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 13:03:02.888234 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.888084 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 13:03:02.889313 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.889295 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 13:03:02.889433 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.889316 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 13:03:02.889433 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.889388 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hr4xm\"" Jun 11 13:03:02.893860 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.893830 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 13:03:02.896692 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.896665 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74f49d7c8d-vm6g5"] Jun 11 13:03:02.947945 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.947907 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:03:02.979076 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.979043 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9bc0b31d-8221-448e-b801-52b18b2fd989-console-config\") pod \"console-74f49d7c8d-vm6g5\" (UID: \"9bc0b31d-8221-448e-b801-52b18b2fd989\") " pod="openshift-console/console-74f49d7c8d-vm6g5" Jun 11 13:03:02.979242 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.979111 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9bc0b31d-8221-448e-b801-52b18b2fd989-console-oauth-config\") pod \"console-74f49d7c8d-vm6g5\" (UID: \"9bc0b31d-8221-448e-b801-52b18b2fd989\") " pod="openshift-console/console-74f49d7c8d-vm6g5" Jun 11 13:03:02.979242 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.979130 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc0b31d-8221-448e-b801-52b18b2fd989-trusted-ca-bundle\") pod \"console-74f49d7c8d-vm6g5\" (UID: \"9bc0b31d-8221-448e-b801-52b18b2fd989\") " pod="openshift-console/console-74f49d7c8d-vm6g5" Jun 11 13:03:02.979242 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.979164 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9bc0b31d-8221-448e-b801-52b18b2fd989-service-ca\") pod \"console-74f49d7c8d-vm6g5\" (UID: \"9bc0b31d-8221-448e-b801-52b18b2fd989\") " pod="openshift-console/console-74f49d7c8d-vm6g5" Jun 11 13:03:02.979242 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.979186 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9bc0b31d-8221-448e-b801-52b18b2fd989-oauth-serving-cert\") pod \"console-74f49d7c8d-vm6g5\" (UID: \"9bc0b31d-8221-448e-b801-52b18b2fd989\") " pod="openshift-console/console-74f49d7c8d-vm6g5" Jun 11 13:03:02.979242 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.979202 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9bc0b31d-8221-448e-b801-52b18b2fd989-console-serving-cert\") pod \"console-74f49d7c8d-vm6g5\" (UID: \"9bc0b31d-8221-448e-b801-52b18b2fd989\") " pod="openshift-console/console-74f49d7c8d-vm6g5" Jun 11 13:03:02.979242 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:02.979217 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqwxl\" (UniqueName: \"kubernetes.io/projected/9bc0b31d-8221-448e-b801-52b18b2fd989-kube-api-access-pqwxl\") pod \"console-74f49d7c8d-vm6g5\" (UID: \"9bc0b31d-8221-448e-b801-52b18b2fd989\") " pod="openshift-console/console-74f49d7c8d-vm6g5" Jun 11 13:03:03.016434 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:03.016402 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:03:03.079695 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:03.079657 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9bc0b31d-8221-448e-b801-52b18b2fd989-console-oauth-config\") pod \"console-74f49d7c8d-vm6g5\" (UID: \"9bc0b31d-8221-448e-b801-52b18b2fd989\") " pod="openshift-console/console-74f49d7c8d-vm6g5" Jun 11 13:03:03.079695 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:03.079692 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc0b31d-8221-448e-b801-52b18b2fd989-trusted-ca-bundle\") pod \"console-74f49d7c8d-vm6g5\" (UID: \"9bc0b31d-8221-448e-b801-52b18b2fd989\") " pod="openshift-console/console-74f49d7c8d-vm6g5" Jun 11 13:03:03.079922 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:03.079718 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9bc0b31d-8221-448e-b801-52b18b2fd989-service-ca\") pod \"console-74f49d7c8d-vm6g5\" (UID: \"9bc0b31d-8221-448e-b801-52b18b2fd989\") " pod="openshift-console/console-74f49d7c8d-vm6g5" Jun 11 13:03:03.079922 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:03.079780 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9bc0b31d-8221-448e-b801-52b18b2fd989-oauth-serving-cert\") pod \"console-74f49d7c8d-vm6g5\" (UID: \"9bc0b31d-8221-448e-b801-52b18b2fd989\") " pod="openshift-console/console-74f49d7c8d-vm6g5" Jun 11 13:03:03.079922 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:03.079811 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9bc0b31d-8221-448e-b801-52b18b2fd989-console-serving-cert\") pod \"console-74f49d7c8d-vm6g5\" (UID: \"9bc0b31d-8221-448e-b801-52b18b2fd989\") " pod="openshift-console/console-74f49d7c8d-vm6g5" Jun 11 13:03:03.080095 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:03.079953 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqwxl\" (UniqueName: \"kubernetes.io/projected/9bc0b31d-8221-448e-b801-52b18b2fd989-kube-api-access-pqwxl\") pod \"console-74f49d7c8d-vm6g5\" (UID: \"9bc0b31d-8221-448e-b801-52b18b2fd989\") " pod="openshift-console/console-74f49d7c8d-vm6g5" Jun 11 13:03:03.080095 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:03.080021 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9bc0b31d-8221-448e-b801-52b18b2fd989-console-config\") pod \"console-74f49d7c8d-vm6g5\" (UID: \"9bc0b31d-8221-448e-b801-52b18b2fd989\") " pod="openshift-console/console-74f49d7c8d-vm6g5" Jun 11 13:03:03.080588 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:03.080568 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9bc0b31d-8221-448e-b801-52b18b2fd989-oauth-serving-cert\") pod \"console-74f49d7c8d-vm6g5\" (UID: \"9bc0b31d-8221-448e-b801-52b18b2fd989\") " pod="openshift-console/console-74f49d7c8d-vm6g5" Jun 11 13:03:03.080666 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:03.080570 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9bc0b31d-8221-448e-b801-52b18b2fd989-service-ca\") pod \"console-74f49d7c8d-vm6g5\" (UID: \"9bc0b31d-8221-448e-b801-52b18b2fd989\") " pod="openshift-console/console-74f49d7c8d-vm6g5" Jun 11 13:03:03.080714 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:03.080668 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bc0b31d-8221-448e-b801-52b18b2fd989-trusted-ca-bundle\") pod \"console-74f49d7c8d-vm6g5\" (UID: \"9bc0b31d-8221-448e-b801-52b18b2fd989\") " pod="openshift-console/console-74f49d7c8d-vm6g5" Jun 11 13:03:03.080812 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:03.080792 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9bc0b31d-8221-448e-b801-52b18b2fd989-console-config\") pod \"console-74f49d7c8d-vm6g5\" (UID: \"9bc0b31d-8221-448e-b801-52b18b2fd989\") " pod="openshift-console/console-74f49d7c8d-vm6g5" Jun 11 13:03:03.082227 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:03.082205 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9bc0b31d-8221-448e-b801-52b18b2fd989-console-oauth-config\") pod \"console-74f49d7c8d-vm6g5\" (UID: \"9bc0b31d-8221-448e-b801-52b18b2fd989\") " pod="openshift-console/console-74f49d7c8d-vm6g5" Jun 11 13:03:03.082334 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:03.082318 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9bc0b31d-8221-448e-b801-52b18b2fd989-console-serving-cert\") pod \"console-74f49d7c8d-vm6g5\" (UID: \"9bc0b31d-8221-448e-b801-52b18b2fd989\") " pod="openshift-console/console-74f49d7c8d-vm6g5" Jun 11 13:03:03.091282 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:03.091253 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqwxl\" (UniqueName: \"kubernetes.io/projected/9bc0b31d-8221-448e-b801-52b18b2fd989-kube-api-access-pqwxl\") pod \"console-74f49d7c8d-vm6g5\" (UID: \"9bc0b31d-8221-448e-b801-52b18b2fd989\") " pod="openshift-console/console-74f49d7c8d-vm6g5" Jun 11 13:03:03.197968 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:03.197871 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74f49d7c8d-vm6g5" Jun 11 13:03:03.346832 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:03.346806 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74f49d7c8d-vm6g5"] Jun 11 13:03:03.348595 ip-10-0-137-120 kubenswrapper[2558]: W0611 13:03:03.348564 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bc0b31d_8221_448e_b801_52b18b2fd989.slice/crio-a82ad3b23b6d7dc60e944b3edd28edafc3be08ff382763bd6c8b6ba3456e0cf9 WatchSource:0}: Error finding container a82ad3b23b6d7dc60e944b3edd28edafc3be08ff382763bd6c8b6ba3456e0cf9: Status 404 returned error can't find the container with id a82ad3b23b6d7dc60e944b3edd28edafc3be08ff382763bd6c8b6ba3456e0cf9 Jun 11 13:03:04.276163 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:04.276126 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74f49d7c8d-vm6g5" event={"ID":"9bc0b31d-8221-448e-b801-52b18b2fd989","Type":"ContainerStarted","Data":"6cbaf74811d103f5dcdb0f7b6f4a47b26544acad9fe1a316947a8e2a3fd2656b"} Jun 11 13:03:04.276337 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:04.276191 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74f49d7c8d-vm6g5" event={"ID":"9bc0b31d-8221-448e-b801-52b18b2fd989","Type":"ContainerStarted","Data":"a82ad3b23b6d7dc60e944b3edd28edafc3be08ff382763bd6c8b6ba3456e0cf9"} Jun 11 13:03:04.295465 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:04.295416 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74f49d7c8d-vm6g5" podStartSLOduration=2.295400574 podStartE2EDuration="2.295400574s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:03:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:03:04.294318114 +0000 UTC m=+583.940840069" watchObservedRunningTime="2026-06-11 13:03:04.295400574 +0000 UTC m=+583.941922516" Jun 11 13:03:08.364617 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:08.364584 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:03:09.378505 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:09.378466 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:03:13.198326 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:13.198280 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74f49d7c8d-vm6g5" Jun 11 13:03:13.198734 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:13.198356 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74f49d7c8d-vm6g5" Jun 11 13:03:13.203231 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:13.203205 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74f49d7c8d-vm6g5" Jun 11 13:03:13.241434 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:13.241405 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:03:13.329792 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:13.329760 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74f49d7c8d-vm6g5" Jun 11 13:03:13.543620 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:13.543517 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:03:13.675412 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:13.675381 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:03:15.007269 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:15.007234 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zrpv"] Jun 11 13:03:15.010293 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:15.010276 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zrpv" Jun 11 13:03:15.013658 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:15.013628 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 13:03:15.013892 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:15.013868 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wfjw2\"" Jun 11 13:03:15.014038 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:15.013983 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 13:03:15.028211 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:15.028182 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zrpv"] Jun 11 13:03:15.067455 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:15.067422 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/888a40cd-5b21-4a99-8e36-ffbad3ec9b7c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7zrpv\" (UID: \"888a40cd-5b21-4a99-8e36-ffbad3ec9b7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zrpv" Jun 11 13:03:15.067607 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:15.067500 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92zh6\" (UniqueName: \"kubernetes.io/projected/888a40cd-5b21-4a99-8e36-ffbad3ec9b7c-kube-api-access-92zh6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7zrpv\" (UID: \"888a40cd-5b21-4a99-8e36-ffbad3ec9b7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zrpv" Jun 11 13:03:15.168342 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:15.168305 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92zh6\" (UniqueName: \"kubernetes.io/projected/888a40cd-5b21-4a99-8e36-ffbad3ec9b7c-kube-api-access-92zh6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7zrpv\" (UID: \"888a40cd-5b21-4a99-8e36-ffbad3ec9b7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zrpv" Jun 11 13:03:15.168509 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:15.168370 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/888a40cd-5b21-4a99-8e36-ffbad3ec9b7c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7zrpv\" (UID: \"888a40cd-5b21-4a99-8e36-ffbad3ec9b7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zrpv" Jun 11 13:03:15.168748 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:15.168732 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/888a40cd-5b21-4a99-8e36-ffbad3ec9b7c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7zrpv\" (UID: \"888a40cd-5b21-4a99-8e36-ffbad3ec9b7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zrpv" Jun 11 13:03:15.182801 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:15.182774 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92zh6\" (UniqueName: \"kubernetes.io/projected/888a40cd-5b21-4a99-8e36-ffbad3ec9b7c-kube-api-access-92zh6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7zrpv\" (UID: \"888a40cd-5b21-4a99-8e36-ffbad3ec9b7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zrpv" Jun 11 13:03:15.321391 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:15.321305 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zrpv" Jun 11 13:03:15.475835 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:15.475802 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zrpv"] Jun 11 13:03:15.479331 ip-10-0-137-120 kubenswrapper[2558]: W0611 13:03:15.479305 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod888a40cd_5b21_4a99_8e36_ffbad3ec9b7c.slice/crio-e2c8fe0ab942b6c918339917cd981498e467c82df9741da467f61e23f74d535c WatchSource:0}: Error finding container e2c8fe0ab942b6c918339917cd981498e467c82df9741da467f61e23f74d535c: Status 404 returned error can't find the container with id e2c8fe0ab942b6c918339917cd981498e467c82df9741da467f61e23f74d535c Jun 11 13:03:15.832705 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:15.832673 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:03:16.344216 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:16.344182 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zrpv" event={"ID":"888a40cd-5b21-4a99-8e36-ffbad3ec9b7c","Type":"ContainerStarted","Data":"e2c8fe0ab942b6c918339917cd981498e467c82df9741da467f61e23f74d535c"} Jun 11 13:03:17.452256 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:17.452225 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:03:17.782718 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:17.782626 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:03:17.886654 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:17.886606 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:03:20.815949 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:20.815920 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lb8tl_20c98c8b-f1fa-4066-8907-1ac8f01bacf5/console-operator/2.log" Jun 11 13:03:20.816416 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:20.816030 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lb8tl_20c98c8b-f1fa-4066-8907-1ac8f01bacf5/console-operator/2.log" Jun 11 13:03:21.052168 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:21.052119 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:03:21.346787 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:21.346753 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:03:21.485052 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:21.485013 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:03:24.226084 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:24.225937 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:03:25.396050 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:25.396008 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zrpv" event={"ID":"888a40cd-5b21-4a99-8e36-ffbad3ec9b7c","Type":"ContainerStarted","Data":"059ca1bd42bcf4d832e76e8628c43b5f36dcd8359399146e3b980086a6f32ad1"} Jun 11 13:03:25.396461 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:25.396108 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zrpv" Jun 11 13:03:25.398362 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:25.398339 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:03:25.418561 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:25.418511 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zrpv" podStartSLOduration=2.353851283 podStartE2EDuration="11.418495535s" totalImagesPullingTime="9.064644252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:03:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:03:25.415737379 +0000 UTC m=+605.062259322" watchObservedRunningTime="2026-06-11 13:03:25.418495535 +0000 UTC m=+605.065017478" Jun 11 13:03:25.499802 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:25.499772 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:03:27.406555 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:27.406522 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:03:27.982364 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:27.982318 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:03:33.170482 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:33.170399 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:03:33.235690 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:33.235642 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:03:33.638633 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:33.638598 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:03:36.404073 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:36.404038 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zrpv" Jun 11 13:03:37.492003 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:37.491965 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lc6sg"] Jun 11 13:03:37.494857 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:37.494841 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lc6sg" Jun 11 13:03:37.510307 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:37.510278 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lc6sg"] Jun 11 13:03:37.557748 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:37.557707 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjgkx\" (UniqueName: \"kubernetes.io/projected/ee8c3f61-e864-46a8-92fd-de260b442204-kube-api-access-xjgkx\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-lc6sg\" (UID: \"ee8c3f61-e864-46a8-92fd-de260b442204\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lc6sg" Jun 11 13:03:37.557949 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:37.557807 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ee8c3f61-e864-46a8-92fd-de260b442204-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-lc6sg\" (UID: \"ee8c3f61-e864-46a8-92fd-de260b442204\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lc6sg" Jun 11 13:03:37.594532 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:37.594493 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lc6sg"] Jun 11 13:03:37.594806 ip-10-0-137-120 kubenswrapper[2558]: E0611 13:03:37.594784 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-xjgkx], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lc6sg" podUID="ee8c3f61-e864-46a8-92fd-de260b442204" Jun 11 13:03:37.658619 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:37.658578 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ee8c3f61-e864-46a8-92fd-de260b442204-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-lc6sg\" (UID: \"ee8c3f61-e864-46a8-92fd-de260b442204\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lc6sg" Jun 11 13:03:37.658788 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:37.658629 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjgkx\" (UniqueName: \"kubernetes.io/projected/ee8c3f61-e864-46a8-92fd-de260b442204-kube-api-access-xjgkx\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-lc6sg\" (UID: \"ee8c3f61-e864-46a8-92fd-de260b442204\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lc6sg" Jun 11 13:03:37.659000 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:37.658979 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ee8c3f61-e864-46a8-92fd-de260b442204-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-lc6sg\" (UID: \"ee8c3f61-e864-46a8-92fd-de260b442204\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lc6sg" Jun 11 13:03:37.673674 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:37.673644 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjgkx\" (UniqueName: \"kubernetes.io/projected/ee8c3f61-e864-46a8-92fd-de260b442204-kube-api-access-xjgkx\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-lc6sg\" (UID: \"ee8c3f61-e864-46a8-92fd-de260b442204\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lc6sg" Jun 11 13:03:38.169207 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.169166 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lc6sg"] Jun 11 13:03:38.178223 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.178195 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lc6sg"] Jun 11 13:03:38.208799 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.208761 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zrpv"] Jun 11 13:03:38.209028 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.208985 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zrpv" podUID="888a40cd-5b21-4a99-8e36-ffbad3ec9b7c" containerName="manager" containerID="cri-o://059ca1bd42bcf4d832e76e8628c43b5f36dcd8359399146e3b980086a6f32ad1" gracePeriod=2 Jun 11 13:03:38.245055 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.245026 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zrpv"] Jun 11 13:03:38.246202 ip-10-0-137-120 kubenswrapper[2558]: E0611 13:03:38.246167 2558 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"888a40cd-5b21-4a99-8e36-ffbad3ec9b7c\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-7zrpv\": pods \"kuadrant-operator-controller-manager-8684c9ff49-7zrpv\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zrpv" Jun 11 13:03:38.265086 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.265060 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znmjk"] Jun 11 13:03:38.265435 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.265422 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="888a40cd-5b21-4a99-8e36-ffbad3ec9b7c" containerName="manager" Jun 11 13:03:38.265481 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.265437 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="888a40cd-5b21-4a99-8e36-ffbad3ec9b7c" containerName="manager" Jun 11 13:03:38.265520 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.265510 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="888a40cd-5b21-4a99-8e36-ffbad3ec9b7c" containerName="manager" Jun 11 13:03:38.268445 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.268430 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znmjk" Jun 11 13:03:38.271088 ip-10-0-137-120 kubenswrapper[2558]: E0611 13:03:38.271057 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7zrpv\" is forbidden: User \"system:node:ip-10-0-137-120.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-120.ec2.internal' and this object" podUID="888a40cd-5b21-4a99-8e36-ffbad3ec9b7c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zrpv" Jun 11 13:03:38.288085 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.288056 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znmjk"] Jun 11 13:03:38.365017 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.364979 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bfcd505d-4b9c-42d5-b722-54f90630a926-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-znmjk\" (UID: \"bfcd505d-4b9c-42d5-b722-54f90630a926\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znmjk" Jun 11 13:03:38.365247 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.365026 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctd6k\" (UniqueName: \"kubernetes.io/projected/bfcd505d-4b9c-42d5-b722-54f90630a926-kube-api-access-ctd6k\") pod \"kuadrant-operator-controller-manager-8684c9ff49-znmjk\" (UID: \"bfcd505d-4b9c-42d5-b722-54f90630a926\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znmjk" Jun 11 13:03:38.458396 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.458372 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zrpv" Jun 11 13:03:38.460999 ip-10-0-137-120 kubenswrapper[2558]: E0611 13:03:38.460964 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7zrpv\" is forbidden: User \"system:node:ip-10-0-137-120.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-120.ec2.internal' and this object" podUID="888a40cd-5b21-4a99-8e36-ffbad3ec9b7c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zrpv" Jun 11 13:03:38.465523 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.465498 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bfcd505d-4b9c-42d5-b722-54f90630a926-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-znmjk\" (UID: \"bfcd505d-4b9c-42d5-b722-54f90630a926\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znmjk" Jun 11 13:03:38.465647 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.465536 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctd6k\" (UniqueName: \"kubernetes.io/projected/bfcd505d-4b9c-42d5-b722-54f90630a926-kube-api-access-ctd6k\") pod \"kuadrant-operator-controller-manager-8684c9ff49-znmjk\" (UID: \"bfcd505d-4b9c-42d5-b722-54f90630a926\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znmjk" Jun 11 13:03:38.465908 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.465885 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bfcd505d-4b9c-42d5-b722-54f90630a926-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-znmjk\" (UID: \"bfcd505d-4b9c-42d5-b722-54f90630a926\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znmjk" Jun 11 13:03:38.466276 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.466253 2558 generic.go:356] "Generic (PLEG): container finished" podID="888a40cd-5b21-4a99-8e36-ffbad3ec9b7c" containerID="059ca1bd42bcf4d832e76e8628c43b5f36dcd8359399146e3b980086a6f32ad1" exitCode=0 Jun 11 13:03:38.466339 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.466295 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zrpv" Jun 11 13:03:38.466377 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.466350 2558 scope.go:117] "RemoveContainer" containerID="059ca1bd42bcf4d832e76e8628c43b5f36dcd8359399146e3b980086a6f32ad1" Jun 11 13:03:38.466446 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.466434 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lc6sg" Jun 11 13:03:38.469881 ip-10-0-137-120 kubenswrapper[2558]: E0611 13:03:38.469852 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7zrpv\" is forbidden: User \"system:node:ip-10-0-137-120.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-120.ec2.internal' and this object" podUID="888a40cd-5b21-4a99-8e36-ffbad3ec9b7c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zrpv" Jun 11 13:03:38.471979 ip-10-0-137-120 kubenswrapper[2558]: E0611 13:03:38.471956 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-lc6sg\" is forbidden: User \"system:node:ip-10-0-137-120.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-120.ec2.internal' and this object" podUID="ee8c3f61-e864-46a8-92fd-de260b442204" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lc6sg" Jun 11 13:03:38.472905 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.472885 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lc6sg" Jun 11 13:03:38.474286 ip-10-0-137-120 kubenswrapper[2558]: E0611 13:03:38.474261 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7zrpv\" is forbidden: User \"system:node:ip-10-0-137-120.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-120.ec2.internal' and this object" podUID="888a40cd-5b21-4a99-8e36-ffbad3ec9b7c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zrpv" Jun 11 13:03:38.475722 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.475703 2558 scope.go:117] "RemoveContainer" containerID="059ca1bd42bcf4d832e76e8628c43b5f36dcd8359399146e3b980086a6f32ad1" Jun 11 13:03:38.475995 ip-10-0-137-120 kubenswrapper[2558]: E0611 13:03:38.475978 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"059ca1bd42bcf4d832e76e8628c43b5f36dcd8359399146e3b980086a6f32ad1\": container with ID starting with 059ca1bd42bcf4d832e76e8628c43b5f36dcd8359399146e3b980086a6f32ad1 not found: ID does not exist" containerID="059ca1bd42bcf4d832e76e8628c43b5f36dcd8359399146e3b980086a6f32ad1" Jun 11 13:03:38.476056 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.476003 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"059ca1bd42bcf4d832e76e8628c43b5f36dcd8359399146e3b980086a6f32ad1"} err="failed to get container status \"059ca1bd42bcf4d832e76e8628c43b5f36dcd8359399146e3b980086a6f32ad1\": rpc error: code = NotFound desc = could not find container \"059ca1bd42bcf4d832e76e8628c43b5f36dcd8359399146e3b980086a6f32ad1\": container with ID starting with 059ca1bd42bcf4d832e76e8628c43b5f36dcd8359399146e3b980086a6f32ad1 not found: ID does not exist" Jun 11 13:03:38.477773 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.477752 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctd6k\" (UniqueName: \"kubernetes.io/projected/bfcd505d-4b9c-42d5-b722-54f90630a926-kube-api-access-ctd6k\") pod \"kuadrant-operator-controller-manager-8684c9ff49-znmjk\" (UID: \"bfcd505d-4b9c-42d5-b722-54f90630a926\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znmjk" Jun 11 13:03:38.480968 ip-10-0-137-120 kubenswrapper[2558]: E0611 13:03:38.480937 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-lc6sg\" is forbidden: User \"system:node:ip-10-0-137-120.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-120.ec2.internal' and this object" podUID="ee8c3f61-e864-46a8-92fd-de260b442204" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lc6sg" Jun 11 13:03:38.483484 ip-10-0-137-120 kubenswrapper[2558]: E0611 13:03:38.483456 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7zrpv\" is forbidden: User \"system:node:ip-10-0-137-120.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-120.ec2.internal' and this object" podUID="888a40cd-5b21-4a99-8e36-ffbad3ec9b7c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zrpv" Jun 11 13:03:38.566417 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.566385 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjgkx\" (UniqueName: \"kubernetes.io/projected/ee8c3f61-e864-46a8-92fd-de260b442204-kube-api-access-xjgkx\") pod \"ee8c3f61-e864-46a8-92fd-de260b442204\" (UID: \"ee8c3f61-e864-46a8-92fd-de260b442204\") " Jun 11 13:03:38.566870 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.566433 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/888a40cd-5b21-4a99-8e36-ffbad3ec9b7c-extensions-socket-volume\") pod \"888a40cd-5b21-4a99-8e36-ffbad3ec9b7c\" (UID: \"888a40cd-5b21-4a99-8e36-ffbad3ec9b7c\") " Jun 11 13:03:38.566870 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.566471 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ee8c3f61-e864-46a8-92fd-de260b442204-extensions-socket-volume\") pod \"ee8c3f61-e864-46a8-92fd-de260b442204\" (UID: \"ee8c3f61-e864-46a8-92fd-de260b442204\") " Jun 11 13:03:38.566870 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.566510 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92zh6\" (UniqueName: \"kubernetes.io/projected/888a40cd-5b21-4a99-8e36-ffbad3ec9b7c-kube-api-access-92zh6\") pod \"888a40cd-5b21-4a99-8e36-ffbad3ec9b7c\" (UID: \"888a40cd-5b21-4a99-8e36-ffbad3ec9b7c\") " Jun 11 13:03:38.566870 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.566765 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee8c3f61-e864-46a8-92fd-de260b442204-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ee8c3f61-e864-46a8-92fd-de260b442204" (UID: "ee8c3f61-e864-46a8-92fd-de260b442204"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:03:38.567088 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.567037 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/888a40cd-5b21-4a99-8e36-ffbad3ec9b7c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "888a40cd-5b21-4a99-8e36-ffbad3ec9b7c" (UID: "888a40cd-5b21-4a99-8e36-ffbad3ec9b7c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:03:38.568532 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.568510 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/888a40cd-5b21-4a99-8e36-ffbad3ec9b7c-kube-api-access-92zh6" (OuterVolumeSpecName: "kube-api-access-92zh6") pod "888a40cd-5b21-4a99-8e36-ffbad3ec9b7c" (UID: "888a40cd-5b21-4a99-8e36-ffbad3ec9b7c"). InnerVolumeSpecName "kube-api-access-92zh6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:03:38.568590 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.568529 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee8c3f61-e864-46a8-92fd-de260b442204-kube-api-access-xjgkx" (OuterVolumeSpecName: "kube-api-access-xjgkx") pod "ee8c3f61-e864-46a8-92fd-de260b442204" (UID: "ee8c3f61-e864-46a8-92fd-de260b442204"). InnerVolumeSpecName "kube-api-access-xjgkx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:03:38.584793 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.584757 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znmjk" Jun 11 13:03:38.667516 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.667484 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/888a40cd-5b21-4a99-8e36-ffbad3ec9b7c-extensions-socket-volume\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:03:38.667516 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.667512 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ee8c3f61-e864-46a8-92fd-de260b442204-extensions-socket-volume\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:03:38.667516 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.667522 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92zh6\" (UniqueName: \"kubernetes.io/projected/888a40cd-5b21-4a99-8e36-ffbad3ec9b7c-kube-api-access-92zh6\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:03:38.667739 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.667532 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjgkx\" (UniqueName: \"kubernetes.io/projected/ee8c3f61-e864-46a8-92fd-de260b442204-kube-api-access-xjgkx\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:03:38.731587 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.731561 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znmjk"] Jun 11 13:03:38.734166 ip-10-0-137-120 kubenswrapper[2558]: W0611 13:03:38.734129 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfcd505d_4b9c_42d5_b722_54f90630a926.slice/crio-67d7372af30e699499aeddc1ea3142655d53c589c46f885a75799e2465693adc WatchSource:0}: Error finding container 67d7372af30e699499aeddc1ea3142655d53c589c46f885a75799e2465693adc: Status 404 returned error can't find the container with id 67d7372af30e699499aeddc1ea3142655d53c589c46f885a75799e2465693adc Jun 11 13:03:38.782116 ip-10-0-137-120 kubenswrapper[2558]: E0611 13:03:38.782086 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7zrpv\" is forbidden: User \"system:node:ip-10-0-137-120.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-120.ec2.internal' and this object" podUID="888a40cd-5b21-4a99-8e36-ffbad3ec9b7c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zrpv" Jun 11 13:03:38.784303 ip-10-0-137-120 kubenswrapper[2558]: E0611 13:03:38.784277 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-lc6sg\" is forbidden: User \"system:node:ip-10-0-137-120.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-120.ec2.internal' and this object" podUID="ee8c3f61-e864-46a8-92fd-de260b442204" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lc6sg" Jun 11 13:03:38.825200 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.825140 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="888a40cd-5b21-4a99-8e36-ffbad3ec9b7c" path="/var/lib/kubelet/pods/888a40cd-5b21-4a99-8e36-ffbad3ec9b7c/volumes" Jun 11 13:03:38.825613 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:38.825593 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee8c3f61-e864-46a8-92fd-de260b442204" path="/var/lib/kubelet/pods/ee8c3f61-e864-46a8-92fd-de260b442204/volumes" Jun 11 13:03:39.010270 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:39.010140 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:03:39.101999 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:39.101964 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:03:39.473924 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:39.473893 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lc6sg" Jun 11 13:03:39.474112 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:39.473895 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znmjk" event={"ID":"bfcd505d-4b9c-42d5-b722-54f90630a926","Type":"ContainerStarted","Data":"3c7b82e9b50e8b5865f671cb18853249a996b3e4d37314b84114a71af749820f"} Jun 11 13:03:39.474112 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:39.474050 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znmjk" event={"ID":"bfcd505d-4b9c-42d5-b722-54f90630a926","Type":"ContainerStarted","Data":"67d7372af30e699499aeddc1ea3142655d53c589c46f885a75799e2465693adc"} Jun 11 13:03:39.474112 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:39.474096 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znmjk" Jun 11 13:03:39.496514 ip-10-0-137-120 kubenswrapper[2558]: E0611 13:03:39.496464 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-lc6sg\" is forbidden: User \"system:node:ip-10-0-137-120.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-120.ec2.internal' and this object" podUID="ee8c3f61-e864-46a8-92fd-de260b442204" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lc6sg" Jun 11 13:03:39.496697 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:39.496653 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znmjk" podStartSLOduration=1.496640244 podStartE2EDuration="1.496640244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:03:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:03:39.494003681 +0000 UTC m=+619.140525623" watchObservedRunningTime="2026-06-11 13:03:39.496640244 +0000 UTC m=+619.143162421" Jun 11 13:03:40.825287 ip-10-0-137-120 kubenswrapper[2558]: E0611 13:03:40.825253 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-lc6sg\" is forbidden: User \"system:node:ip-10-0-137-120.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-120.ec2.internal' and this object" podUID="ee8c3f61-e864-46a8-92fd-de260b442204" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-lc6sg" Jun 11 13:03:41.975858 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:41.975821 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:03:42.077210 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:42.077176 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:03:45.771779 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:45.771746 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:03:45.872644 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:45.872608 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:03:50.481968 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:50.481933 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znmjk" Jun 11 13:03:52.212309 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:52.212277 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:03:52.308101 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:52.308068 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:03:55.553238 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:55.553206 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:03:55.637419 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:55.637386 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:03:57.710732 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:57.710704 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:03:57.779794 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:57.779764 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:03:58.767733 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:58.767620 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:03:58.869610 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:58.869560 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:03:58.934255 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:03:58.934220 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:04:01.786548 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:01.786517 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:04:01.904670 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:01.904629 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:04:05.976480 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:05.976448 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:04:06.074582 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:06.074551 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:04:10.581757 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:10.581719 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znmjk"] Jun 11 13:04:10.582248 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:10.581947 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znmjk" podUID="bfcd505d-4b9c-42d5-b722-54f90630a926" containerName="manager" containerID="cri-o://3c7b82e9b50e8b5865f671cb18853249a996b3e4d37314b84114a71af749820f" gracePeriod=10 Jun 11 13:04:10.784074 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:10.784021 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4s9h"] Jun 11 13:04:10.786741 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:10.786719 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4s9h" Jun 11 13:04:10.803356 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:10.803332 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4s9h"] Jun 11 13:04:10.845540 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:10.845517 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znmjk" Jun 11 13:04:10.961505 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:10.961474 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctd6k\" (UniqueName: \"kubernetes.io/projected/bfcd505d-4b9c-42d5-b722-54f90630a926-kube-api-access-ctd6k\") pod \"bfcd505d-4b9c-42d5-b722-54f90630a926\" (UID: \"bfcd505d-4b9c-42d5-b722-54f90630a926\") " Jun 11 13:04:10.961705 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:10.961531 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bfcd505d-4b9c-42d5-b722-54f90630a926-extensions-socket-volume\") pod \"bfcd505d-4b9c-42d5-b722-54f90630a926\" (UID: \"bfcd505d-4b9c-42d5-b722-54f90630a926\") " Jun 11 13:04:10.961705 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:10.961660 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b036f74-c880-4c52-be66-9b0a49a7c318-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-s4s9h\" (UID: \"7b036f74-c880-4c52-be66-9b0a49a7c318\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4s9h" Jun 11 13:04:10.961834 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:10.961710 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmh7z\" (UniqueName: \"kubernetes.io/projected/7b036f74-c880-4c52-be66-9b0a49a7c318-kube-api-access-kmh7z\") pod \"kuadrant-operator-controller-manager-86878c769f-s4s9h\" (UID: \"7b036f74-c880-4c52-be66-9b0a49a7c318\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4s9h" Jun 11 13:04:10.961940 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:10.961912 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfcd505d-4b9c-42d5-b722-54f90630a926-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bfcd505d-4b9c-42d5-b722-54f90630a926" (UID: "bfcd505d-4b9c-42d5-b722-54f90630a926"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:04:10.963952 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:10.963919 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfcd505d-4b9c-42d5-b722-54f90630a926-kube-api-access-ctd6k" (OuterVolumeSpecName: "kube-api-access-ctd6k") pod "bfcd505d-4b9c-42d5-b722-54f90630a926" (UID: "bfcd505d-4b9c-42d5-b722-54f90630a926"). InnerVolumeSpecName "kube-api-access-ctd6k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:04:11.063277 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:11.063232 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b036f74-c880-4c52-be66-9b0a49a7c318-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-s4s9h\" (UID: \"7b036f74-c880-4c52-be66-9b0a49a7c318\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4s9h" Jun 11 13:04:11.063277 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:11.063287 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmh7z\" (UniqueName: \"kubernetes.io/projected/7b036f74-c880-4c52-be66-9b0a49a7c318-kube-api-access-kmh7z\") pod \"kuadrant-operator-controller-manager-86878c769f-s4s9h\" (UID: \"7b036f74-c880-4c52-be66-9b0a49a7c318\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4s9h" Jun 11 13:04:11.063505 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:11.063378 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctd6k\" (UniqueName: \"kubernetes.io/projected/bfcd505d-4b9c-42d5-b722-54f90630a926-kube-api-access-ctd6k\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:04:11.063505 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:11.063396 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bfcd505d-4b9c-42d5-b722-54f90630a926-extensions-socket-volume\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:04:11.063663 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:11.063644 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b036f74-c880-4c52-be66-9b0a49a7c318-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-s4s9h\" (UID: \"7b036f74-c880-4c52-be66-9b0a49a7c318\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4s9h" Jun 11 13:04:11.071286 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:11.071254 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmh7z\" (UniqueName: \"kubernetes.io/projected/7b036f74-c880-4c52-be66-9b0a49a7c318-kube-api-access-kmh7z\") pod \"kuadrant-operator-controller-manager-86878c769f-s4s9h\" (UID: \"7b036f74-c880-4c52-be66-9b0a49a7c318\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4s9h" Jun 11 13:04:11.098181 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:11.098071 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4s9h" Jun 11 13:04:11.240199 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:11.240148 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4s9h"] Jun 11 13:04:11.243866 ip-10-0-137-120 kubenswrapper[2558]: W0611 13:04:11.243831 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b036f74_c880_4c52_be66_9b0a49a7c318.slice/crio-272c5724814cebfa5d5a29086c1bb6772898fad95df77e46729efc3be22cf035 WatchSource:0}: Error finding container 272c5724814cebfa5d5a29086c1bb6772898fad95df77e46729efc3be22cf035: Status 404 returned error can't find the container with id 272c5724814cebfa5d5a29086c1bb6772898fad95df77e46729efc3be22cf035 Jun 11 13:04:11.656171 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:11.656126 2558 generic.go:356] "Generic (PLEG): container finished" podID="bfcd505d-4b9c-42d5-b722-54f90630a926" containerID="3c7b82e9b50e8b5865f671cb18853249a996b3e4d37314b84114a71af749820f" exitCode=0 Jun 11 13:04:11.656579 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:11.656186 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znmjk" Jun 11 13:04:11.656579 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:11.656212 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znmjk" event={"ID":"bfcd505d-4b9c-42d5-b722-54f90630a926","Type":"ContainerDied","Data":"3c7b82e9b50e8b5865f671cb18853249a996b3e4d37314b84114a71af749820f"} Jun 11 13:04:11.656579 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:11.656262 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znmjk" event={"ID":"bfcd505d-4b9c-42d5-b722-54f90630a926","Type":"ContainerDied","Data":"67d7372af30e699499aeddc1ea3142655d53c589c46f885a75799e2465693adc"} Jun 11 13:04:11.656579 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:11.656293 2558 scope.go:117] "RemoveContainer" containerID="3c7b82e9b50e8b5865f671cb18853249a996b3e4d37314b84114a71af749820f" Jun 11 13:04:11.657986 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:11.657960 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4s9h" event={"ID":"7b036f74-c880-4c52-be66-9b0a49a7c318","Type":"ContainerStarted","Data":"bfc722b00eb361d2056a1aad3830e199cec3a0ae03dcae8c280536d9ff0e55cd"} Jun 11 13:04:11.658087 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:11.658009 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4s9h" Jun 11 13:04:11.658087 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:11.658029 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4s9h" event={"ID":"7b036f74-c880-4c52-be66-9b0a49a7c318","Type":"ContainerStarted","Data":"272c5724814cebfa5d5a29086c1bb6772898fad95df77e46729efc3be22cf035"} Jun 11 13:04:11.665572 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:11.665557 2558 scope.go:117] "RemoveContainer" containerID="3c7b82e9b50e8b5865f671cb18853249a996b3e4d37314b84114a71af749820f" Jun 11 13:04:11.665846 ip-10-0-137-120 kubenswrapper[2558]: E0611 13:04:11.665827 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c7b82e9b50e8b5865f671cb18853249a996b3e4d37314b84114a71af749820f\": container with ID starting with 3c7b82e9b50e8b5865f671cb18853249a996b3e4d37314b84114a71af749820f not found: ID does not exist" containerID="3c7b82e9b50e8b5865f671cb18853249a996b3e4d37314b84114a71af749820f" Jun 11 13:04:11.665916 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:11.665853 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c7b82e9b50e8b5865f671cb18853249a996b3e4d37314b84114a71af749820f"} err="failed to get container status \"3c7b82e9b50e8b5865f671cb18853249a996b3e4d37314b84114a71af749820f\": rpc error: code = NotFound desc = could not find container \"3c7b82e9b50e8b5865f671cb18853249a996b3e4d37314b84114a71af749820f\": container with ID starting with 3c7b82e9b50e8b5865f671cb18853249a996b3e4d37314b84114a71af749820f not found: ID does not exist" Jun 11 13:04:11.686244 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:11.686198 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znmjk"] Jun 11 13:04:11.698345 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:11.693849 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znmjk"] Jun 11 13:04:11.719215 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:11.719142 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4s9h" podStartSLOduration=1.719125547 podStartE2EDuration="1.719125547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:04:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:04:11.715988977 +0000 UTC m=+651.362510935" watchObservedRunningTime="2026-06-11 13:04:11.719125547 +0000 UTC m=+651.365647489" Jun 11 13:04:12.824923 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:12.824879 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfcd505d-4b9c-42d5-b722-54f90630a926" path="/var/lib/kubelet/pods/bfcd505d-4b9c-42d5-b722-54f90630a926/volumes" Jun 11 13:04:13.172883 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:13.172849 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:04:13.278903 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:13.278871 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:04:19.179904 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:19.179867 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:04:19.280429 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:19.280393 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:04:19.376096 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:19.376060 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:04:22.172439 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:22.172402 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:04:22.272792 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:22.272757 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:04:22.670287 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:22.670252 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4s9h" Jun 11 13:04:22.733140 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:22.733107 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:04:22.830305 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:22.830277 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:04:26.909943 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:26.909909 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:04:27.365409 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:27.365377 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:04:30.156562 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:30.156527 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:04:30.161204 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:30.161175 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pxtl7"] Jun 11 13:04:30.161556 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:30.161543 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfcd505d-4b9c-42d5-b722-54f90630a926" containerName="manager" Jun 11 13:04:30.161600 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:30.161558 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfcd505d-4b9c-42d5-b722-54f90630a926" containerName="manager" Jun 11 13:04:30.161643 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:30.161634 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfcd505d-4b9c-42d5-b722-54f90630a926" containerName="manager" Jun 11 13:04:30.165000 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:30.164984 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-pxtl7" Jun 11 13:04:30.167411 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:30.167389 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 13:04:30.167672 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:30.167640 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-t6b8c\"" Jun 11 13:04:30.172424 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:30.172402 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pxtl7"] Jun 11 13:04:30.220972 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:30.220940 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b20ceb4a-72ce-46db-baf2-ffab61c260fc-config-file\") pod \"limitador-limitador-64c94fd64f-pxtl7\" (UID: \"b20ceb4a-72ce-46db-baf2-ffab61c260fc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-pxtl7" Jun 11 13:04:30.220972 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:30.220977 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8gqj\" (UniqueName: \"kubernetes.io/projected/b20ceb4a-72ce-46db-baf2-ffab61c260fc-kube-api-access-s8gqj\") pod \"limitador-limitador-64c94fd64f-pxtl7\" (UID: \"b20ceb4a-72ce-46db-baf2-ffab61c260fc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-pxtl7" Jun 11 13:04:30.256211 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:30.256148 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:04:30.258033 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:30.258007 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pxtl7"] Jun 11 13:04:30.321798 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:30.321762 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8gqj\" (UniqueName: \"kubernetes.io/projected/b20ceb4a-72ce-46db-baf2-ffab61c260fc-kube-api-access-s8gqj\") pod \"limitador-limitador-64c94fd64f-pxtl7\" (UID: \"b20ceb4a-72ce-46db-baf2-ffab61c260fc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-pxtl7" Jun 11 13:04:30.321968 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:30.321859 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b20ceb4a-72ce-46db-baf2-ffab61c260fc-config-file\") pod \"limitador-limitador-64c94fd64f-pxtl7\" (UID: \"b20ceb4a-72ce-46db-baf2-ffab61c260fc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-pxtl7" Jun 11 13:04:30.322473 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:30.322454 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b20ceb4a-72ce-46db-baf2-ffab61c260fc-config-file\") pod \"limitador-limitador-64c94fd64f-pxtl7\" (UID: \"b20ceb4a-72ce-46db-baf2-ffab61c260fc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-pxtl7" Jun 11 13:04:30.330989 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:30.330961 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8gqj\" (UniqueName: \"kubernetes.io/projected/b20ceb4a-72ce-46db-baf2-ffab61c260fc-kube-api-access-s8gqj\") pod \"limitador-limitador-64c94fd64f-pxtl7\" (UID: \"b20ceb4a-72ce-46db-baf2-ffab61c260fc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-pxtl7" Jun 11 13:04:30.354634 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:30.354607 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:04:30.477108 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:30.477027 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-pxtl7" Jun 11 13:04:30.615282 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:30.615255 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pxtl7"] Jun 11 13:04:30.618038 ip-10-0-137-120 kubenswrapper[2558]: W0611 13:04:30.618014 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb20ceb4a_72ce_46db_baf2_ffab61c260fc.slice/crio-a2f8370ccf211680f11cc49d34db2f9e97cd58718a163e2cfe609a46f80a38e3 WatchSource:0}: Error finding container a2f8370ccf211680f11cc49d34db2f9e97cd58718a163e2cfe609a46f80a38e3: Status 404 returned error can't find the container with id a2f8370ccf211680f11cc49d34db2f9e97cd58718a163e2cfe609a46f80a38e3 Jun 11 13:04:30.766092 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:30.766002 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-pxtl7" event={"ID":"b20ceb4a-72ce-46db-baf2-ffab61c260fc","Type":"ContainerStarted","Data":"a2f8370ccf211680f11cc49d34db2f9e97cd58718a163e2cfe609a46f80a38e3"} Jun 11 13:04:30.985860 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:30.985826 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:04:31.085876 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:31.085789 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:04:33.790696 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:33.790664 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-pxtl7" event={"ID":"b20ceb4a-72ce-46db-baf2-ffab61c260fc","Type":"ContainerStarted","Data":"a0d70028a648db7b935fac8fdb4dbef29a550499cc077345f1547171f59dc69d"} Jun 11 13:04:33.791190 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:33.790793 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-pxtl7" Jun 11 13:04:33.811069 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:33.811014 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-pxtl7" podStartSLOduration=0.834318787 podStartE2EDuration="3.810999929s" totalImagesPullingTime="2.976681142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:04:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:04:33.810419492 +0000 UTC m=+673.456941447" watchObservedRunningTime="2026-06-11 13:04:33.810999929 +0000 UTC m=+673.457521870" Jun 11 13:04:44.796774 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:44.796744 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-pxtl7" Jun 11 13:04:47.141239 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:47.141194 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pxtl7"] Jun 11 13:04:47.141720 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:47.141451 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-pxtl7" podUID="b20ceb4a-72ce-46db-baf2-ffab61c260fc" containerName="limitador" containerID="cri-o://a0d70028a648db7b935fac8fdb4dbef29a550499cc077345f1547171f59dc69d" gracePeriod=30 Jun 11 13:04:47.696211 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:47.696123 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-pxtl7" Jun 11 13:04:47.785459 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:47.785423 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8gqj\" (UniqueName: \"kubernetes.io/projected/b20ceb4a-72ce-46db-baf2-ffab61c260fc-kube-api-access-s8gqj\") pod \"b20ceb4a-72ce-46db-baf2-ffab61c260fc\" (UID: \"b20ceb4a-72ce-46db-baf2-ffab61c260fc\") " Jun 11 13:04:47.785655 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:47.785520 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b20ceb4a-72ce-46db-baf2-ffab61c260fc-config-file\") pod \"b20ceb4a-72ce-46db-baf2-ffab61c260fc\" (UID: \"b20ceb4a-72ce-46db-baf2-ffab61c260fc\") " Jun 11 13:04:47.785921 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:47.785896 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b20ceb4a-72ce-46db-baf2-ffab61c260fc-config-file" (OuterVolumeSpecName: "config-file") pod "b20ceb4a-72ce-46db-baf2-ffab61c260fc" (UID: "b20ceb4a-72ce-46db-baf2-ffab61c260fc"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 13:04:47.787648 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:47.787624 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b20ceb4a-72ce-46db-baf2-ffab61c260fc-kube-api-access-s8gqj" (OuterVolumeSpecName: "kube-api-access-s8gqj") pod "b20ceb4a-72ce-46db-baf2-ffab61c260fc" (UID: "b20ceb4a-72ce-46db-baf2-ffab61c260fc"). InnerVolumeSpecName "kube-api-access-s8gqj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:04:47.867016 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:47.866984 2558 generic.go:356] "Generic (PLEG): container finished" podID="b20ceb4a-72ce-46db-baf2-ffab61c260fc" containerID="a0d70028a648db7b935fac8fdb4dbef29a550499cc077345f1547171f59dc69d" exitCode=0 Jun 11 13:04:47.867186 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:47.867029 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-pxtl7" Jun 11 13:04:47.867186 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:47.867077 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-pxtl7" event={"ID":"b20ceb4a-72ce-46db-baf2-ffab61c260fc","Type":"ContainerDied","Data":"a0d70028a648db7b935fac8fdb4dbef29a550499cc077345f1547171f59dc69d"} Jun 11 13:04:47.867186 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:47.867130 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-pxtl7" event={"ID":"b20ceb4a-72ce-46db-baf2-ffab61c260fc","Type":"ContainerDied","Data":"a2f8370ccf211680f11cc49d34db2f9e97cd58718a163e2cfe609a46f80a38e3"} Jun 11 13:04:47.867186 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:47.867175 2558 scope.go:117] "RemoveContainer" containerID="a0d70028a648db7b935fac8fdb4dbef29a550499cc077345f1547171f59dc69d" Jun 11 13:04:47.875932 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:47.875915 2558 scope.go:117] "RemoveContainer" containerID="a0d70028a648db7b935fac8fdb4dbef29a550499cc077345f1547171f59dc69d" Jun 11 13:04:47.876224 ip-10-0-137-120 kubenswrapper[2558]: E0611 13:04:47.876205 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0d70028a648db7b935fac8fdb4dbef29a550499cc077345f1547171f59dc69d\": container with ID starting with a0d70028a648db7b935fac8fdb4dbef29a550499cc077345f1547171f59dc69d not found: ID does not exist" containerID="a0d70028a648db7b935fac8fdb4dbef29a550499cc077345f1547171f59dc69d" Jun 11 13:04:47.876282 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:47.876232 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0d70028a648db7b935fac8fdb4dbef29a550499cc077345f1547171f59dc69d"} err="failed to get container status \"a0d70028a648db7b935fac8fdb4dbef29a550499cc077345f1547171f59dc69d\": rpc error: code = NotFound desc = could not find container \"a0d70028a648db7b935fac8fdb4dbef29a550499cc077345f1547171f59dc69d\": container with ID starting with a0d70028a648db7b935fac8fdb4dbef29a550499cc077345f1547171f59dc69d not found: ID does not exist" Jun 11 13:04:47.886678 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:47.886484 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8gqj\" (UniqueName: \"kubernetes.io/projected/b20ceb4a-72ce-46db-baf2-ffab61c260fc-kube-api-access-s8gqj\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:04:47.886678 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:47.886506 2558 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b20ceb4a-72ce-46db-baf2-ffab61c260fc-config-file\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:04:47.889444 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:47.889423 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pxtl7"] Jun 11 13:04:47.893395 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:47.893371 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pxtl7"] Jun 11 13:04:48.824956 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:48.824917 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b20ceb4a-72ce-46db-baf2-ffab61c260fc" path="/var/lib/kubelet/pods/b20ceb4a-72ce-46db-baf2-ffab61c260fc/volumes" Jun 11 13:04:49.815486 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:49.815192 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-5f972"] Jun 11 13:04:49.815728 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:49.815705 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b20ceb4a-72ce-46db-baf2-ffab61c260fc" containerName="limitador" Jun 11 13:04:49.815728 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:49.815725 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b20ceb4a-72ce-46db-baf2-ffab61c260fc" containerName="limitador" Jun 11 13:04:49.815860 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:49.815844 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b20ceb4a-72ce-46db-baf2-ffab61c260fc" containerName="limitador" Jun 11 13:04:49.819295 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:49.819272 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-5f972" Jun 11 13:04:49.822018 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:49.821995 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 11 13:04:49.826606 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:49.826580 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-5f972"] Jun 11 13:04:49.846137 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:49.846110 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:04:49.905722 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:49.905686 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a9387b28-80dd-47a8-9955-d119556806cc-data\") pod \"postgres-69fb4594cf-5f972\" (UID: \"a9387b28-80dd-47a8-9955-d119556806cc\") " pod="opendatahub/postgres-69fb4594cf-5f972" Jun 11 13:04:49.905899 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:49.905786 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r56qs\" (UniqueName: \"kubernetes.io/projected/a9387b28-80dd-47a8-9955-d119556806cc-kube-api-access-r56qs\") pod \"postgres-69fb4594cf-5f972\" (UID: \"a9387b28-80dd-47a8-9955-d119556806cc\") " pod="opendatahub/postgres-69fb4594cf-5f972" Jun 11 13:04:50.006638 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:50.006601 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r56qs\" (UniqueName: \"kubernetes.io/projected/a9387b28-80dd-47a8-9955-d119556806cc-kube-api-access-r56qs\") pod \"postgres-69fb4594cf-5f972\" (UID: \"a9387b28-80dd-47a8-9955-d119556806cc\") " pod="opendatahub/postgres-69fb4594cf-5f972" Jun 11 13:04:50.006827 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:50.006690 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a9387b28-80dd-47a8-9955-d119556806cc-data\") pod \"postgres-69fb4594cf-5f972\" (UID: \"a9387b28-80dd-47a8-9955-d119556806cc\") " pod="opendatahub/postgres-69fb4594cf-5f972" Jun 11 13:04:50.007106 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:50.007087 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a9387b28-80dd-47a8-9955-d119556806cc-data\") pod \"postgres-69fb4594cf-5f972\" (UID: \"a9387b28-80dd-47a8-9955-d119556806cc\") " pod="opendatahub/postgres-69fb4594cf-5f972" Jun 11 13:04:50.015422 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:50.015390 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r56qs\" (UniqueName: \"kubernetes.io/projected/a9387b28-80dd-47a8-9955-d119556806cc-kube-api-access-r56qs\") pod \"postgres-69fb4594cf-5f972\" (UID: \"a9387b28-80dd-47a8-9955-d119556806cc\") " pod="opendatahub/postgres-69fb4594cf-5f972" Jun 11 13:04:50.132067 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:50.132036 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-5f972" Jun 11 13:04:50.270367 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:50.270325 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-5f972"] Jun 11 13:04:50.275471 ip-10-0-137-120 kubenswrapper[2558]: W0611 13:04:50.275428 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9387b28_80dd_47a8_9955_d119556806cc.slice/crio-8314310f3ffd7d4cf9d4df968cf980c1763449807bfafa552e1ede62718e6cf3 WatchSource:0}: Error finding container 8314310f3ffd7d4cf9d4df968cf980c1763449807bfafa552e1ede62718e6cf3: Status 404 returned error can't find the container with id 8314310f3ffd7d4cf9d4df968cf980c1763449807bfafa552e1ede62718e6cf3 Jun 11 13:04:50.884319 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:50.884282 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-5f972" event={"ID":"a9387b28-80dd-47a8-9955-d119556806cc","Type":"ContainerStarted","Data":"8314310f3ffd7d4cf9d4df968cf980c1763449807bfafa552e1ede62718e6cf3"} Jun 11 13:04:53.901748 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:53.901713 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-5f972" event={"ID":"a9387b28-80dd-47a8-9955-d119556806cc","Type":"ContainerStarted","Data":"77759a6fbf2a99d3cebf1ef67d3b193545cb16613c52c5b22bbf78fedfec07ec"} Jun 11 13:04:53.902140 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:53.901856 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-5f972" Jun 11 13:04:53.919839 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:53.919777 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-5f972" podStartSLOduration=2.33893347 podStartE2EDuration="4.91976068s" totalImagesPullingTime="2.58082721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:04:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:04:53.917700153 +0000 UTC m=+693.564222095" watchObservedRunningTime="2026-06-11 13:04:53.91976068 +0000 UTC m=+693.566282643" Jun 11 13:04:59.937170 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:04:59.937128 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-5f972" Jun 11 13:05:00.263974 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:00.263888 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:05:00.363374 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:00.363346 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:05:00.502557 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:00.502400 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:05:01.554754 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:01.554709 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z989f"] Jun 11 13:05:01.561904 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:01.561863 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z989f" Jun 11 13:05:01.564912 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:01.564886 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 13:05:01.565062 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:01.565040 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z989f"] Jun 11 13:05:01.565857 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:01.565835 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r44s6\"" Jun 11 13:05:01.565857 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:01.565867 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 13:05:01.715866 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:01.715820 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78897906-a65c-4f25-a0aa-86ca98bf1d85-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z989f\" (UID: \"78897906-a65c-4f25-a0aa-86ca98bf1d85\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z989f" Jun 11 13:05:01.716036 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:01.715964 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78897906-a65c-4f25-a0aa-86ca98bf1d85-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z989f\" (UID: \"78897906-a65c-4f25-a0aa-86ca98bf1d85\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z989f" Jun 11 13:05:01.716036 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:01.716021 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkmh9\" (UniqueName: \"kubernetes.io/projected/78897906-a65c-4f25-a0aa-86ca98bf1d85-kube-api-access-pkmh9\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z989f\" (UID: \"78897906-a65c-4f25-a0aa-86ca98bf1d85\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z989f" Jun 11 13:05:01.816555 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:01.816457 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78897906-a65c-4f25-a0aa-86ca98bf1d85-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z989f\" (UID: \"78897906-a65c-4f25-a0aa-86ca98bf1d85\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z989f" Jun 11 13:05:01.816555 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:01.816507 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkmh9\" (UniqueName: \"kubernetes.io/projected/78897906-a65c-4f25-a0aa-86ca98bf1d85-kube-api-access-pkmh9\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z989f\" (UID: \"78897906-a65c-4f25-a0aa-86ca98bf1d85\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z989f" Jun 11 13:05:01.816749 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:01.816632 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78897906-a65c-4f25-a0aa-86ca98bf1d85-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z989f\" (UID: \"78897906-a65c-4f25-a0aa-86ca98bf1d85\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z989f" Jun 11 13:05:01.816912 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:01.816895 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78897906-a65c-4f25-a0aa-86ca98bf1d85-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z989f\" (UID: \"78897906-a65c-4f25-a0aa-86ca98bf1d85\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z989f" Jun 11 13:05:01.816953 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:01.816922 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78897906-a65c-4f25-a0aa-86ca98bf1d85-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z989f\" (UID: \"78897906-a65c-4f25-a0aa-86ca98bf1d85\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z989f" Jun 11 13:05:01.826420 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:01.826389 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkmh9\" (UniqueName: \"kubernetes.io/projected/78897906-a65c-4f25-a0aa-86ca98bf1d85-kube-api-access-pkmh9\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z989f\" (UID: \"78897906-a65c-4f25-a0aa-86ca98bf1d85\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z989f" Jun 11 13:05:01.872324 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:01.872248 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z989f" Jun 11 13:05:02.009267 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:02.009242 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z989f"] Jun 11 13:05:02.011113 ip-10-0-137-120 kubenswrapper[2558]: W0611 13:05:02.011085 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78897906_a65c_4f25_a0aa_86ca98bf1d85.slice/crio-b87353569f0d2f51cf3378595c07ab28b36a23db9a0080a30207d2408acbaaf0 WatchSource:0}: Error finding container b87353569f0d2f51cf3378595c07ab28b36a23db9a0080a30207d2408acbaaf0: Status 404 returned error can't find the container with id b87353569f0d2f51cf3378595c07ab28b36a23db9a0080a30207d2408acbaaf0 Jun 11 13:05:02.952311 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:02.952273 2558 generic.go:356] "Generic (PLEG): container finished" podID="78897906-a65c-4f25-a0aa-86ca98bf1d85" containerID="f9341dbd24555e7f814b6c9eda6c0dbf2dde0fa6e32f2ba695d6d879ab186cd2" exitCode=0 Jun 11 13:05:02.952673 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:02.952360 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z989f" event={"ID":"78897906-a65c-4f25-a0aa-86ca98bf1d85","Type":"ContainerDied","Data":"f9341dbd24555e7f814b6c9eda6c0dbf2dde0fa6e32f2ba695d6d879ab186cd2"} Jun 11 13:05:02.952673 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:02.952418 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z989f" event={"ID":"78897906-a65c-4f25-a0aa-86ca98bf1d85","Type":"ContainerStarted","Data":"b87353569f0d2f51cf3378595c07ab28b36a23db9a0080a30207d2408acbaaf0"} Jun 11 13:05:03.959416 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:03.959383 2558 generic.go:356] "Generic (PLEG): container finished" podID="78897906-a65c-4f25-a0aa-86ca98bf1d85" containerID="f50db94e94ce311506170bd8005c48f450cf399707991e92696202b517271ca2" exitCode=0 Jun 11 13:05:03.959798 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:03.959468 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z989f" event={"ID":"78897906-a65c-4f25-a0aa-86ca98bf1d85","Type":"ContainerDied","Data":"f50db94e94ce311506170bd8005c48f450cf399707991e92696202b517271ca2"} Jun 11 13:05:04.967172 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:04.967129 2558 generic.go:356] "Generic (PLEG): container finished" podID="78897906-a65c-4f25-a0aa-86ca98bf1d85" containerID="ddcecae9841f77813958f02ad755950c80bfb6f0fea2df8992fdcef92eccaba2" exitCode=0 Jun 11 13:05:04.967537 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:04.967185 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z989f" event={"ID":"78897906-a65c-4f25-a0aa-86ca98bf1d85","Type":"ContainerDied","Data":"ddcecae9841f77813958f02ad755950c80bfb6f0fea2df8992fdcef92eccaba2"} Jun 11 13:05:06.104334 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:06.104309 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z989f" Jun 11 13:05:06.152414 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:06.152370 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78897906-a65c-4f25-a0aa-86ca98bf1d85-bundle\") pod \"78897906-a65c-4f25-a0aa-86ca98bf1d85\" (UID: \"78897906-a65c-4f25-a0aa-86ca98bf1d85\") " Jun 11 13:05:06.152414 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:06.152414 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78897906-a65c-4f25-a0aa-86ca98bf1d85-util\") pod \"78897906-a65c-4f25-a0aa-86ca98bf1d85\" (UID: \"78897906-a65c-4f25-a0aa-86ca98bf1d85\") " Jun 11 13:05:06.152659 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:06.152444 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkmh9\" (UniqueName: \"kubernetes.io/projected/78897906-a65c-4f25-a0aa-86ca98bf1d85-kube-api-access-pkmh9\") pod \"78897906-a65c-4f25-a0aa-86ca98bf1d85\" (UID: \"78897906-a65c-4f25-a0aa-86ca98bf1d85\") " Jun 11 13:05:06.152942 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:06.152917 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78897906-a65c-4f25-a0aa-86ca98bf1d85-bundle" (OuterVolumeSpecName: "bundle") pod "78897906-a65c-4f25-a0aa-86ca98bf1d85" (UID: "78897906-a65c-4f25-a0aa-86ca98bf1d85"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:05:06.154610 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:06.154584 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78897906-a65c-4f25-a0aa-86ca98bf1d85-kube-api-access-pkmh9" (OuterVolumeSpecName: "kube-api-access-pkmh9") pod "78897906-a65c-4f25-a0aa-86ca98bf1d85" (UID: "78897906-a65c-4f25-a0aa-86ca98bf1d85"). InnerVolumeSpecName "kube-api-access-pkmh9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 13:05:06.159663 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:06.159637 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78897906-a65c-4f25-a0aa-86ca98bf1d85-util" (OuterVolumeSpecName: "util") pod "78897906-a65c-4f25-a0aa-86ca98bf1d85" (UID: "78897906-a65c-4f25-a0aa-86ca98bf1d85"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 13:05:06.253148 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:06.253061 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78897906-a65c-4f25-a0aa-86ca98bf1d85-bundle\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:05:06.253148 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:06.253089 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78897906-a65c-4f25-a0aa-86ca98bf1d85-util\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:05:06.253148 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:06.253101 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkmh9\" (UniqueName: \"kubernetes.io/projected/78897906-a65c-4f25-a0aa-86ca98bf1d85-kube-api-access-pkmh9\") on node \"ip-10-0-137-120.ec2.internal\" DevicePath \"\"" Jun 11 13:05:06.979587 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:06.979560 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z989f" Jun 11 13:05:06.979751 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:06.979554 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748z989f" event={"ID":"78897906-a65c-4f25-a0aa-86ca98bf1d85","Type":"ContainerDied","Data":"b87353569f0d2f51cf3378595c07ab28b36a23db9a0080a30207d2408acbaaf0"} Jun 11 13:05:06.979751 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:06.979687 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b87353569f0d2f51cf3378595c07ab28b36a23db9a0080a30207d2408acbaaf0" Jun 11 13:05:09.276242 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:09.276204 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-xpd6q"] Jun 11 13:05:09.276611 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:09.276591 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78897906-a65c-4f25-a0aa-86ca98bf1d85" containerName="util" Jun 11 13:05:09.276611 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:09.276603 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="78897906-a65c-4f25-a0aa-86ca98bf1d85" containerName="util" Jun 11 13:05:09.276611 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:09.276612 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78897906-a65c-4f25-a0aa-86ca98bf1d85" containerName="extract" Jun 11 13:05:09.276715 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:09.276618 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="78897906-a65c-4f25-a0aa-86ca98bf1d85" containerName="extract" Jun 11 13:05:09.276715 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:09.276635 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78897906-a65c-4f25-a0aa-86ca98bf1d85" containerName="pull" Jun 11 13:05:09.276715 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:09.276644 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="78897906-a65c-4f25-a0aa-86ca98bf1d85" containerName="pull" Jun 11 13:05:09.276715 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:09.276701 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="78897906-a65c-4f25-a0aa-86ca98bf1d85" containerName="extract" Jun 11 13:05:09.279202 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:09.279184 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-xpd6q" Jun 11 13:05:09.283002 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:09.282979 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-lxl5q\"" Jun 11 13:05:09.284669 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:09.284649 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 13:05:09.284945 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:09.284928 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 13:05:09.291411 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:09.291387 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-xpd6q"] Jun 11 13:05:09.381136 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:09.381104 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntmt2\" (UniqueName: \"kubernetes.io/projected/11e21cec-b7c4-42db-bd3d-fabeb4ec7e08-kube-api-access-ntmt2\") pod \"keycloak-operator-d67dbbb48-xpd6q\" (UID: \"11e21cec-b7c4-42db-bd3d-fabeb4ec7e08\") " pod="keycloak-system/keycloak-operator-d67dbbb48-xpd6q" Jun 11 13:05:09.481989 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:09.481955 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntmt2\" (UniqueName: \"kubernetes.io/projected/11e21cec-b7c4-42db-bd3d-fabeb4ec7e08-kube-api-access-ntmt2\") pod \"keycloak-operator-d67dbbb48-xpd6q\" (UID: \"11e21cec-b7c4-42db-bd3d-fabeb4ec7e08\") " pod="keycloak-system/keycloak-operator-d67dbbb48-xpd6q" Jun 11 13:05:09.526233 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:09.526196 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntmt2\" (UniqueName: \"kubernetes.io/projected/11e21cec-b7c4-42db-bd3d-fabeb4ec7e08-kube-api-access-ntmt2\") pod \"keycloak-operator-d67dbbb48-xpd6q\" (UID: \"11e21cec-b7c4-42db-bd3d-fabeb4ec7e08\") " pod="keycloak-system/keycloak-operator-d67dbbb48-xpd6q" Jun 11 13:05:09.589803 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:09.589715 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-xpd6q" Jun 11 13:05:09.724228 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:09.724199 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-xpd6q"] Jun 11 13:05:09.725540 ip-10-0-137-120 kubenswrapper[2558]: W0611 13:05:09.725515 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11e21cec_b7c4_42db_bd3d_fabeb4ec7e08.slice/crio-3fdf143eb8c0588a9575ec10a2a5672a82b5c31871853a0a2b05f0cd21212ff6 WatchSource:0}: Error finding container 3fdf143eb8c0588a9575ec10a2a5672a82b5c31871853a0a2b05f0cd21212ff6: Status 404 returned error can't find the container with id 3fdf143eb8c0588a9575ec10a2a5672a82b5c31871853a0a2b05f0cd21212ff6 Jun 11 13:05:09.997872 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:09.997836 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-xpd6q" event={"ID":"11e21cec-b7c4-42db-bd3d-fabeb4ec7e08","Type":"ContainerStarted","Data":"3fdf143eb8c0588a9575ec10a2a5672a82b5c31871853a0a2b05f0cd21212ff6"} Jun 11 13:05:15.031367 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:15.031329 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-xpd6q" event={"ID":"11e21cec-b7c4-42db-bd3d-fabeb4ec7e08","Type":"ContainerStarted","Data":"260796a30584d0a50180d9b5b251da7d033be756b722dc82e1b38ccc36efed1e"} Jun 11 13:05:15.066838 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:15.066778 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-xpd6q" podStartSLOduration=1.2699408220000001 podStartE2EDuration="6.066760313s" totalImagesPullingTime="4.796819491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:05:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:05:15.065178192 +0000 UTC m=+714.711700135" watchObservedRunningTime="2026-06-11 13:05:15.066760313 +0000 UTC m=+714.713282254" Jun 11 13:05:23.510541 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:23.510512 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:05:23.616019 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:23.615985 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:05:53.073254 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:53.073223 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:05:53.292169 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:53.292122 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:05:58.146984 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:58.146910 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:05:58.319165 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:58.319130 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:05:58.440436 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:05:58.440358 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:06:01.639449 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:06:01.639414 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:06:01.781081 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:06:01.781047 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:06:33.328762 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:06:33.328681 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:06:33.596510 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:06:33.596477 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:06:33.779331 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:06:33.779293 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:06:33.968263 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:06:33.968184 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:07:13.951642 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:07:13.951608 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:07:14.051701 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:07:14.051668 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:08:20.861024 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:08:20.860996 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lb8tl_20c98c8b-f1fa-4066-8907-1ac8f01bacf5/console-operator/2.log" Jun 11 13:08:20.861509 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:08:20.861030 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lb8tl_20c98c8b-f1fa-4066-8907-1ac8f01bacf5/console-operator/2.log" Jun 11 13:09:27.231341 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:27.231308 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:09:28.331784 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:28.331704 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:09:36.373478 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:36.373395 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:09:40.879742 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:40.879688 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:09:45.513144 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:45.513107 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-jg5fq"] Jun 11 13:09:45.516055 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:45.516032 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jg5fq" Jun 11 13:09:45.520774 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:45.520755 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-248hb\"" Jun 11 13:09:45.520979 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:45.520966 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 13:09:45.521951 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:45.521933 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 11 13:09:45.522031 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:45.521982 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 13:09:45.536273 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:45.536240 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-jg5fq"] Jun 11 13:09:45.588490 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:45.588451 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/479160d7-009a-41cc-8fc8-80b08ff8e58b-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jg5fq\" (UID: \"479160d7-009a-41cc-8fc8-80b08ff8e58b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jg5fq" Jun 11 13:09:45.588683 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:45.588509 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/479160d7-009a-41cc-8fc8-80b08ff8e58b-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jg5fq\" (UID: \"479160d7-009a-41cc-8fc8-80b08ff8e58b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jg5fq" Jun 11 13:09:45.588683 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:45.588649 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/479160d7-009a-41cc-8fc8-80b08ff8e58b-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jg5fq\" (UID: \"479160d7-009a-41cc-8fc8-80b08ff8e58b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jg5fq" Jun 11 13:09:45.588808 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:45.588690 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/479160d7-009a-41cc-8fc8-80b08ff8e58b-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jg5fq\" (UID: \"479160d7-009a-41cc-8fc8-80b08ff8e58b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jg5fq" Jun 11 13:09:45.588808 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:45.588718 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9sd9\" (UniqueName: \"kubernetes.io/projected/479160d7-009a-41cc-8fc8-80b08ff8e58b-kube-api-access-t9sd9\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jg5fq\" (UID: \"479160d7-009a-41cc-8fc8-80b08ff8e58b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jg5fq" Jun 11 13:09:45.588808 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:45.588754 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/479160d7-009a-41cc-8fc8-80b08ff8e58b-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jg5fq\" (UID: \"479160d7-009a-41cc-8fc8-80b08ff8e58b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jg5fq" Jun 11 13:09:45.601432 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:45.601380 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:09:45.689809 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:45.689774 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/479160d7-009a-41cc-8fc8-80b08ff8e58b-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jg5fq\" (UID: \"479160d7-009a-41cc-8fc8-80b08ff8e58b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jg5fq" Jun 11 13:09:45.690047 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:45.689853 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/479160d7-009a-41cc-8fc8-80b08ff8e58b-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jg5fq\" (UID: \"479160d7-009a-41cc-8fc8-80b08ff8e58b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jg5fq" Jun 11 13:09:45.690047 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:45.689892 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/479160d7-009a-41cc-8fc8-80b08ff8e58b-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jg5fq\" (UID: \"479160d7-009a-41cc-8fc8-80b08ff8e58b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jg5fq" Jun 11 13:09:45.690047 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:45.689981 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/479160d7-009a-41cc-8fc8-80b08ff8e58b-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jg5fq\" (UID: \"479160d7-009a-41cc-8fc8-80b08ff8e58b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jg5fq" Jun 11 13:09:45.690047 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:45.690016 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/479160d7-009a-41cc-8fc8-80b08ff8e58b-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jg5fq\" (UID: \"479160d7-009a-41cc-8fc8-80b08ff8e58b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jg5fq" Jun 11 13:09:45.690047 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:45.690041 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9sd9\" (UniqueName: \"kubernetes.io/projected/479160d7-009a-41cc-8fc8-80b08ff8e58b-kube-api-access-t9sd9\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jg5fq\" (UID: \"479160d7-009a-41cc-8fc8-80b08ff8e58b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jg5fq" Jun 11 13:09:45.690392 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:45.690267 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/479160d7-009a-41cc-8fc8-80b08ff8e58b-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jg5fq\" (UID: \"479160d7-009a-41cc-8fc8-80b08ff8e58b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jg5fq" Jun 11 13:09:45.690481 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:45.690456 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/479160d7-009a-41cc-8fc8-80b08ff8e58b-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jg5fq\" (UID: \"479160d7-009a-41cc-8fc8-80b08ff8e58b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jg5fq" Jun 11 13:09:45.690542 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:45.690455 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/479160d7-009a-41cc-8fc8-80b08ff8e58b-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jg5fq\" (UID: \"479160d7-009a-41cc-8fc8-80b08ff8e58b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jg5fq" Jun 11 13:09:45.692210 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:45.692190 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/479160d7-009a-41cc-8fc8-80b08ff8e58b-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jg5fq\" (UID: \"479160d7-009a-41cc-8fc8-80b08ff8e58b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jg5fq" Jun 11 13:09:45.692509 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:45.692493 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/479160d7-009a-41cc-8fc8-80b08ff8e58b-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jg5fq\" (UID: \"479160d7-009a-41cc-8fc8-80b08ff8e58b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jg5fq" Jun 11 13:09:45.699242 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:45.699222 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9sd9\" (UniqueName: \"kubernetes.io/projected/479160d7-009a-41cc-8fc8-80b08ff8e58b-kube-api-access-t9sd9\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jg5fq\" (UID: \"479160d7-009a-41cc-8fc8-80b08ff8e58b\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jg5fq" Jun 11 13:09:45.826793 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:45.826693 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jg5fq" Jun 11 13:09:45.978060 ip-10-0-137-120 kubenswrapper[2558]: W0611 13:09:45.978030 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod479160d7_009a_41cc_8fc8_80b08ff8e58b.slice/crio-9aae2da248a33461103c1f73f0425a4966a8581df9ee6f422f2d89010d614742 WatchSource:0}: Error finding container 9aae2da248a33461103c1f73f0425a4966a8581df9ee6f422f2d89010d614742: Status 404 returned error can't find the container with id 9aae2da248a33461103c1f73f0425a4966a8581df9ee6f422f2d89010d614742 Jun 11 13:09:45.978204 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:45.978120 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-jg5fq"] Jun 11 13:09:45.980409 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:45.980390 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 13:09:46.545859 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:46.545819 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jg5fq" event={"ID":"479160d7-009a-41cc-8fc8-80b08ff8e58b","Type":"ContainerStarted","Data":"9aae2da248a33461103c1f73f0425a4966a8581df9ee6f422f2d89010d614742"} Jun 11 13:09:49.566212 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:49.566168 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jg5fq" event={"ID":"479160d7-009a-41cc-8fc8-80b08ff8e58b","Type":"ContainerStarted","Data":"178b872bc9ddf97f62db108d4e4216bf3cc03fd95875688c561e2c93549ded37"} Jun 11 13:09:50.573883 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:50.573844 2558 generic.go:356] "Generic (PLEG): container finished" podID="479160d7-009a-41cc-8fc8-80b08ff8e58b" containerID="178b872bc9ddf97f62db108d4e4216bf3cc03fd95875688c561e2c93549ded37" exitCode=0 Jun 11 13:09:50.574356 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:50.573928 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jg5fq" event={"ID":"479160d7-009a-41cc-8fc8-80b08ff8e58b","Type":"ContainerDied","Data":"178b872bc9ddf97f62db108d4e4216bf3cc03fd95875688c561e2c93549ded37"} Jun 11 13:09:56.116501 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:56.116468 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:09:56.610222 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:56.610181 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jg5fq" event={"ID":"479160d7-009a-41cc-8fc8-80b08ff8e58b","Type":"ContainerStarted","Data":"b2a73b1ac1a11a10659e2eff852d6d93439a8d61c340075f6540ff8f1e6f6967"} Jun 11 13:09:56.636562 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:56.636504 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jg5fq" podStartSLOduration=2.009491864 podStartE2EDuration="11.636489446s" totalImagesPullingTime="8.207301477s" totalInitContainerRuntime="1.419696105s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:09:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:09:56.633569597 +0000 UTC m=+996.280091539" watchObservedRunningTime="2026-06-11 13:09:56.636489446 +0000 UTC m=+996.283011387" Jun 11 13:09:58.844953 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:09:58.844894 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:10:05.826965 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:10:05.826925 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jg5fq" Jun 11 13:10:05.827421 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:10:05.827018 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jg5fq" Jun 11 13:10:05.839647 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:10:05.839619 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jg5fq" Jun 11 13:10:05.892665 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:10:05.892629 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:10:06.675388 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:10:06.675359 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jg5fq" Jun 11 13:10:07.655731 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:10:07.655685 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:10:24.244753 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:10:24.244715 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:10:29.625058 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:10:29.625023 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:10:42.677558 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:10:42.677519 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-r6s4p"] Jun 11 13:10:42.681733 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:10:42.681705 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r6s4p" Jun 11 13:10:42.684846 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:10:42.684602 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 11 13:10:42.688903 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:10:42.688878 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-r6s4p"] Jun 11 13:10:42.712352 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:10:42.712314 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:10:42.784206 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:10:42.784166 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b0ae0d04-c173-4eaf-afb9-114d50628c6a-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-r6s4p\" (UID: \"b0ae0d04-c173-4eaf-afb9-114d50628c6a\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r6s4p" Jun 11 13:10:42.784404 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:10:42.784218 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0ae0d04-c173-4eaf-afb9-114d50628c6a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-r6s4p\" (UID: \"b0ae0d04-c173-4eaf-afb9-114d50628c6a\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r6s4p" Jun 11 13:10:42.784404 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:10:42.784304 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjc5t\" (UniqueName: \"kubernetes.io/projected/b0ae0d04-c173-4eaf-afb9-114d50628c6a-kube-api-access-sjc5t\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-r6s4p\" (UID: \"b0ae0d04-c173-4eaf-afb9-114d50628c6a\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r6s4p" Jun 11 13:10:42.784404 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:10:42.784367 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0ae0d04-c173-4eaf-afb9-114d50628c6a-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-r6s4p\" (UID: \"b0ae0d04-c173-4eaf-afb9-114d50628c6a\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r6s4p" Jun 11 13:10:42.784564 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:10:42.784422 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0ae0d04-c173-4eaf-afb9-114d50628c6a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-r6s4p\" (UID: \"b0ae0d04-c173-4eaf-afb9-114d50628c6a\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r6s4p" Jun 11 13:10:42.784564 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:10:42.784510 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0ae0d04-c173-4eaf-afb9-114d50628c6a-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-r6s4p\" (UID: \"b0ae0d04-c173-4eaf-afb9-114d50628c6a\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r6s4p" Jun 11 13:10:42.885141 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:10:42.885109 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b0ae0d04-c173-4eaf-afb9-114d50628c6a-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-r6s4p\" (UID: \"b0ae0d04-c173-4eaf-afb9-114d50628c6a\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r6s4p" Jun 11 13:10:42.885358 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:10:42.885178 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0ae0d04-c173-4eaf-afb9-114d50628c6a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-r6s4p\" (UID: \"b0ae0d04-c173-4eaf-afb9-114d50628c6a\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r6s4p" Jun 11 13:10:42.885421 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:10:42.885347 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjc5t\" (UniqueName: \"kubernetes.io/projected/b0ae0d04-c173-4eaf-afb9-114d50628c6a-kube-api-access-sjc5t\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-r6s4p\" (UID: \"b0ae0d04-c173-4eaf-afb9-114d50628c6a\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r6s4p" Jun 11 13:10:42.885421 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:10:42.885393 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0ae0d04-c173-4eaf-afb9-114d50628c6a-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-r6s4p\" (UID: \"b0ae0d04-c173-4eaf-afb9-114d50628c6a\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r6s4p" Jun 11 13:10:42.885532 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:10:42.885436 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0ae0d04-c173-4eaf-afb9-114d50628c6a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-r6s4p\" (UID: \"b0ae0d04-c173-4eaf-afb9-114d50628c6a\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r6s4p" Jun 11 13:10:42.885532 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:10:42.885501 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0ae0d04-c173-4eaf-afb9-114d50628c6a-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-r6s4p\" (UID: \"b0ae0d04-c173-4eaf-afb9-114d50628c6a\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r6s4p" Jun 11 13:10:42.885649 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:10:42.885559 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b0ae0d04-c173-4eaf-afb9-114d50628c6a-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-r6s4p\" (UID: \"b0ae0d04-c173-4eaf-afb9-114d50628c6a\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r6s4p" Jun 11 13:10:42.885649 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:10:42.885612 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0ae0d04-c173-4eaf-afb9-114d50628c6a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-r6s4p\" (UID: \"b0ae0d04-c173-4eaf-afb9-114d50628c6a\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r6s4p" Jun 11 13:10:42.885772 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:10:42.885740 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0ae0d04-c173-4eaf-afb9-114d50628c6a-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-r6s4p\" (UID: \"b0ae0d04-c173-4eaf-afb9-114d50628c6a\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r6s4p" Jun 11 13:10:42.887617 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:10:42.887592 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0ae0d04-c173-4eaf-afb9-114d50628c6a-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-r6s4p\" (UID: \"b0ae0d04-c173-4eaf-afb9-114d50628c6a\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r6s4p" Jun 11 13:10:42.888012 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:10:42.887991 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0ae0d04-c173-4eaf-afb9-114d50628c6a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-r6s4p\" (UID: \"b0ae0d04-c173-4eaf-afb9-114d50628c6a\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r6s4p" Jun 11 13:10:42.905064 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:10:42.905040 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjc5t\" (UniqueName: \"kubernetes.io/projected/b0ae0d04-c173-4eaf-afb9-114d50628c6a-kube-api-access-sjc5t\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-r6s4p\" (UID: \"b0ae0d04-c173-4eaf-afb9-114d50628c6a\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r6s4p" Jun 11 13:10:42.994179 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:10:42.994072 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r6s4p" Jun 11 13:10:43.143747 ip-10-0-137-120 kubenswrapper[2558]: W0611 13:10:43.143716 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0ae0d04_c173_4eaf_afb9_114d50628c6a.slice/crio-97657032e731c891c64f103050f9eaf281fe87db040b1111e0019821092b4d9b WatchSource:0}: Error finding container 97657032e731c891c64f103050f9eaf281fe87db040b1111e0019821092b4d9b: Status 404 returned error can't find the container with id 97657032e731c891c64f103050f9eaf281fe87db040b1111e0019821092b4d9b Jun 11 13:10:43.143941 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:10:43.143916 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-r6s4p"] Jun 11 13:10:43.871092 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:10:43.871053 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r6s4p" event={"ID":"b0ae0d04-c173-4eaf-afb9-114d50628c6a","Type":"ContainerStarted","Data":"df3f411e6f1b7211860ac724c5944892d5af236280cb8a2596fb01db8c005668"} Jun 11 13:10:43.871092 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:10:43.871097 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r6s4p" event={"ID":"b0ae0d04-c173-4eaf-afb9-114d50628c6a","Type":"ContainerStarted","Data":"97657032e731c891c64f103050f9eaf281fe87db040b1111e0019821092b4d9b"} Jun 11 13:11:14.330462 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:11:14.330375 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:11:14.389843 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:11:14.389807 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:11:46.225895 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:11:46.225858 2558 generic.go:356] "Generic (PLEG): container finished" podID="b0ae0d04-c173-4eaf-afb9-114d50628c6a" containerID="df3f411e6f1b7211860ac724c5944892d5af236280cb8a2596fb01db8c005668" exitCode=0 Jun 11 13:11:46.226322 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:11:46.225931 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r6s4p" event={"ID":"b0ae0d04-c173-4eaf-afb9-114d50628c6a","Type":"ContainerDied","Data":"df3f411e6f1b7211860ac724c5944892d5af236280cb8a2596fb01db8c005668"} Jun 11 13:11:47.233346 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:11:47.233309 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r6s4p" event={"ID":"b0ae0d04-c173-4eaf-afb9-114d50628c6a","Type":"ContainerStarted","Data":"f3a095233cff5383a4bb186e3ebc4fed8a96563ca08725a7c5a48d98cf8098c3"} Jun 11 13:11:47.257660 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:11:47.257608 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r6s4p" podStartSLOduration=2.361377221 podStartE2EDuration="1m5.257591225s" totalImagesPullingTime="313.957417ms" totalInitContainerRuntime="1m2.582256587s" isStatefulPod=false podCreationTimestamp="2026-06-11 13:10:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:11:47.255630697 +0000 UTC m=+1106.902152632" watchObservedRunningTime="2026-06-11 13:11:47.257591225 +0000 UTC m=+1106.904113167" Jun 11 13:11:52.994430 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:11:52.994393 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r6s4p" Jun 11 13:11:52.994915 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:11:52.994546 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r6s4p" Jun 11 13:11:53.007321 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:11:53.007292 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r6s4p" Jun 11 13:11:53.285488 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:11:53.285407 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-r6s4p" Jun 11 13:13:20.909959 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:13:20.909929 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lb8tl_20c98c8b-f1fa-4066-8907-1ac8f01bacf5/console-operator/2.log" Jun 11 13:13:20.910842 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:13:20.910819 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lb8tl_20c98c8b-f1fa-4066-8907-1ac8f01bacf5/console-operator/2.log" Jun 11 13:17:01.025498 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:01.025468 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7cf4859678-4sfmk_081f5bed-9db1-4ff9-9d7e-c7298404be81/nginx/0.log" Jun 11 13:17:01.243717 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:01.243679 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-n722s_507d46a3-33db-45da-b480-7d779a38181f/manager/0.log" Jun 11 13:17:01.370486 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:01.370456 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-pg2q9_fc57507e-35cf-4278-a645-12d53519f8c8/manager/0.log" Jun 11 13:17:01.835195 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:01.835091 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-mkwq7_9336f330-5089-4b43-a89c-6de50995f06c/server/0.log" Jun 11 13:17:01.954215 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:01.954127 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-cs2gf_18559f15-3ab2-43e0-90ed-954267dd0d0d/manager/0.log" Jun 11 13:17:02.068576 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:02.068547 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fb67dbd4-p4dk5_18f34f4a-233b-45b1-8b35-4d5c7778dc3e/copy-manifests/0.log" Jun 11 13:17:02.087245 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:02.087166 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fb67dbd4-p4dk5_18f34f4a-233b-45b1-8b35-4d5c7778dc3e/manager/0.log" Jun 11 13:17:02.439396 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:02.439371 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-5f972_a9387b28-80dd-47a8-9955-d119556806cc/postgres/0.log" Jun 11 13:17:03.236423 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:03.236396 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598k97j_f1627eef-ae1c-4873-958c-5317afed5572/util/0.log" Jun 11 13:17:03.242662 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:03.242637 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598k97j_f1627eef-ae1c-4873-958c-5317afed5572/pull/0.log" Jun 11 13:17:03.248365 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:03.248333 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598k97j_f1627eef-ae1c-4873-958c-5317afed5572/extract/0.log" Jun 11 13:17:03.376986 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:03.376955 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt_3f97c524-7191-47b6-b71d-63eb7a2f556f/extract/0.log" Jun 11 13:17:03.382967 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:03.382940 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt_3f97c524-7191-47b6-b71d-63eb7a2f556f/util/0.log" Jun 11 13:17:03.389492 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:03.389470 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt_3f97c524-7191-47b6-b71d-63eb7a2f556f/pull/0.log" Jun 11 13:17:03.505282 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:03.505199 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ngn47_56b21d34-cc8b-4859-b9ff-cb90d7edb795/util/0.log" Jun 11 13:17:03.512105 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:03.512082 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ngn47_56b21d34-cc8b-4859-b9ff-cb90d7edb795/pull/0.log" Jun 11 13:17:03.519035 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:03.519016 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ngn47_56b21d34-cc8b-4859-b9ff-cb90d7edb795/extract/0.log" Jun 11 13:17:03.632812 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:03.632783 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12ftld_bda59a98-d0ac-4a05-add9-acbf09836217/util/0.log" Jun 11 13:17:03.639429 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:03.639395 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12ftld_bda59a98-d0ac-4a05-add9-acbf09836217/pull/0.log" Jun 11 13:17:03.645282 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:03.645260 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12ftld_bda59a98-d0ac-4a05-add9-acbf09836217/extract/0.log" Jun 11 13:17:04.385127 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:04.385098 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-s4s9h_7b036f74-c880-4c52-be66-9b0a49a7c318/manager/0.log" Jun 11 13:17:05.103356 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:05.103321 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-5xd8n_e97f92ed-82b1-4b39-9a4f-b7f315fe66c1/discovery/0.log" Jun 11 13:17:05.338618 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:05.338585 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-bb48c64d9-mpgkw_1fd1c0e7-a6f4-4876-9e1f-791af54f8b75/kube-auth-proxy/0.log" Jun 11 13:17:05.816700 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:05.816670 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bccb87fdf-hn668_058a7bf8-5cab-4f2f-9f11-a48e58370f14/router/0.log" Jun 11 13:17:06.285270 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:06.285243 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-jg5fq_479160d7-009a-41cc-8fc8-80b08ff8e58b/storage-initializer/0.log" Jun 11 13:17:06.292946 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:06.292923 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-jg5fq_479160d7-009a-41cc-8fc8-80b08ff8e58b/main/0.log" Jun 11 13:17:06.799886 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:06.799860 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-r6s4p_b0ae0d04-c173-4eaf-afb9-114d50628c6a/storage-initializer/0.log" Jun 11 13:17:06.810909 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:06.810886 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-r6s4p_b0ae0d04-c173-4eaf-afb9-114d50628c6a/main/0.log" Jun 11 13:17:12.033378 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:12.033343 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:17:13.192640 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:13.192603 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" limit=1024 Jun 11 13:17:14.520292 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:14.520263 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dl6mx_b3b5dc2f-8831-4790-85e8-9934466019b8/global-pull-secret-syncer/0.log" Jun 11 13:17:14.615104 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:14.615069 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-229ps_0b5e8ffb-3e76-44e4-8648-dcbaa4c82d34/konnectivity-agent/0.log" Jun 11 13:17:14.726369 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:14.726335 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-120.ec2.internal_ff108f13402cbf8ebb304d587916d091/haproxy/0.log" Jun 11 13:17:18.704201 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:18.704172 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-8gwhb_bd4caf5b-4ca9-400c-ab74-d056840b3247/sail-operator/0.log" Jun 11 13:17:19.623884 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:19.623843 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598k97j_f1627eef-ae1c-4873-958c-5317afed5572/extract/0.log" Jun 11 13:17:19.651050 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:19.651012 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598k97j_f1627eef-ae1c-4873-958c-5317afed5572/util/0.log" Jun 11 13:17:19.681832 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:19.681805 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598k97j_f1627eef-ae1c-4873-958c-5317afed5572/pull/0.log" Jun 11 13:17:19.714289 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:19.714264 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt_3f97c524-7191-47b6-b71d-63eb7a2f556f/extract/0.log" Jun 11 13:17:19.742346 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:19.742315 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt_3f97c524-7191-47b6-b71d-63eb7a2f556f/util/0.log" Jun 11 13:17:19.771634 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:19.771605 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nptxt_3f97c524-7191-47b6-b71d-63eb7a2f556f/pull/0.log" Jun 11 13:17:19.805701 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:19.805670 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ngn47_56b21d34-cc8b-4859-b9ff-cb90d7edb795/extract/0.log" Jun 11 13:17:19.833935 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:19.833908 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ngn47_56b21d34-cc8b-4859-b9ff-cb90d7edb795/util/0.log" Jun 11 13:17:19.863538 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:19.863508 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ngn47_56b21d34-cc8b-4859-b9ff-cb90d7edb795/pull/0.log" Jun 11 13:17:19.895728 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:19.895631 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12ftld_bda59a98-d0ac-4a05-add9-acbf09836217/extract/0.log" Jun 11 13:17:19.923667 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:19.923639 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12ftld_bda59a98-d0ac-4a05-add9-acbf09836217/util/0.log" Jun 11 13:17:19.948955 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:19.948931 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12ftld_bda59a98-d0ac-4a05-add9-acbf09836217/pull/0.log" Jun 11 13:17:20.165262 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:20.165174 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-s4s9h_7b036f74-c880-4c52-be66-9b0a49a7c318/manager/0.log" Jun 11 13:17:22.141231 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:22.141201 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-j9zf5_aa1e7777-83cf-4536-9e9e-dcc68a066c62/cluster-monitoring-operator/0.log" Jun 11 13:17:22.260493 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:22.260457 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-f7c4fbc7f-992fg_b2c38901-dc6a-4f6f-810d-ebb448a80f50/metrics-server/0.log" Jun 11 13:17:22.294013 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:22.293986 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-787h4_f26dcba0-eac9-44e3-8f3b-7712e8a96b60/monitoring-plugin/0.log" Jun 11 13:17:22.332643 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:22.332591 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2m2wk_f8d31c2e-6c0b-4193-a3c3-959435fea56b/node-exporter/0.log" Jun 11 13:17:22.357279 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:22.357259 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2m2wk_f8d31c2e-6c0b-4193-a3c3-959435fea56b/kube-rbac-proxy/0.log" Jun 11 13:17:22.383447 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:22.383424 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2m2wk_f8d31c2e-6c0b-4193-a3c3-959435fea56b/init-textfile/0.log" Jun 11 13:17:22.895299 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:22.895262 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-j27sv_42412644-77a4-4534-b14f-249659d5428d/prometheus-operator/0.log" Jun 11 13:17:22.920581 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:22.920548 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-j27sv_42412644-77a4-4534-b14f-249659d5428d/kube-rbac-proxy/0.log" Jun 11 13:17:22.986466 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:22.986438 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-57747d55bd-5w9dp_45918f10-dcf7-4753-924d-f4a43c9906e3/telemeter-client/0.log" Jun 11 13:17:23.014220 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:23.014177 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-57747d55bd-5w9dp_45918f10-dcf7-4753-924d-f4a43c9906e3/reload/0.log" Jun 11 13:17:23.038900 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:23.038864 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-57747d55bd-5w9dp_45918f10-dcf7-4753-924d-f4a43c9906e3/kube-rbac-proxy/0.log" Jun 11 13:17:24.913881 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:24.913847 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nzlpt/perf-node-gather-daemonset-xp8bw"] Jun 11 13:17:24.917285 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:24.917264 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-xp8bw" Jun 11 13:17:24.920293 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:24.920267 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nzlpt\"/\"openshift-service-ca.crt\"" Jun 11 13:17:24.920432 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:24.920274 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nzlpt\"/\"default-dockercfg-vftqm\"" Jun 11 13:17:24.921294 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:24.921279 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nzlpt\"/\"kube-root-ca.crt\"" Jun 11 13:17:24.929023 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:24.928999 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nzlpt/perf-node-gather-daemonset-xp8bw"] Jun 11 13:17:25.051558 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:25.051520 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f8834149-c685-4002-86c0-7110f48938f3-podres\") pod \"perf-node-gather-daemonset-xp8bw\" (UID: \"f8834149-c685-4002-86c0-7110f48938f3\") " pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-xp8bw" Jun 11 13:17:25.051742 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:25.051606 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hsp7\" (UniqueName: \"kubernetes.io/projected/f8834149-c685-4002-86c0-7110f48938f3-kube-api-access-4hsp7\") pod \"perf-node-gather-daemonset-xp8bw\" (UID: \"f8834149-c685-4002-86c0-7110f48938f3\") " pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-xp8bw" Jun 11 13:17:25.051742 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:25.051633 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8834149-c685-4002-86c0-7110f48938f3-sys\") pod \"perf-node-gather-daemonset-xp8bw\" (UID: \"f8834149-c685-4002-86c0-7110f48938f3\") " pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-xp8bw" Jun 11 13:17:25.051742 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:25.051705 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f8834149-c685-4002-86c0-7110f48938f3-proc\") pod \"perf-node-gather-daemonset-xp8bw\" (UID: \"f8834149-c685-4002-86c0-7110f48938f3\") " pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-xp8bw" Jun 11 13:17:25.051742 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:25.051730 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f8834149-c685-4002-86c0-7110f48938f3-lib-modules\") pod \"perf-node-gather-daemonset-xp8bw\" (UID: \"f8834149-c685-4002-86c0-7110f48938f3\") " pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-xp8bw" Jun 11 13:17:25.106324 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:25.106295 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lb8tl_20c98c8b-f1fa-4066-8907-1ac8f01bacf5/console-operator/2.log" Jun 11 13:17:25.113889 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:25.113848 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-lb8tl_20c98c8b-f1fa-4066-8907-1ac8f01bacf5/console-operator/3.log" Jun 11 13:17:25.152946 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:25.152913 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hsp7\" (UniqueName: \"kubernetes.io/projected/f8834149-c685-4002-86c0-7110f48938f3-kube-api-access-4hsp7\") pod \"perf-node-gather-daemonset-xp8bw\" (UID: \"f8834149-c685-4002-86c0-7110f48938f3\") " pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-xp8bw" Jun 11 13:17:25.153063 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:25.152950 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8834149-c685-4002-86c0-7110f48938f3-sys\") pod \"perf-node-gather-daemonset-xp8bw\" (UID: \"f8834149-c685-4002-86c0-7110f48938f3\") " pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-xp8bw" Jun 11 13:17:25.153063 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:25.152992 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f8834149-c685-4002-86c0-7110f48938f3-proc\") pod \"perf-node-gather-daemonset-xp8bw\" (UID: \"f8834149-c685-4002-86c0-7110f48938f3\") " pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-xp8bw" Jun 11 13:17:25.153063 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:25.153010 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f8834149-c685-4002-86c0-7110f48938f3-lib-modules\") pod \"perf-node-gather-daemonset-xp8bw\" (UID: \"f8834149-c685-4002-86c0-7110f48938f3\") " pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-xp8bw" Jun 11 13:17:25.153063 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:25.153060 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f8834149-c685-4002-86c0-7110f48938f3-podres\") pod \"perf-node-gather-daemonset-xp8bw\" (UID: \"f8834149-c685-4002-86c0-7110f48938f3\") " pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-xp8bw" Jun 11 13:17:25.153244 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:25.153104 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8834149-c685-4002-86c0-7110f48938f3-sys\") pod \"perf-node-gather-daemonset-xp8bw\" (UID: \"f8834149-c685-4002-86c0-7110f48938f3\") " pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-xp8bw" Jun 11 13:17:25.153244 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:25.153104 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f8834149-c685-4002-86c0-7110f48938f3-proc\") pod \"perf-node-gather-daemonset-xp8bw\" (UID: \"f8834149-c685-4002-86c0-7110f48938f3\") " pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-xp8bw" Jun 11 13:17:25.153244 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:25.153189 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f8834149-c685-4002-86c0-7110f48938f3-podres\") pod \"perf-node-gather-daemonset-xp8bw\" (UID: \"f8834149-c685-4002-86c0-7110f48938f3\") " pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-xp8bw" Jun 11 13:17:25.153244 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:25.153199 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f8834149-c685-4002-86c0-7110f48938f3-lib-modules\") pod \"perf-node-gather-daemonset-xp8bw\" (UID: \"f8834149-c685-4002-86c0-7110f48938f3\") " pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-xp8bw" Jun 11 13:17:25.162070 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:25.162048 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hsp7\" (UniqueName: \"kubernetes.io/projected/f8834149-c685-4002-86c0-7110f48938f3-kube-api-access-4hsp7\") pod \"perf-node-gather-daemonset-xp8bw\" (UID: \"f8834149-c685-4002-86c0-7110f48938f3\") " pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-xp8bw" Jun 11 13:17:25.228487 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:25.228397 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-xp8bw" Jun 11 13:17:25.369311 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:25.369281 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nzlpt/perf-node-gather-daemonset-xp8bw"] Jun 11 13:17:25.370232 ip-10-0-137-120 kubenswrapper[2558]: W0611 13:17:25.370200 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf8834149_c685_4002_86c0_7110f48938f3.slice/crio-e0531cadfee57a9b37dd1a8ad3afc4dabe7d742be752ea5ecb86171d8730bef4 WatchSource:0}: Error finding container e0531cadfee57a9b37dd1a8ad3afc4dabe7d742be752ea5ecb86171d8730bef4: Status 404 returned error can't find the container with id e0531cadfee57a9b37dd1a8ad3afc4dabe7d742be752ea5ecb86171d8730bef4 Jun 11 13:17:25.690032 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:25.690006 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-74f49d7c8d-vm6g5_9bc0b31d-8221-448e-b801-52b18b2fd989/console/0.log" Jun 11 13:17:25.738537 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:25.738497 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-nnwsj_1bac29f4-0707-4acc-9354-16589cded12e/download-server/0.log" Jun 11 13:17:26.197474 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:26.197440 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-xp8bw" event={"ID":"f8834149-c685-4002-86c0-7110f48938f3","Type":"ContainerStarted","Data":"3e1d5bb20a54dd34461c42918563f4600a178fda7ef5da021fdc79cd619641d2"} Jun 11 13:17:26.197867 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:26.197500 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-xp8bw" event={"ID":"f8834149-c685-4002-86c0-7110f48938f3","Type":"ContainerStarted","Data":"e0531cadfee57a9b37dd1a8ad3afc4dabe7d742be752ea5ecb86171d8730bef4"} Jun 11 13:17:26.197867 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:26.197528 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-xp8bw" Jun 11 13:17:26.234370 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:26.234316 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-xp8bw" podStartSLOduration=2.2342988249999998 podStartE2EDuration="2.234298825s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 13:17:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 13:17:26.226471618 +0000 UTC m=+1445.872993561" watchObservedRunningTime="2026-06-11 13:17:26.234298825 +0000 UTC m=+1445.880820767" Jun 11 13:17:27.604788 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:27.604755 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w6vpc_b06d4318-3ca7-4101-8f86-d1454c9b82cb/dns/0.log" Jun 11 13:17:27.630781 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:27.630747 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w6vpc_b06d4318-3ca7-4101-8f86-d1454c9b82cb/kube-rbac-proxy/0.log" Jun 11 13:17:27.718415 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:27.718390 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hcnkc_52db0382-33eb-4bbd-8c3a-850757a8b9fb/dns-node-resolver/0.log" Jun 11 13:17:28.346460 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:28.346425 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w7dg4_b10f8cf9-e375-4b40-bd55-c0cb329ce19e/node-ca/0.log" Jun 11 13:17:29.445832 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:29.445795 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-5xd8n_e97f92ed-82b1-4b39-9a4f-b7f315fe66c1/discovery/0.log" Jun 11 13:17:29.513426 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:29.513399 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-bb48c64d9-mpgkw_1fd1c0e7-a6f4-4876-9e1f-791af54f8b75/kube-auth-proxy/0.log" Jun 11 13:17:29.637036 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:29.637005 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bccb87fdf-hn668_058a7bf8-5cab-4f2f-9f11-a48e58370f14/router/0.log" Jun 11 13:17:30.321319 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:30.321278 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xjmtd_8c9a9482-6765-4d5f-b21b-37c26d9be26d/serve-healthcheck-canary/0.log" Jun 11 13:17:30.892958 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:30.892905 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bwmrj_c04f77fb-af91-4a59-b78e-400b06751a93/kube-rbac-proxy/0.log" Jun 11 13:17:30.916974 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:30.916945 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bwmrj_c04f77fb-af91-4a59-b78e-400b06751a93/exporter/0.log" Jun 11 13:17:30.945192 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:30.945147 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bwmrj_c04f77fb-af91-4a59-b78e-400b06751a93/extractor/0.log" Jun 11 13:17:32.213244 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:32.213217 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nzlpt/perf-node-gather-daemonset-xp8bw" Jun 11 13:17:33.495436 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:33.495411 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7cf4859678-4sfmk_081f5bed-9db1-4ff9-9d7e-c7298404be81/nginx/0.log" Jun 11 13:17:33.574797 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:33.574771 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-n722s_507d46a3-33db-45da-b480-7d779a38181f/manager/0.log" Jun 11 13:17:33.620820 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:33.620787 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-pg2q9_fc57507e-35cf-4278-a645-12d53519f8c8/manager/0.log" Jun 11 13:17:33.744842 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:33.744811 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-mkwq7_9336f330-5089-4b43-a89c-6de50995f06c/server/0.log" Jun 11 13:17:33.815914 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:33.815789 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-cs2gf_18559f15-3ab2-43e0-90ed-954267dd0d0d/manager/0.log" Jun 11 13:17:33.891422 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:33.891393 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fb67dbd4-p4dk5_18f34f4a-233b-45b1-8b35-4d5c7778dc3e/manager/0.log" Jun 11 13:17:33.910204 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:33.910177 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fb67dbd4-p4dk5_18f34f4a-233b-45b1-8b35-4d5c7778dc3e/copy-manifests/0.log" Jun 11 13:17:34.070772 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:34.070697 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-5f972_a9387b28-80dd-47a8-9955-d119556806cc/postgres/0.log" Jun 11 13:17:39.006412 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:39.006376 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-5xd8n_e97f92ed-82b1-4b39-9a4f-b7f315fe66c1/discovery/0.log" Jun 11 13:17:39.042856 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:39.042829 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-bb48c64d9-mpgkw_1fd1c0e7-a6f4-4876-9e1f-791af54f8b75/kube-auth-proxy/0.log" Jun 11 13:17:39.117245 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:39.117212 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bccb87fdf-hn668_058a7bf8-5cab-4f2f-9f11-a48e58370f14/router/0.log" Jun 11 13:17:40.324228 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:40.324191 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-5xd8n_e97f92ed-82b1-4b39-9a4f-b7f315fe66c1/discovery/0.log" Jun 11 13:17:40.359461 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:40.359430 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-bb48c64d9-mpgkw_1fd1c0e7-a6f4-4876-9e1f-791af54f8b75/kube-auth-proxy/0.log" Jun 11 13:17:40.437562 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:40.437519 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bccb87fdf-hn668_058a7bf8-5cab-4f2f-9f11-a48e58370f14/router/0.log" Jun 11 13:17:42.165505 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:42.165471 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-5xd8n_e97f92ed-82b1-4b39-9a4f-b7f315fe66c1/discovery/0.log" Jun 11 13:17:42.195670 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:42.195639 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-bb48c64d9-mpgkw_1fd1c0e7-a6f4-4876-9e1f-791af54f8b75/kube-auth-proxy/0.log" Jun 11 13:17:42.276418 ip-10-0-137-120 kubenswrapper[2558]: I0611 13:17:42.276391 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bccb87fdf-hn668_058a7bf8-5cab-4f2f-9f11-a48e58370f14/router/0.log"